simonwillison.net
Structured Generation w/ SmolLM2 running in browser & WebGPU
Extraordinary demo by Vaibhav Srivastav. Here's Hugging Face's [SmolLM2-1.7B-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct) running directly in a web browser (using WebGPU, so requires Chrome [for the moment](https://github.com/gpuweb/gpuweb/wiki/Implementation-Status)) demonstrating structured text extraction, converting a text …
![{
"filter": {
"and": [
{
"attribute_compare": [
"embed.external.uri",
"==",
"https://www.youtube.com/watch?v=E8Ew6K0W3RY"
]
},
{
"regex_matches": ["text", "\\bthe\\b"]
},
{
"regex_negation_matches": ["text", "\\bunwanted_term\\b"]
},
{
"user_network": ["devingaffney.com", "in", "follows"]
},
{
"text_similarity": [
"text",
{
"anchor_text": "This is an important update",
"model_name": "all-MiniLM-L6-v2"
},
">=",
0.3
]
},](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:kft6lu4trxowqmter2b6vg6z/bafkreicria2jounrzuq7xuhmkc6ynhqzafqdfv4umokjpaj3jduvosuxna)
