Sign in

Mat Miller

@matdmiller.bsky.social
825 followers 2.3K following 65 posts

AI, Engineer, Developer, Traveler, Technologist, @fastdotai Fellow

PostsRepliesMedia
Reposted by Mat Miller
Simon Willison @simonwillison.net · 06/01/2025
Made a tiny tool to help turn a Bluesky handle into a DID: tools.simonwillison.net/bluesky-reso...
Resolve Bluesky handle to DID

UI text box containing simonwillison.net and a Resolve button

Below, the output:

did:plc:kft6lu4trxowqmter2b6vg6z
5817
Reposted by Mat Miller
Simon Willison @simonwillison.net · 04/01/2025
I like Anthropic's "contextual retrieval" suggestion for creating chunks simonwillison.net/2024/Sep/20/...
simonwillison.net
Introducing Contextual Retrieval
Here's an interesting new embedding/RAG technique, described by Anthropic but it should work for any embedding model against any other LLM. One of the big challenges in implementing semantic search …
0162
Reposted by Mat Miller
Simon Willison @simonwillison.net · 05/01/2025
Looks like @graze.social exists already! Their programming language is a nested JSON object of filters and Boolean operations: www.graze.social/docs/editor-... bsky.app/profile/graz...
{
  "filter": {
    "and": [
      {
        "attribute_compare": [
          "embed.external.uri",
          "==",
          "https://www.youtube.com/watch?v=E8Ew6K0W3RY"
        ]
      },
      {
        "regex_matches": ["text", "\\bthe\\b"]
      },
      {
        "regex_negation_matches": ["text", "\\bunwanted_term\\b"]
      },
      {
        "user_network": ["devingaffney.com", "in", "follows"]
      },
      {
        "text_similarity": [
          "text",
          {
            "anchor_text": "This is an important update",
            "model_name": "all-MiniLM-L6-v2"
          },
          ">=",
          0.3
        ]
      },
5704
Reposted by Mat Miller
Mat Miller @matdmiller.bsky.social · 01/01/2025
🔥 Host your apps for FREE and simplify your infrastructure! 🚀 Tired of complex cloud hosting and the recurring bills that come with it? Host locally on hardware you already own and access anywhere with a browser. It's simpler than you think! Learn how in my latest post. 🔗👇
3345
Mat Miller @matdmiller.bsky.social · 01/01/2025
🔥 Host your apps for FREE and simplify your infrastructure! 🚀 Tired of complex cloud hosting and the recurring bills that come with it? Host locally on hardware you already own and access anywhere with a browser. It's simpler than you think! Learn how in my latest post. 🔗👇
3345
Reposted by Mat Miller
Benjamin Warner @benjaminwarner.dev · 22/12/2024
This week we released ModernBERT, the first encoder to reach SOTA on most common benchmarks across language understanding, retrieval, and code, while running twice as fast as DeBERTaV3 on short context and three times faster than NomicBERT & GTE on long context.
27415
Reposted by Mat Miller
Jeremy Howard @howard.fm · 19/12/2024
I'll get straight to the point. We trained 2 new models. Like BERT, but modern. ModernBERT. Not some hypey GenAI thing, but a proper workhorse model, for retrieval, classification, etc. Real practical stuff. It's much faster, more accurate, longer context, and more useful. 🧵
19620147
Reposted by Mat Miller
Simon Willison @simonwillison.net · 19/12/2024
I figured out a prompting pattern for getting Claude to produce fully self-contained Python scripts that execute with "uv run" using PEP 723 inline script dependencies - and now I can one-shot useful Python utilities with it simonwillison.net/2024/Dec/19/...
simonwillison.net
Building Python tools with a one-shot prompt using uv run and Claude Projects
I’ve written a lot about how I’ve been using Claude to build one-shot HTML+JavaScript applications via Claude Artifacts. I recently started using a similar pattern to create one-shot Python utilities,...
820826
Reposted by Mat Miller
Remi Cadene @remicadene.bsky.social · 15/12/2024
HOT 🔥 fastest, most precise, and most capable hand control setup ever... Less than $450 and fully open-source 🤯 by @huggingface, @therobotstudio, @NepYope This tendon-driven technology will disrupt robotics! Retweet to accelerate its democratization 🚀 A thread 🧵
37327
Mat Miller @matdmiller.bsky.social · 14/12/2024
Hey @runme.dev - love your notebook-style script execution! Any plans for Windows native support? Many of us in corporate environments need this without the WSL dependency. As a Jupyter notebooks fan, I can immediately see the value of this but a many of my use cases today would be Windows native.
000
Reposted by Mat Miller
David Bikard @dbikard.bsky.social · 13/12/2024
Excited to share that we have just released genomenotebook 1.0 together with @trichomedoctor.bsky.social ! If you like to analyze genomics data in Jupyter notebooks this is for you. You can get beautiful genome browsers directly in your notebooks: dbikard.github.io/genomenotebo...
dbikard.github.io
genomenotebook
A genome browser in your Jupyter notebook
37722
Reposted by Mat Miller
Jeremy Howard @howard.fm · 13/12/2024
Non-commercial license, as usual from MSR. 🙄 And of course they don't even give you the option to pay for it.
6563
Reposted by Mat Miller
Ian Maurer @imaurer.bsky.social · 08/12/2024
Chat with any open source repo easily. Gitingest (free online tool) turns any GitHub repository into a single markdown file for pasting. Claude artifacts makes this 300k token output pretty easy to work with.
46412
Reposted by Mat Miller
Simon Willison @simonwillison.net · 06/12/2024
This is a neat new variant on RAG - no vectors, not even full-text search, instead showing the model a header hierarchy and giving it a tool to read the relevant sections My notes here: simonwillison.net/2024/Dec/6/r...
simonwillison.net
Roaming RAG – make the model find the answers
Neat new RAG technique (with a snappy name) from John Berryman: > The big idea of Roaming RAG is to craft a simple LLM application so that the LLM assistant …
1216020
Reposted by Mat Miller
Nathan Cooper @ncoop57.bsky.social · 05/12/2024
As R&D staff @ answer.ai, I work a lot on boosting productivity with AI. A common theme that always comes up is the combination of human+AI. This combination proved to be powerful in our new project ShellSage, which is an AI terminal buddy that learns and teaches with you. A 🧵
77416
Reposted by Mat Miller
Jeremy Howard @howard.fm · 05/12/2024
I can't begin to describe how life-changing this new project, ShellSage, has been for me over the last few weeks. ShellSage is an LLM that lives in your terminal. It can see what directory you're in, what commands you've typed, what output you got, & your previous AI Q&A's.🧵
518521
Reposted by Mat Miller
Ben Burtenshaw @benburtenshaw.bsky.social · 03/12/2024
For anyone interested in fine-tuning or aligning LLMs, I’m running this free and open course called smol course. It’s not a big deal, it’s just smol. 🧵>>
932363
Reposted by Mat Miller
Simon Willison @simon.fedi.simonwillison.net.ap.brid.gy · 29/11/2024
Amazing demo by Vaibhav Srivastav of structured data extraction running on an LLM that executes entirely in the browser (Chrome only for the moment since it uses WebGPU). simonwillison.net/2024/Nov/29/struc…
simonwillison.net
Structured Generation w/ SmolLM2 running in browser & WebGPU
Extraordinary demo by Vaibhav Srivastav. Here's Hugging Face's [SmolLM2-1.7B-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM2-1.7B-Instruct) running directly in a web browser (using WebGPU, so requires Chrome [for the moment](https://github.com/gpuweb/gpuweb/wiki/Implementation-Status)) demonstrating structured text extraction, converting a text …
0236
Reposted by Mat Miller
Thomas Capelle @capetorch.bsky.social · 29/11/2024
After seeing all those toxic replies to @danielvanstrien.bsky.social , I created a small script to auto-block people. Let's use AI to moderate the replies. gist.github.com/tcapelle/00a... cc. @eugeneyan.bsky.social
2142
Reposted by Mat Miller
Thomas Capelle @capetorch.bsky.social · 29/11/2024
Hello World from Python SDK
051
Reposted by Mat Miller
Stella Biderman @stellaathena.bsky.social · 28/11/2024
A dataset of 1 million or 2 million Bluesky posts is completely irrelevant to training large language models. The primary usecase for the datasets that people are losing their shit over isn't ChatGPT, it's social science research and developing systems that improve Bluesky.
825139
Reposted by Mat Miller
François Fleuret @francois.fleuret.org · 29/11/2024
I find strange that engineering the gradient radically to learn better is not a whole field.
9535
Reposted by Mat Miller
Simon Willison @simon.fedi.simonwillison.net.ap.brid.gy · 29/11/2024
TIL how to implement GitHub OAuth for an otherwise completely static website (HTML+JavaScript on GitHub Pages) using Cloudflare Workers: til.simonwillison.net/cloudflare/wo…
24410
Reposted by Mat Miller
Nick Tsergas @nicktsergas.ca · 28/11/2024
✨ More Bluesky tools for power-users, curious people, and nerds. ✨ One thing that makes this place a better option for anyone wanting a more conscious social experience is its "opensource-ness." It gives us a level of freedom we haven't had since the MySpace era. I missed that. 🧵 1/10
Screenshot of part of SkyZoo's analytics dashboard (see thread)
113373154
Reposted by Mat Miller
Jeremy Howard @howard.fm · 28/11/2024
Did you know that 99% of email today is spam? Your inbox isn’t 99% spam because AI is used to filter it. The same 99% will happen here too, but if AI researchers continue to get perma-banned for making available the datasets needed to filter it, it’s going to make this platform unusable.
4251064
Reposted by Mat Miller
merve @merve.bsky.social · 27/11/2024
It's pretty sad to see the negative sentiment towards Hugging Face on this platform due to a dataset put by one of the employees. I want to write a small piece. 🧵 Hugging Face empowers everyone to use AI to create value and is against monopolization of AI it's a hosting platform above all.
2945570
Reposted by Mat Miller
Eugene Yan @eugeneyan.com · 27/11/2024
Feels good to be mentioned on HN for engineers learning AI 🥰 Helping others is a big reason I write. Here's a list on ML/AI: ## Building AI systems • Patterns for Building LLM-based Systems: eugeneyan.com/writing/llm-... • What We’ve Learned From A Year of Building with LLMs: applied-llms.org
Read through this making flashcards as you to: https://eugeneyan.com/writing/llm-patterns/
Then spin up a RAG-enhanced chatbot using pgvector on your favourite subject, and keep improving it when you learn about cool techniques

---

Lots of people can get impressive demos up and running, but if you want to run AI products in production, you're going to have to do system evals. System evals make sure your product is doing what it says on the box with unquantifiable qualities.
We wrote a zine on system evals without jargon: https://forestfriends.tech
Eugene Yan has written extensively on it https://eugeneyan.com/writing/evals/
Hamel has as well. https://hamel.dev/blog/posts/evals/
3709
Reposted by Mat Miller
merve @merve.bsky.social · 26/11/2024
Small yet mighty! 💫 We are releasing SmolVLM: a new 2B small vision language made for on-device use, fine-tunable on consumer GPU, immensely memory efficient 🤠 We release three checkpoints under Apache 2.0: SmolVLM-Instruct, SmolVLM-Synthetic and SmolVLM-Base huggingface.co/collections/...
1115927
Reposted by Mat Miller
Hamel Husain @hamel.bsky.social · 24/11/2024
Thanks to @simonwillison.net for improving this > forked this to add script inline metadata for the dependency and use input() and getpass() to accept the credentials - now you can run it without having to install it first with uv See comment in new gist: gist.github.com/simonw/848a3...
gist.github.com
Run like this: uv run https://gist.githubusercontent.com/simonw/848a3b91169a789bc084a459aa7ecf83/raw/44fe7e0b326832e88beb83748b50104e5e7f70d0/follow_theirs.py
Run like this: uv run https://gist.githubusercontent.com/simonw/848a3b91169a789bc084a459aa7ecf83/raw/44fe7e0b326832e88beb83748b50104e5e7f70d0/follow_theirs.py - follow_theirs.py
1141
Reposted by Mat Miller
Simon Willison @simonwillison.net · 24/11/2024
It is their implementation of PEP 723 - it's really handy peps.python.org/pep-0723/
peps.python.org
PEP 723 – Inline script metadata | peps.python.org
This PEP specifies a metadata format that can be embedded in single-file Python scripts to assist launchers, IDEs and other external tools which may need to interact with such scripts.
131
Reposted by Mat Miller
Simon Willison @simonwillison.net · 23/11/2024
I want to see a screenshot or photo of a project that you've never published anything online about before
6723128
Reposted by Mat Miller
Jeremy Lewi @jeremy.lewi.us · 23/11/2024
@hamel.bsky.social has a very cool demo of using Apple Shortcuts to do cool things with AI without writing code www.loom.com/share/d19d7c...
loom.com
Apple Shortcuts Demo 🍎
Hi, in this quick demo, I showcase using Apple shortcuts for legal timekeeping. I demonstrate triggering Siri, creating time entries, and automating tasks. No specific action requested, just an explor...
1153
Reposted by Mat Miller
Raphael Pisoni @4rtemi5.bsky.social · 22/11/2024
For those waiting for news on the training of the single-GPU "DINO-like" model: About half the training is now over so let me pick some cherries for you: 🍒 🧵
3122
Reposted by Mat Miller
Ethan Mollick @emollick.bsky.social · 22/11/2024
Its scary to know that I am always only a click away from destroying my productivity.
8862
Reposted by Mat Miller
Carlo Piovesan @carlo.piovesan.io · 22/11/2024
This is a terrific direction for extensibility of SQL syntax. I had the luck to see @andypavlo.bsky.social discussing SQL evolution going in circles (graph db, vector db, ...), and one of the questions was on SQL dialects. Work on parsers / tooling is the answer to make SQL composable / expansible
1121
Mat Miller @matdmiller.bsky.social · 22/11/2024
I saw this really impressive demonstration of one/few shot learning in robotics using a graph diffusion model. If you’re interested in Robotics and AI I think it’s worth checking out! #mlsky #ai #robotics threadreaderapp.com/thread/18595... www.robot-learning.uk/instant-policy
threadreaderapp.com
Thread by @Ed__Johns on Thread Reader App
@Ed__Johns: This is a single uncut video, showing a robot learning several tasks instantly, after just one demonstration each ... This is possible because we've now been able to achieve in-context lea...
090
Reposted by Mat Miller
Chris Offner @chrisoffner3d.bsky.social · 20/11/2024
Features from TwitterX that I'd like to see on @bsky.app: - "The bell": An option to get notified when a given user posts - Bookmarks - High-quality (and longer) video - Gathering "highlight posts" in a tab on one's own profile
3505
Reposted by Mat Miller
Saloni @scientificdiscovery.dev · 20/11/2024
Since I've been here for a while… here are some useful features on Bluesky that you might not have discovered yet! 🧵
2531521584
Reposted by Mat Miller
Simon Willison @simonwillison.net · 20/11/2024
Built my first experiment on top of Bluesky's API (actually the Jetstream WebSocket proxy) - it took ~15s of prompting in Claude to get this working: tools.simonwillison.net/bluesky-fire... More details including the prompt transcript here: simonwillison.net/2024/Nov/20/...
Animated demo. Page title is Bluesky WebSocket Feed Monitor and there are Connect, Disconnect and Clear Log buttons. When I click Connect the Bluesky firehose instantly starts streaming in JSON in a textarea on the page.
1618716
Reposted by Mat Miller
Eugene Yan @eugeneyan.com · 20/11/2024
Just set up my M4 MacBook Pro from scratch, Marie Kondoing existing tools and exploring new options. Here's my minimal guide to setting up a new Mac. Updates include: • Oh My Zsh → Fish • iTerm → Warp • Wispr Flow, Ollama + Open WebUI, Ice Any other suggestions? eugeneyan.com/writing/mac-...
eugeneyan.com
My Minimal MacBook Pro Setup Guide
Setting up my new MacBook Pro from scratch
17782
Reposted by Mat Miller
Mat Miller @matdmiller.bsky.social · 16/11/2024
Hi everyone! I’m Mat and I work on data engineering and AI in the engineering. I love learning new things, am perpetually curious, and am passionate about technology. I started my AI journey in 2017 with fast.ai and have really enjoyed applying it to different problems.
fast.ai
fast.ai—Making neural nets uncool again – fast.ai
0162
Mat Miller @matdmiller.bsky.social · 19/11/2024
This looks cool! Hacking on the BSKY API. Am planning on checking this out.
030
Reposted by Mat Miller
Maike Osborne @maosbot.bsky.social · 09/11/2024
New here? Interested in AI/ML? Check out these great starter packs! AI: go.bsky.app/SipA7it RL: go.bsky.app/3WPHcHg Women in AI: go.bsky.app/LaGDpqg NLP: go.bsky.app/SngwGeS AI and news: go.bsky.app/5sFqVNS You can also search all starter packs here: blueskydirectory.com/starter-pack...
66557212
Reposted by Mat Miller
Pelayo Arbués @pelayoarbues.com · 14/11/2024
Hi Thomas! I’m a huge fan of how your teams share knowledge on social networks about models, datasets, and tools. That’s why I’m curating this Starter Pack: go.bsky.app/PTmCYsU
193
Mat Miller @matdmiller.bsky.social · 14/11/2024
This is a really interesting thread on model scaling and quantization with a prediction that we may getting close to the scaling limit with current architectures, precision and hardware. threadreaderapp.com/thread/18563...
threadreaderapp.com
Thread by @Tim_Dettmers on Thread Reader App
@Tim_Dettmers: This is the most important paper in a long time . It shows with strong evidence we are reaching the limits of quantization. The paper says this: the more tokens you train on, the more.....
140
Mat Miller @matdmiller.bsky.social · 14/11/2024
This was a really interesting podcast by @ericries.bsky.social . Hard to imagine the patience and perseverance required to hang on until the Generative AI explosion. Reminds me of Nvidia in some sense but Groq didn’t have gaming to tide them through until the AI revolution. youtu.be/KhLXVRiZBdo
m.youtube.com
Risks, Rewards & Building the Unicorn Chip Company Taking on Nvidia | Inside Groq with Jonathan Ross
YouTube video by The Eric Ries Show
021
Mat Miller @matdmiller.bsky.social · 14/11/2024
This is a great overview of use cases for DuckDB. DuckDB is an ultra fast analytical query engine that you can run locally. If you deal with data processing for analytics or ETL and want to be able to run things locally and high performance I highly recommend you check it out.
140
Mat Miller @matdmiller.bsky.social · 14/11/2024
In my blog post, I tackle @karpathy.bsky.social 'Let's build GPT' to construct a transformer 🤖 model from scratch, leveraging the foundational knowledge I gained from the fantastic @fastdotai courses by @jph.bsky.social Curious about how transformers work? blog.matdmiller.com/posts/2023-0...
blog.matdmiller.com
Mat’s Blog - Transformers From Scratch
241
Mat Miller @matdmiller.bsky.social · 14/11/2024
Ever wondered how to supercharge your code with GPU acceleration? Check out my blog post, where I explore creating custom CUDA kernels that delivered an 8.4 million times speedup over (a naive) baseline on a real-world problem. blog.matdmiller.com/posts/2024-0...
blog.matdmiller.com
Mat’s Blog - CUDA MODE - Accelerate your code with massively parallel programming plus some other tricks
020