Sign in

Smerity

@smerity.bsky.social
3.9K followers 1.1K following 83 posts

Always pondering startups, ML, Rust, Python, and 3D printing. Independent ML researcher consulting on LMs + data. Previously: Salesforce Research, MetaMind, CommonCrawl, Harvard. 🇦🇺 in SF. He/him. Personal blog: state.smerity.com

PostsRepliesMedia
Smerity @smerity.bsky.social · 12/09/2025
Brainstorming with an LLM that's glazing you a tad is helpful when you're under glazing by default 🤔
140
Reposted by Smerity
Microplastics Sommelier @leastactionhero.bsky.social · 27/06/2024
einstein sent this to curie in 1911 when she was being harassed by tabloids. it contains everything you’d want in such a letter: (1) your haters are trash (2) you’re a baller, a true queen (3) i have determined the statistical law of motion of the diatomic molecule in planck’s radiation field 🧪⚛️
Prague, 23 November 1911
Highly esteemed Mrs. Curie,
Do not laugh at me for writing you without having anything sensible to say.
But I am so enraged by the base manner in which the public is presently daring to concern itself with you!? that I absolutely must give vent to this feeling. However, I am convinced that you consistently despise this rabble, whether it obsequiously lavishes respect on you or whether it attempts to satiate its lust for sensationalism!
I am impelled to tell you how much I have come to admire your intellect, your drive, and your honesty, and that I consider myself lucky to have made your personal acquaintance in Brussels. Anyone who does not number among these reptiles is certainly happy, now as before, that we have such personages among us as you, and Langevin(3) too, real people with whom one feels privileged to be in contact. If the rabble continues to occupy itself with you, then simply don't read that hogwash, but rather leave it to the reptile for whom i
6790193195
Smerity @smerity.bsky.social · 12/02/2025
If done well the proper env setup will help end users as much as LLMs. For proper play, human or machine, you need the equivalent of GET and POST - knowing you can hammer the test Sqlite database as much as you want given it's either resettable sandbox or only running read only queries.
050
Smerity @smerity.bsky.social · 12/02/2025
I had a not dissimilar situation with a complicated Pandas query recently. All of the major LLMs defaulted to the same mistaken thinking and required hard nudges. First LLM that seamlessly integrates interactions with the user's own tooling will do so much better given the LLMs can self correct.
160
Reposted by Smerity
antirez @antirez.bsky.social · 04/01/2025
Very few people see a full video on YouTube apparently, even if it lasts just 10-15 minutes.
3417819
Smerity @smerity.bsky.social · 12/12/2024
There are similarity and differences to tweetstorms and I think that's a great example of where it transitions to marketing / hype. The first tweet in a tweetstorm is usually hype and noise and promise but no value. "Five amazing secrets that gradient optimizers don't want you to know! 🧵 1/9"
060
Smerity @smerity.bsky.social · 12/12/2024
I still think there's strong value in the annoyance you're experiencing 😅 The extra effort you use is gifted to everyone as a richer contextualized message, and I think below the fold encouraged above the fold to be marketing/noise instead of signal. bsky.app/profile/smer...
1130
Smerity @smerity.bsky.social · 11/12/2024
tldr; as a language modeler I always thought compression was intelligence, and short tweets force compression and hence intelligence :)
081
Smerity @smerity.bsky.social · 11/12/2024
Longer posts on Twitter actually kill a core Twitter feature imho. There's value and art in a tweet compressing long form information. This can be done by anyone, not just the original author. The feed becomes a high level "skim reader", progressing to depth when interested piqued.
3160
Smerity @smerity.bsky.social · 06/12/2024
Been a while since I've seen parse trees, though I'm partial to CCG 🤣
010
Smerity @smerity.bsky.social · 05/12/2024
The Dell XPS 13 with Ubuntu Linux native was what I tried last. It's close but there's still a few hardware issues and most importantly a weird system lag with Google Chrome that can drive me insane. If I can't type without random double presses it no longer counts as a functional device 😭
270
Smerity @smerity.bsky.social · 05/12/2024
I fought for some time to keep using a Linux laptop but even for those which promise "first class Linux support" seem to fall short. I dual wielded a Linux laptop and a Macbook Pro, slowly transitioned to just the latter :(
160
Smerity @smerity.bsky.social · 03/12/2024
My contribution to a discussion at hiddenstates.org on explorables/user interfaces for controlling ML tools > We're trying to rig soundboards to control LLMs thinking there's a well defined interface underneath when it's actually a button that drops fertilizer into the river of a complex ecosystem.
0100
Smerity @smerity.bsky.social · 29/11/2024
I think with a default chronological pipeline it's harder for (3)/(4) to gain traction. When the points rely on rage / clickbait / etc to propagate there's more active work needed, with algorithmic feed redirecting air to the spark. Chronological + local interaction helps minimize (1)/2) as well?
010
Reposted by Smerity
Smerity @smerity.bsky.social · 29/11/2024
The fact that most wouldn't pay money for passive consumption "there" (reels, feed, ...) but do actively pay with the tick tock of our mind (hours spent, enriching the content locally, ...) is fascinating. If this is psychological obliteration we're very much an active participant in it.
041
Smerity @smerity.bsky.social · 29/11/2024
The fact that most wouldn't pay money for passive consumption "there" (reels, feed, ...) but do actively pay with the tick tock of our mind (hours spent, enriching the content locally, ...) is fascinating. If this is psychological obliteration we're very much an active participant in it.
041
Smerity @smerity.bsky.social · 29/11/2024
Imagination feels like a double edged sword "there". Too little and you consume only as "there" actually exists, nothing novel. Too much and you enter Don Quixote mode where "no history has more reality in it". Aphantasia may seem an accidental defense, preventing excessive self enriching?
110
Smerity @smerity.bsky.social · 29/11/2024
A new perspective to me as well which explains why I'm always interrogating when passive via comparative analysis of "here"/"there", intending to pull back analogical wisdom to my present situation. I think that's as much protective delusion as practical defense. news.ycombinator.com/item?id=4226...
news.ycombinator.com
In Praise of Print: Reading Is Essential in an Era of Epistemological Collapse | Hacker News
140
Reposted by Smerity
Michael Nielsen @michaelnielsen.bsky.social · 29/11/2024
A new-to-me perspective on passive consumption of media (Also: I'm gifting you some psychological obliteration here!)
5434
Smerity @smerity.bsky.social · 28/11/2024
As an Australian I don't think it will be effective (enforcement or result), opens the possibility of broader tracking, and likely doesn't mitigate the harms they're trying to avoid either. It definitely would have stunted my learning as a teen. A contentious issue regardless ¯\_(ツ)_/¯
120
Smerity @smerity.bsky.social · 27/11/2024
Out of curiosity, as I'm not in deep in the panadas ecosystem, would polars fill a similar need for you or was there something different?
110
Smerity @smerity.bsky.social · 27/11/2024
Glad I found you again! You're the type of follow I didn't want to lose in the Twitter migration ^_^ I appreciated the bridge app but it was definitely slow, had many false positives I filtered manually, and won't catch those moving after I migrated.
110
Reposted by Smerity
kyunghyuncho.bsky.social @kyunghyuncho.bsky.social · 27/11/2024
congratulations, @ian-goodfellow.bsky.social, for the test-of-time award at @neuripsconf.bsky.social! this award reminds me of how GAN started with this one email ian sent to the Mila (then Lisa) lab mailing list in May 2014. super insightful and amazing execution!
318727
Smerity @smerity.bsky.social · 27/11/2024
This is great! I'm mentally adding it to the same collection as Linus first announcing Linux via mailing list ^_^
From: torvalds@klaava.Hels
Subject: What would you like to see most in minix?
Date: 25 Aug 91 20:57:08 GMT
Organization: University of Helsinki

Hello everybody out there using minix -

I'm doing a (free) operating system (just a hobby, won't be big and professional like gnu) for 386(486) AT clones. This has been brewing since april, and is starting to get ready. I'd like any feedback on things people like/dislike in minix, as my OS resembles it somewhat (same physical layout of the file-system (due to practical reasons) among other things).

I've currently ported bash(1.08) and gcc(1.40), and things seem to work. This implies that I'll get something practical within a few months, and I'd like to know what features most people would want. Any suggestions are welcome, but I won't promise I'll implement them :-)

Linus
0100
Smerity @smerity.bsky.social · 27/11/2024
What got you this time? Last "yeah I definitely need to play with nightly" for me was Flex Attention - which admittedly was pretty recent too 🤣
210
Smerity @smerity.bsky.social · 26/11/2024
The part that's insane to me is that external hyperlink isn't even opposite to "central host". Reddit and X aren't that different from each other and most of Reddit is linking to outside content w/ discussion returning on site. X decided they ... didn't want free content to spur discussion ..? 🤔
020
Smerity @smerity.bsky.social · 26/11/2024
I loved seeing @commoncrawl.bsky.social's use grow after contributing a decade ago. I'm expecting the Bluesky API + firehose to have an even faster pace of innovation given it's so accessible, has a small but potent dataset (total / incremental size), and directly tracks the pulse of the community!
020
Smerity @smerity.bsky.social · 26/11/2024
Perhaps closer to how I've played with embeddings/discovery on English Wikipedia in the past but likely similar :) Also sticky taping in my personal bookmarking system for the discovery aspect, may release if works well. The Bluesky API is complex but the docs are strong! Jetstream is also JSONL 🔥
040
Smerity @smerity.bsky.social · 26/11/2024
I've got good mileage for playing by a slightly more advanced `cat atproto/examples/*.py` and feeding it into an LLM gist.github.com/Smerity/f896... P.S. I don't mean to make a "Bluesky posting about Bluesky" post, but honestly, if I'd have been playing around with this regardless, so ... 😅
gist.github.com
All the examples from the Bluesky `atproto` Python API as a single text file with delineation
All the examples from the Bluesky `atproto` Python API as a single text file with delineation - all_examples_from_bluesky_atproto_python_api.py.txt
1111
Smerity @smerity.bsky.social · 26/11/2024
I'm both hopeful about and want to contribute to the ecosystem that could build up around this. There are many opportunities that I can't see existing elsewhere. The documentation is also far less painful than I'd have thought. Bluesky's slow rolled start is a strong help in that regard!
190
Smerity @smerity.bsky.social · 26/11/2024
Who is playing around with Bluesky at an API / data level? I've used the API to {read a bot's DMs, collect your likes, analyze your following / followers} (with heavy `time.sleep` for latter as I've not found bulk queries). Leaping into "Bluesky as a dataset" by exploring Jetstream. Hints?
1356
Smerity @smerity.bsky.social · 25/11/2024
Caddy's a great choice. I love that it stretches from local poking and prodding to full production. The Caddy local file server (i.e. `caddy file-server --listen 0.0.0.0:8000 --browse`) overtook `python -m http<dot>server` for me given it looks nicer and has grid view for images :)
1121
Smerity @smerity.bsky.social · 24/11/2024
Definitely true! I've personally seen it more on ML side vs broad Python. In ML your hot path usually has a cliff to both sides. Broad Python's fine with 5-10x slower pre "JIT" - your task / fixed data just takes 5-10x as long. In ML you lose even "fixed data" - epochs, experiments, variations, ...
060
Smerity @smerity.bsky.social · 24/11/2024
You need at least a zillion PDFs and to have downloaded all dependencies and documentation for that new framework you've been meaning to play with but haven't yet had the chance 👍 (I not frequently do 16+ hour flights back home to AU and even that flight length doesn't help lol)
010
Smerity @smerity.bsky.social · 22/11/2024
Draft, redraft, redraft, ..., {% if random.random() > 0.5 %}never post, delete{% else %}post{% endif %}
000
Smerity @smerity.bsky.social · 22/11/2024
Writing more Rust recently led me to a revelation about Python. Rust was vital to my original task, but only a few simplifications away, the shorter Python version leapt to almost as fast. I'd stumbled from a cold path to a hot path, part of a vast network of optimized trails in Python's ecosystem.
state.smerity.com
Smerity.com: Python isn't just glue, it's an implicit JIT ecosystem
The ecosystem wears in the desire paths, and when slow Python becomes a problem, the ecosystem doesn't optimize the Python, it paves new roads beneath
1467
Smerity @smerity.bsky.social · 22/11/2024
I was recently writing and when you really get into flow with the iterative refining, reordering, rewording, reordering, ... The final piece ended up in a vastly different place than where it started, the best insights not even in the starting text. Not sure speech would have given the same result.
020
Smerity @smerity.bsky.social · 20/11/2024
Darn, sorry, I misunderstood the setting myself. I've added a follow up.
000
Smerity @smerity.bsky.social · 20/11/2024
Thanks, noted in the follow up -_-
000
Smerity @smerity.bsky.social · 20/11/2024
I regret to note this isn't what I had assumed - the "Priority notifications filter" still lets through likes and follows ... =[
120
Smerity @smerity.bsky.social · 20/11/2024
Turns out the functionality does exist, both on web and mobile, but you can _only_ access it via the ⚙️ button on the Notifications tab, not through Settings.
100
Smerity @smerity.bsky.social · 20/11/2024
Turns out it's possible! Sadly the option is quite hidden.
110
Smerity @smerity.bsky.social · 20/11/2024
PSA: Are your Bluesky notifications a tad too loud? You can set Bluesky to only replies and quotes. Go to the Notifications tab (web or mobile) and click on the ⚙️ in the top right. Note: This option is not found under Settings
Notification Settings

Notification filters

Enable priority notifications [Toggle box]

Experimental: When this preference is enabled, you'll only receive reply and quote notifications from users you follow. We'll continue to add more controls here over time.
2179
Smerity @smerity.bsky.social · 20/11/2024
I don't see notification settings in my options but I'm on iPhone so perhaps a platform discrepancy. Excited for it though! New follows / likes are (not necessarily bad but still) dopamine whilst replies and quotes are deeper interactions 👍
230
Smerity @smerity.bsky.social · 20/11/2024
I'm especially excited by the latter as that isn't traditionally an option on other social networks and can't be done yourself on a locked down social network. I could (and will if someone else doesn't) code up my own version with my existing Bluesky ATProto examples 🔥
230
Smerity @smerity.bsky.social · 20/11/2024
I think it'll work out fine! - Short term the probability of them interacting with you is high, you incrementally follow those with overlapping interests / dispositions - Long term there'll likely be a (smart?) feed from those that follow you (as there already exists feeds from only your mutuals)
1111
Smerity @smerity.bsky.social · 20/11/2024
I have the exact same problem - I chose my header photo to try to start bridging the transition 😅
The ten year old profile picture of Smerity next to the header photo of Smerity from ten years later
040
Smerity @smerity.bsky.social · 20/11/2024
I still had muscle memory of typing "tw + Enter" to go to X, even a year and a half after the rename. Browser extensions exist redirecting Twitter / X to Bluesky but those were too extreme - I wrote one that _just_ redirects twitter.com to bsky.com so I could take advantage of that muscle memory 🤣
0200
Smerity @smerity.bsky.social · 20/11/2024
Similar hidden magic, WebARChive (WARC) files do the same with the gzip (and zstd) spec: you can concatenate multiple gzip files together yet treat them as a continuous stream. By breaking up WARC/JSONL files into individual / blocks you can HTTP range query for random access + decompression!
030
Smerity @smerity.bsky.social · 19/11/2024
I'm wondering what the world would look like if there was a 🔴Big Red Button🔴 on each page of the documentation for {libraries, APIs, books, ...}. It doesn't even need to be complex. A heat map of pain is by itself such a strong signal given we lack insight even as simple as churn rate for non-use.
050