Sign in

Amit Chaudhary

@amitness.com
219 followers 276 following 33 posts

ai engineer | blog: amitness.com past: cogsci, low-res nlp, multimodality

PostsRepliesMedia
Amit Chaudhary @amitness.com · 04/06/2025
For pre-training data, this thread has good paper recommendations bsky.app/profile/mari...
040
Amit Chaudhary @amitness.com · 04/06/2025
Not academic work, but for evals and data, these survey articles are quite in-depth with links to papers. LLM judge survey: eugeneyan.com/writing/llm-... Synthetic pre-training/post-training survey: eugeneyan.com/writing/synt...
eugeneyan.com
Evaluating the Effectiveness of LLM-Evaluators (aka LLM-as-Judge)
Use cases, techniques, alignment, finetuning, and critiques against LLM-evaluators.
250
Amit Chaudhary @amitness.com · 10/05/2025
I had watched a talk from @thomwolf.bsky.social of @hf.co and they use trafilatura.readthedocs.io for the HTML to text conversion in their library datatrove (github.com/huggingface/...). The talk is more focused on filtering though but here it is: www.youtube.com/watch?v=2-SP...
trafilatura.readthedocs.io
A Python package & command-line tool to gather text on the Web — Trafilatura 2.0.0 documentation
Trafilatura is a Python package and command-line tool designed to gather text on the Web. Its main applications are web crawling, downloads, scraping, and extraction of main texts, comments and metada...
130
Amit Chaudhary @amitness.com · 19/02/2025
👋
010
Amit Chaudhary @amitness.com · 16/02/2025
Wrote a package for the gpu-poor/mac-poor to run ollama via remote servers (paid, colab, kaggle etc.) Just 2 lines and your local ollama can run all models on server-side GPU: > pip install ollama-remote > ollama-remote github.com/amitness/oll...
050
Amit Chaudhary @amitness.com · 15/02/2025
Wrote up a deep-dive on how @tool decorators in various Agent frameworks leverage python runtime introspection for function to JSON schema conversion. amitness.com/posts/functi...
amitness.com
Introspection for Function Calling
Learn runtime introspection in Python to convert functions into JSON schema for function calling with LLMs
030
Amit Chaudhary @amitness.com · 14/02/2025
Sure, SFT is simulating annotators from those countries But, you see this multiple times on reddit/linkedin, where people downvote and point out some comment as "sounds like chatgpt". Cause it has antislop phrase or syntax Not accurate as you pointed, but that's what a layman is using as proxy
000
Amit Chaudhary @amitness.com · 14/02/2025
Picking a few keywords from this antislop list: github.com/sam-paech/an...
github.com
100
Amit Chaudhary @amitness.com · 14/02/2025
You actually don't need multiple --with. A comma separated list of packages also works (though looks a bit uglier) uvx --with llm,sqlite-utils ipython
060
Amit Chaudhary @amitness.com · 09/02/2025
Wrote a literature review on various automated evals for measuring linguistic diversity in LLM generated synthetic data. Useful to systematically test impact of various techniques on diversity amitness.com/posts/divers...
amitness.com
Evals for Diversity in Synthetic Data
An overview of evaluation metrics for measuring linguistic diversity in LLM-generated synthetic data
080
Amit Chaudhary @amitness.com · 06/01/2025
You can do it with skyfeed + running your custom logic on github actions bsky.app/profile/amit...
080
Amit Chaudhary @amitness.com · 30/12/2024
Same energy (h/t @hamel.bsky.social ) x.com/HamelHusain/...
0220
Amit Chaudhary @amitness.com · 25/12/2024
Reminded me of this paper: arxiv.org/abs/2310.06816
arxiv.org
Text Embeddings Reveal (Almost) As Much As Text
How much private information do text embeddings reveal about the original text? We investigate the problem of embedding \textit{inversion}, reconstructing the full text represented in dense text embed...
120
Amit Chaudhary @amitness.com · 19/12/2024
I just rely on these: - alphasignal for daily updates - email subs to blogs (eugeneyan, simonw, hamel, jasonliu) - read orielly for bird-eye surveys (chip huyen's ai eng, jay's hands-on llm etc.) - deeplearning.ai "short" courses to know what's out there (topics I don't touch at work e.g. agents)
010
Amit Chaudhary @amitness.com · 19/12/2024
how are you tackling the last 2 points?
110
Amit Chaudhary @amitness.com · 03/12/2024
That's super cool, I'll give it a try and thank you for building Skyfeed!
010
Amit Chaudhary @amitness.com · 01/12/2024
cc: @pfrazee.com @simonwillison.net (another git scraping avenue)
060
Amit Chaudhary @amitness.com · 01/12/2024
Wrote down the process to build your own custom feeds for Bluesky programmatically in Python and run it 100% free Uses @skyfeed.app + @github.com actions to do periodic filtering and re-ranking and @cloudflare.social static pages to provide data to @bsky.app
amitness.com
Zero-Cost Custom Feeds on Bluesky
A simple stack for generating custom feeds for Bluesky programmatically without a backend server
1013425
Amit Chaudhary @amitness.com · 29/11/2024
Would this be stance detection? A controversial post would have a high entropy of stance distribution in replies/quotes aka the "1M posts" drama. paperswithcode.com/task/stance-... Mutes to a post might also be a good proxy to downvotes but those are private and can't be accessed via API.
paperswithcode.com
Papers with Code - Stance Detection
Stance detection is the extraction of a subject's reaction to a claim made by a primary actor. It is a core part of a set of approaches to fake news assessment. Example: * Source: "Apples are the mo...
020
Amit Chaudhary @amitness.com · 28/11/2024
It's also why the feed loads super fast. Bluesky is simply making a request to this static endpoint on cloudflare when you open the feed and just fetches the JSON for the post ids and loads that into their UI. bluesky-1tj.pages.dev/xrpc/app.bsk...
bluesky-1tj.pages.dev
110
Amit Chaudhary @amitness.com · 28/11/2024
Thanks; the trick is how bluesky protocol operates. It makes GET requests to 3 endpoints and expects JSON So, instead of running a server 24/7, you can offload indexing to @skyfeed.app, periodically filter the feed via github actions and just dump that into cloudflare pages with correct paths
110
Amit Chaudhary @amitness.com · 27/11/2024
I fetch the feed created by skyfeed using bluesky sdk, and for posts with arxiv links, used the pyarxiv library to fetch the category and filtered items to these categories: cs.AI, cs.CL, cs.CV, cs.LG, cs.MA Here is the relevant code The filtering runs every 30m for free via github actions
130
Amit Chaudhary @amitness.com · 27/11/2024
Hey @mariaa.bsky.social, I got it working. Here you go bsky.app/profile/amit...
110
Amit Chaudhary @amitness.com · 27/11/2024
The most interesting part is the filtering and ranking; you can do a bunch of stuff. I went with hackernews ranking for as a start to balance recency vs popularity. You could even train your own classifiers to make it more personalized; bluesky seems super hackable, love it!
020
Amit Chaudhary @amitness.com · 27/11/2024
Built a custom feed that shows latest arxiv+acl papers that belong to AI/ML/NLP/Computer vision categories. No bots/random papers belonging to other fields now. bsky.app/profile/amit... Generated in python but runs 100% free without a server; I'll do a write-up soon github.com/amitness/blu...
3123
Reposted by Amit Chaudhary
✨️ Sydney ✨️ @deadpoolian.bsky.social · 17/11/2024
Bookmark labeler/feed! Unlike the pin feed where you have to comment 📌 to save a post, this alternative is completely private! Subscribe to both the labeler and feed here. Report a post to the label to add to the feed! Report again to remove! bsky.app/profile/book...
20047242452
Amit Chaudhary @amitness.com · 26/11/2024
I am also planning to hack-around some ML powered feed this weekend. Goal is to see if it can be hosted for free (thinking cloudflare workers + kv cache free tier) Also saw this earlier, could be useful to join bsky.app/profile/dani...
040
Reposted by Amit Chaudhary
Jay 🦋 @jay.bsky.team · 25/11/2024
Want to use bluesky replies as your blog’s comment section? `npm install bluesky-comments` Built by @coryzue.com
1553167556
Amit Chaudhary @amitness.com · 25/11/2024
If using OpenAI, you need to make sure the "reasoning" key is before the "answer" fields (i.e. ResponseFormatA if using pydantic) @dylancastillo.co has done a nice analysis on this and the order matters dylancastillo.co/posts/llm-py...
020
Amit Chaudhary @amitness.com · 25/11/2024
I wonder if it's possible to do it for free via github actions. (cc: @simonwillison.net ) Bluesky seems to do GET requests to a path and expect valid JSON of post ids to build the feed. Maybe it's possible to generate JSON periodically via actions and just host it on github pages?
docs.bsky.app
app.bsky.feed.getFeedSkeleton | Bluesky
*This endpoint is part of the Bluesky application Lexicon APIs (`app.bsky.*`). Public endpoints which don't require authentication can be made directly against the public Bluesky AppView API: https://...
010
Amit Chaudhary @amitness.com · 25/11/2024
With @skyfeed.app , I don't think it's currently possible. It only allows regex on text of posts/link. It should be possible by building a server in python (github.com/MarshalX/blu...) to read the firehose, filter arxiv links, scrap the html and take only the cs.CL papers (or even classifier here)
github.com
GitHub - MarshalX/bluesky-feed-generator: 🦋 Bluesky custom feed algorithms server in Python 🐍
🦋 Bluesky custom feed algorithms server in Python 🐍 - MarshalX/bluesky-feed-generator
120
Amit Chaudhary @amitness.com · 20/11/2024
There has also been proposals like having a llms.txt endpoint that contains the entire documentation for the library in a single markdown page for LLM consumption (cc: @jph.bsky.social) llmstxt.org
llmstxt.org
The /llms.txt file – llms-txt
A proposal to standardise on using an /llms.txt file to provide information to help LLMs use a website at inference time.
010
Amit Chaudhary @amitness.com · 20/11/2024
Added bluesky to quarto blog. For any @quarto.org users, you can do it via: 1. Save this svg into `images/bluesky.svg` 2. Replace currentColor in <path fill="currentColor" in the svg with color matching your other icons. I did rgba(255,255,255,.8) 3. Add this yaml code to _quarto.yml
030
Reposted by Amit Chaudhary
JD Long @jdlong.cerebralmastication.com · 16/11/2024
This Bluesky follow finder is super neat. It finds folks you don’t follow who follow folks you follow. So it helps fill in your network. It’s the type of cool stuff enabled by an open ecosystem. bsky-follow-finder.theo.io
bsky-follow-finder.theo.io
Bluesky Network Analyzer
Find accounts that you don't follow (yet) but are followed by lots of accounts that you do follow.
1915452
Reposted by Amit Chaudhary
Boris @boris.pds.cosocial.ca · 16/11/2024
How am I making these amazing posts with links in them? That’s the Ouranos web client, made by @pouriade.com — which now supports self-hosted PDS logins! Plus: add out of band tags, search replies in long threads, search other posts discussing a link, and more.
071
Amit Chaudhary @amitness.com · 16/11/2024
A mod like Revanced applied to the original app has ton more features (hiding shorts/home feed, no ads, auto-skipping sponsor segments) compared to paying for premium 😂 Google should just copy their features
100
Amit Chaudhary @amitness.com · 16/11/2024
What's socratic models?
100