iiinova — where your digital self keeps evolving

Replies

fry69 @fry69.dev · 10/09/2026

Highly recommended blog and video by @anniesexton.com about the relation between compression algorithms and large language model token prediction. -> ngrok.com/blog/compres...

ngrok.com

Compression is prediction | ngrok blog

Compression and LLMs are trying to solve the exact same problem: predicting what comes next. Learn the fundamentals of compression and how better prediction leads to better shrinkage.

ngrok@ngrok.com

The best compressors are... LLMs? Compression and language modeling share a job: predicting what comes next. @anniesexton.com shows how those predictions become fewer bits, and why gzip still gets to keep its all-important job. ↓ www.youtube.com/watch?v=HkUy...

youtube.com

The best compressors are...LLMs?

YouTube video by ngrok

161

fry69 @fry69.dev · 10/09/2026

Related highly recommended deep dive into the not-so-obvious connection between compression algorithms, guessing games and LLMs ->

Adam Gordon Bell@adamgordonbell.bsky.social

I've been a little obsessed with compression and the Hutter Prize. €5,000 for every 1% you shave off a zip file's size. Don and I attempt to beat it in the latest podcast episode. corecursive.com/the-hutter-p...

corecursive.com

The Hutter Prize

I texted Don about a side gig: €5,000 for every 1% you shave off a zip file. It's a real contest. For 20 years, Marcus Hutter has offered €500,000 to anyone who can losslessly compress a gigabyte of ...

101

fry69 @fry69.dev · 10/09/2026

Mentioned paper: "Language Modeling Is Compression" (first submitted Sep 2023) -> arxiv.org/abs/2309.10668

arxiv.org

Language Modeling Is Compression

It has long been established that predictive models can be transformed into lossless compressors and vice versa. Incidentally, in recent years, the machine learning community has focused on training i...

000