iiinova — where your digital self keeps evolving

Denis Shepelin @denshe.bsky.social · 15/02/2025

Great summary! Uv indeed feels very magical and as there was a team that polished that for like 15 years.

Reposted by Denis Shepelin

Bite Code! @bitecode.dev · 15/02/2025

The time has come. The prophecy is accomplished. We are going to review one year of uv usage to ponder the pros, the cons, and whether you should migrate. It's a long article, but I have a 10 lines TL;DR at the top, you can pretend you read the whole thing :) open.substack.com/pub/bitecode...

open.substack.com

A year of uv: pros, cons, and should you migrate

Yes, probably.

085

Denis Shepelin @denshe.bsky.social · 19/12/2024

This is great news huggingface.co/blog/modernb... Not everything needs to be fed through LLM and for that we now have much better foundation for tons of apps that work with texts but not necessarily need to generate any, so classification, NER, similarity scores.

huggingface.co

Finally, a Replacement for BERT: Introducing ModernBERT

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

000

Reposted by Denis Shepelin

Eugene Yan @eugeneyan.com · 07/12/2024

Learning about quantization suffixes while `ollama pull llama3.3` download completes (fyi, quantization for the default 70b is q4_K_M) • make-ggml .py: github.com/ggerganov/ll... • pull request: github.com/ggerganov/ll...

Old quant types (some base model types require these):
- Q4_0: small, very high quality loss - legacy, prefer using Q3_K_M
- Q4_1: small, substantial quality loss - legacy, prefer using Q3_K_L
- Q5_0: medium, balanced quality - legacy, prefer using Q4_K_M
- Q5_1: medium, low quality loss - legacy, prefer using Q5_K_M

New quant types (recommended):
- Q2_K: smallest, extreme quality loss - not recommended
- Q3_K: alias for Q3_K_M
- Q3_K_S: very small, very high quality loss
- Q3_K_M: very small, very high quality loss
- Q3_K_L: small, substantial quality loss
- Q4_K: alias for Q4_K_M
- Q4_K_S: small, significant quality loss
- Q4_K_M: medium, balanced quality - recommended
- Q5_K: alias for Q5_K_M
- Q5_K_S: large, low quality loss - recommended
- Q5_K_M: large, very low quality loss - recommended
- Q6_K: very large, extremely low quality loss
- Q8_0: very large, extremely low quality loss - not recommended
- F16: extremely large, virtually no quality loss - not recommended
- F32: absolutely huge, lossless - not recommended

3234

Denis Shepelin @denshe.bsky.social · 03/12/2024

aws.amazon.com/ai/generativ... Looks quite impressive. I really appreciate the direction towards cost and speed optimization rather than accuracy for most cases I care about.

aws.amazon.com

Generative Foundation Model - Amazon Nova - AWS

Amazon Nova is a generation of state-of-the-art (SOTA) foundation model that delivers frontier intelligence and industry leading price-performance.

110

Denis Shepelin @denshe.bsky.social · 25/11/2024

Structured outputs make no negative impact on reasoning abilities of LLMs (I've also observed that in practice). Key takeaways: 1. Proper design of prompts is important Even the most senior researchers can do wrong. Many builtin prompts in packages are also bad. blog.dottxt.co/say-what-you...

blog.dottxt.co

Say What You Mean: A Response to 'Let Me Speak Freely'

100

Reposted by Denis Shepelin

Ned Batchelder @nedbat.com · 21/11/2024

Also: you can also use variables (or expressions?!) for the formatting information! #Python is cool... More details and explanation at fstring.help

Showing using variables for the character and width specification in the format. Full text at https://gist.github.com/nedbat/db70d4cc6f16e88a33889ec113dcbe4d

2366

Denis Shepelin @denshe.bsky.social · 30/10/2024

Maybe one can also interact with aging data as well. Remind that there was something really interesting back then, but forgotten for a while in Read-It-Later style of apps for example. Or liberate the users like Arc browser does with their auto-discarded tabs.

000

Denis Shepelin @denshe.bsky.social · 27/10/2024

It's so strange to feel immediate ick on Twitter/X given their update that 1) made videos autoplay 2) pushed too many "meme"/tiktok/youtube shorts like entertainment videos 3) pushed me to Followed tab to only find extremely low activity of people whom I actually following there.

040