iiinova — where your digital self keeps evolving

Lucas Beyer (bl16) @giffmana.ai · 26/01/2025

I noticed that I'm not using bsky much anymore. Not sure why, vibes. Anyways, someone noticing that DeepSeek refuses to answer *anything* about Xi Jinping, even the question whether he exists at all, triggered me writing a short snippet on safety fine-tuning: lb.eyer.be/s/safety-sft...

6888

Lucas Beyer (bl16) @giffmana.ai · 02/01/2025

First candidate for banger of the year appeared, only 2 days in:

0280

Reposted by Lucas Beyer (bl16)

Nathan Lambert @natolambert.bsky.social · 20/12/2024

OpenAI skips o2, previews o3 scores, and they're truly crazy. Huge progress on the few benchmarks we think are truly hard today. Including ARC AGI. Rip to people who say any of "progress is done," "scale is done," or "llms cant reason" 2024 was awesome. I love my job.

1111314

Lucas Beyer (bl16) @giffmana.ai · 18/12/2024

A post by @cloneofsimo on Twitter made me write up some lore about residuals, ResNets, and Transformers. And I couldn't resist sliding in the usual cautionary tale about small/mid-scale != large-scale. Blogpost: lb.eyer.be/s/residuals....

3819

Lucas Beyer (bl16) @giffmana.ai · 10/12/2024

Good morning Vancouver! Things are different here: this guy is alone, chonky, and not scared at all, I was more scared of him towards the end lol. Also look at that … industrialization

3310

Lucas Beyer (bl16) @giffmana.ai · 09/12/2024

Good morning! On my way to NeurIPS, slightly sad to leave this beautiful place and my family for the week, but also excited to meet many new and old friends at NeurIPS!

3650

Reposted by Lucas Beyer (bl16)

Sai Kumar Dwivedi @saidwivedi.in · 08/12/2024

One of the best tutorials for understanding Transformers! 📽️ Watch here: www.youtube.com/watch?v=bMXq... Big thanks to @giffmana.ai for this excellent content! 🙌

youtube.com

[M2L 2024] Transformers - Lucas Beyer

YouTube video by Mediterranean Machine Learning (M2L) summer school

0548

Reposted by Lucas Beyer (bl16)

Ibrahim Alabdulmohsin @ibomohsin.bsky.social · 07/12/2024

Attending #NeurIPS2024? If you're interested in multimodal systems, building inclusive & culturally aware models, and how fractals relate to LLMs, we've 3 posters for you. I look forward to presenting them on behalf of our GDM team @ Zurich & collaborators. Details below (1/4)

1125

Reposted by Lucas Beyer (bl16)

Andrei Bursuc @abursuc.bsky.social · 05/12/2024

This aged well

0231

Lucas Beyer (bl16) @giffmana.ai · 05/12/2024

The fourth nice thing we* have for you this week: PaliGemma 2. It’s also a perfect transition: this v2 was carried a lot more by @andreaspsteiner.bsky.social André and Michael than by us. Crazy new sota tasks! Interesting res vs LLM size study! Better OCR! Less hallucination!

1222

Reposted by Lucas Beyer (bl16)

Marvin Schmitt @marvin-schmitt.com · 05/12/2024

OpenAI is coming to Switzerland, and the founding team of the new Zurich office is nothing short of stellar🇨🇭⭐️ What a fantastic win for the European AI landscape 🇪🇺 Congrats to @giffmana.ai @kolesnikov.ch @xzhai.bsky.social for that move, and to OpenAI for making these hires!

1382

Lucas Beyer (bl16) @giffmana.ai · 04/12/2024

@francois.fleuret.org hey, can you buy me a few of tomorrow's Le Temps, if the news about us is printed in it? I'll pay you in beers at neurips.

2180

Lucas Beyer (bl16) @giffmana.ai · 04/12/2024

So, now that our move to OpenAI became public, @kolesnikov.ch @xzhai.bsky.social and I are drowning in notifications. I read everything, but may not reply. Excited about this new journey! 🚀 Quick FAQ thread...

151114

Reposted by Lucas Beyer (bl16)

Alexander Kolesnikov @handle.invalid · 04/12/2024

Ok, it is yesterdays news already, but good night sleep is important. After 7 amazing years at Google Brain/DM, I am joining OpenAI. Together with @xzhai.bsky.social and @giffmana.ai, we will establish OpenAI Zurich office. Proud of our past work and looking forward to the future.

811611

Reposted by Lucas Beyer (bl16)

Dmytro Mishkin @ducha-aiki.bsky.social · 03/12/2024

JetFormer: An Autoregressive Generative Model of Raw Images and Text @mtschannen.bsky.social @asusanopinto.bsky.social @kolesnikov.ch tl;dr: VQGAN quality w/o VQGAN, but optimizing pixel tokens with NLL. Also some normalizing flow magic, which I have to read up arxiv.org/abs/2411.19722

1424

Lucas Beyer (bl16) @giffmana.ai · 03/12/2024

So this was the second cool thing that we* got this week. * this time the « we » is really just me, but hey, academic we 🙃

0270

Lucas Beyer (bl16) @giffmana.ai · 03/12/2024

Our big_vision codebase is really good! And it's *the* reference for ViT, SigLIP, PaliGemma, JetFormer, ... including fine-tuning them. However, it's criminally undocumented. I tried using it outside Google to fine-tune PaliGemma and SigLIP on GPUs, and wrote a tutorial: lb.eyer.be/a/bv_tuto.html

311519

Reposted by Lucas Beyer (bl16)

Alexander Kolesnikov @handle.invalid · 02/12/2024

The answer has just dropped: bsky.app/profile/kole...

2152

Lucas Beyer (bl16) @giffmana.ai · 02/12/2024

The first of the cool things we* got this week! Typically, you'd train a VQ-VAE/GAN tokenizer first, and then use its tokens for your LLM/DiT/... But we all know eventually end-to-end wins over pipelines. With flow models, you can actually learn pixel-LLM-pixel end-to-end!

2534

Lucas Beyer (bl16) @giffmana.ai · 29/11/2024

Some recent discussions made me write up a short read on how I think about doing computer vision research when there's clear potential for abuse. Alternative title: why I decided to stop working on tracking. Curious about other's thoughts on this. lb.eyer.be/s/cv-ethics....

1917320

Lucas Beyer (bl16) @giffmana.ai · 28/11/2024

hahahahhahaah holy cow, paligemma is good =)

3323

Lucas Beyer (bl16) @giffmana.ai · 28/11/2024

segment cow not on the beach, but as you may know I like cows in "out of distribution" places and poses. huggingface.co/spaces/big-v...

2190

Lucas Beyer (bl16) @giffmana.ai · 27/11/2024

Here's a fun real-life prompt where 30min of Googling didn't really help me. The small/fast/mini chatbots all failed miserably The large ones work great (except Gemini). Also: 1. I really like C3.6 giving only answer and asking if explain 2. Wild that Chat understood the calls and added comments!

1151

Lucas Beyer (bl16) @giffmana.ai · 27/11/2024

Reminder that robots.txt is a gentleman’s agreement, not a legal document. The good actors all respect it, but there’s many bad actors out there on the internet.

3411

Lucas Beyer (bl16) @giffmana.ai · 27/11/2024

No need to be a deep pocketed company, or HF. Scraping one million posts is not much. I did more than 14M just for fun on my single cheap desktop during PhD. Please don’t be intimidated too easily.

4260

Lucas Beyer (bl16) @giffmana.ai · 26/11/2024

A sunny winter morning near the lake in Zürich is probably one of the best mood enhancers available world-wide. I don't think I'll ever get tired of this.

2900

Lucas Beyer (bl16) @giffmana.ai · 25/11/2024

In the end I got emotional and couldn't bring myself to kill little `riesling`, who's remained loyal this whole decade. So I embarked on a journey to update Ubuntu 14.04 to 24.04. What an adventure! `failed to execute process '/usr/bin/ln'` almost killed me. But I made it, a decade of updates!

3310

Lucas Beyer (bl16) @giffmana.ai · 24/11/2024

So how long do we give it before the bots and spam arrive here, and how well do we think @bsky.app is prepared? 1. L I N K I N B I O. 2. Crypto spam 3. If you’re not doing these 10 GenAI things, you’re falling behind 4. Wow. This changes everything. My guesses: 2 months, and not well.

23824

Reposted by Lucas Beyer (bl16)

xjdr @xjdr.bsky.social · 24/11/2024

the BigVision repo is my current reference impl for gemma and ViT. such an underrated repo @giffmana.bsky.social and team are doing the lord's work github.com/google-resea... github.com/google-resea...

github.com

big_vision/big_vision/models/ppp/gemma.py at main · google-research/big_vision

Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more. - google-research/big_vision

39112

Reposted by Lucas Beyer (bl16)

Alina Peter @alinapeter.bsky.social · 24/11/2024

I tried to go through my entire list of follows in the other place. But need to do again as people move. And then this place has the quiet posters feed which could be really powerful. It shows you posts by people who post the least often. Fantastic idea.

2101

Lucas Beyer (bl16) @giffmana.ai · 24/11/2024

I think Elnaz is right actually. Over time I’ve followed quite a few juniors on X who post sparsely (eg only their papers) and I can’t remember them to follow here. If you think « Lucas just look at your X follows and search them here » then you’re missing the point entirely.

6411

Lucas Beyer (bl16) @giffmana.ai · 23/11/2024

PSA: force-pushing to GitHub does NOT actually delete/overwrite anything. Everything you squash and force-push over is still there:

2301

Lucas Beyer (bl16) @giffmana.ai · 23/11/2024

A real-time (or very fast) open-source txt2video model dropped: LTXV. HF: huggingface.co/Lightricks/L... Gradio: huggingface.co/spaces/Light... Github: github.com/Lightricks/L... Look at that prompt example though. Need to be a proper writer to get that quality.

68910

Lucas Beyer (bl16) @giffmana.ai · 23/11/2024

soooo, this marks the 10th anniversary of using digitalocean for my personal server. It's been running smoothly on 512MB RAM all that time. Now I'm going to splurge on a 1GB RAM, just so it feels like an upgrade! (Same price.)

5420

Reposted by Lucas Beyer (bl16)

Ximing Lu @gximing.bsky.social · 22/11/2024

Are LLMs 🤖 as creative as humans 👩‍🎓? Not quite! Introducing CREATIVITY INDEX: a metric that quantifies the linguistic creativity of a text by reconstructing it from existing text snippets on the web. Spoiler: professional human writers like Hemingway are still far more creative than LLMs! 😲

3436

Reposted by Lucas Beyer (bl16)

Dinos Papakostas @din0s.me · 22/11/2024

0224

Lucas Beyer (bl16) @giffmana.ai · 21/11/2024

I switched from htop to the much prettier `btop`. Love it, but few caveats: 1. ubuntu pkg too old, need to build from source (easy) 2. for me, it crashes because of some assert with 8 GPUs, works with 6. 3. Researching the above, found a comment where author recommends using nvtop in that case :(

6850

Lucas Beyer (bl16) @giffmana.ai · 20/11/2024

www.astralcodexten.com/p/how-did-yo...

89818

Lucas Beyer (bl16) @giffmana.ai · 19/11/2024

French startup H Company released their first model/product today: Runner H, a web agent that's a 3B VLM. The startup was co-founded by Charles Kantor and 4 DeepMinders: Laurent Sifre, Karl Tuyls, Daan Wierstra and Julien Perolat in May. The latter 3 left in August. www.hcompany.ai/blog/a-resea...

1284

Lucas Beyer (bl16) @giffmana.ai · 19/11/2024

Hello, Python! Do you know the reason?

10331

Lucas Beyer (bl16) @giffmana.ai · 19/11/2024

This is how i worked on conference deadlines during PhD.

16890

Lucas Beyer (bl16) @giffmana.ai · 19/11/2024

Context always matters. The paper/model is so good that this was a great poster: everybody relevant already knew all about it before the conference, so the poster reminds them and makes them talk more about it. If it was a less known/good paper, it would have been cringe. Context always matters.

2200

Lucas Beyer (bl16) @giffmana.ai · 18/11/2024

They really missed an opportunity for "Willkommen in La Forêt" here. That being said, nice to see Europe going strong!

2401