Sign in

Ivar Flakstad

@ivarf.bsky.social
221 followers 153 following 19 posts

ML Engineer at 🤗

PostsRepliesMedia
Reposted by Ivar Flakstad
Michael (compiler-errors) Goulet @errs.io · 02/07/2025
Howdy all. I'm unfortunately not going to be with my employer for much longer due to team relocation. If anyone has any info on roles that would allow me to continue my Rust compiler work (in New York City), they'd be greatly appreciated.
19345
Reposted by Ivar Flakstad
kb @keighbee.bsky.social · 13/06/2025
I'm writing an article series about creating tensors from scratch in Rust. #tensors #machine-learning #ml #ai huggingface.co/blog/KeighBe...
huggingface.co
Building Tensors From Scratch in Rust: Part 1, Core Structure and Indexing
A Blog post by Kyle Birnbaum on Hugging Face
083
Reposted by Ivar Flakstad
Rust Language @rust-lang.org · 05/04/2025
🦀 Hello World! The Rust project now has an official presence on Bluesky! ✨ We'll be posting the same on our Mastodon and Bluesky accounts, so you won't miss anything on either platform.
311459285
Ivar Flakstad @ivarf.bsky.social · 09/03/2025
Want an in depth exploration of the different hardware architectures within AI? Of course you do :) Another great article by Chris Fleetwood: fleetwood.dev/posts/domain...
fleetwood.dev
fleetwood.dev
fleetwood.dev
011
Reposted by Ivar Flakstad
narsilou.bsky.social @narsilou.bsky.social · 10/12/2024
Performance leap: TGI v3 is out. Processes 3x more tokens, 13x faster than vLLM on long prompts. Zero config !
1196
Reposted by Ivar Flakstad
kb @keighbee.bsky.social · 05/12/2024
Preliminary data shows the Apple Neural Engine uses ~94% less energy than the CPU and ~75% less than the GPU 🤯 On the On-Device team at Hugging Face, we've been profiling energy usage for CoreML models. Here’s some data I collected:
Chart Title: Model Hardware vs Energy per GigaFLOP.
Vertical Axis: mJ/GFLOP(Log)
Horizontal Axis: Hardware Type(CPU, CPU + GPU, CPU + ANE)
CPU: min 6.9 1st quartile 11.7 median 13.4 3rd quartile 35.6 max 53.1
CPU + GPU: 4.6 4.6 4.7 6.2 9.6
CPU + ANE: 0.9 1.0	1.1 1.4 1.8
241
Reposted by Ivar Flakstad
Thomas Wolf @thomwolf.bsky.social · 24/11/2024
It's Sunday morning so taking a minute for a nerdy thread (on math, tokenizers and LLMs) of the work of our intern Garreth By adding a few lines of code to the base Llama 3 tokenizer, he got a free boost in arithmetic performance 😮 [thread]
527134
Reposted by Ivar Flakstad
Vicki @vickiboykis.com · 20/11/2024
when you try to convert your text into smaller pieces but all it gives you is Elvish, that’s a tolkienizer
341006103
Ivar Flakstad @ivarf.bsky.social · 18/11/2024
RoPE can be confusing, so here’s a great write up by my buddy Chris Fleetwood on the topic: fleetwood.dev/posts/you-co...
fleetwood.dev
fleetwood.dev
fleetwood.dev
030