Reposted by Ivar FlakstadMichael (compiler-errors) Goulet @errs.io · 02/07/2025Howdy all. I'm unfortunately not going to be with my employer for much longer due to team relocation. If anyone has any info on roles that would allow me to continue my Rust compiler work (in New York City), they'd be greatly appreciated. 19345
Reposted by Ivar Flakstadkb @keighbee.bsky.social · 13/06/2025I'm writing an article series about creating tensors from scratch in Rust. #tensors #machine-learning #ml #ai huggingface.co/blog/KeighBe...huggingface.coBuilding Tensors From Scratch in Rust: Part 1, Core Structure and IndexingA Blog post by Kyle Birnbaum on Hugging Face 083
Reposted by Ivar FlakstadRust Language @rust-lang.org · 05/04/2025🦀 Hello World! The Rust project now has an official presence on Bluesky! ✨ We'll be posting the same on our Mastodon and Bluesky accounts, so you won't miss anything on either platform. 311459285
Ivar Flakstad @ivarf.bsky.social · 09/03/2025Want an in depth exploration of the different hardware architectures within AI? Of course you do :) Another great article by Chris Fleetwood: fleetwood.dev/posts/domain...fleetwood.devfleetwood.devfleetwood.dev 011
Reposted by Ivar Flakstadnarsilou.bsky.social @narsilou.bsky.social · 10/12/2024Performance leap: TGI v3 is out. Processes 3x more tokens, 13x faster than vLLM on long prompts. Zero config ! 1196
Reposted by Ivar Flakstadkb @keighbee.bsky.social · 05/12/2024Preliminary data shows the Apple Neural Engine uses ~94% less energy than the CPU and ~75% less than the GPU 🤯 On the On-Device team at Hugging Face, we've been profiling energy usage for CoreML models. Here’s some data I collected: 241
Reposted by Ivar FlakstadThomas Wolf @thomwolf.bsky.social · 24/11/2024It's Sunday morning so taking a minute for a nerdy thread (on math, tokenizers and LLMs) of the work of our intern Garreth By adding a few lines of code to the base Llama 3 tokenizer, he got a free boost in arithmetic performance 😮 [thread] 527134
Reposted by Ivar FlakstadVicki @vickiboykis.com · 20/11/2024when you try to convert your text into smaller pieces but all it gives you is Elvish, that’s a tolkienizer 341006103
Ivar Flakstad @ivarf.bsky.social · 18/11/2024RoPE can be confusing, so here’s a great write up by my buddy Chris Fleetwood on the topic: fleetwood.dev/posts/you-co...fleetwood.devfleetwood.devfleetwood.dev 030