narsilou.bsky.social @narsilou.bsky.social · 11/06/2025Me: This function is too slow. Find a faster algorithm. Cursor: Hold my beer. Me: *Slacking off with colleagues* Cursor: Ping. Me: 🤯 000
Reposted by @narsilou.bsky.socialDaniël de Kok @danieldk.eu · 09/05/2025We just released text-generation-inference 3.3.0. This release adds prefill chunking for VLMs 🚀. We have also Gemma 3 faster & use less VRAM by switching to flashinfer for prefills with images. github.com/huggingface/...github.comRelease v3.3.0 · huggingface/text-generation-inferenceNotable changes Prefill chunking for VLMs. What's Changed Fixing Qwen 2.5 VL (32B). by @Narsil in #3157 Fixing tokenization like https://github.com/huggingface/text-embeddin… by @Narsil in #3156... 021
narsilou.bsky.social @narsilou.bsky.social · 08/05/2025Hot take: Rust is really good for vibe coding, much better than Python or JS. Why ? The compiler will not let crap pass. Yes the LLM can still get it wrong, and fail. The elegant error messages will nudge the LLM, so I don't have to do it constantly. 320
narsilou.bsky.social @narsilou.bsky.social · 08/05/2025Tipping my toe into vibe coding myself to get a gist for it. My first project is writing something like superwhisper, because I couldn't find anything that worked good enough for wayland. github.com/Narsil/whisp... It also works on Mac for kicks (Whisper.cpp backed)github.comGitHub - Narsil/whisperingContribute to Narsil/whispering development by creating an account on GitHub. 010
narsilou.bsky.social @narsilou.bsky.social · 31/01/2025Want to run Deepseek R1 ? Text-generation-inference v3.1.0 is out and supports it out of the box. Both on AMD and Nvidia ! 051
narsilou.bsky.social @narsilou.bsky.social · 24/01/2025Text-generation-inference v3.0.2 is out. Basically we can run transformers models (that support flash) at roughly the same speed as native TGI ones. What this means is broader model support. Today it unlocks Cohere2, Olmo, Olmo2 and Helium Congrats Cyril Vallez github.com/huggingface/...github.comRelease v3.0.2 · huggingface/text-generation-inferenceTl;dr New transformers backend supporting flashattention at roughly same performance as pure TGI for all non officially supported models directly in TGI. Congrats @Cyrilvallez New models unlocked: ... 063
narsilou.bsky.social @narsilou.bsky.social · 10/12/2024Performance leap: TGI v3 is out. Processes 3x more tokens, 13x faster than vLLM on long prompts. Zero config ! 1196
Reposted by @narsilou.bsky.socialNathan Sarrazin @nsarrazin.com · 28/11/2024We just deployed Qwen/QwQ-32B-Preview on HuggingChat! It's Qwen's latest experimental reasoning model. It's super interesting to see the reasoning steps, and with really impressive results too. Feel free to try it out here: huggingface.co/chat/models/... I'd love to get your feedback on it!huggingface.coQwen/QwQ-32B-Preview - HuggingChatUse Qwen/QwQ-32B-Preview with HuggingChat 1397
Reposted by @narsilou.bsky.socialOmar Sanseviero @osanseviero.bsky.social · 27/11/2024I'm disheartened by how toxic and violent some responses were here. There was a mistake, a quick follow up to mitigate and an apology. I worked with Daniel for years and is one of the persons most preoccupied with ethical implications of AI. Some replies are Reddit-toxic level. We need empathy. 2933237
Reposted by @narsilou.bsky.socialmerve @merve.bsky.social · 27/11/2024It's pretty sad to see the negative sentiment towards Hugging Face on this platform due to a dataset put by one of the employees. I want to write a small piece. 🧵 Hugging Face empowers everyone to use AI to create value and is against monopolization of AI it's a hosting platform above all. 2945570
