Sign in

Amadeus

@amadeusz.bsky.social
196 followers 424 following 138 posts

hacker @hsp.sh | mlops | ai builder | socdem | 🇵🇱

PostsRepliesMedia
Reposted by Amadeus
Sakana AI @sakanaai.bsky.social · 12/05/2025
“Continuous Thought Machines” Blog → sakana.ai/ctm Modern AI is powerful, but it's still distinct from human-like flexible intelligence. We believe neural timing is key. Our Continuous Thought Machine is built from the ground up to use neural dynamics as a powerful representation for intelligence.
37315
Reposted by Amadeus
Adina Yakup @adinayakup.bsky.social · 28/04/2025
Kimi-Audio 🚀🎧 an OPEN audio foundation model released by Moonshot AI huggingface.co/moonshotai/K... ✨ 7B ✨ 13M+ hours of pretraining data ✨ Novel hybrid input architecture ✨ Universal audio capabilities (ASR, AQA, AAC, SER, SEC/ASC, end-to-end conversation)
huggingface.co
moonshotai/Kimi-Audio-7B-Instruct · Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
031
Reposted by Amadeus
mr. TIM @timkellogg.me · 04/04/2025
🚨New DeepSeek Model Incoming🚨 but first they release the paper describing generative reward modeling (GRM) via Self-Principled Critique Tuning (SPCT) looking forward to DeepSeek-GRM! arxiv.org/abs/2504.02495
A line chart titled “Figure 1: Inference-time scaling performance with different RMs on all tested RM benchmarks” shows performance on the y-axis (ranging from 66.5 to 72.5) and k: #sampled rewards (logscale) on the x-axis, with values from 1 to 32.

Key observations:
	•	DeepSeek-GRM-27B (MetaRM@k) (Ours) is the top performer, shown with a red line and star markers, rising steeply and leveling near 72.5.
	•	DeepSeek-GRM-27B (Voting@k) (Ours) follows, in blue with stars, peaking slightly above 70.5.
	•	GPT-4o (Greedy) is shown as a gray dashed line, sitting just under 71.
	•	Other models, shown in orange, green, brown, and gray lines (scalar or voting methods), plateau between ~66.5 and ~68.5.
	•	LLM-as-a-Judge w/ TokenProb, Skywork-Reward-Gemma-2-27B, and DeepSeek-BTRM-27B are among these lower-performing models.

Caption summary: The plot shows how performance scales with the number of reward samples at inference time. Results are up to 8 samples, with some (DeepSeek models) extrapolated to 32. Models in non-italic font use Gemma-2-27B as their base.
4306
Reposted by Amadeus
Sung Kim @sungkim.bsky.social · 31/03/2025
You’ve probably heard about how AI/LLMs can solve Math Olympiad problems ( deepmind.google/discover/blo... ). So naturally, some people put it to the test — hours after the 2025 US Math Olympiad problems were released. The result: They all sucked!
917350
Reposted by Amadeus
Sung Kim @sungkim.bsky.social · 27/02/2025
Kimi 1.6 is coming ... Source: livecodebench.github.io/leaderboard.... Chat: kimi.ai
0173
Reposted by Amadeus
Sung Kim @sungkim.bsky.social · 22/02/2025
This is new - Moonshot AI (i.e., kimi.ai) released the two open-weigh models. Moonlight: 3B/16B MoE model trained with Muon on 5.7T tokens, advancing the Pareto frontier with better performance at fewer FLOPs. huggingface.co/moonshotai
1154
Reposted by Amadeus
Sung Kim @sungkim.bsky.social · 18/02/2025
The paper below describes Huawei's cloud AI platform designed to efficiently serve LLMs. It uses four major design components: serverless abstraction and infrastructure, serving engine, scheduling algorithms, and scaling optimizations.
2131
Reposted by Amadeus
Nicolay Gerold @nicolaygerold.com · 13/02/2025
RAG is dead. Long live RAG. LLMs suck at long context. This paper shows what I have seen in most deployments. With longer contexts, performance degrades.
161
Reposted by Amadeus
Costa Huang @vwxyzjn.bsky.social · 12/02/2025
🔥 allenai/Llama-3.1-Tulu-3-8B (trained with PPO) -> allenai/Llama-3.1-Tulu-3.1-8B (trained with GRPO) We are happy to "quietly" release our latest GRPO-trained Tulu 3.1 model, which is considerably better in MATH and GSM8K!
1225
Reposted by Amadeus
Leshem (Legend) Choshen @EMNLP @lchoshen.bsky.social · 07/02/2025
can we scale small, open LMs to o1 level? Using classical probabilistic inference methods, YES! Particle filtering approach to Improved inference w/o any training! Check out probabilistic-inference-scaling.github.io By Aisha Puri et al📈🤖 Joint MIT-CSAIL & RedHat
probabilistic-inference-scaling.github.io
Probabilistic Inference Scaling
Probabilistic Inference Scaling
1475
Reposted by Amadeus
Sung Kim @sungkim.bsky.social · 07/02/2025
Post training an LLM for reasoning with GRPO in TRL by @sergiopaniego.bsky.social A guide to post-training a LLM using GRPO. It's particularly effective for scaling test-time compute for extended reasoning, making it an ideal approach for solving complex tasks, such as mathematical problem-solving
1112
Reposted by Amadeus
Marcin Jasiukowicz 🅨 @yasiu.pl · 05/02/2025
Dzisiaj spotkanie z załogą misji Ax-4 w Centrum Nauki Kopernik. Trzymamy kciuki za lot Sławosza Uznańskiego! z @polsa.studenci @astro_peggy @astro_slawosz @tibor_to_orbit
031
Reposted by Amadeus
Simon Willison @simon.fedi.simonwillison.net.ap.brid.gy · 04/02/2025
Tiny TIL: I just figured out how to run pytest with a different Python version against my pyproject.toml/setup.py projects using uv run uv run --python 3.12 --with '.[test]' pytest til.simonwillison.net/pytest/pytest…
til.simonwillison.net
Running pytest against a specific Python version with uv run
While working on this issue I figured out a neat pattern for running the tests for my project locally against a specific Python version using uv run :
0124
Amadeus @amadeusz.bsky.social · 04/02/2025
A ateizm to jakiś lewicowy postulat?
000
Reposted by Amadeus
mr. TIM @timkellogg.me · 03/02/2025
R1-V: teaching a VLM how to count with RL with verifiable rewards Starting with Qwen2VL-Instruct-2B, they spent $3 on compute and got it to outperform the 72B github.com/Deep-Agent/R...
github.com
GitHub - Deep-Agent/R1-V: Witness the aha moment of VLM with less than $3.
Witness the aha moment of VLM with less than $3. Contribute to Deep-Agent/R1-V development by creating an account on GitHub.
093
Reposted by Amadeus
Sung Kim @sungkim.bsky.social · 26/01/2025
Alibaba Qwen2.5-1M ! 💥 Now supporting a 1 MILLION TOKEN CONTEXT LENGTH 🔥 📄 Blog: qwenlm.github.io/blog/qwen2.5...
5395
Reposted by Amadeus
mr. TIM @timkellogg.me · 26/01/2025
Explainer: What's R1 and Everything Else This is an attempt to consolidate the dizzying rate of AI developments since Christmas. If you're into AI but not deep enough, this should get you oriented again. timkellogg.me/blog/2025/01...
The image depicts a monumental statue of Buddha, emphasizing serenity and grandeur. The statue's intricate design captures traditional Buddhist features, including a meditative posture with hands placed in a symbolic gesture, flowing robes, and a calm facial expression exuding peace. The perspective highlights the statue's immense size against a minimalistic white sky background, underscoring its significance as a spiritual and cultural landmark.
411526
Reposted by Amadeus
Python Hub @pythonhub.dev · 26/01/2025
The “Active Enum” Pattern Enums are objects, why not give them attributes? blog.glyph.im/2025/01/active-enum.h…
2101
Reposted by Amadeus
Sung Kim @sungkim.bsky.social · 24/01/2025
Aider reports that R1+Sonnet (R1 Thinking + Sonnet) set a new SOTA on the aider polyglot benchmark at 14X less cost compared to o1. 64% R1+Sonnet 62% o1 57% R1 52% Sonnet 48% DeepSeek V3 aider.chat/2025/01/24/r...
aider.chat
R1+Sonnet set SOTA on aider’s polyglot benchmark
R1+Sonnet has set a new SOTA on the aider polyglot benchmark. At 14X less cost compared to o1.
1419
Reposted by Amadeus
mr. TIM @timkellogg.me · 15/01/2025
MiniMax-01 supports a 4M (!!!) context width That’s 100% on needle in the haystack all the way through 4M, as i understand (seems like a benchmark mistake tbqh, it’s too good) www.minimaxi.com/en/news/mini...
minimaxi.com
MiniMax - Intelligence with everyone
MiniMax is a leading global technology company and one of the pioneers of large language models (LLMs) in Asia. Our mission is to build a world where intelligence thrives with everyone.
1296
Reposted by Amadeus
Sung Kim @sungkim.bsky.social · 15/01/2025
InternLM v3 - Performance surpasses models like Llama3.1-8B and Qwen2.5-7B - Capable of deep reasoning with system prompts - Trained only on 4T high-quality tokens huggingface.co/collections/...
2187
Reposted by Amadeus
Tom Aarsen @tomaarsen.com · 14/01/2025
The newest extremely strong embedding model based on ModernBERT-base is out: `cde-small-v2`. Both faster and stronger than its predecessor, this one tops the MTEB leaderboard for its tiny size! Details in 🧵
1317
Reposted by Amadeus
Sebastian Raschka (rasbt) @rasbt.bsky.social · 14/01/2025
"Sky-T1-32B-Preview, our reasoning model that performs on par with o1-preview on popular reasoning and coding benchmarks." That was quick! Is this already the Alpaca moment for reasoning models? Source: novasky-ai.github.io/posts/sky-t1/
3398
Reposted by Amadeus
Sung Kim @sungkim.bsky.social · 13/01/2025
Google's Titans: a new architecture with attention and a meta in-context memory that learns how to memorize at test time as presented by one of the author - @alibehrouz.bsky.social
47018
Reposted by Amadeus
merve @merve.bsky.social · 10/01/2025
What a week to open the year in open ML, all the things released at @hf.co 🤠 Here's everything released, find text-readable version here huggingface.co/posts/merve/... All models are here huggingface.co/collections/...
0211
Reposted by Amadeus
Sung Kim @sungkim.bsky.social · 10/01/2025
Contemplative LLMs: Anxiety is all you need? by Maharshi Let the LLM 'contemplate' for a bit before answering using this simple system prompt, which might (in most cases) lead to the correct final answer! maharshi.bearblog.dev/contemplativ...
maharshi.bearblog.dev
Contemplative LLMs: Anxiety is all you need?
Let the LLM 'contemplate' before answering
1258
Reposted by Amadeus
David Soria Parra @thedsp.bsky.social · 03/01/2025
This is a big one: Python MCP SDK 1.2.0 is out! The best part? It contains the widely used FastMCP library as part of the SDK. Don't worry, the old code still works and there is no need to update, but writing new servers is much easier. Check out the release notes: github.com/modelcontext...
github.com
Release v1.2.0 · modelcontextprotocol/python-sdk
A big thank you to @jlowin for the creation of the fantastic FastMCP, which is now included into the MCP SDK. Backwards Compatibility This release is semver compatible. Existing code will continue ...
0184
Reposted by Amadeus
Tom Aarsen @tomaarsen.com · 31/12/2024
That didn't take long! Nomic AI has finetuned the new ModernBERT-base encoder model into a strong embedding model for search, classification, clustering and more! Details in 🧵
23710
Reposted by Amadeus
Ellie Huxtable @ellie.wtf · 27/12/2024
Atuin v18.4 is out now! Including `atuin wrapped`, your year in shell history 🐢 thanks @daveeddy.com for the suggestion!
A screenshot of my Atuin wrapped, showing some fun stats about my command history in the style of "spotify wrapped"
912120
Reposted by Amadeus
Making a free cycling game @dfeldman.org · 25/12/2024
You’re still arguing about tabs vs. spaces? May I present…
Code written with box characters used on old old software to make fake UIs
15652601264
Reposted by Amadeus
Sung Kim @sungkim.bsky.social · 25/12/2024
Confirmed. DeepSeek-V3 is coming soon and it is bit better than Claude 3.5 Sonnet per Aider LLM Leaderboard. aider.chat/docs/leaderb...
1254
Amadeus @amadeusz.bsky.social · 22/12/2024
I'm #teamo3 here. The game is rigged by Big Evals.
010
Reposted by Amadeus
mr. TIM @timkellogg.me · 20/12/2024
AI Engingeering Primer This should be a good starting point. A little bit of advice, and then a lot of topics to cover and l places to get information timkellogg.me/blog/2024/12...
timkellogg.me
AI Engineering Primer - Tim Kellogg
97015
Reposted by Amadeus
Mark Riedl @markriedl.bsky.social · 21/12/2024
Six months ago someone put a for-loop around GPT-4o and got 50% on the ARC-AGI test set and 72% on a held-out training set redwoodresearch.substack.com/p/getting-50... Just sample 8000 times with beam search. o3 is probably a more principled search technique...
redwoodresearch.substack.com
Getting 50% (SoTA) on ARC-AGI with GPT-4o
You can just draw more samples
413723
Amadeus @amadeusz.bsky.social · 19/12/2024
Good old Deep Learning
010
Amadeus @amadeusz.bsky.social · 18/12/2024
Same, every year.
010
Reposted by Amadeus
Sung Kim @sungkim.bsky.social · 18/12/2024
Boost Llama 3.3 70B Inference Throughput 3x with NVIDIA TensorRT-LLM Speculative Decoding Using in-flight batching, KV caching, custom FP8 quantization, speculative decoding, and more for fast, cost-efficient LLM serving. developer.nvidia.com/blog/boost-l...
2194
Amadeus @amadeusz.bsky.social · 17/12/2024
When are you taking over cpython?
140
Amadeus @amadeusz.bsky.social · 17/12/2024
I wonder if they prepared the dataset, calculated the metrics and were like "oh wow, it seems like our models are the most grounded in facts! Who knew?" or maybe something else happened here 🤔
120
Amadeus @amadeusz.bsky.social · 17/12/2024
It's a killer but for budget gaming.
010
Reposted by Amadeus
Kaggle @kaggle.com · 17/12/2024
Introducing FACTS Grounding. A new benchmark we’re launching with Google DeepMind to evaluate LLM’s factual accuracy on over 1700 tasks. 🧠📐
175
Reposted by Amadeus
Sung Kim @sungkim.bsky.social · 17/12/2024
TII UAE's Falcon 3 1B, 3B, 7B, 10B (Base + Instruct) & 7B Mamba, trained on 14 trillion tokens! - 1B-Base surpasses SmolLM2-1.7B and matches gemma-2-2b - 3B-Base outperforms larger models like Llama-3.1-8B and Minitron-4B-Base - 7B-Base is on par with Qwen2.5-7B in the under-9B category
2143
Amadeus @amadeusz.bsky.social · 17/12/2024
Very cool! Although saying 3B model beats 70B sounds a bit like cheating if you need to use an additional PRM model :D Anyway, great results! If I understand correctly there is hope to add self-verification and remove this additional model?
000
Reposted by Amadeus
Sung Kim @sungkim.bsky.social · 16/12/2024
This is number 1 on MTEB Leaderboard, but the VRAM requirement may be higher than its peers since the base model is gemma-2-9b-it.
0225
Reposted by Amadeus
Lewis Tunstall @lewtun.bsky.social · 16/12/2024
We outperform Llama 70B with Llama 3B on hard math by scaling test-time compute 🔥 How? By combining step-wise reward models with tree search algorithms :) We're open sourcing the full recipe and sharing a detailed blog post 👇
410821
Reposted by Amadeus
Sung Kim @sungkim.bsky.social · 16/12/2024
Meta's Apollo Multimodal Models - 1.5B, 3B and 7B model checkpoints - Can comprehend up-to 1 hour of video - Temporal reasoning & complex video question-answering - Multi-turn conversations grounded in video content Project: apollo-lmms.github.io Models: huggingface.co/Apollo-LMMs
2133
Reposted by Amadeus
Gaël Varoquaux @gaelvaroquaux.bsky.social · 15/12/2024
Slides for "Table Foundation Models" I explain why these models can strongly outperform tree-based models, what are the intuitions, hopefully pointing to ways forward for more improvement speakerdeck.com/gaelvaroquau...
speakerdeck.com
Table foundation models for analytics
Deep-learning typically does not outperform tree-based models on tabular data. Often this may be explained by the small size of such datasets. For image…
38113
Amadeus @amadeusz.bsky.social · 14/12/2024
Push and pull anything
010
Amadeus @amadeusz.bsky.social · 14/12/2024
That's really interesting. I need to try it. Especially for questions with context.
020