Reposted by Aryo Pradipta GemaEmile van Krieken @emilevankrieken.com · 21/05/2025We propose Neurosymbolic Diffusion Models! We find diffusion is especially compelling for neurosymbolic approaches, combining powerful multimodal understanding with symbolic reasoning 🚀 Read more 👇 49327
Aryo Pradipta Gema @aryopg.bsky.social · 02/05/2025MMLU-Redux just touched down at #NAACL2025! 🎉 Wish I could be there for our "Are We Done with MMLU?" poster today (9:00-10:30am in Hall 3, Poster Session 7), but visa drama said nope 😅 If anyone's swinging by, give our research some love! Hit me up if you check it out! 👋 01711
Reposted by Aryo Pradipta GemaBenjamin Minixhofer @bminixhofer.bsky.social · 02/04/2025We created Approximate Likelihood Matching, a principled (and very effective) method for *cross-tokenizer distillation*! With ALM, you can create ensembles of models from different families, convert existing subword-level models to byte-level and a bunch more🧵 12514
Reposted by Aryo Pradipta GemaAlex Murphy @alexandermurphy.bsky.social · 01/04/2025🚀 Thrilled to share our new preprint, "An Analysis of Decoding Methods for LLM-based Agents for Faithful Multi-Hop Question Answering"! 📄 Dive into the paper: arxiv.org/abs/2503.23415 #AI #MachineLearning #LLM #NLP #Research #QuestionAnswering #Retrieval 121
Aryo Pradipta Gema @aryopg.bsky.social · 24/03/2025Today, I'm starting as an AI Safety Fellow @anthropic.com ! 🚀 Super excited to collaborate and learn from some of the brightest minds in AI! 🌟 140
Reposted by Aryo Pradipta GemaPasquale Minervini @neuralnoise.com · 17/03/2025madly in love with this article from @thesun.co.uk covering a paper from @rohit-saxena.bsky.social and @aryopg.bsky.social Paper: arxiv.org/abs/2502.05092 The Sun: www.thesun.co.uk/tech/3384555... 081
Reposted by Aryo Pradipta GemaRohit Saxena @rohit-saxena.bsky.social · 10/03/2025Can multimodal LLMs truly understand research poster images?📊 🚀 We introduce PosterSum—a new multimodal benchmark for scientific poster summarization! 📂 Dataset: huggingface.co/datasets/rohitsaxena/PosterSum 📜 Paper: arxiv.org/abs/2502.17540 184
Reposted by Aryo Pradipta GemaPasquale Minervini @neuralnoise.com · 06/12/2024Garbage in, garbage out -- nice gem for the Italian-speaking folks on this platform 😅 TLDR, in arxiv.org/abs/2406.04127 we found that MMLU contains TONS of errors, and looks like all these seamlessly propagated to this new "Global MMLU" dataset 0112
Aryo Pradipta Gema @aryopg.bsky.social · 06/12/2024Super Cool work from Cohere for AI! 🎉 However, this highlights a concern raised by our MMLU-Redux team (arxiv.org/abs/2406.04127): **error propagation to many languages**. Issues in MMLU (e.g., "rapid intervention to solve ebola") seem to persist in many languages. Let's solve the root cause first? 193
Reposted by Aryo Pradipta GemaPasquale Minervini @neuralnoise.com · 06/12/2024For clarity -- great project, but most of the MMLU errors we found (and fixed) in our MMLU Redux paper (arxiv.org/abs/2406.04127) are also present in this dataset. We also provide a curated version of MMLU, so it's easy to fix 😊 1154
Reposted by Aryo Pradipta GemaCyril Zakka, MD @cyrilzakka.bsky.social · 19/11/2024Super excited to introduce Halo: A beginner's guide to DIY health tracking with wearables! 🤗✨ Using an $11 smart ring, I'll show you how to build your own private health monitoring app. From basic metrics to advanced features like: - Activity tracking - HR monitoring - Sleep analysis and more! 57715
Reposted by Aryo Pradipta GemaPasquale Minervini @neuralnoise.com · 20/11/2024Starter pack for University of Edinburgh researchers done by the amazing ramandutt4.bsky.social - go.bsky.app/KRNDkN7go.bsky.appUniversity of Edinburgh Starter PackJoin the conversation 9359
Reposted by Aryo Pradipta GemaSweta Karlekar @swetakar.bsky.social · 19/11/2024If you’re interested in mechanistic interpretability, I just found this starter pack and wanted to boost it (thanks for creating it @butanium.bsky.social !). Excited to have a mech interp community on bluesky 🎉 go.bsky.app/LisK3CP 3368
Reposted by Aryo Pradipta GemaPasquale Minervini @neuralnoise.com · 19/11/2024Joining the Generative AI Lab (GAIL, gail.ed.ac.uk) at the University of Edinburgh as a GAIL Fellow! Excited for what's ahead 🤗gail.ed.ac.ukGenerative AI Laboratory 0192
Reposted by Aryo Pradipta GemaGiwon Hong @giwonhong.bsky.social · 18/11/2024🤔How to achieve efficient ICL without storing a huge dataset in one prompt? 💡Mixtures of In-Context Learners (𝗠𝗼𝗜𝗖𝗟): we treat LLMs prompted with subsets of demonstrations as experts and learn a weighting function to optimise the distribution over the continuation (🧵1/n) 1334
Reposted by Aryo Pradipta GemaMaria Antoniak @mariaa.bsky.social · 18/11/2024Started making a list of researchers working at the intersection of healthcare, language, and computation. Please help me add more people! 146110
Aryo Pradipta Gema @aryopg.bsky.social · 18/11/2024I’ll be travelling to London from Wednesday to Friday for an upcoming event and would be very happy to meet up! 🚀 I'd love to chat about my recent works (DeCoRe, MMLU-Redux, etc.). DM me if you’re around! 👋 DeCoRe: arxiv.org/abs/2410.18860 MMLU-Redux: arxiv.org/abs/2406.04127 0117