iiinova — where your digital self keeps evolving

Reposted by Aryo Pradipta Gema

Emile van Krieken @emilevankrieken.com · 21/05/2025

We propose Neurosymbolic Diffusion Models! We find diffusion is especially compelling for neurosymbolic approaches, combining powerful multimodal understanding with symbolic reasoning 🚀 Read more 👇

49327

Aryo Pradipta Gema @aryopg.bsky.social · 02/05/2025

MMLU-Redux just touched down at #NAACL2025! 🎉 Wish I could be there for our "Are We Done with MMLU?" poster today (9:00-10:30am in Hall 3, Poster Session 7), but visa drama said nope 😅 If anyone's swinging by, give our research some love! Hit me up if you check it out! 👋

01711

Reposted by Aryo Pradipta Gema

Benjamin Minixhofer @bminixhofer.bsky.social · 02/04/2025

We created Approximate Likelihood Matching, a principled (and very effective) method for *cross-tokenizer distillation*! With ALM, you can create ensembles of models from different families, convert existing subword-level models to byte-level and a bunch more🧵

Image illustrating that ALM can enable Ensembling, Transfer to Bytes, and general Cross-Tokenizer Distillation.

12514

Reposted by Aryo Pradipta Gema

Alex Murphy @alexandermurphy.bsky.social · 01/04/2025

🚀 Thrilled to share our new preprint, "An Analysis of Decoding Methods for LLM-based Agents for Faithful Multi-Hop Question Answering"! 📄 Dive into the paper: arxiv.org/abs/2503.23415 #AI #MachineLearning #LLM #NLP #Research #QuestionAnswering #Retrieval

121

Aryo Pradipta Gema @aryopg.bsky.social · 24/03/2025

Today, I'm starting as an AI Safety Fellow @anthropic.com ! 🚀 Super excited to collaborate and learn from some of the brightest minds in AI! 🌟

140

Reposted by Aryo Pradipta Gema

Pasquale Minervini @neuralnoise.com · 17/03/2025

madly in love with this article from @thesun.co.uk covering a paper from @rohit-saxena.bsky.social and @aryopg.bsky.social Paper: arxiv.org/abs/2502.05092 The Sun: www.thesun.co.uk/tech/3384555...

081

Reposted by Aryo Pradipta Gema

Rohit Saxena @rohit-saxena.bsky.social · 10/03/2025

Can multimodal LLMs truly understand research poster images?📊 🚀 We introduce PosterSum—a new multimodal benchmark for scientific poster summarization! 📂 Dataset: huggingface.co/datasets/rohitsaxena/PosterSum 📜 Paper: arxiv.org/abs/2502.17540

184

Reposted by Aryo Pradipta Gema

Pasquale Minervini @neuralnoise.com · 06/12/2024

Garbage in, garbage out -- nice gem for the Italian-speaking folks on this platform 😅 TLDR, in arxiv.org/abs/2406.04127 we found that MMLU contains TONS of errors, and looks like all these seamlessly propagated to this new "Global MMLU" dataset

0112

Aryo Pradipta Gema @aryopg.bsky.social · 06/12/2024

This goes without saying: As someone from a non-English speaking country, I salute the effort to democratise LLM evaluations across languages. But we must also ensure we don't democratise mistakes.

110

Aryo Pradipta Gema @aryopg.bsky.social · 06/12/2024

Super Cool work from Cohere for AI! 🎉 However, this highlights a concern raised by our MMLU-Redux team (arxiv.org/abs/2406.04127): **error propagation to many languages**. Issues in MMLU (e.g., "rapid intervention to solve ebola") seem to persist in many languages. Let's solve the root cause first?

193

Reposted by Aryo Pradipta Gema

Pasquale Minervini @neuralnoise.com · 06/12/2024

For clarity -- great project, but most of the MMLU errors we found (and fixed) in our MMLU Redux paper (arxiv.org/abs/2406.04127) are also present in this dataset. We also provide a curated version of MMLU, so it's easy to fix 😊

1154

Aryo Pradipta Gema @aryopg.bsky.social · 05/12/2024

Oops! Some errors we noticed in MMLU-Redux still exist in some languages (e.g., rapid intervention to "solve" ebola). (I just checked the 2 languages that I understand: Indonesian and Malay)

031

Reposted by Aryo Pradipta Gema

Cyril Zakka, MD @cyrilzakka.bsky.social · 19/11/2024

Super excited to introduce Halo: A beginner's guide to DIY health tracking with wearables! 🤗✨ Using an $11 smart ring, I'll show you how to build your own private health monitoring app. From basic metrics to advanced features like: - Activity tracking - HR monitoring - Sleep analysis and more!

A picture showing Halo's features which include heart rate, sleep cycle and SPO2 monitoring, using on-device ML.

57715

Reposted by Aryo Pradipta Gema

Pasquale Minervini @neuralnoise.com · 20/11/2024

Starter pack for University of Edinburgh researchers done by the amazing ramandutt4.bsky.social - go.bsky.app/KRNDkN7

go.bsky.app

University of Edinburgh Starter Pack

Join the conversation

9359

Aryo Pradipta Gema @aryopg.bsky.social · 20/11/2024

Would you be so kind including me to the party? @ramandutt4.bsky.social

020

Reposted by Aryo Pradipta Gema

Sweta Karlekar @swetakar.bsky.social · 19/11/2024

If you’re interested in mechanistic interpretability, I just found this starter pack and wanted to boost it (thanks for creating it @butanium.bsky.social !). Excited to have a mech interp community on bluesky 🎉 go.bsky.app/LisK3CP

3368

Reposted by Aryo Pradipta Gema

Pasquale Minervini @neuralnoise.com · 19/11/2024

Joining the Generative AI Lab (GAIL, gail.ed.ac.uk) at the University of Edinburgh as a GAIL Fellow! Excited for what's ahead 🤗

gail.ed.ac.uk

Generative AI Laboratory

0192

Reposted by Aryo Pradipta Gema

Giwon Hong @giwonhong.bsky.social · 18/11/2024

🤔How to achieve efficient ICL without storing a huge dataset in one prompt? 💡Mixtures of In-Context Learners (𝗠𝗼𝗜𝗖𝗟): we treat LLMs prompted with subsets of demonstrations as experts and learn a weighting function to optimise the distribution over the continuation (🧵1/n)

1334

Reposted by Aryo Pradipta Gema

Maria Antoniak @mariaa.bsky.social · 18/11/2024

Started making a list of researchers working at the intersection of healthcare, language, and computation. Please help me add more people!

146110

Aryo Pradipta Gema @aryopg.bsky.social · 18/11/2024

I’ll be travelling to London from Wednesday to Friday for an upcoming event and would be very happy to meet up! 🚀 I'd love to chat about my recent works (DeCoRe, MMLU-Redux, etc.). DM me if you’re around! 👋 DeCoRe: arxiv.org/abs/2410.18860 MMLU-Redux: arxiv.org/abs/2406.04127

0117