iiinova — where your digital self keeps evolving

Sam Blouir

@samblouir.bsky.social

2K followers 3.9K following 21 posts

Thanks for coming to “Foundation Models for Biological Discoveries” (FMs4Bio) @ AAAI 2025!

Posts Replies Media

Reposted by Sam Blouir

Mete @mismayil.bsky.social · 30/04/2025

I am attending @naaclmeeting.bsky.social this week to present our paper. Come check out our poster at 14:00, Apr 30 in Hall 3 . @defnecirci.bsky.social and Hale Sirin will also be there to answer your questions!

052

Sam Blouir @samblouir.bsky.social · 30/04/2025

#ICLR2025 & #ACMHCI are a wrap! 🎉 Couldn't ask for better vibes, conversations, and food. 🧬 BirdieDNA 🗣️ SLP Sidekick 🤖 Agents for Genomics Big thanks to my co-authors @defnecirci.bsky.social, Flavia Negrete, Celeste Watkins, Asher Moldwin & Amarda Shehu, absolute rockstars 🤝🙏

031

Sam Blouir @samblouir.bsky.social · 18/11/2024

Meet Birdie 🐤! Our EMNLP 2024 paper boosts SSMs like Mamba and Hawk on long-range, context-heavy tasks, closing the gap with Transformers. Proud to work with @jimmysmith1919.bsky.social, @antonisa.bsky.social, & Amarda Shehu. 📄 Paper: arxiv.org/abs/2411.01030 💻 Code: github.com/samblouir/bi...

The multi-number phonebook retrieval task entails retrieving several phone numbers from a phonebook at once, given names.

Hawk trained using Birdie strongly outperforms Hawk trained using Next Token Prediction on the multi-number phonebook retrieval task.

Hawk trained using Next Token Prediction performs just above random guessing when retrieving 1 and 4 phone numbers, and falls to random performance when retrieving more than 4 phone numbers.

In contrast, Hawk trained using Birdie gets 100% accuracy when retrieving 1 phone number. That 100% score slowly decays to about 80% accuracy when retrieving up to 32 phone numbers simultaneously.

Two Transformers are included, one trained using Birdie, and the other trained using Next Token Prediction. They both always achieve about 100% accuracy, even when retrieving 32 phone numbers.

1171