iiinova — where your digital self keeps evolving

Ali Behrouz

@alibehrouz.bsky.social

647 followers 524 following 21 posts

Intern @Google, Ph.D. Student @Cornell_CS. Interested in machine learning, LLM, brain, and healthcare. abehrouz.github.io

Posts Replies Media

Reposted by Ali Behrouz

Sung Kim @sungkim.bsky.social · 13/01/2025

Google's Titans: a new architecture with attention and a meta in-context memory that learns how to memorize at test time as presented by one of the author - @alibehrouz.bsky.social

47018

Ali Behrouz @alibehrouz.bsky.social · 05/12/2024

I'll be at #NeurIPS2024 next week, and would be happy to chat about deep learning architectures, sequence modeling, reasoning, neuroscience, world models, graphs, and almost anything :) I also will be presenting Chimera (a 2D SSM) on Wednesday (4:30 PM).

020

Ali Behrouz @alibehrouz.bsky.social · 03/12/2024

🌟 Best of Both Worlds! ❓Have you ever wondered why hybrid models (RNN + Transformers) are powerful? We answer this through the lens of circuit complexity and graphs! Excited to share our work on understanding Graph Sequence Models (GSM), which allows the use of any sequence model for graphs.

171

Ali Behrouz @alibehrouz.bsky.social · 20/11/2024

Are univariate SSMs effective when there are 2D dependencies? ✨In our #NeurIPS paper we show how to effectively model multivariate time series by input-dependent (selective) 2-dimensional state space models with fast training using a 2D parallel scan. (1/8)

1100