Sign in

Hung-Yueh Chiang

@hychiang.bsky.social
2 followers 3 following 8 posts

Ph.D. student @ UT hychiang.info

PostsRepliesMedia
Hung-Yueh Chiang @hychiang.bsky.social · 17/07/2025
📄 Paper: arxiv.org/abs/2503.22879 🌐 Project: hychiang.info/projects/qua... 💻 Code: github.com/enyac-group/... 🤗 Models: huggingface.co/ut-enyac
arxiv.org
Quamba2: A Robust and Scalable Post-training Quantization Framework for Selective State Space Models
State Space Models (SSMs) are emerging as a compelling alternative to Transformers because of their consistent memory usage and high performance. Despite this, scaling up SSMs on cloud services or lim...
000
Hung-Yueh Chiang @hychiang.bsky.social · 17/07/2025
Welcome to DM me if you’d like to chat about quantization, SSMs, or efficient model deployment. Looking forward to connecting at the venue!
000
Hung-Yueh Chiang @hychiang.bsky.social · 17/07/2025
Excited to share that our #ICML2025 paper “Quamba2: A Robust and Scalable Post-training Quantization Framework for Selective State Space Models”!
200
Hung-Yueh Chiang @hychiang.bsky.social · 24/04/2025
000
Hung-Yueh Chiang @hychiang.bsky.social · 24/04/2025
📍 Come check out our poster this Friday, April 25, from 3:00–5:30 PM at Hall 3 + Hall 2B, Poster #279. We’d love to chat! 🔗 ICLR Presentation: iclr.cc/virtual/2025... 📄 Paper on arXiv: arxiv.org/abs/2410.13229
iclr.cc
ICLR Poster Quamba: A Post-Training Quantization Recipe for Selective State Space ModelsICLR 2025
100
Hung-Yueh Chiang @hychiang.bsky.social · 24/04/2025
Our work Quamba, an 8-bit weight-activation quantization method for Selective State Space Models (SSMs), is being presented at #ICLR2025!
100
Hung-Yueh Chiang @hychiang.bsky.social · 05/04/2025
📄 Preprint: arxiv.org/pdf/2503.22879 🌐 Project Page: hychiang.info/projects/quamba2 🤗 Models: huggingface.co/ut-enyac 💻 Code: github.com/enyac-group/...
github.com
GitHub - enyac-group/Quamba: The official repository of Quamba
The official repository of Quamba. Contribute to enyac-group/Quamba development by creating an account on GitHub.
000
Hung-Yueh Chiang @hychiang.bsky.social · 05/04/2025
We’re excited to pre-release our latest work: Quamba2 🔧 Supports W4A8 / W4A16 / W4AX / W8A8 for Mamba1 and Mamba2 🚀 Achieves 4× memory reduction and 3× generation speedup ⚡️ Enables 8B model inference on Orin Nano 8G at 13 tokens/sec 🔥 Outperforms W4A8KV4 Llama3-8B in both speed and quality
121