Sign in

chloesu07.bsky.social

@chloesu07.bsky.social
13 followers 25 following 0 posts

CS PhD student @ Harvard/Kempner Institute

PostsRepliesMedia
Reposted by @chloesu07.bsky.social
Isabel Papadimitriou @isabelpapad.bsky.social · 17/09/2025
Are there conceptual directions in VLMs that transcend modality? Check out our COLM oral spotlight 🔦 paper! We use SAEs to analyze the multimodality of linear concepts in VLMs with @chloesu07.bsky.social, @thomasfel.bsky.social, @shamkakade.bsky.social and Stephanie Gil arxiv.org/abs/2504.11695
1256
Reposted by @chloesu07.bsky.social
Kempner Institute at Harvard University @kempnerinstitute.bsky.social · 28/04/2025
New in the Deeper Learning blog: Kempner researchers show how VLMs speak the same semantic language across images and text. bit.ly/KempnerVLM by @isabelpapad.bsky.social ,Chloe Huangyuan Su, @thomasfel.bsky.social, Stephanie Gil, and @shamkakade.bsky.social #AI #ML #VLMs #SAEs
bit.ly
Interpreting the Linear Structure of Vision-Language Model Embedding Spaces - Kempner Institute
Using sparse autoencoders, the authors show that vision-language embeddings boil down to a small, stable dictionary of single-modality concepts that snap together into cross-modal bridges. This resear...
093