Reposted by Praneet
I wrote a post on multimodal interpretability techniques, including sparse feature circuit discovery, exploiting the shared text-image space of CLIP, and training adapters.
soniajoseph.ai/multimodal-i... 💜
soniajoseph.ai
Multimodal interpretability in 2024
Multimodal interpretability, from sparse feature circuits with SAEs, to vision transformers leveraging CLIP's shared text-image space.