Ai2 @ai2.bsky.social · 13/10/2026Kai Van Brunt adapted Molmo 2, our open model for video understanding, to a domain far outside its training data: sonar video of salmon. Meet Molmo2Fish, a prototype that tracks fish + can correct some of its mistakes through natural-language guidance. 🧵 buff.ly/fRNkIGY 1241 24
Ai2 @ai2.bsky.social · 13/10/2026Tracking salmon by analyzing video helps researchers monitor their populations. But when a salmon-tracking system makes a mistake, like an overcount, fixing it can mean editing clips frame after frame by hand. What if you could just tell the system to fix what it got wrong? 130 3
Ai2 @ai2.bsky.social · 13/10/2026Kai fine-tuned Molmo 2 on sonar video then trained it on examples of tracking errors, instructions, & corrections. In tests, Molmo2Fish could fix some mistakes after guidance—for example, when two salmon had been assigned the same track. 141 4