iiinova — where your digital self keeps evolving

Daniel Marczak

@dmarczak.bsky.social

mostly trying to merge models | phd student @ warsaw university of technology & ideas

Daniel Marczak @dmarczak.bsky.social · 10/02/2025

🚀 What happens when you modify the spectrum of singular values of the merged task vector? 🤔 Apparently, you achieve 🚨state-of-the-art🚨 model merging results! 🔥 ✨ Introducing “No Task Left Behind: Isotropic Model Merging with Common and Task-Specific Subspaces”

164

Reposted by Daniel Marczak

Marcin Przewięźlikowski @pszwnzl.bsky.social · 05/12/2024

Self-supervised Learning with Masked Autoencoders (MAE) is known to produce worse image representations than Joint-Embedding approaches (e.g. DINO). In our new paper, we identify new reasons for why that is and point towards solutions: arxiv.org/abs/2412.03215 🧵

1144