iiinova — where your digital self keeps evolving

Aleksander Hołyński

@holynski.bsky.social

569 followers 95 following 4 posts

UC Berkeley + Google DeepMind holynski.org

Posts Replies Media

Reposted by Aleksander Hołyński

carldoersch.bsky.social @carldoersch.bsky.social · 09/04/2025

We're very excited to introduce TAPNext: a model that sets a new state-of-art for Tracking Any Point in videos, by formulating the task as Next Token Prediction. For more, see: tap-next.github.io

1259 0

Reposted by Aleksander Hołyński

zhengqili.bsky.social @zhengqili.bsky.social · 06/12/2024

Introducing MegaSaM! Accurate, fast, & robust structure + camera estimation from casual monocular videos of dynamic scenes! MegaSaM outputs camera parameters and consistent video depth, scaling to long videos with unconstrained camera paths and complex scene dynamics!

16818 0

Aleksander Hołyński @holynski.bsky.social · 06/12/2024

I know, it's hard to believe. But this thing really works. Check out the website, there are a couple dozen interactive results and over 80 video examples in the gallery. No cherry-picking here. mega-sam.github.io

010 0

Aleksander Hołyński @holynski.bsky.social · 06/12/2024

I love SfM, but it's way less useful than it should be because of a handful of characteristic failures. @zhengqi_li's new paper basically solves them all: -No parallax? ✅ -No calibration? ✅ -Dynamic scenes? ✅ -Dense geometry? ✅ Best of all, it's super fast.

1100 0

Aleksander Hołyński @holynski.bsky.social · 29/11/2024

This is my favorite kind of social media content.

010 0

Reposted by Aleksander Hołyński

Ziyang Chen @czyang.bsky.social · 27/11/2024

🎥 Introducing MultiFoley, a video-aware audio generation method with multimodal controls! 🔊 We can ⌨️Make a typewriter sound like a piano 🎹 🐱Make a cat meow like a lion roars! 🦁 ⏱️Perfectly time existing SFX 💥 to a video. arXiv: arxiv.org/abs/2411.17698 website: ificl.github.io/MultiFoley/

24212 0

Reposted by Aleksander Hołyński

Clément Godard @mrharicot.bsky.social · 28/11/2024

Quark is out! Come check our work on generalized realtime 3D reconstruction. quark-3d.github.io PS: We're looking for interns!

0193 0

Reposted by Aleksander Hołyński

Ben Poole @benmpoole.bsky.social · 28/11/2024

Stop watching videos, start interacting with worlds. Stoked to share CAT4D, our new method for turning videos into dynamic 3D scenes that you can move through in real-time! cat-4d.github.io arxiv.org/abs/2411.18613

29114 0

Aleksander Hołyński @holynski.bsky.social · 28/11/2024

Check out CAT4D: our new paper that turns (text, sparse images, videos) => (dynamic 3D scenes)! I can't get over how cool the interactive demo is. Try it out for yourself on the project page: cat-4d.github.io

16314 0

Reposted by Aleksander Hołyński

Jon Barron @jonbarron.bsky.social · 28/11/2024

We just dropped CAT4D, text to dynamic 3D models that you can render in real time. Not posting a video because Bluesky is garbage in this respect; go straight to the real time viewer on a desktop browser and look around. The cat kneading dough is my favorite. cat-4d.github.io

cat-4d.github.io

CAT4D: Create Anything in 4D with Multi-View Video Diffusion Models

We present CAT4D, a method for creating 4D (dynamic 3D) scenes from monocular video. CAT4D leverages a multi-view video diffusion model trained on a diverse combination of datasets to enable novel vie...

311311 0

Reposted by Aleksander Hołyński

Jon Barron @jonbarron.bsky.social · 25/11/2024

Our group at Google DeepMind is now accepting intern applications for summer 2025. Attached is the official "call for interns" email; the links and email aliases that got lost in the screenshot are below.

39626 0