Sign in

Kwang Moo Yi

@kmyid.bsky.social
148 followers 39 following 435 posts

Assistant Professor of Computer Science at the University of British Columbia. I also post my daily finds on arxiv.

PostsRepliesMedia
Kwang Moo Yi @kmyid.bsky.social · 09/10/2026
dominik-schnaus.github.io/unpaired-ros...
dominik-schnaus.github.io
Shared Geometry as a Rosetta Stone
Cross-modal alignment without paired data.
000
Kwang Moo Yi @kmyid.bsky.social · 09/10/2026
Schnaus et al., "Shared Geometry As A Rosetta Stone: Cross-Modal Alignment Without Paired Data" Linked-in structures learned from different modalities on different datasets seem to share a lot of the geometry. And alignment between them can give some coarse translation.
110
Kwang Moo Yi @kmyid.bsky.social · 08/10/2026
ifradlin.github.io/arrow/
ifradlin.github.io
ARROW: Arbitrary Reconstruction and Tracking of 4D Observations in the Wild
ARROW unifies 3D reconstruction and point tracking from arbitrary RGB observations through order-invariant querying and training across viewpoints and capture times.
000
Kwang Moo Yi @kmyid.bsky.social · 08/10/2026
Fradlin et al., "ARROW: Arbitrary Reconstruction and Tracking of 4D Observations in the Wild" D4RT-style, extended to various modalities beyond videos.
100
Kwang Moo Yi @kmyid.bsky.social · 07/10/2026
hydragon.co.kr/DensiTok/
hydragon.co.kr
DensiTok: Making Feed-Forward 3D Gaussian Splatting See More Views Than It Is Given
A plug-in that densifies the geometry tokens of pretrained feed-forward 3DGS models, so a frozen backbone reconstructs as if it had seen many more views than it was given.
010
Kwang Moo Yi @kmyid.bsky.social · 07/10/2026
Lee and Lee et al., "DensiTok: Making Feed-Forward 3D Gaussian Splatting See More Views Than It Is Given" Simple idea. Can you actually learn to fill in the gaps in the latent token space such that you can simulate as if you had more views for sparse-view reconstruction?
151
Kwang Moo Yi @kmyid.bsky.social · 06/10/2026
omer11a.github.io/learning_to_...
omer11a.github.io
Learning to Read the Contextual Tokens in Diffusion Transformers
Reading the visual semantics that emerge inside multimodal diffusion transformers, then strengthening them to improve generation.
000
Kwang Moo Yi @kmyid.bsky.social · 06/10/2026
Dahary and Sella et al., "Learning to Read the Contextual Tokens in Diffusion Transformers" Turns out you can already read out a LOT about the image that is being generated even before it becomes barely interpretable.
110
Kwang Moo Yi @kmyid.bsky.social · 05/10/2026
4dcodebench.com
4dcodebench.com
4DCodeBench
Can a coding agent watch a video of a physical event and write the program that rebuilds it? 200 tasks, 100 real videos and 100 simulated.
000
Kwang Moo Yi @kmyid.bsky.social · 05/10/2026
Shen, Kovačič, and Kulits et al., "4DCodeBench: Benchmarking Agents on Inverse Graphics of Dynamic Scenes" Benchmarking frontier models on how well they are at generating dynamic scenes with code. Astra Max is indeed very impressive.
100
Kwang Moo Yi @kmyid.bsky.social · 02/10/2026
arxiv.org/abs/2610.00749
arxiv.org
What Builds the Scene? Luminance Dominates Geometry Formation in 3D Gaussian Splatting
Standard 3D Gaussian Splatting (3DGS) learns geometry and appearance jointly from RGB supervision, making it difficult to isolate how luminance and chroma contribute to the learned representation. We ...
000
Kwang Moo Yi @kmyid.bsky.social · 02/10/2026
Joshaghani et al., "What Builds the Scene? Luminance Dominates Geometry Formation in 3D Gaussian Splatting" This work reminded me of something that I completely forgot. We used to use grayscale images because that was all we needed to infer geometry and shapes. It still holds!
110
Kwang Moo Yi @kmyid.bsky.social · 01/10/2026
arxiv.org/abs/2609.36777 lego-anything.com
arxiv.org
Code4Scene: Benchmarking Coding Agents for Constructing and Editing 3D Scenes
Frontier coding agents can now write and execute code that authors 3D environments, but whether they reliably understand 3D structure and precisely control scene state remains unclear. The generated 3...
020
Kwang Moo Yi @kmyid.bsky.social · 01/10/2026
Li et al., "LEGO-Anything: Coding Agents for 3D Scene Reconstruction" Ye et al., "Code4Scene: Benchmarking Coding Agents for Constructing and Editing 3D Scenes" Benchmarking frontier models for constructing 3D scenes. Surprised that Gemini 3.8 was already good even before Astra
110
Kwang Moo Yi @kmyid.bsky.social · 30/09/2026
prodygs.github.io
prodygs.github.io
ProDyGS: Dynamic Gaussian Splatting from a Single Static Monocular Camera
ProDyGS is a method for dynamic Gaussian splatting from a single static monocular camera, achieving state-of-the-art performance in novel view synthesis.
000
Kwang Moo Yi @kmyid.bsky.social · 30/09/2026
Cavalcanti et al., "ProDyGS: Dynamic Gaussian Splatting from a Single Static Monocular Camera" A quick, neat idea -- if monocular dynamic novel view synthesis is hard, why not leverage single-view novel-view synthesis to turn it into pseudo-multi-view?
101
Kwang Moo Yi @kmyid.bsky.social · 29/09/2026
arxiv.org/abs/2609.30566
arxiv.org
Atlases Are Already Inside: Recovering Population Templates from Pretrained Diffusion Models
We present a new inference-time sampler for diffusion models that gives a pretrained model a capability it was never trained for: constructing the atlas of the population it synthesizes. The sampler c...
000
Kwang Moo Yi @kmyid.bsky.social · 29/09/2026
Shi et al., "Atlases Are Already Inside: Recovering Population Templates from Pretrained Diffusion Models" It's so annoying when your samples from diffusion models collapse, but is it actually bad? You can extract atlases from the models by making them collapse on purpose.
100
Kwang Moo Yi @kmyid.bsky.social · 25/09/2026
arxiv.org/abs/2609.25746
arxiv.org
Dual Covariance Gaussian Splatting SLAM: Decoupling Rendering and Registration for Robust Real-Time Tracking
ICP-based 3D Gaussian Splatting (3DGS) SLAM tracks in real time by registering incoming frames against map Gaussians, using each primitive's covariance for both rendering and registration. These two u...
000
Kwang Moo Yi @kmyid.bsky.social · 25/09/2026
Tan et al., "Dual Covariance Gaussian Splatting SLAM: Decoupling Rendering and Registration for Robust Real-Time Tracking" Geometric anchor uncertainty and appearance do not always coincide. Having separate variants allows better SLAM.
100
Kwang Moo Yi @kmyid.bsky.social · 16/09/2026
github.com/TangentH/RIGOR
github.com
GitHub - TangentH/RIGOR: official repo for RIGOR: Rig-Informed Geometry for Omnidirectional Reconstruction
official repo for RIGOR: Rig-Informed Geometry for Omnidirectional Reconstruction - TangentH/RIGOR
000
Kwang Moo Yi @kmyid.bsky.social · 16/09/2026
Huang et al., "RIGOR: Rig-Informed Geometry for Omnidirectional Reconstruction" Here's how you can use existing feed-forward models with 360 cameras. A tightly knit system that treats 360 images as four virtual "rigs" that must agree.
100
Kwang Moo Yi @kmyid.bsky.social · 15/09/2026
arxiv.org/abs/2609.12557
arxiv.org
DRS-VPT: Directly Relocalizing in a Scan with Vision Point Transformers
We present DRS-VPT, a feed-forward transformer architecture for foundational image-to-scan registration. Given query images and a reference 3D point cloud, the model predicts the scan pose and point m...
000
Kwang Moo Yi @kmyid.bsky.social · 15/09/2026
Fu and Fallon, "DRS-VPT: Directly Relocalizing in a Scan with Vision Point Transformers" Given a point cloud scan (without colors) and an image, this method performs feed-forward estimation to get camera pose. DINO + Sonata + DPT (+scale)
100
Kwang Moo Yi @kmyid.bsky.social · 10/09/2026
github.com/davnords/RoM...
github.com
GitHub - davnords/RoMa-Omega: [ECCVW 2026] RoMa-Ω: What Feed-Forward 3D Models Know About Image Matching
[ECCVW 2026] RoMa-Ω: What Feed-Forward 3D Models Know About Image Matching - davnords/RoMa-Omega
010
Kwang Moo Yi @kmyid.bsky.social · 10/09/2026
Nordström et al., "RoMa-Ω: What Feed-Forward 3D Models Know About Image Matching" VGGT-Ω works well for geometry estimation -- let's train RoMA with its features. It now works even better, even on scenes where VGGT doesn't do so well.
130
Kwang Moo Yi @kmyid.bsky.social · 10/09/2026
huggingface.co/spaces/huawe...
huggingface.co
Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation - a Hugging Face Space by huawei-bayerlab
Depth, surface normals, and albedo from a single image
000
Kwang Moo Yi @kmyid.bsky.social · 10/09/2026
Pavlovic et al., "Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation" My personal favourite from this work: Pay attention to your data -- pixel-wise losses have their limits when GT depth creation is limited in resolution. + QLoRA and Semantic loss.
120
Kwang Moo Yi @kmyid.bsky.social · 08/09/2026
#ECCV SONIC will be presented at ExHall #B1 on Thursday 10:30 CEST. Come talk to Seungyeon about it! Optimize your initial noise to match observations via (1) linearization to skip unrolling denoising trajectories (2) optimize with spectral conditioning for robustness.
020
Kwang Moo Yi @kmyid.bsky.social · 08/09/2026
github.com/naver/blast3r
github.com
GitHub - naver/blast3r
Contribute to naver/blast3r development by creating an account on GitHub.
142
Kwang Moo Yi @kmyid.bsky.social · 08/09/2026
Leroy et al., "BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors" We are back to image matching again I guess? Bundle adjusment with coarse/fine matching and depth scaling. State-of-the-art results.
181
Kwang Moo Yi @kmyid.bsky.social · 04/09/2026
arxiv.org/abs/2609.03931
arxiv.org
Sparse auto-regressive modeling for scene generation from multi-view images
Generating complete 3D scenes from sparse, unconstrained views is a fundamental challenge in 3D vision which requires reasoning beyond observed content while remaining computationally tractable. Exist...
000
Kwang Moo Yi @kmyid.bsky.social · 04/09/2026
Lucas and Pietrantoni et al., "Sparse auto-regressive modeling for scene generation from multi-view images" Multiview images+pointmaps & autoregressive latent space generator == 3d scene generation, decoded as 3D Gaussians.
120
Kwang Moo Yi @kmyid.bsky.social · 03/09/2026
junchao-cs.github.io/SolarWM-Web/
junchao-cs.github.io
SolarWM — Open Data and Scalable Training for Long-Horizon Video World Models
SolarWM — Open Data and Scalable Training for Long-Horizon Video World Models
000
Kwang Moo Yi @kmyid.bsky.social · 03/09/2026
Huang et al., "SolarWM Open Data and Scalable Training for Long-Horizon Video World Models" Another day, another controllable video model. Open dataset, open weights, open source.
110
Kwang Moo Yi @kmyid.bsky.social · 02/09/2026
github.com/VISION-SJTU/...
github.com
GitHub - VISION-SJTU/Lapis: [ECCV 2026] Efficient and High-Quality Depth Estimation via Pixel-Space Diffusion with Linear Attention
[ECCV 2026] Efficient and High-Quality Depth Estimation via Pixel-Space Diffusion with Linear Attention - VISION-SJTU/Lapis
000
Kwang Moo Yi @kmyid.bsky.social · 02/09/2026
Liu et al., "Efficient and High-Quality Depth Estimation via Pixel-Space Diffusion with Linear Attention" I thought generative pixel-space methods would be slow, but I guess not since one-step denoisers work well these days. SOTA results, with similar speed as DA3.
110
Kwang Moo Yi @kmyid.bsky.social · 31/08/2026
valeoai.github.io/VATIX/
valeoai.github.io
VATIX | Scaling Law Analysis of Video Diffusion Models
VATIX: A Scaling Law Analysis of Video Diffusion Models for driving video generation.
011
Kwang Moo Yi @kmyid.bsky.social · 31/08/2026
Besnier et al., "How Far Can 5,500 Hours of Driving Take You? A Scaling Law Analysis of Video Diffusion Models" 5,500 hours of driving data, a 9B model trained from scratch, open-source (committed and data is there, but models not delivered yet!) Vid: GT on top, generated below.
161
Kwang Moo Yi @kmyid.bsky.social · 28/08/2026
fangchuan.github.io/SpatialCraft...
fangchuan.github.io
SpatialCrafter
000
Kwang Moo Yi @kmyid.bsky.social · 28/08/2026
Fang et al., "SpatialCrafter: Single-Image World Modeling with Generative 3D Proxies" Generative models for 3D scenes + video models to refine renderings. Not perfect, but cool nonetheless!
110
Kwang Moo Yi @kmyid.bsky.social · 26/08/2026
arxiv.org/abs/2608.23869
arxiv.org
Gen2Physics: Grounding Generated 3D Meshes in Physics via Multi-View Material Decomposition
While state-of-the-art generative models produce high-fidelity 3D meshes, these outputs lack the physical properties required for interactive simulation, gaming, or robotics. We introduce Gen2Physics,...
000
Kwang Moo Yi @kmyid.bsky.social · 26/08/2026
Comi et al., "Gen2Physics: Grounding Generated 3D Meshes in Physics via Multi-View Material Decomposition" Render assets into multiple views, then estimate their material properties for simulation.
100
Kwang Moo Yi @kmyid.bsky.social · 26/08/2026
fix-anything.github.io
fix-anything.github.io
FixAnything: 3D-Consistent Rendering Refinement via Video Generative Priors
One video model repairs rendering artifacts from 3DGS, NeRF, mesh, or sparse point clouds. ECCV 2026, Carnegie Mellon University.
000
Kwang Moo Yi @kmyid.bsky.social · 26/08/2026
Vuong et al., "FixAnything: 3D-Consistent Rendering Refinement via Video Generative Priors" Fix intermediate render representations via a fine-tuned video model. Uses LoRA and DPO (with geometric consistency reward)
110
Kwang Moo Yi @kmyid.bsky.social · 25/08/2026
github.com/qsong2001/mv...
github.com
GitHub - qsong2001/mvap-g: Official implementation of MVAP-G [ECCV'26 Oral]
Official implementation of MVAP-G [ECCV'26 Oral]. Contribute to qsong2001/mvap-g development by creating an account on GitHub.
000
Kwang Moo Yi @kmyid.bsky.social · 25/08/2026
Song et al., "MVAP-G: Generating Multi-view Adversarial Examples for Visual Geometry Grounded Transformer" Yep, you can fool VGGT. Now, I guess time for someone to create a sticker with said patterns.
100
Kwang Moo Yi @kmyid.bsky.social · 21/08/2026
equilibriumforcing.github.io
equilibriumforcing.github.io
Equilibrium Forcing
Equilibrium Forcing: Adaptive Video Generation Without Noise Conditioning
000
Kwang Moo Yi @kmyid.bsky.social · 21/08/2026
Lillemark and Rojas, et al., "Equilibrium Forcing: Adaptive Video Generation Without Noise Conditioning" Instead of conditioning your flow model on pre-defined schedules, let it estimate noise levels and use them during inference.
120
Kwang Moo Yi @kmyid.bsky.social · 20/08/2026
github.com/ThereWillCom...
github.com
GitHub - ThereWillComeSoftRains/RevisitingCFGMethods
Contribute to ThereWillComeSoftRains/RevisitingCFGMethods development by creating an account on GitHub.
000