iiinova — where your digital self keeps evolving

Rundong Luo

@redfairy2002.bsky.social

CS PhD Student @cornelluniversity.bsky.social

Rundong Luo @redfairy2002.bsky.social · 23/04/2025

6/6 Check out our project page: red-fairy.github.io/argus/ Paper: arxiv.org/abs/2504.07940 Joint with: Matt Wallingford, Ali Farhadi, Noah @snavely.bsky.social , and Wei-Chiu Ma

red-fairy.github.io

Beyond the Frame: Generating 360° Panoramic Videos from Perspective Videos

000

Rundong Luo @redfairy2002.bsky.social · 23/04/2025

5/6 But it doesn't stop there! Our model enables exciting potential applications like video stabilization without cropping, camera viewpoint control, and even interactive visual question answering.

000

Rundong Luo @redfairy2002.bsky.social · 23/04/2025

4/6 Our model can predict scene dynamics: We capture a scene with a 360° camera and provide our model with a 60° FoV input of fixed viewing direction (left). The car's ground truth trajectory (middle) and our model's predicted trajectory (right) shows strong alignment.

000

Rundong Luo @redfairy2002.bsky.social · 23/04/2025

3/6 Our solution? We've created a high-quality data pipeline leveraging vast online 360° videos, carefully curated to build effective training pairs. Our model can generate spatially-coherent and temporally-consistent 360° videos from arbitrary in-the-wild perspective inputs.

010

Rundong Luo @redfairy2002.bsky.social · 23/04/2025

2/6 ⬆️Input (left): Standard perspective video from a single viewpoint Output (right): Our generated 360° panorama created from the input. The red box highlights the corresponding region from the original input.

000

Rundong Luo @redfairy2002.bsky.social · 23/04/2025

1/6 🔍➡️ How to transform standard videos into immersive 360° panoramas? We've designed a new AI system for video-to-360° panorama generation! Our key insight: large-scale data is crucial for robust panoramic synthesis across diverse scenes.

541