Abstract
Existing volumetric capture of dynamic human performance achieves high fidelity with dense camera arrays. However, in real-world scenarios, only a handful of low-overlap cameras are available, which degrades the output quality and leaves large areas unobserved. Recent 4D reconstruction methods have focused on low-overlap settings, yet they still produce noticeable artifacts in under-observed regions. Video diffusion models have emerged as another option, but they show geometrically inconsistent results for humans. To address these limitations, we propose StudioRecon, a pipeline that reconstructs 4D human scenes from sparse, low-overlap cameras by decoupling background and humans. We densify background supervision by synthesizing hundreds of camera-controlled novel views with a video diffusion model. We also robustly initialize deformable Gaussian humans with cross-view identity association and triangulated multi-view keypoint fitting. Finally, our recursive enhancement module with motion-adaptive consistency injection harmonizes the composed output, thereby further avoiding remaining artifacts. We achieve state-of-the-art novel view synthesis across four real-world datasets and demonstrate applications such as novel trajectory rendering and human replacement.
Community
Four cameras around a room, roughly 90° apart, with barely any overlap between neighboring views. COLMAP doesn't even register them. That's the setting we went after.
Our insight: backgrounds and humans want different priors, so we stop making one model solve both.
🎬 Video diffusion densifies the background, turning 4 real views into hundreds.
🧍 SMPL constrains the humans, where video diffusion falls apart under motion.
✨ A recursive enhancement module harmonizes the two, without per-frame flicker.
Across 8 scenes from EgoHumans, Harmony4D, Mobile Stage, and SelfCap, StudioRecon outperforms prior methods on every scene: +1.5 to +5.0 dB PSNR over the best baseline, with LPIPS reduced by 33 to 74%.
Accepted to SIGGRAPH Conference Papers '26. First two authors contributed equally.
Amazing work! Thanks for sharing
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Ground4D: Consistency-Aware 4D Reconstruction from Monocular Video (2026)
- 4D Reconstruction from Sparse Dynamic Cameras (2026)
- Full-4D: Generating Full-Scope 4D Scenes from a Single-View Video (2026)
- GUSH3R: Everyone Everywhere All at Once as Gaussians (2026)
- Lift4D: Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild (2026)
- Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesis (2026)
- Progressive Pose-Guided 4D Animal Reconstruction from Monocular Video (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper