English
Related papers

Related papers: Human-VDM: Learning Single-Image 3D Human Gaussian…

200 papers

We present the first application of 3D Gaussian Splatting in monocular SLAM, the most fundamental but the hardest setup for Visual SLAM. Our method, which runs live at 3fps, utilises Gaussians as the only 3D representation, unifying the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Hidenobu Matsuki , Riku Murai , Paul H. J. Kelly , Andrew J. Davison

Recent advances in video diffusion models have enabled the generation of high-quality videos. However, these videos still suffer from unrealistic deformations, semantic violations, and physical inconsistencies that are largely rooted in the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Shurui Gui , Deep Anil Patel , Xiner Li , Martin Renqiang Min

In this paper, we find that the generation of 3D human motions and 2D human videos is intrinsically coupled. 3D motions provide the structural prior for plausibility and consistency in videos, while pre-trained video models offer strong…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Chengfeng Zhao , Jiazhi Shu , Yubo Zhao , Tianyu Huang , Jiahao Lu , Zekai Gu , Chengwei Ren , Zhiyang Dou , Qing Shuai , Yuan Liu

This paper presents a novel approach to image-goal navigation by integrating 3D Gaussian Splatting (3DGS) with Visual Navigation Models (VNMs), a method we refer to as GSplatVNM. VNMs offer a promising paradigm for image-goal navigation by…

Robotics · Computer Science 2025-07-29 Kohei Honda , Takeshi Ishita , Yasuhiro Yoshimura , Ryo Yonetani

Recovering 3D scenes from sparse views is a challenging task due to its inherent ill-posed problem. Conventional methods have developed specialized solutions (e.g., geometry regularization or feed-forward deterministic model) to mitigate…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Hanyang Wang , Fangfu Liu , Jiawei Chi , Yueqi Duan

Traditional 3D garment creation is labor-intensive, involving sketching, modeling, UV mapping, and texturing, which are time-consuming and costly. Recent advances in diffusion-based generative models have enabled new possibilities for 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Boqian Li , Xuan Li , Ying Jiang , Tianyi Xie , Feng Gao , Huamin Wang , Yin Yang , Chenfanfu Jiang

Jointly estimating camera poses and mapping scenes from RGBD images is a fundamental task in simultaneous localization and mapping (SLAM). State-of-the-art methods employ 3D Gaussians to represent a scene, and render these Gaussians through…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Pengchong Hu , Zhizhong Han

Rendering dynamic 3D human from monocular videos is crucial for various applications such as virtual reality and digital entertainment. Most methods assume the people is in an unobstructed scene, while various objects may cause the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Jingrui Ye , Zongkai Zhang , Yujiao Jiang , Qingmin Liao , Wenming Yang , Zongqing Lu

Recent advances in generative diffusion models have enabled the previously unfeasible capability of generating 3D assets from a single input image or a text prompt. In this work, we aim to enhance the quality and functionality of these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Xiyi Chen , Marko Mihajlovic , Shaofei Wang , Sergey Prokudin , Siyu Tang

3D Gaussian Splatting represents a breakthrough in the field of novel view synthesis. It establishes Gaussians as core rendering primitives for highly accurate real-world environment reconstruction. Recent advances have drastically…

Graphics · Computer Science 2025-06-25 Jonathan Haberl , Philipp Fleck , Clemens Arth

4D content generation has achieved remarkable progress recently. However, existing methods suffer from long optimization times, a lack of motion controllability, and a low quality of details. In this paper, we introduce DreamGaussian4D…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jiawei Ren , Liang Pan , Jiaxiang Tang , Chi Zhang , Ang Cao , Gang Zeng , Ziwei Liu

The increasing prominence of e-commerce has underscored the importance of Virtual Try-On (VTON). However, previous studies predominantly focus on the 2D realm and rely heavily on extensive data for training. Research on 3D VTON primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Haodong Chen , Yongle Huang , Haojian Huang , Xiangsheng Ge , Dian Shao

The modeling and manipulation of 3D scenes captured from the real world are pivotal in various applications, attracting growing research interest. While previous works on editing have achieved interesting results through manipulating 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Guan Luo , Tian-Xing Xu , Ying-Tian Liu , Xiao-Xiong Fan , Fang-Lue Zhang , Song-Hai Zhang

Modeling animatable human avatars from videos is a long-standing and challenging problem. While conventional methods require per-instance optimization, recent feed-forward methods have been proposed to generate 3D Gaussians with a learnable…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Yifan Liu , Shengjun Zhang , Chensheng Dai , Yang Chen , Hao Liu , Chen Li , Yueqi Duan

3D content creation has achieved significant progress in terms of both quality and speed. Although current feed-forward models can produce 3D objects in seconds, their resolution is constrained by the intensive computation required during…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Jiaxiang Tang , Zhaoxi Chen , Xiaokang Chen , Tengfei Wang , Gang Zeng , Ziwei Liu

Dense colored point clouds enhance visual perception and are of significant value in various robotic applications. However, existing learning-based point cloud upsampling methods are constrained by computational resources and batch…

Robotics · Computer Science 2024-09-04 Zixuan Guo , Yifan Xie , Weijing Xie , Peng Huang , Fei Ma , Fei Richard Yu

Estimating accurate and temporally consistent 3D human geometry from videos is a challenging problem in computer vision. Existing methods, primarily optimized for single images, often suffer from temporal inconsistencies and fail to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Gwanghyun Kim , Xueting Li , Ye Yuan , Koki Nagano , Tianye Li , Jan Kautz , Se Young Chun , Umar Iqbal

Generating realistic 3D objects from single-view images requires natural appearance, 3D consistency, and the ability to capture multiple plausible interpretations of unseen regions. Existing approaches often rely on fine-tuning pretrained…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Pufan Li , Bi'an Du , Wei Hu

Conventional geometry-based SLAM systems lack dense 3D reconstruction capabilities since their data association usually relies on feature correspondences. Additionally, learning-based SLAM systems often fall short in terms of real-time…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Zhongche Qu , Zhi Zhang , Cong Liu , Jianhua Yin

Accurately recovering human pose and appearance from video is an essential component of scene reconstruction, with applications to motion capture, motion prediction, virtual reality, and digital twinning. Despite significant interest in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Yeheng Zong , Pou-Chun Kung , Yike Pan , Seth Isaacson , Yizhou Chen , Ram Vasudevan , Katherine A. Skinner