English
Related papers

Related papers: Real3D: Scaling Up Large Reconstruction Models wit…

200 papers

Deep learning-based super-resolution models have the potential to revolutionize biomedical imaging and diagnoses by effectively tackling various challenges associated with early detection, personalized medicine, and clinical automation.…

Medical Physics · Physics 2023-06-27 Yuanzheng Ma , Xinyue Wang , Benqi Zhao , Ying Xiao , Shijie Deng , Jian Song , Xun Guan

A prominent approach to visual Reinforcement Learning (RL) is to learn an internal state representation using self-supervised methods, which has the potential benefit of improved sample-efficiency and generalization through additional…

Machine Learning · Computer Science 2023-03-16 Yanjie Ze , Nicklas Hansen , Yinbo Chen , Mohit Jain , Xiaolong Wang

Transformer based methods have enabled users to create, modify, and comprehend text and image data. Recently proposed Large Reconstruction Models (LRMs) further extend this by providing the ability to generate high-quality 3D models with…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Kunal Kathare , Ankit Dhiman , K Vikas Gowda , Siddharth Aravindan , Shubham Monga , Basavaraja Shanthappa Vandrotti , Lokesh R Boregowda

Deep learning (DL) has emerged as a tool for improving accelerated MRI reconstruction. A common strategy among DL methods is the physics-based approach, where a regularized iterative algorithm alternating between data consistency and a…

Image and Video Processing · Electrical Eng. & Systems 2020-07-03 Burhaneddin Yaman , Seyed Amir Hossein Hosseini , Steen Moeller , Jutta Ellermann , Kâmil Uǧurbil , Mehmet Akçakaya

With increasing focus on augmented and virtual reality applications (XR) comes the demand for algorithms that can lift objects from images and videos into representations that are suitable for a wide variety of related 3D tasks. Large-scale…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Felix Wimbauer , Shangzhe Wu , Christian Rupprecht

Single-view 3D reconstruction is currently approached from two dominant perspectives: reconstruction of scenes with limited diversity using 3D data supervision or reconstruction of diverse singular objects using large image priors. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Andreea Ardelean , Mert Özer , Bernhard Egger

Aiming at inferring 3D shapes from 2D images, 3D shape reconstruction has drawn huge attention from researchers in computer vision and deep learning communities. However, it is not practical to assume that 2D input images and their…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yi-Lun Liao , Yao-Cheng Yang , Yu-Chiang Frank Wang

Video super-resolution (VSR) techniques, especially deep-learning-based algorithms, have drastically improved over the last few years and shown impressive performance on synthetic data. However, their performance on real-world video data…

Image and Video Processing · Electrical Eng. & Systems 2023-05-05 Mehran Jeelani , Sadbhawna , Noshaba Cheema , Klaus Illgner-Fehns , Philipp Slusallek , Sunil Jaiswal

Self-supervised learning is crucial for super-resolution because ground-truth images are usually unavailable for real-world settings. Existing methods derive self-supervision from low-resolution images by creating pseudo-pairs or by…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Yuehan Zhang , Angela Yao

Learning-based image harmonization techniques are usually trained to undo synthetic random global transformations applied to a masked foreground in a single ground truth photo. This simulated data does not model many of the important…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Ke Wang , Michaël Gharbi , He Zhang , Zhihao Xia , Eli Shechtman

Unsupervised real-world super-resolution (SR) faces critical challenges due to the complex, unknown degradation distributions in practical scenarios. Existing methods struggle to generalize from synthetic low-resolution (LR) and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Hongyang Zhou , Xiaobin Zhu , Liuling Chen , Junyi He , Jingyan Qin , Xu-Cheng Yin , Zhang xiaoxing

Most learning-based super-resolution (SR) methods aim to recover high-resolution (HR) image from a given low-resolution (LR) image via learning on LR-HR image pairs. The SR methods learned on synthetic data do not perform well in…

Image and Video Processing · Electrical Eng. & Systems 2020-01-09 Dong Gong , Wei Sun , Qinfeng Shi , Anton van den Hengel , Yanning Zhang

Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Yixin Chen , Junfeng Ni , Nan Jiang , Yaowei Zhang , Yixin Zhu , Siyuan Huang

Recently, deep learning based 3D face reconstruction methods have shown promising results in both quality and efficiency.However, training deep neural networks typically requires a large volume of data, whereas face images with ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Yu Deng , Jiaolong Yang , Sicheng Xu , Dong Chen , Yunde Jia , Xin Tong

With recent advances, Feed-forward Reconstruction Models (FFRMs) have demonstrated great potential in reconstruction quality and adaptiveness to multiple downstream tasks. However, the excessive reliance on multi-view geometric annotations,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Youyu Chen , Junjun Jiang , Yueru Luo , Kui Jiang , Xianming Liu , Xu Yan , Dave Zhenyu Chen

Faithfully reconstructing 3D geometry and generating novel views of scenes are critical tasks in 3D computer vision. Despite the widespread use of image augmentations across computer vision applications, their potential remains…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Juan C. Pérez , Sara Rojas , Jesus Zarzar , Bernard Ghanem

We propose scaling up 3D scene reconstruction by training with synthesized data. At the core of our work is MegaSynth, a procedurally generated 3D dataset comprising 700K scenes - over 50 times larger than the prior real dataset DL3DV -…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Hanwen Jiang , Zexiang Xu , Desai Xie , Ziwen Chen , Haian Jin , Fujun Luan , Zhixin Shu , Kai Zhang , Sai Bi , Xin Sun , Jiuxiang Gu , Qixing Huang , Georgios Pavlakos , Hao Tan

We present FaceLift, a novel feed-forward approach for generalizable high-quality 360-degree 3D head reconstruction from a single image. Our pipeline first employs a multi-view latent diffusion model to generate consistent side and back…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Weijie Lyu , Yi Zhou , Ming-Hsuan Yang , Zhixin Shu

Deep learning approaches have become the standard solution to many problems in computer vision and robotics, but obtaining sufficient training data in high enough quality is challenging, as human labor is error prone, time consuming, and…

Machine Learning · Computer Science 2021-06-16 Jan Blumenkamp , Andreas Baude , Tim Laue

Fast and robust three-dimensional reconstruction of facial geometric structure from a single image is a challenging task with numerous applications. Here, we introduce a learning-based approach for reconstructing a three-dimensional face…

Computer Vision and Pattern Recognition · Computer Science 2016-09-27 Elad Richardson , Matan Sela , Ron Kimmel