English
Related papers

Related papers: Improving 2D-3D Dense Correspondences with Diffusi…

200 papers

Estimating the 6D pose of unseen objects from monocular RGB images remains a challenging problem, especially due to the lack of prior object-specific knowledge. To tackle this issue, we propose RefPose, an innovative approach to object pose…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Jaeguk Kim , Jaewoo Park , Keuntek Lee , Nam Ik Cho

We propose a direct, regression-based approach to 2D human pose estimation from single images. We formulate the problem as a sequence prediction task, which we solve using a Transformer network. This network directly learns a regression…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Weian Mao , Yongtao Ge , Chunhua Shen , Zhi Tian , Xinlong Wang , Zhibin Wang , Anton van den Hengel

Diffusion models have demonstrated impressive capabilities in modeling complex data distributions and are increasingly applied in various generative tasks. In this work, we propose Pose Analysis by Diffusion Synthesis PADS, a unified…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Haorui Ji , Hongdong Li

We introduce GazeD, a new 3D gaze estimation method that jointly provides 3D gaze and human pose from a single RGB image. Leveraging the ability of diffusion models to deal with uncertainty, it generates multiple plausible 3D gaze and pose…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Riccardo Catalini , Davide Di Nucci , Guido Borghi , Davide Davoli , Lorenzo Garattoni , Gianpiero Francesca , Yuki Kawana , Roberto Vezzani

Domain generalization (DG) for object detection aims to enhance detectors' performance in unseen scenarios. This task remains challenging due to complex variations in real-world applications. Recently, diffusion models have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Boyong He , Yuxiang Ji , Qianwen Ye , Zhuoyue Tan , Liaoni Wu

Robust in-bed human pose estimation under blanket occlusion remains challenging due to the scarcity of reliable labeled training data for heavily covered poses. Existing approaches rely on multi-modal sensing or image-to-image translation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Navid Aslankhani Khameneh , Marco Carletti , Cigdem Beyan

Recent breakthroughs in text-to-image synthesis have been driven by diffusion models trained on billions of image-text pairs. Adapting this approach to 3D synthesis would require large-scale datasets of labeled 3D data and efficient…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Ben Poole , Ajay Jain , Jonathan T. Barron , Ben Mildenhall

Accurate 6D object pose estimation is an important task for a variety of robotic applications such as grasping or localization. It is a challenging task due to object symmetries, clutter and occlusion, but it becomes more challenging when…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Thomas Jantos , Mohamed Amin Hamdad , Wolfgang Granig , Stephan Weiss , Jan Steinbrener

Image harmonization, which involves adjusting the foreground of a composite image to attain a unified visual consistency with the background, can be conceptualized as an image-to-image translation task. Diffusion models have recently…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Pengfei Zhou , Fangxiang Feng , Xiaojie Wang

In this work, we present a novel dense-correspondence method for 6DoF object pose estimation from a single RGB-D image. While many existing data-driven methods achieve impressive performance, they tend to be time-consuming due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yongliang Lin , Yongzhi Su , Praveen Nathan , Sandeep Inuganti , Yan Di , Martin Sundermeyer , Fabian Manhardt , Didier Stricker , Jason Rambach , Yu Zhang

We present an approach to learn dense, continuous 2D-3D correspondence distributions over the surface of objects from data with no prior knowledge of visual ambiguities like symmetry. We also present a new method for 6D pose estimation of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Rasmus Laurvig Haugaard , Anders Glent Buch

3D pose estimation from a single 2D image is an important and challenging task in computer vision with applications in autonomous driving, robot manipulation and augmented reality. Since 3D pose is a continuous quantity, a natural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Siddharth Mahendran , Haider Ali , Rene Vidal

Establishment of point correspondence between camera and object coordinate systems is a promising way to solve 6D object poses. However, surrogate objectives of correspondence learning in 3D space are a step away from the true ones of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Hongyang Li , Jiehong Lin , Kui Jia

Structural guidance in an image-to-image translation allows intricate control over the shapes of synthesized images. Generating high-quality realistic images from user-specified rough hand-drawn sketches is one such task that aims to impose…

Graphics · Computer Science 2025-02-24 Prasun Roy , Saumik Bhattacharya , Subhankar Ghosh , Umapada Pal , Michael Blumenstein

Most recent 6D pose estimation frameworks first rely on a deep network to establish correspondences between 3D object keypoints and 2D image locations and then use a variant of a RANSAC-based Perspective-n-Point (PnP) algorithm. This…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Yinlin Hu , Pascal Fua , Wei Wang , Mathieu Salzmann

Deep learning-based pose estimation algorithms can successfully estimate the pose of objects in an image, especially in the field of color images. 6D Object pose estimation based on deep learning models for X-ray images often use custom…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Christiaan G. A. Viviers , Joel de Bruijn , Lena Filatova , Peter H. N. de With , Fons van der Sommen

Estimating the 6D pose of novel objects is a fundamental yet challenging problem in robotics, often relying on access to object CAD models. However, acquiring such models can be costly and impractical. Recent approaches aim to bypass this…

Robotics · Computer Science 2025-08-25 Zhaodong Jiang , Ashish Sinha , Tongtong Cao , Yuan Ren , Bingbing Liu , Binbin Xu

6D pose estimation of textureless objects is a valuable but challenging task for many robotic applications. In this work, we propose a framework to address this challenge using only RGB images acquired from multiple viewpoints. The core…

Robotics · Computer Science 2023-02-23 Jun Yang , Wenjie Xue , Sahar Ghavidel , Steven L. Waslander

Despite remarkable progress in image translation, the complex scene with multiple discrepant objects remains a challenging problem. The translated images have low fidelity and tiny objects in fewer details causing unsatisfactory performance…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Liyun Zhang , Photchara Ratsamee , Bowen Wang , Zhaojie Luo , Yuki Uranishi , Manabu Higashida , Haruo Takemura

Over the last two decades, deep learning has transformed the field of computer vision. Deep convolutional networks were successfully applied to learn different vision tasks such as image classification, image segmentation, object detection…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Yoli Shavit , Ron Ferens