English
Related papers

Related papers: Diffusion Models Enable Zero-Shot Pose Estimation …

200 papers

Monocular 3D human pose estimation is quite challenging due to the inherent ambiguity and occlusion, which often lead to high uncertainty and indeterminacy. On the other hand, diffusion models have recently emerged as an effective tool for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Jia Gong , Lin Geng Foo , Zhipeng Fan , Qiuhong Ke , Hossein Rahmani , Jun Liu

Generative models have made remarkable advancements and are capable of producing high-quality content. However, performing controllable editing with generative models remains challenging, due to their inherent uncertainty in outputs. This…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Yikun Ma , Yiqing Li , Jiawei Wu , Xing Luo , Zhi Jin

We propose two distributed set-based observers using strip-based and set-propagation approaches for linear discrete-time dynamical systems with bounded modeling and measurement uncertainties. Both algorithms utilize a set-based diffusion…

Systems and Control · Electrical Eng. & Systems 2023-06-21 Amr Alanwar , Jagat Jyoti Rath , Hazem Said , Karl Henrik Johansson , Matthias Althoff

Diffusion Transformers (DiTs) have achieved remarkable success in diverse and high-quality text-to-image(T2I) generation. However, how text and image latents individually and jointly contribute to the semantics of generated images, remain…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Zitao Shuai , Chenwei Wu , Zhengxu Tang , Bowen Song , Liyue Shen

Creating in-silico data with generative AI promises a cost-effective alternative to staining, imaging, and annotating whole slide images in computational pathology. Diffusion models are the state-of-the-art solution for generating in-silico…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Dominik Winter , Nicolas Triltsch , Marco Rosati , Anatoliy Shumilov , Ziya Kokaragac , Yuri Popov , Thomas Padel , Laura Sebastian Monasor , Ross Hill , Markus Schick , Nicolas Brieu

3D part assembly aims to understand part relationships and predict their 6-DoF poses to construct realistic 3D shapes, addressing the growing demand for autonomous assembly, which is crucial for robots. Existing methods mainly estimate the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Ruiyuan Zhang , Qi Wang , Jiaxiang Liu , Yu Zhang , Yuchi Huo , Chao Wu

Despite the remarkable success of deep learning in medical imaging analysis, medical image segmentation remains challenging due to the scarcity of high-quality labeled images for supervision. Further, the significant domain gap between…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Hedda Cohen Indelman , Elay Dahan , Angeles M. Perez-Agosto , Carmit Shiran , Doron Shaked , Nati Daniel

The diffusion model has demonstrated superior performance in synthesizing diverse and high-quality images for text-guided image translation. However, there remains room for improvement in both the formulation of text prompts and the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Qi Si , Bo Wang , Zhao Zhang

Pedestrian Attribute Recognition (PAR) is a challenging task as models are required to generalize across numerous attributes in real-world data. Traditional approaches focus on complex methods, yet recognition performance is often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Alejandro Alonso , Sawaiz A. Chaudhry , Juan C. SanMiguel , Álvaro García-Martín , Pablo Ayuso-Albizu , Pablo Carballeira

3-D pose estimation of instruments is a crucial step towards automatic scene understanding in robotic minimally invasive surgery. Although robotic systems can potentially directly provide joint values, this information is not commonly…

Robotics · Computer Science 2021-03-02 Luca Sestini , Benoit Rosa , Elena De Momi , Giancarlo Ferrigno , Nicolas Padoy

Inertial measurement unit (IMU)-based 3-DoF angle estimation methods for lower limb joints have been studied for decades, however the calibration motions and/or careful sensor placement are still necessary due to challenges of real-time…

Signal Processing · Electrical Eng. & Systems 2019-10-17 Chunzhi Yi , Feng Jiang , Zhiyuan Chen , Baichun Wei , Hao Guo , Xunfeng Yin , Fangzhuo Li , Chifu Yang

Continuous diffusion models have demonstrated their effectiveness in addressing the inherent uncertainty and indeterminacy in monocular 3D human pose estimation (HPE). Despite their strengths, the need for large search spaces and the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Weiquan Wang , Jun Xiao , Chunping Wang , Wei Liu , Zhao Wang , Long Chen

We introduce pix2gestalt, a framework for zero-shot amodal segmentation, which learns to estimate the shape and appearance of whole objects that are only partially visible behind occlusions. By capitalizing on large-scale diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Ege Ozguroglu , Ruoshi Liu , Dídac Surís , Dian Chen , Achal Dave , Pavel Tokmakov , Carl Vondrick

As a unique biometric that can be perceived at a distance, gait has broad applications in person authentication, social security, and so on. Existing gait recognition methods suffer from changes in viewpoint and clothing and barely consider…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jingqi Li , Jiaqi Gao , Yuzhen Zhang , Hongming Shan , Junping Zhang

The upper limb of the body is a vital for various kind of activities for human. The complete or partial loss of the upper limb would lead to a significant impact on daily activities of the amputees. EMG carries important information of…

Human-Computer Interaction · Computer Science 2024-10-28 Sidharth Pancholi , Amit M. Joshi Deepak Joshi , Bradly S. Duerstock

The aim of this study is to assess the performances of the global optimisation (GO) method (Bone position estimation from skin marker co-ordinates using GO with joint constraints. Journal of Biomechanics 32, 129-134) within the upper limb…

Optimization and Control · Mathematics 2009-06-19 Emmanuel Roux , Stéphane Bouilland , Anne-Pascale Godillon-Maquinghen , Denis Bouttens

Unified image restoration is a significantly challenging task in low-level vision. Existing methods either make tailored designs for specific tasks, limiting their generalizability across various types of degradation, or rely on training…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Huaqiu Li , Yong Wang , Tongwen Huang , Hailang Huang , Haoqian Wang , Xiangxiang Chu

Object pose estimation is a fundamental task in computer vision and robotics, yet most methods require extensive, dataset-specific training. Concurrently, large-scale vision language models show remarkable zero-shot capabilities. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Liming Kuang , Yordanka Velikova , Mahdi Saleh , Jan-Nico Zaech , Danda Pani Paudel , Benjamin Busam

Despite their mechanical sophistication, surgical robots remain blind to their surroundings. This lack of spatial awareness causes collisions, system recoveries, and workflow disruptions, issues that will intensify with the introduction of…

Diverse human motion generation is an increasingly important task, having various applications in computer vision, human-computer interaction and animation. While text-to-motion synthesis using diffusion models has shown success in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Heechang Kim , Gwanghyun Kim , Se Young Chun