English
Related papers

Related papers: HDiffTG: A Lightweight Hybrid Diffusion-Transforme…

200 papers

Many real-world applications require the estimation of human body joints for higher-level tasks as, for example, human behaviour understanding. In recent years, depth sensors have become a popular approach to obtain three-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Manuel J. Marin-Jimenez , Francisco J. Romero-Ramirez , Rafael Muñoz-Salinas , Rafael Medina-Carnicer

In this work, we aim to improve the 3D reasoning ability of Transformers in multi-view 3D human pose estimation. Recent works have focused on end-to-end learning-based transformer designs, which struggle to resolve geometric information…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Ziwei Liao , Jialiang Zhu , Chunyu Wang , Han Hu , Steven L. Waslander

We propose a Transformer-based framework for 3D human texture estimation from a single image. The proposed Transformer is able to effectively exploit the global information of the input image, overcoming the limitations of existing methods…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Xiangyu Xu , Chen Change Loy

3D human shape reconstruction under severe occlusion due to human-object or human-human interaction is a challenging problem. Parametric models i.e., SMPL(-X), which are based on the statistics across human shapes, can represent whole human…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Donghwan Kim , Tae-Kyun Kim

The accuracy and robustness of 3D human pose estimation (HPE) are limited by 2D pose detection errors and 2D to 3D ill-posed challenges, which have drawn great attention to Multi-Hypothesis HPE research. Most existing MH-HPE methods are…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Xianzhou Zeng , Hao Qin , Ming Kong , Luyuan Chen , Qiang Zhu

The state-of-the-art for monocular 3D human pose estimation in videos is dominated by the paradigm of 2D-to-3D pose uplifting. While the uplifting methods themselves are rather efficient, the true computational complexity depends on the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Moritz Einfalt , Katja Ludwig , Rainer Lienhart

Text-to-image models (T2I) such as StableDiffusion have been used to generate high quality images of people. However, due to the random nature of the generation process, the person has a different appearance e.g. pose, face, and clothing,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Soon Yau Cheong , Armin Mustafa , Andrew Gilbert

Generating high-quality videos that synthesize desired realistic content is a challenging task due to their intricate high-dimensionality and complexity of videos. Several recent diffusion-based methods have shown comparable performance by…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Kihong Kim , Haneol Lee , Jihye Park , Seyeon Kim , Kwanghee Lee , Seungryong Kim , Jaejun Yoo

Diffusion models (DMs) have recently been introduced in image deblurring and exhibited promising performance, particularly in terms of details reconstruction. However, the diffusion model requires a large number of inference iterations to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Zheng Chen , Yulun Zhang , Ding Liu , Bin Xia , Jinjin Gu , Linghe Kong , Xin Yuan

Traditional methods for human localization and pose estimation (HPE), which mainly rely on RGB images as an input modality, confront substantial limitations in real-world applications due to privacy concerns. In contrast, radar-based HPE…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yuan-Hao Ho , Jen-Hao Cheng , Sheng Yao Kuan , Zhongyu Jiang , Wenhao Chai , Hsiang-Wei Huang , Chih-Lung Lin , Jenq-Neng Hwang

In this paper we introduce a novel method to estimate the head pose of people in single images starting from a small set of head keypoints. To this purpose, we propose a regression model that exploits keypoints computed automatically by 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Giorgio Cantarini , Federico Figari Tomenotti , Nicoletta Noceti , Francesca Odone

Stable Diffusion Models (SDMs) have shown remarkable proficiency in image synthesis. However, their broad application is impeded by their large model sizes and intensive computational requirements, which typically require expensive cloud…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Chenqian Yan , Songwei Liu , Hongjian Liu , Xurui Peng , Xiaojian Wang , Fangmin Chen , Lean Fu , Xing Mei

Object pose estimation plays a vital role in embodied AI and computer vision, enabling intelligent agents to comprehend and interact with their surroundings. Despite the practicality of category-level pose estimation, current approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Jiyao Zhang , Mingdong Wu , Hao Dong

We propose a viewpoint invariant model for 3D human pose estimation from a single depth image. To achieve this, our discriminative model embeds local regions into a learned viewpoint invariant feature space. Formulated as a multi-task…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Albert Haque , Boya Peng , Zelun Luo , Alexandre Alahi , Serena Yeung , Li Fei-Fei

3D hand pose estimation (HPE) is the process of locating the joints of the hand in 3D from any visual input. HPE has recently received an increased amount of attention due to its key role in a variety of human-computer interaction…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Leyla Khaleghi , Joshua Marshall , Ali Etemad

Accurate surface reconstruction from unposed images is crucial for efficient 3D object or scene creation. However, it remains challenging, particularly for the joint camera pose estimation. Previous approaches have achieved impressive…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Li-Heng Chen , Zi-Xin Zou , Chang Liu , Tianjiao Jing , Yan-Pei Cao , Shi-Sheng Huang , Hongbo Fu , Hua Huang

Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) have led to significant progress in 2D body pose estimation. However, achieving a good balance between accuracy, efficiency, and robustness remains a challenge. For…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Kaleab A. Kinfu , René Vidal

Recently, several deep learning models have been proposed for 3D human pose estimation. Nevertheless, most of these approaches only focus on the single-person case or estimate 3D pose of a few people at high resolution. Furthermore, many…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Abdallah Benzine , Florian Chabot , Bertrand Luvison , Quoc Cong Pham , Cahterine Achrd

Diffusion-based approaches have recently achieved strong results in face swapping, offering improved visual quality over traditional GAN-based methods. However, even state-of-the-art models often suffer from fine-grained artifacts and poor…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Weston Bondurant , Arkaprava Sinha , Hieu Le , Srijan Das , Stephanie Schuckers

Estimating 3D human poses from a monocular video is still a challenging task. Many existing methods' performance drops when the target person is occluded by other objects, or the motion is too fast/slow relative to the scale and speed of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Cheng Yu , Bo Wang , Bo Yang , Robby T. Tan