English
Related papers

Related papers: Zero-shot Human Pose Estimation using Diffusion-ba…

200 papers

Human pose estimation in unconstrained images and videos is a fundamental computer vision task. To illustrate the evolutionary path in technique, in this survey we summarize representative human pose methods in a structured taxonomy, with a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Feng Zhang , Xiatian Zhu , Chen Wang

Diffusion-based human animation aims to animate a human character based on a source human image as well as driving signals such as a sequence of poses. Leveraging the generative capacity of diffusion model, existing approaches are able to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Fa-Ting Hong , Zhan Xu , Haiyang Liu , Qinjie Lin , Luchuan Song , Zhixin Shu , Yang Zhou , Duygu Ceylan , Dan Xu

This paper addresses the challenging problem of category-level pose estimation. Current state-of-the-art methods for this task face challenges when dealing with symmetric objects and when attempting to generalize to new environments solely…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Takuya Ikeda , Sergey Zakharov , Tianyi Ko , Muhammad Zubair Irshad , Robert Lee , Katherine Liu , Rares Ambrus , Koichi Nishiwaki

Continuous diffusion models have demonstrated their effectiveness in addressing the inherent uncertainty and indeterminacy in monocular 3D human pose estimation (HPE). Despite their strengths, the need for large search spaces and the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Weiquan Wang , Jun Xiao , Chunping Wang , Wei Liu , Zhao Wang , Long Chen

Human pose estimation in images and videos is one of key technologies for realizing a variety of human activity recognition tasks (e.g., human-computer interaction, gesture recognition, surveillance, and video summarization). This paper…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Norimichi Ukita

We propose a direct, regression-based approach to 2D human pose estimation from single images. We formulate the problem as a sequence prediction task, which we solve using a Transformer network. This network directly learns a regression…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Weian Mao , Yongtao Ge , Chunhua Shen , Zhi Tian , Xinlong Wang , Zhibin Wang , Anton van den Hengel

Learning-based methods have dominated the 3D human pose estimation (HPE) tasks with significantly better performance in most benchmarks than traditional optimization-based methods. Nonetheless, 3D HPE in the wild is still the biggest…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Zhongyu Jiang , Zhuoran Zhou , Lei Li , Wenhao Chai , Cheng-Yen Yang , Jenq-Neng Hwang

Zero-shot object pose estimation enables the retrieval of object poses from images without necessitating object-specific training. In recent approaches this is facilitated by vision foundation models (VFM), which are pre-trained models that…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Bernd Von Gimborn , Philipp Ausserlechner , Markus Vincze , Stefan Thalhammer

Human pose forecasting predicts future poses based on past observations, and has many significant applications in areas such as action recognition, autonomous driving or human-robot interaction. This paper evaluates a wide range of pose…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Daniel Bermuth , Alexander Poeppel , Wolfgang Reif

Human pose estimation from single images is a challenging problem that is typically solved by supervised learning. Unfortunately, labeled training data does not yet exist for many human activities since 3D annotation requires dedicated…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Bastian Wandt , James J. Little , Helge Rhodin

Human pose forecasting is the task of predicting articulated human motion given past human motion. There exists a number of popular benchmarks that evaluate an array of different models performing human pose forecasting. These benchmarks do…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Maria Priisalu , Ted Kronvall , Cristian Sminchisescu

We propose a human pose estimation framework that solves the task in the regression-based fashion. Unlike previous regression-based methods, which often fall behind those state-of-the-art methods, we formulate the pose estimation task into…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Weian Mao , Yongtao Ge , Chunhua Shen , Zhi Tian , Xinlong Wang , Zhibin Wang

We describe a method for 3D human pose estimation from transient images (i.e., a 3D spatio-temporal histogram of photons) acquired by an optical non-line-of-sight (NLOS) imaging system. Our method can perceive 3D human pose by `looking…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Mariko Isogawa , Ye Yuan , Matthew O'Toole , Kris Kitani

This paper proposes a statistical approach to 2D pose estimation from human images. The main problems with the standard supervised approach, which is based on a deep recognition (image-to-pose) model, are that it often yields anatomically…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Takayuki Nakatsuka , Kazuyoshi Yoshii , Yuki Koyama , Satoru Fukayama , Masataka Goto , Shigeo Morishima

Human pose analysis has garnered significant attention within both the research community and practical applications, owing to its expanding array of uses, including gaming, video surveillance, sports performance analysis, and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Lijuan Zhou , Xiang Meng , Zhihuan Liu , Mengqi Wu , Zhimin Gao , Pichao Wang

3D human pose estimation has been a long-standing challenge in computer vision and graphics, where multi-view methods have significantly progressed but are limited by the tedious calibration processes. Existing multi-view methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Boyuan Jiang , Lei Hu , Shihong Xia

Human pose estimation (HPE) from Radio Frequency vision (RF-vision) performs human sensing using RF signals that penetrate obstacles without revealing privacy (e.g., facial information). Recently, mmWave radar has emerged as a promising…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Junqiao Fan , Jianfei Yang , Yuecong Xu , Lihua Xie

This paper explores the problem of 3D human pose estimation from only low-level acoustic signals. The existing active acoustic sensing-based approach for 3D human pose estimation implicitly assumes that the target user is positioned along a…

Sound · Computer Science 2024-11-12 Yusuke Oumi , Yuto Shibata , Go Irie , Akisato Kimura , Yoshimitsu Aoki , Mariko Isogawa

Recovering a signal from its degraded measurements is a long standing challenge in science and engineering. Recently, zero-shot diffusion based methods have been proposed for such inverse problems, offering a posterior sampling based…

Machine Learning · Computer Science 2026-05-19 Roi Benita , Michael Elad , Joseph Keshet

We study human pose estimation in extremely low-light images. This task is challenging due to the difficulty of collecting real low-light images with accurate labels, and severely corrupted inputs that degrade prediction quality…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Sohyun Lee , Jaesung Rim , Boseung Jeong , Geonu Kim , Byungju Woo , Haechan Lee , Sunghyun Cho , Suha Kwak