English
Related papers

Related papers: Hyperbolic Space Learning Method Leveraging Tempor…

200 papers

The end-to-end Human Mesh Recovery (HMR) approach has been successfully used for 3D body reconstruction. However, most HMR-based frameworks reconstruct human body by directly learning mesh parameters from images or videos, while lacking…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Tianyu Luan , Yali Wang , Junhao Zhang , Zhe Wang , Zhipeng Zhou , Yu Qiao

Videos from edited media like movies are a useful, yet under-explored source of information. The rich variety of appearance and interactions between humans depicted over a large temporal context in these films could be a valuable source of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Georgios Pavlakos , Jitendra Malik , Angjoo Kanazawa

Conventional approaches to human mesh recovery predominantly employ a region-based strategy. This involves initially cropping out a human-centered region as a preprocessing step, with subsequent modeling focused on this zoomed-in image.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Zeyu Wang , Zhenzhen Weng , Serena Yeung-Levy

Dynamic multi-person mesh recovery has broad applications in sports broadcasting, virtual reality, and video games. However, current multi-view frameworks rely on a time-consuming camera calibration procedure. In this work, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Buzhen Huang , Jingyi Ju , Yuan Shu , Yangang Wang

Human Mesh Recovery (HMR) aims to reconstruct 3D human pose and shape from 2D observations and is fundamental to human-centric understanding in real-world scenarios. While recent image-based HMR methods such as SAM 3D Body achieve strong…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Mingqi Gao , Yunqi Miao , Jungong Han

From an image of a person, we can easily infer the natural 3D pose and shape of the person even if ambiguity exists. This is because we have a mental model that allows us to imagine a person's appearance at different viewing directions from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Hanbyel Cho , Yooshin Cho , Jaesung Ahn , Junmo Kim

3D human pose estimation captures the human joint points in three-dimensional space while keeping the depth information and physical structure. That is essential for applications that require precise pose information, such as human-computer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Jianbin Jiao , Xina Cheng , Weijie Chen , Xiaoting Yin , Hao Shi , Kailun Yang

Detecting events and their evolution through time is a crucial task in natural language understanding. Recent neural approaches to event temporal relation extraction typically map events to embeddings in the Euclidean space and train a…

Computation and Language · Computer Science 2024-06-11 Xingwei Tan , Gabriele Pergola , Yulan He

To date, little attention has been given to multi-view 3D human mesh estimation, despite real-life applicability (e.g., motion capture, sport analysis) and robustness to single-view ambiguities. Existing solutions typically suffer from poor…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Xuan Gong , Liangchen Song , Meng Zheng , Benjamin Planche , Terrence Chen , Junsong Yuan , David Doermann , Ziyan Wu

Metric learning plays a critical role in training image retrieval and classification. It is also a key algorithm in representation learning, e.g., for feature learning and its alignment in metric space. Hyperbolic embedding has been…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Shiyang Yan , Zongxuan Liu , Lin Xu

In this work, we propose a fashion item recommendation model that incorporates hyperbolic geometry into user and item representations. Using hyperbolic space, our model aims to capture implicit hierarchies among items based on their visual…

Information Retrieval · Computer Science 2024-09-05 Ryotaro Shimizu , Yu Wang , Masanari Kimura , Yuki Hirakawa , Takashi Wada , Yuki Saito , Julian McAuley

Recovering high-quality 3D human motion in complex scenes from monocular videos is important for many applications, ranging from AR/VR to robotics. However, capturing realistic human-scene interactions, while dealing with occlusions and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Siwei Zhang , Yan Zhang , Federica Bogo , Marc Pollefeys , Siyu Tang

In general, hand pose estimation aims to improve the robustness of model performance in the real-world scenes. However, it is difficult to enhance the robustness since existing datasets are obtained in restricted environments to annotate 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Bosang Kim , Jonghyun Kim , Hyotae Lee , Lanying Jin , Jeongwon Ha , Dowoo Kwon , Jungpyo Kim , Wonhyeok Im , KyungMin Jin , Jungho Lee

Learning the prior knowledge of the 3D human-object spatial relation is crucial for reconstructing human-object interaction from images and understanding how humans interact with objects in 3D space. Previous works learn this prior from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Chaofan Huo , Ye Shi , Jingya Wang

Despite the recent success of single image-based 3D human pose and shape estimation methods, recovering temporally consistent and smooth 3D human motion from a video is still challenging. Several video-based methods have been proposed;…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Hongsuk Choi , Gyeongsik Moon , Ju Yong Chang , Kyoung Mu Lee

We present a simple yet effective method for skeleton-free motion retargeting. Previous methods transfer motion between high-resolution meshes, failing to preserve the inherent local-part motions in the mesh. Addressing this issue, our…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Haoyu Wang , Shaoli Huang , Fang Zhao , Chun Yuan , Ying Shan

We present MeshLeTemp, a powerful method for 3D human pose and mesh reconstruction from a single image. In terms of human body priors encoding, we propose using a learnable template human mesh instead of a constant template as utilized by…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Trung Tran-Quang , Cuong Than-Cao , Hai Nguyen-Thanh , Hong Hoang Si

We propose an end-to-end unified 3D mesh recovery of humans and quadruped animals trained in a weakly-supervised way. Unlike recent work focusing on a single target class only, we aim to recover 3D mesh of broader classes with a single…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Kim Youwang , Kim Ji-Yeon , Kyungdon Joo , Tae-Hyun Oh

Due to its geometric properties, hyperbolic space can support high-fidelity embeddings of tree- and graph-structured data, upon which various hyperbolic networks have been developed. Existing hyperbolic networks encode geometric priors not…

Machine Learning · Computer Science 2023-03-14 Tao Yu , Christopher De Sa

Metric learning aims to learn a highly discriminative model encouraging the embeddings of similar classes to be close in the chosen metrics and pushed apart for dissimilar ones. The common recipe is to use an encoder to extract embeddings…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Aleksandr Ermolov , Leyla Mirvakhabova , Valentin Khrulkov , Nicu Sebe , Ivan Oseledets