English
Related papers

Related papers: ActFormer: A GAN-based Transformer towards General…

200 papers

Accepted in the ICIP 2025 We present a novel transformer-based framework for whole-body grasping that addresses both pose generation and motion infilling, enabling realistic and stable object interactions. Our pipeline comprises three…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Edward Effendy , Kuan-Wei Tseng , Rei Kawakami

Unsupervised generation of clothed virtual humans with various appearance and animatable poses is important for creating 3D human avatars and other AR/VR applications. Existing methods are either limited to rigid object modeling, or not…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

In this paper, we address the challenge of generating realistic 3D human motions for action classes that were never seen during the training phase. Our approach involves decomposing complex actions into simpler movements, specifically those…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Lorenzo Mandelli , Stefano Berretti

Text-guided human motion generation has drawn significant interest because of its impactful applications spanning animation and robotics. Recently, application of diffusion models for motion generation has enabled improvements in the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Samaneh Azadi , Akbar Shah , Thomas Hayes , Devi Parikh , Sonal Gupta

We revisit human motion synthesis, a task useful in various real world applications, in this paper. Whereas a number of methods have been developed previously for this task, they are often limited in two aspects: focusing on the poses while…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Jingbo Wang , Sijie Yan , Bo Dai , Dahua LIn

Multi-agent trajectory prediction is a fundamental problem in autonomous driving. The key challenges in prediction are accurately anticipating the behavior of surrounding agents and understanding the scene context. To address these…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Elmira Amirloo , Amir Rasouli , Peter Lakner , Mohsen Rohani , Jun Luo

Generating 3D dances from music is an emerged research task that benefits a lot of applications in vision and graphics. Previous works treat this task as sequence generation, however, it is challenging to render a music-aligned long-term…

Artificial Intelligence · Computer Science 2023-07-28 Buyu Li , Yongchi Zhao , Zhelun Shi , Lu Sheng

Synthesizing natural human motions that enable a 3D human avatar to walk and reach for arbitrary goals in 3D space remains an unsolved problem with many applications. Existing methods (data-driven or using reinforcement learning) are…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Markos Diomataris , Nikos Athanasiou , Omid Taheri , Xi Wang , Otmar Hilliges , Michael J. Black

This paper presents a novel framework for modeling and conditional generation of 3D articulated objects. Troubled by flexibility-quality tradeoffs, existing methods are often limited to using predefined structures or retrieving shapes from…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Jiayi Su , Youhe Feng , Zheng Li , Jinhua Song , Yangfan He , Botao Ren , Botian Xu

Algorithms for the action segmentation task typically use temporal models to predict what action is occurring at each frame for a minute-long daily activity. Recent studies have shown the potential of Transformer in modeling the relations…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Fangqiu Yi , Hongyu Wen , Tingting Jiang

Human Activity Recognition (HAR) has recently witnessed advancements with Transformer-based models. Especially, ActionFormer shows us a new perspectives for HAR in the sense that this approach gives us additional outputs which detect the…

Machine Learning · Computer Science 2025-05-28 Kunpeng Zhao , Asahi Miyazaki , Tsuyoshi Okita

We tackle the problem of generating long-term 3D human motion from multiple action labels. Two main previous approaches, such as action- and motion-conditioned methods, have limitations to solve this problem. The action-conditioned methods…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Taeryung Lee , Gyeongsik Moon , Kyoung Mu Lee

Grasping manipulation is a fundamental mode for human interaction with daily life objects. The synthesis of grasping motion is also greatly demanded in many applications such as animation and robotics. In objects grasping research field,…

Robotics · Computer Science 2024-10-04 Quanquan Shao , Yi Fang

Skeleton-based human action recognition leverages sequences of human joint coordinates to identify actions performed in videos. Owing to the intrinsic spatiotemporal structure of skeleton data, Graph Convolutional Networks (GCNs) have been…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yusen Peng , Alper Yilmaz

Synthesising the spatial and temporal dynamics of the human body skeleton remains a challenging task, not only in terms of the quality of the generated shapes, but also of their diversity, particularly to synthesise realistic body movements…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Bruno Degardin , João Neves , Vasco Lopes , João Brito , Ehsan Yaghoubi , Hugo Proença

We consider the problem of synthesizing multi-action human motion sequences of arbitrary lengths. Existing approaches have mastered motion sequence generation in single action scenarios, but fail to generalize to multi-action and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Rania Briq , Chuhang Zou , Leonid Pishchulin , Chris Broaddus , Juergen Gall

This paper proposes the Transition Motion Tensor, a data-driven framework that creates novel and physically accurate transitions outside of the motion dataset. It enables simulated characters to adopt new motion skills efficiently and…

Robotics · Computer Science 2021-12-01 Jonathan Hans Soeseno , Ying-Sheng Luo , Trista Pei-Chun Chen , Wei-Chao Chen

Data generation is a data augmentation technique for enhancing the generalization ability for skeleton-based human action recognition. Most existing data generation methods face challenges to ensure the temporal consistency of the dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Long Liu , Xin Wang , Fangming Li , Jiayu Chen

Human motion generation aims to produce plausible human motion sequences according to various conditional inputs, such as text or audio. Despite the feasibility of existing methods in generating motion based on short prompts and simple…

Multimedia · Computer Science 2024-11-12 Bo Han , Hao Peng , Minjing Dong , Yi Ren , Yixuan Shen , Chang Xu

Dynamic scene reconstruction is a long-term challenge in 3D vision. Recent methods extend 3D Gaussian Splatting to dynamic scenes via additional deformation fields and apply explicit constraints like motion flow to guide the deformation.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 DaDong Jiang , Zhihui Ke , Xiaobo Zhou , Zhi Hou , Xianghui Yang , Wenbo Hu , Tie Qiu , Chunchao Guo