English
Related papers

Related papers: Heracles: Bridging Precise Tracking and Generative…

200 papers

Video data is more cost-effective than motion capture data for learning 3D character motion controllers, yet synthesizing realistic and diverse behaviors directly from videos remains challenging. Previous approaches typically rely on…

Graphics · Computer Science 2025-12-10 Jianan Li , Xiao Chen , Tao Huang , Tien-Tsin Wong

Recent years have seen substantial progress in diffusion-based controllable video generation. However, achieving precise control in complex scenarios, including fine-grained object parts, sophisticated motion trajectories, and coherent…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Haitao Zhou , Chuang Wang , Rui Nie , Jinlin Liu , Dongdong Yu , Qian Yu , Changhu Wang

Generating long-term, coherent, and realistic music-conditioned dance sequences remains a challenging task in human motion synthesis. Existing approaches exhibit critical limitations: motion graph methods rely on fixed template libraries,…

Sound · Computer Science 2025-06-04 Mingyang Huang , Peng Zhang , Bang Zhang

Learning directly from human demonstration videos is a key milestone toward scalable and generalizable robot learning. Yet existing methods rely on intermediate representations such as keypoints or trajectories, introducing information loss…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Yiren Song , Cheng Liu , Weijia Mao , Mike Zheng Shou

The integration of Large Language Models (LLMs) into enterprise knowledge management systems has been catalyzed by the Retrieval-Augmented Generation (RAG) paradigm, which augments parametric memory with non-parametric external data.…

Information Retrieval · Computer Science 2026-03-02 Weixi Lin

We introduce Diffusion Parametric Head Models (DPHMs), a generative model that enables robust volumetric head reconstruction and tracking from monocular depth sequences. While recent volumetric head models, such as NPHMs, can now excel in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Jiapeng Tang , Angela Dai , Yinyu Nie , Lev Markhasin , Justus Thies , Matthias Niessner

Urban search and rescue missions require rapid first response to minimize loss of life and damage. Often, such efforts are assisted by humanitarian robots which need to handle dynamic operational conditions such as uneven and rough…

Robotics · Computer Science 2024-01-09 Nishaant Shah , Kshitij Tiwari , Aniket Bera

Generalist humanoid motion trackers have recently achieved strong simulation metrics by scaling data and training, yet often remain brittle on hardware during sustained teleoperation due to interface- and dynamics-induced errors. We present…

While diffusion models are powerful in generating high-quality, diverse synthetic data for object-centric tasks, existing methods struggle with scene-aware tasks such as Visual Question Answering (VQA) and Human-Object Interaction (HOI)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Minh-Quan Le , Gaurav Mittal , Tianjian Meng , A S M Iftekhar , Vishwas Suryanarayanan , Barun Patra , Dimitris Samaras , Mei Chen

Modern video diffusion models excel at appearance synthesis but still struggle with physical consistency: objects drift, collisions lack realistic rebound, and material responses seldom match their underlying properties. We present PhyCo, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Sriram Narayanan , Ziyu Jiang , Srinivasa Narasimhan , Manmohan Chandraker

There is a rapidly growing interest in controlling consistency across multiple generated images using diffusion models. Among various methods, recent works have found that simply manipulating attention modules by concatenating features from…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Jiaojiao Fan , Haotian Xue , Qinsheng Zhang , Yongxin Chen

Controlling the evolution of complex physical systems is a fundamental task across science and engineering. Classical techniques suffer from limited applicability or huge computational costs. On the other hand, recent deep learning and…

Machine Learning · Computer Science 2024-10-31 Long Wei , Peiyan Hu , Ruiqi Feng , Haodong Feng , Yixuan Du , Tao Zhang , Rui Wang , Yue Wang , Zhi-Ming Ma , Tailin Wu

Large Vision-Language-Action (VLA) models, leveraging powerful pre trained Vision-Language Models (VLMs) backends, have shown promise in robotic control due to their impressive generalization ability. However, the success comes at a cost.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Jianke Zhang , Yanjiang Guo , Xiaoyu Chen , Yen-Jen Wang , Yucheng Hu , Chengming Shi , Jianyu Chen

Humanoid robots show promise for complex whole-body tasks in unstructured environments. Although Human-Object Interaction (HOI) has advanced, most methods focus on fully actuated objects rigidly coupled to the robot, ignoring underactuated…

Tracking of dynamic people in cluttered and crowded human-centered environments is a challenging robotics problem due to the presence of intraclass variations including occlusions, pose deformations, and lighting variations. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Angus Fung , Beno Benhabib , Goldie Nejat

The Diffusion Transformer plays a pivotal role in advancing text-to-image and text-to-video generation, owing primarily to its inherent scalability. However, existing controlled diffusion transformer methods incur significant parameter and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Ke Cao , Jing Wang , Ao Ma , Jiasong Feng , Xuanhua He , Run Ling , Haowei Liu , Jian Lu , Wei Feng , Haozhe Wang , Hongjuan Pei , Yihua Shao , Zhanjie Zhang , Jie Zhang

The surge in generative AI workloads has created a need for scalable inference systems that can flexibly harness both GPUs and specialized accelerators while containing operational costs. This paper proposes a hardware-agnostic control loop…

Performance · Computer Science 2025-03-28 Yahav Biran , Imry Kissos

Diffusion models have recently gained significant attention in robotics due to their ability to generate multi-modal distributions of system states and behaviors. However, a key challenge remains: ensuring precise control over the generated…

Robotics · Computer Science 2025-10-01 Luobin Wang , Hongzhan Yu , Chenning Yu , Sicun Gao , Henrik Christensen

We address the problem of coordinating a team of robots to cover an unknown environment while ensuring safe operation and avoiding collisions with non-cooperative agents. Traditional coverage strategies often rely on simplified assumptions,…

Robotics · Computer Science 2026-02-23 Mattia Catellani , Marta Gabbi , Lorenzo Sabattini

This paper presents a generalized flexible Hybrid Cable-Driven Robot (HCDR). For the proposed HCDR, the derivation of the equations of motion and proof provide a very effective way to find items for generalized system modeling. The proposed…

Robotics · Computer Science 2024-10-30 Ronghuai Qi , Amir Khajepour , William W. Melek