English
Related papers

Related papers: Refining Diffusion Models for Motion Synthesis wit…

200 papers

Combining sparse IMUs and a monocular camera is a new promising setting to perform real-time human motion capture. This paper proposes a diffusion-based solution to learn human motion priors and fuse the two modalities of signals together…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Shaohua Pan , Xinyu Yi , Yan Zhou , Weihua Jian , Yuan Zhang , Pengfei Wan , Feng Xu

Our goal is to generate realistic human motion from natural language. Modern methods often face a trade-off between model expressiveness and text-to-motion alignment. Some align text and motion latent spaces but sacrifice expressiveness;…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Nefeli Andreou , Xi Wang , Victoria Fernández Abrevaya , Marie-Paule Cani , Yiorgos Chrysanthou , Vicky Kalogeiton

Inertial Measurement Unit (IMU) sensors are widely employed for Human Activity Recognition (HAR) due to their portability, energy efficiency, and growing research interest. However, a significant challenge for IMU-HAR models is achieving…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Qi Qiu , Tao Zhu , Furong Duan , Kevin I-Kai Wang , Liming Chen , Mingxing Nie , Mingxing Nie

Motion sensing and tracking with IMU data is essential for spatial intelligence, which however is challenging due to the presence of time-varying stochastic bias. IMU bias is affected by various factors such as temperature and vibration,…

Robotics · Computer Science 2025-05-20 Shenghao Zhou , Saimouli Katragadda , Guoquan Huang

Text-guided motion synthesis aims to generate 3D human motion that not only precisely reflects the textual description but reveals the motion details as much as possible. Pioneering methods explore the diffusion model for text-to-motion…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Zhenyu Xie , Yang Wu , Xuehao Gao , Zhongqian Sun , Wei Yang , Xiaodan Liang

Diffusion models have become a popular choice for human motion synthesis due to their powerful generative capabilities. However, their high computational complexity and large sampling steps pose challenges for real-time applications.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Lei Jiang , Ye Wei , Hao Ni

Automated evaluation of movement quality holds significant potential for enhancing physiotherapeutic treatments and sports training by providing objective, real-time feedback. However, the effectiveness of deep learning models in assessing…

Machine Learning · Computer Science 2025-06-02 Andreas Spilz , Heiko Oppel , Michael Munz

Due to the scarcity of labeled sensor data in HAR, prior research has turned to video data to synthesize Inertial Measurement Units (IMU) data, capitalizing on its rich activity annotations. However, generating IMU data from videos presents…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Vitor Fortes Rey , Lala Shakti Swarup Ray , Xia Qingxin , Kaishun Wu , Paul Lukowicz

Inertial measurement units (IMUs) are fundamental sensing components in multi-source integrated navigation systems, and their performance directly determines the accuracy and reliability of solutions. However, the precision of low-cost IMUs…

Signal Processing · Electrical Eng. & Systems 2026-05-19 Jiarui Lv , Feng Zhu , Xiaohong Zhang

A diffusion model, which is formulated to produce an image using thousands of denoising steps, usually suffers from a slow inference speed. Existing acceleration algorithms simplify the sampling by skipping most steps yet exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Mengfei Xia , Yujun Shen , Changsong Lei , Yu Zhou , Ran Yi , Deli Zhao , Wenping Wang , Yong-Jin Liu

Interactive Text-to-image retrieval (I-TIR) is an important enabler for a wide range of state-of-the-art services in domains such as e-commerce and education. However, current methods rely on finetuned Multimodal Large Language Models…

Information Retrieval · Computer Science 2025-07-11 Zijun Long , Kangheng Liang , Gerardo Aragon-Camarasa , Richard Mccreadie , Paul Henderson

Wearable sensors such as Inertial Measurement Units (IMUs) are often used to assess the performance of human exercise. Common approaches use handcrafted features based on domain expertise or automatically extracted features using time…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Ashish Singh , Antonio Bevilacqua , Timilehin B. Aderinola , Thach Le Nguyen , Darragh Whelan , Martin O'Reilly , Brian Caulfield , Georgiana Ifrim

Over the past decade, lidars have become a cornerstone of robotics state estimation and perception thanks to their ability to provide accurate geometric information about their surroundings in the form of 3D scans. Unfortunately, most of…

Robotics · Computer Science 2024-10-08 Cedric Le Gentil , Raphael Falque , Teresa Vidal-Calleja

Diffusion models have been successfully adapted to text generation tasks by mapping the discrete text into the continuous space. However, there exist nonnegligible gaps between training and inference, owing to the absence of the forward…

Computation and Language · Computer Science 2023-05-09 Zecheng Tang , Pinzheng Wang , Keyan Zhou , Juntao Li , Ziqiang Cao , Min Zhang

Multiple rigidly attached Inertial Measurement Unit (IMU) sensors provide a richer flow of data compared to a single IMU. State-of-the-art methods follow a probabilistic model of IMU measurements based on the random nature of errors…

Robotics · Computer Science 2022-09-20 Marsel Faizullin , Gonzalo Ferrer

Flow and diffusion models have demonstrated strong performance and training stability across various tasks but lack two critical properties of simulation-based methods: freedom of dimensionality and adaptability to different inference…

Machine Learning · Computer Science 2025-08-13 Dohoon Lee , Jaehyun Park , Hyunwoo J. Kim , Kyogu Lee

This paper presents a motion data augmentation scheme incorporating motion synthesis encouraging diversity and motion correction imposing physical plausibility. This motion synthesis consists of our modified Variational AutoEncoder (VAE)…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Takahiro Maeda , Norimichi Ukita

Diffusion models are a powerful generative framework, but come with expensive inference. Existing acceleration methods often compromise image quality or fail under complex conditioning when operating in an extremely low-step regime. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Jonas Kohler , Albert Pumarola , Edgar Schönfeld , Artsiom Sanakoyeu , Roshan Sumbaly , Peter Vajda , Ali Thabet

Human Activity Recognition (HAR) with wearable sensors is essential for applications in healthcare, fitness, and human-computer interaction. Bio-impedance sensing offers unique advantages for fine-grained motion capture but remains…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Lala Shakti Swarup Ray , Mengxi Liu , Deepika Gurung , Bo Zhou , Sungho Suh , Paul Lukowicz

Text-driven human motion generation based on diffusion strategies establishes a reliable foundation for multimodal applications in human-computer interactions. However, existing advances face significant efficiency challenges due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Mengxian Hu , Minghao Zhu , Xun Zhou , Qingqing Yan , Shu Li , Chengju Liu , Qijun Chen