English
Related papers

Related papers: Cross-Modal Diffusion for Biomechanical Dynamical …

200 papers

Disentanglement is a useful property in representation learning which increases the interpretability of generative models such as Variational autoencoders (VAE), Generative Adversarial Models, and their many variants. Typically in such…

Machine Learning · Computer Science 2022-05-31 Arun Pandey , Michael Fanuel , Joachim Schreurs , Johan A. K. Suykens

Recent work has explored a range of model families for human motion generation, including Variational Autoencoders (VAEs), Generative Adversarial Networks (GANs), and diffusion-based models. Despite their differences, many methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 David Björkstrand , Tiesheng Wang , Lars Bretzner , Josephine Sullivan

Inferring 3D human motion is fundamental in many applications, including understanding human activity and analyzing one's intention. While many fruitful efforts have been made to human motion prediction, most approaches focus on pose-driven…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Xuehao Gao , Yang Yang , Yang Wu , Shaoyi Du , Guo-Jun Qi

Recently, the application of diffusion probabilistic models has advanced speech enhancement through generative approaches. However, existing diffusion-based methods have focused on the generation process in high-dimensional waveform or…

Sound · Computer Science 2025-01-20 Shengkui Zhao , Zexu Pan , Kun Zhou , Yukun Ma , Chong Zhang , Bin Ma

In this paper we present a fully distributed, asynchronous, and general purpose optimization algorithm for Consensus Simultaneous Localization and Mapping (CSLAM). Multi-robot teams require that agents have timely and accurate solutions to…

Robotics · Computer Science 2024-03-20 Daniel McGann , Kyle Lassak , Michael Kaess

Diffusion language models (DLMs) have emerged as a promising alternative to autoregressive (AR) generation, yet their reliance on Transformer backbones limits inference efficiency due to quadratic attention or KV-cache overhead. We…

Machine Learning · Computer Science 2026-03-02 Vaibhav Singh , Oleksiy Ostapenko , Pierre-André Noël , Eugene Belilovsky , Torsten Scholak

Recently, generative machine-learning models have gained popularity in physics, driven by the goal of improving the efficiency of Markov chain Monte Carlo techniques and of exploring their potential in capturing experimental data…

Statistical Mechanics · Physics 2021-09-03 Japneet Singh , Vipul Arora , Vinay Gupta , Mathias S. Scheurer

Finding appropriate low dimensional representations of high-dimensional multi-modal data can be challenging, since each modality embodies unique deformations and interferences. In this paper, we address the problem using manifold learning,…

Signal Processing · Electrical Eng. & Systems 2018-08-23 Tal Shnitzer , Mirela Ben-Chen , Leonidas Guibas , Ronen Talmon , Hau-Tieng Wu

Modern ultra-high-resolution image synthesis relies heavily on the robust generative capacity of large-scale pre-trained Latent Diffusion Models (LDMs). While recent representation alignment methods have proven effective by distilling…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Jinjin Zhang , Xiefan Guo , Di Huang

Text-to-motion generation holds significant potential for cross-linguistic applications, yet it is hindered by the lack of bilingual datasets and the poor cross-lingual semantic understanding of existing language models. To address these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Wanjiang Weng , Xiaofeng Tan , Xiangbo Shu , Guo-Sen Xie , Pan Zhou , Hongsong Wang

Human pose, action, and motion generation are critical for applications in digital humans, character animation, and humanoid robotics. However, many existing methods struggle to produce physically plausible movements that are consistent…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Zixi Kang , Xinghan Wang , Yadong Mu

Vision-Language-Action (VLA) models have recently emerged, demonstrating strong generalization in robotic scene understanding and manipulation. However, when confronted with long-horizon tasks that require defined goal states, such as LEGO…

Interleaved text-image generation aims to jointly produce coherent visual frames and aligned textual descriptions within a single sequence, enabling tasks such as style transfer, compositional synthesis, and procedural tutorials. We present…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Mingcheng Ye , Jiaming Liu , Yiren Song

Diffusion models have made significant strides in language-driven and layout-driven image generation. However, most diffusion models are limited to visible RGB image generation. In fact, human perception of the world is enriched by diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Zeyu Wang , Jingyu Lin , Yifei Qian , Yi Huang , Shicen Tian , Bosong Chai , Juncan Deng , Qu Yang , Lan Du , Cunjian Chen , Kejie Huang

Non-contrast CT (NCCT) imaging may reduce image contrast and anatomical visibility, potentially increasing diagnostic uncertainty. In contrast, contrast-enhanced CT (CECT) facilitates the observation of regions of interest (ROI). Leading…

Image and Video Processing · Electrical Eng. & Systems 2024-11-18 Tingyi Lin , Pengju Lyu , Jie Zhang , Yuqing Wang , Cheng Wang , Jianjun Zhu

While Diffusion Large Language Models (dLLMs) offer structural advantages for global planning, efficiently verifying that they arrive at correct answers via valid reasoning traces remains a critical challenge. In this work, we propose a…

Machine Learning · Computer Science 2026-05-28 Jiaoyang Ruan , Xin Gao , Yinda Chen , Hengyu Zeng , Liang Du , Guanghao Li , Jie Fu , Jian Pu

We introduce beta diffusion, a novel generative modeling method that integrates demasking and denoising to generate data within bounded ranges. Using scaled and shifted beta distributions, beta diffusion utilizes multiplicative transitions…

Machine Learning · Computer Science 2023-12-27 Mingyuan Zhou , Tianqi Chen , Zhendong Wang , Huangjie Zheng

Diffusion-based generative models have achieved promising results recently, but raise an array of open questions in terms of conceptual understanding, theoretical analysis, algorithm improvement and extensions to discrete, structured,…

Machine Learning · Computer Science 2022-09-01 Xingchao Liu , Lemeng Wu , Mao Ye , Qiang Liu

Generating realistic human motion sequences from text descriptions is a challenging task that requires capturing the rich expressiveness of both natural language and human motion.Recent advances in diffusion models have enabled significant…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Beibei Jing , Youjia Zhang , Zikai Song , Junqing Yu , Wei Yang

We present InterHandGen, a novel framework that learns the generative prior of two-hand interaction. Sampling from our model yields plausible and diverse two-hand shapes in close interaction with or without an object. Our prior can be…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Jihyun Lee , Shunsuke Saito , Giljoo Nam , Minhyuk Sung , Tae-Kyun Kim