English
Related papers

Related papers: Bridging Semantic and Kinematic Conditions with Di…

200 papers

Recent advancements in generative models have highlighted the crucial role of image tokenization in the efficient synthesis of high-resolution images. Tokenization, which transforms images into latent representations, reduces computational…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Qihang Yu , Mark Weber , Xueqing Deng , Xiaohui Shen , Daniel Cremers , Liang-Chieh Chen

While 2D diffusion models have achieved remarkable success in identity-preserving personalization, extending this capability to 3D assets remains a significant challenge due to the complexities of multi-view consistency and spatial control.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jinxin Ai , Matthias Nießner , Ziya Erkoç

Despite recent advances in 3D human motion generation (MoGen) on standard benchmarks, existing text-to-motion models still face a fundamental bottleneck in their generalization capability. In contrast, adjacent generative fields, most…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jing Lin , Ruisi Wang , Junzhe Lu , Ziqi Huang , Guorui Song , Ailing Zeng , Xian Liu , Chen Wei , Wanqi Yin , Qingping Sun , Zhongang Cai , Lei Yang , Ziwei Liu

Motion generation from discrete quantization offers many advantages over continuous regression, but at the cost of inevitable approximation errors. Previous methods usually quantize the entire body pose into one code, which not only faces…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Weihao Yuan , Weichao Shen , Yisheng He , Yuan Dong , Xiaodong Gu , Zilong Dong , Liefeng Bo , Qixing Huang

The acquisition cost for large, annotated motion datasets remains a critical bottleneck for skeletal-based Human Activity Recognition (HAR). Although Text-to-Motion (T2M) generative models offer a compelling, scalable source of synthetic…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Luca Cazzola , Ahed Alboody

The objective of the multi-condition human motion synthesis task is to incorporate diverse conditional inputs, encompassing various forms like text, music, speech, and more. This endows the task with the capability to adapt across multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zeyu Ling , Bo Han , Yongkang Wong , Mohan Kangkanhalli , Weidong Geng

Despite significant advancements in human motion generation, current motion representations, typically formulated as discrete frame sequences, still face two critical limitations: (i) they fail to capture motion from a multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Zan Wang , Jingze Zhang , Yixin Chen , Baoxiong Jia , Wei Liang , Siyuan Huang

Recent advances in visual generation have emphasized the importance of Latent Generative Models (LGMs), which critically depend on effective visual tokenizers to bridge pixels and semantic representations. However, tokenizers constructed on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Mingkai Jia , Mingxiao Li , Zhijian Shu , Anlin Zheng , Liaoyuan Fan , Jiaxin Guo , Tianxing Shi , Dongyue Lu , Zeming Li , Xiaoyang Guo , Xiaojuan Qi , Xiao-Xiao Long , Qian Zhang , Ping Tan , Wei Yin

Diffusion-based visuomotor policies perform well in robotic manipulation, yet current methods still inherit image-generation-style decoders and multi-step sampling. We revisit this design from a frequency-domain perspective. Robot action…

Robotics · Computer Science 2026-05-12 Jinhao Zhang , Zhexuan Zhou , Huizhe Li , Yichen Lai , Wenlong Xia , Haoming Song , Youmin Gong , Jie Mei

While significant progress has been achieved in multimodal facial generation using semantic masks and textual descriptions, conventional feature fusion approaches often fail to enable effective cross-modal interactions, thereby leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Yushe Cao , Dianxi Shi , Xing Fu , Xuechao Zou , Haikuo Peng , Xueqi Li , Chun Yu , Junliang Xing

Image tokenization plays a central role in modern generative modeling by mapping visual inputs into compact representations that serve as an intermediate signal between pixels and generative models. Diffusion-based decoders have recently…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Chuhan Wang , Hao Chen

We present Diff3F as a simple, robust, and class-agnostic feature descriptor that can be computed for untextured input shapes (meshes or point clouds). Our method distills diffusion features from image foundational models onto input shapes.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Niladri Shekhar Dutt , Sanjeev Muralikrishnan , Niloy J. Mitra

In this study, we introduce a learning-based method for generating high-quality human motion sequences from text descriptions (e.g., ``A person walks forward"). Existing techniques struggle with motion diversity and smooth transitions in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Weilin Wan , Yiming Huang , Shutong Wu , Taku Komura , Wenping Wang , Dinesh Jayaraman , Lingjie Liu

Human motion synthesis conditioned on textual input has gained significant attention in recent years due to its potential applications in various domains such as gaming, film production, and virtual reality. Conditioned Motion synthesis…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Avinash Amballa , Gayathri Akkinapalli , Vinitra Muralikrishnan

Tokenizing images into compact visual representations is a key step in learning efficient and high-quality image generative models. We present a simple diffusion tokenizer (DiTo) that learns compact visual representations for image…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Yinbo Chen , Rohit Girdhar , Xiaolong Wang , Sai Saketh Rambhatla , Ishan Misra

Diffusion models have emerged as a powerful class of generative models for molecular design, capable of capturing complex structural distributions and achieving high fidelity in 3D molecule generation. However, their widespread use remains…

Machine Learning · Computer Science 2026-01-15 Adrita Das , Peiran Jiang , Dantong Zhu , Barnabas Poczos , Jose Lugo-Martinez

Diffusion language models generate text through iterative refinement, a process that is often computationally inefficient because many tokens reach stability long before the final denoising step. We introduce a training-free, token-level…

Machine Learning · Computer Science 2026-02-12 Zahar Kohut , Severyn Shykula , Dmytro Khamula , Mykola Vysotskyi , Taras Rumezhak , Volodymyr Karpiv

The bifurcation of generative modeling into autoregressive approaches for discrete data (text) and diffusion approaches for continuous data (images) hinders the development of truly unified multimodal systems. While Masked Language Models…

Computation and Language · Computer Science 2026-01-08 Yuanfeng Xu , Yuhao Chen , Liang Lin , Guangrun Wang

Three-dimensional molecular generators based on diffusion models can now reach near-crystallographic accuracy, yet they remain fragmented across tasks. SMILES-only inputs, two-stage pretrain-finetune pipelines, and one-task-one-model…

Biomolecules · Quantitative Biology 2025-07-11 Dong Xu , Zhangfan Yang , Sisi Yuan , Jenna Xinyi Yao , Jiangqiang Li , Junkai Ji

Diffusion Language Models (DLMs) offer a promising alternative for language modeling by enabling parallel decoding through iterative refinement. However, most DLMs rely on hard binary masking and discrete token assignments, which hinder the…

Computation and Language · Computer Science 2026-01-19 Linhao Zhong , Linyu Wu , Bozhen Fang , Tianjian Feng , Chenchen Jing , Wen Wang , Jiaheng Zhang , Hao Chen , Chunhua Shen