English
Related papers

Related papers: JointDiff: Bridging Continuous and Discrete in Mul…

200 papers

Generating the motion of orchestral conductors from a given piece of symphony music is a challenging task since it requires a model to learn semantic music features and capture the underlying distribution of real conducting motion. Prior…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-14 Zhuoran Zhao , Jinbin Bai , Delong Chen , Debang Wang , Yubo Pan

Diffusion models have emerged as powerful generative frameworks by progressively adding noise to data through a forward process and then reversing this process to generate realistic samples. While these models have achieved strong…

Machine Learning · Computer Science 2025-03-04 Xingzhuo Guo , Yu Zhang , Baixu Chen , Haoran Xu , Jianmin Wang , Mingsheng Long

We introduce a framework for joint grounded scene graph - image generation, a challenging task involving high-dimensional, multi-modal structured data. To effectively model this complex joint distribution, we adopt a factorized approach:…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Bicheng Xu , Qi Yan , Renjie Liao , Lele Wang , Leonid Sigal

The generation of synthetic financial data is a critical technology in the financial domain, addressing challenges posed by limited data availability. Traditionally, statistical models have been employed to generate synthetic data. However,…

Computational Finance · Quantitative Finance 2025-03-07 Yuki Tanaka , Ryuji Hashimoto , Takehiro Takayanagi , Zhe Piao , Yuri Murayama , Kiyoshi Izumi

Collaborative 3D object detection holds significant importance in the field of autonomous driving, as it greatly enhances the perception capabilities of each individual agent by facilitating information exchange among multiple agents.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Zhe Huang , Shuo Wang , Yongcai Wang , Lei Wang

User mobility trajectory and mobile traffic data are essential for a wide spectrum of applications including urban planning, network optimization, and emergency management. However, large-scale and fine-grained mobility data remains…

Networking and Internet Architecture · Computer Science 2025-10-14 Ziyi Liu , Qingyue Long , Zhiwen Xue , Huandong Wang , Yong Li

Realistic scene-level multi-agent motion simulations are crucial for developing and evaluating self-driving algorithms. However, most existing works focus on generating trajectories for a certain single agent type, and typically ignore the…

Robotics · Computer Science 2023-11-28 Zhiming Guo , Xing Gao , Jianlan Zhou , Xinyu Cai , Botian Shi

The paradigm shift toward structure-driven molecule generation has been propelled by advances in deep generative models, such as variational auto-encoders and diffusion models. However, these generative models for molecular design remain…

Machine Learning · Computer Science 2026-04-17 Peidong Liu , Wenbo Zhang , Wei Ju , Jiancheng Lv , Xianggen Liu

Iterative generative models such as Flow Matching and Diffusion models have demonstrated strong test-time scaling behavior, where additional inference computation can improve generation quality. In contrast, Drift Models offer efficient…

Machine Learning · Computer Science 2026-05-19 Chenrui Ma , Xi Xiao , Lin Zhao , Tianyang Wang , Ferdinando Fioretto , Yanning Shen

Although autoregressive models have dominated language modeling in recent years, there has been a growing interest in exploring alternative paradigms to the conventional next-token prediction framework. Diffusion-based language models have…

Computation and Language · Computer Science 2025-10-23 Chihan Huang , Hao Tang

Layout generation aims to synthesize realistic graphic scenes consisting of elements with different attributes including category, size, position, and between-element relation. It is a crucial task for reducing the burden on heavy-duty…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Mude Hui , Zhizheng Zhang , Xiaoyi Zhang , Wenxuan Xie , Yuwang Wang , Yan Lu

Combining discrete and continuous data is an important capability for generative models. We present Discrete Flow Models (DFMs), a new flow-based model of discrete data that provides the missing link in enabling flow-based generative models…

Machine Learning · Statistics 2024-06-07 Andrew Campbell , Jason Yim , Regina Barzilay , Tom Rainforth , Tommi Jaakkola

Visual generation and understanding are two deeply interconnected aspects of human intelligence, yet they have been traditionally treated as separate tasks in machine learning. In this paper, we propose Jodi, a diffusion framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yifeng Xu , Zhenliang He , Meina Kan , Shiguang Shan , Xilin Chen

Diffusion models have emerged as a promising approach for text generation, with recent works falling into two main categories: discrete and continuous diffusion models. Discrete diffusion models apply token corruption independently using…

Computation and Language · Computer Science 2025-05-29 Bocheng Li , Zhujin Gao , Linli Xu

The sharing of microdata, such as fund holdings and derivative instruments, by regulatory institutions presents a unique challenge due to strict data confidentiality and privacy regulations. These challenges often hinder the ability of both…

Machine Learning · Computer Science 2023-09-06 Timur Sattarov , Marco Schreyer , Damian Borth

Accurate trajectory prediction is fundamental to autonomous driving, as it underpins safe motion planning and collision avoidance in complex environments. However, existing benchmark datasets suffer from a pronounced long-tail distribution…

Robotics · Computer Science 2025-10-06 Ruining Yang , Yi Xu , Yixiao Chen , Yun Fu , Lili Su

The efficiency of multi-agent systems driven by large language models (LLMs) largely hinges on their communication topology. However, designing an optimal topology is a non-trivial challenge, as it requires balancing competing objectives…

Computation and Language · Computer Science 2026-05-19 Eric Hanchen Jiang , Mengting Li , Guancheng Wan , Sophia Yin , Yuchen Wu , Xiao Liang , Xinfeng Li , Yizhou Sun , Wei Wang , Kai-Wei Chang , Ying Nian Wu

The recently developed discrete diffusion models perform extraordinarily well in the text-to-image task, showing significant promise for handling the multi-modality signals. In this work, we harness these traits and present a unified…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Minghui Hu , Chuanxia Zheng , Heliang Zheng , Tat-Jen Cham , Chaoyue Wang , Zuopeng Yang , Dacheng Tao , Ponnuthurai N. Suganthan

Reliable co-speech motion generation requires precise motion representation and consistent structural priors across all joints. Existing generative methods typically operate on local joint rotations, which are defined hierarchically based…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Xiangyue Zhang , Jianfang Li , Jianqiang Ren , Jiaxu Zhang

This paper introduces StructDiff, a generative framework based on a single-scale diffusion model for single-image generation. Single-image generation aims to synthesize diverse samples with similar visual content to the source image by…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yinxi He , Kang Liao , Chunyu Lin , Tianyi Wei , Yao Zhao