English
Related papers

Related papers: SimDiff: Simulator-constrained Diffusion Model for…

200 papers

Generating large-scale, physically consistent AC Optimal Power Flow (ACOPF) datasets is essential for modern data-driven power system applications. The central challenge lies in balancing solution accuracy with computational efficiency.…

Systems and Control · Electrical Eng. & Systems 2026-02-04 Shashank Shekhar , Abhinav Karn , Kris Keshav , Shivam Bansal , Parikshit Pareek

We propose a new class of generative models that naturally handle data of varying dimensionality by jointly modeling the state and dimension of each datapoint. The generative process is formulated as a jump diffusion process that makes…

Generative modeling within constrained sets is essential for scientific and engineering applications involving physical, geometric, or safety requirements (e.g., molecular generation, robotics). We present a unified framework for…

Machine Learning · Computer Science 2026-04-21 Kijung Jeon , Michael Muehlebach , Molei Tao

Goal-conditioned dynamic manipulation is inherently challenging due to complex system dynamics and stringent task constraints, particularly in deformable object scenarios characterized by high degrees of freedom and underactuation. Prior…

Robotics · Computer Science 2025-05-26 Guanzhou Lan , Yuqi Yang , Anup Teejo Mathew , Feiping Nie , Rong Wang , Xuelong Li , Federico Renda , Bin Zhao

While modern diffusion models excel at generating diverse single images, extending this to sequential generation reveals a fundamental challenge: balancing narrative dynamism with multi-character coherence. Existing methods often falter at…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Qi Zhao , Jun Chen , Ivor Tsang , Guang Dai

Simulation of autonomous vehicle systems requires that simulated traffic participants exhibit diverse and realistic behaviors. The use of prerecorded real-world traffic scenarios in simulation ensures realism but the rarity of safety…

Rapid urbanization demands accurate and efficient monitoring of turbulent wind patterns to support air quality, climate resilience and infrastructure design. Traditional sparse reconstruction and sensor placement strategies face major…

Creating graphic layouts is a fundamental step in graphic designs. In this work, we present a novel generative model named LayoutDiffusion for automatic layout generation. As layout is typically represented as a sequence of discrete tokens,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Junyi Zhang , Jiaqi Guo , Shizhao Sun , Jian-Guang Lou , Dongmei Zhang

Diffusion models have demonstrated strong potential for robotic trajectory planning. However, generating coherent trajectories from high-level instructions remains challenging, especially for long-range composition tasks requiring multiple…

Robotics · Computer Science 2024-03-29 Zhixuan Liang , Yao Mu , Hengbo Ma , Masayoshi Tomizuka , Mingyu Ding , Ping Luo

Denoising diffusion models are a novel class of generative algorithms that achieve state-of-the-art performance across a range of domains, including image generation and text-to-image tasks. Building on this success, diffusion models have…

Machine Learning · Computer Science 2024-03-08 Nic Fishman , Leo Klarner , Valentin De Bortoli , Emile Mathieu , Michael Hutchinson

Diffusion policies generate robot motions by learning to denoise action-space trajectories conditioned on observations. These observations are commonly streams of RGB images, whose high dimensionality includes substantial task-irrelevant…

Robotics · Computer Science 2025-09-18 Xiatao Sun , Yinxing Chen , Daniel Rakita

Synthesizing realistic human-object interaction motions is a critical problem in VR/AR and human animation. Unlike the commonly studied scenarios involving a single human or hand interacting with one object, we address a more generic…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Wenkun He , Yun Liu , Ruitao Liu , Li Yi

Diffusion and flow-based models have enabled significant progress in generation tasks across various modalities and have recently found applications in predictive learning. However, unlike typical generation tasks that encourage sample…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yu Zhang , Xingzhuo Guo , Haoran Xu , Jialong Wu , Mingsheng Long

Diffusion probabilistic model (DPM) recently becomes one of the hottest topic in computer vision. Its image generation application such as Imagen, Latent Diffusion Models and Stable Diffusion have shown impressive generation capabilities,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Junde Wu , Rao Fu , Huihui Fang , Yu Zhang , Yehui Yang , Haoyi Xiong , Huiying Liu , Yanwu Xu

Generative models have made remarkable advancements and are capable of producing high-quality content. However, performing controllable editing with generative models remains challenging, due to their inherent uncertainty in outputs. This…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Yikun Ma , Yiqing Li , Jiawei Wu , Xing Luo , Zhi Jin

Interactable objects are ubiquitous in our daily lives. Recent advances in 3D generative models make it possible to automate the modeling of these objects, benefiting a range of applications from 3D printing to the creation of robot…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Rundong Luo , Haoran Geng , Congyue Deng , Puhao Li , Zan Wang , Baoxiong Jia , Leonidas Guibas , Siyuan Huang

The human-like form of humanoid robots positions them uniquely to achieve the agility and versatility in motor skills that humans possess. Learning from human demonstrations offers a scalable approach to acquiring these capabilities.…

Robotics · Computer Science 2025-11-14 Qiayuan Liao , Takara E. Truong , Xiaoyu Huang , Yuman Gao , Guy Tevet , Koushil Sreenath , C. Karen Liu

Despite tremendous recent progress in human video generation, generative video diffusion models still struggle to capture the dynamics and physics of human motions faithfully. In this paper, we propose a new framework for human video…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Tao Hu , Varun Jampani

In recent years, diffusion models have demonstrated remarkable potential across diverse domains, from vision generation to language modeling. Transferring its generative capabilities to modern end-to-end autonomous driving systems has also…

Robotics · Computer Science 2025-09-17 Xuefeng Jiang , Yuan Ma , Pengxiang Li , Leimeng Xu , Xin Wen , Kun Zhan , Zhongpu Xia , Peng Jia , Xianpeng Lang , Sheng Sun

Creating novel images by fusing visual cues from multiple sources is a fundamental yet underexplored problem in image-to-image generation, with broad applications in artistic creation, virtual reality and visual media. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zeren Xiong , Yue Yu , Zedong Zhang , Shuo Chen , Jian Yang , Jun Li