English
Related papers

Related papers: Constraint-Aware Diffusion Priors for High-Fidelit…

200 papers

Recently, large-scale diffusion models, e.g., Stable diffusion and DallE2, have shown remarkable results on image synthesis. On the other hand, large-scale cross-modal pre-trained models (e.g., CLIP, ALIGN, and FILIP) are competent for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Runhui Huang , Jianhua Han , Guansong Lu , Xiaodan Liang , Yihan Zeng , Wei Zhang , Hang Xu

LiDAR-based semantic segmentation is a key component for autonomous mobile robots, yet large-scale annotation of LiDAR point clouds is prohibitively expensive and time-consuming. Although simulators can provide labeled synthetic data,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Tomoya Miyawaki , Kazuto Nakashima , Yumi Iwashita , Ryo Kurazume

Diffusion models have recently gained significant attention in robotics due to their ability to generate multi-modal distributions of system states and behaviors. However, a key challenge remains: ensuring precise control over the generated…

Robotics · Computer Science 2025-10-01 Luobin Wang , Hongzhan Yu , Chenning Yu , Sicun Gao , Henrik Christensen

Unsupervised representation learning, particularly sequential disentanglement, aims to separate static and dynamic factors of variation in data without relying on labels. This remains a challenging problem, as existing approaches based on…

Machine Learning · Computer Science 2025-10-08 Hedi Zisling , Ilan Naiman , Nimrod Berman , Supasorn Suwajanakorn , Omri Azencot

Accurate modeling of robot dynamics is essential for model-based control, yet remains challenging under distributional shifts and real-time constraints. In this work, we formulate system identification as an in-context meta-learning problem…

Machine Learning · Computer Science 2026-04-21 Angelo Moroncelli , Matteo Rufolo , Gunes Cagin Aydin , Asad Ali Shahid , Loris Roveda

Legged locomotion demands controllers that are both robust and adaptable, while remaining compatible with task and safety considerations. However, model-free reinforcement learning (RL) methods often yield a fixed policy that can be…

Robotics · Computer Science 2025-10-07 Runhan Huang , Haldun Balim , Heng Yang , Yilun Du

Recent advances in offline Reinforcement Learning (RL) have proven that effective policy learning can benefit from imposing conservative constraints on pre-collected datasets. However, such static datasets often exhibit distribution bias,…

Machine Learning · Computer Science 2026-05-15 Yunpeng Qing , Yixiao Chi , Shuo Chen , Shunyu Liu , Kexuan Zhou , Sixu Lin , Litao Liu , Changqing Zou

Recent advancements in diffusion models have been effective in learning data priors for solving inverse problems. They leverage diffusion sampling steps for inducing a data prior while using a measurement guidance gradient at each step to…

Machine Learning · Computer Science 2025-04-02 Rayhan Zirvi , Bahareh Tolooshams , Anima Anandkumar

Current training of motion style transfer systems relies on consistency losses across style domains to preserve contents, hindering its scalable application to a large number of domains and private data. Recent image transfer works show the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Wenjie Yin , Yi Yu , Hang Yin , Danica Kragic , Mårten Björkman

In the context of continuously rising global air traffic, efficient and safe Conflict Detection and Resolution (CD&R) is paramount for air traffic management. Although Deep Reinforcement Learning (DRL) offers a promising pathway for CD&R…

Artificial Intelligence · Computer Science 2025-09-05 Tonghe Li , Jixin Liu , Weili Zeng , Hao Jiang

Visuomotor imitation learning policies enable robots to efficiently acquire manipulation skills from visual demonstrations. However, as scene complexity and visual distractions increase, policies that perform well in simple settings often…

Artificial Intelligence · Computer Science 2025-11-11 Yuhang Dong , Haizhou Ge , Yupei Zeng , Jiangning Zhang , Beiwen Tian , Hongrui Zhu , Yufei Jia , Ruixiang Wang , Zhucun Xue , Guyue Zhou , Longhua Ma , Guanzhong Tian

Learning priors on trajectory distributions can help accelerate robot motion planning optimization. Given previously successful plans, learning trajectory generative models as priors for a new planning problem is highly desirable. Prior…

Robotics · Computer Science 2024-03-27 Joao Carvalho , An T. Le , Mark Baierl , Dorothea Koert , Jan Peters

Text-to-image diffusion models often memorize training data, revealing a fundamental failure to generalize beyond the training set. Current mitigation strategies typically sacrifice image quality or prompt alignment to reduce memorization.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Sathwik Karnik , Juyeop Kim , Sanmi Koyejo , Jong-Seok Lee , Somil Bansal

Generative diffusion models for end-to-end autonomous driving often suffer from mode collapse, tending to generate conservative and homogeneous behaviors. While DiffusionDrive employs predefined anchors representing different driving…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jialv Zou , Shaoyu Chen , Bencheng Liao , Zhiyu Zheng , Yuehao Song , Lefei Zhang , Qian Zhang , Wenyu Liu , Xinggang Wang

Diffusion models promise efficient parallel text generation but rely on bidirectional attention, creating a structural mismatch with pre-trained Autoregressive (AR) models. This incompatibility precludes reusing robust AR priors,…

Computation and Language · Computer Science 2026-05-29 Xiangyu Ma , Teng Xiao , Zuchao Li , Lefei Zhang

This paper introduces DiffCarl, a diffusion-modeled carbon- and risk-aware reinforcement learning algorithm for intelligent operation of multi-microgrid systems. With the growing integration of renewables and increasing system complexity,…

Machine Learning · Computer Science 2025-07-24 Yunyi Zhao , Wei Zhang , Cheng Xiang , Hongyang Du , Dusit Niyato , Shuhua Gao

Diffusion models have recently emerged as effective generative frameworks for trajectory optimization, capable of producing high-quality and diverse solutions. However, training these models in a purely data-driven manner without explicit…

Robotics · Computer Science 2025-04-02 Anjian Li , Ryne Beeson

World Model-based Reinforcement Learning (WMRL) enables sample efficient policy learning by reducing the need for online interactions which can potentially be costly and unsafe, especially for autonomous driving. However, existing world…

Robotics · Computer Science 2025-03-11 Anant Garg , K Madhava Krishna

In autonomous driving tasks, trajectory prediction in complex traffic environments requires adherence to real-world context conditions and behavior multimodalities. Existing methods predominantly rely on prior assumptions or generative…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yiming Xu , Hao Cheng , Monika Sester

Acquiring aligned visuo-tactile datasets is slow and costly, requiring specialised hardware and large-scale data collection. Synthetic generation is promising, but prior methods are typically single-modality, limiting cross-modal learning.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Sirine Bhouri , Lan Wei , Jian-Qing Zheng , Dandan Zhang