English
Related papers

Related papers: DiMSam: Diffusion Models as Samplers for Task and …

200 papers

The reconstruction of unsteady flow fields from limited measurements is a challenging and crucial task for many engineering applications. Machine learning models are gaining popularity for solving this problem due to their ability to learn…

Fluid Dynamics · Physics 2026-01-09 Marc Amorós-Trepat , Luis Medrano-Navarro , Qiang Liu , Luca Guastoni , Nils Thuerey

Complex manipulation tasks require careful integration of symbolic reasoning and motion planning. This problem, commonly referred to as Task and Motion Planning (TAMP), is even more challenging if the workspace is non-static, e.g. due to…

Robotics · Computer Science 2021-08-31 Nicola Castaman , Enrico Pagello , Emanuele Menegatti , Alberto Pretto

Autonomous agents rely on sensor data to construct representations of their environments, essential for predicting future events and planning their actions. However, sensor measurements suffer from limited range, occlusions, and sensor…

Despite recent progress improving the efficiency and quality of motion planning, planning collision-free and dynamically-feasible trajectories in partially-mapped environments remains challenging, since constantly replanning as unseen…

Robotics · Computer Science 2023-06-16 Abhish Khanal , Hoang-Dung Bui , Gregory J. Stein , Erion Plaku

In this paper, we propose a deep convolutional recurrent neural network that predicts action sequences for task and motion planning (TAMP) from an initial scene image. Typical TAMP problems are formalized by combining reasoning on a…

Machine Learning · Computer Science 2020-06-11 Danny Driess , Jung-Su Ha , Marc Toussaint

Controllable layout generation aims at synthesizing plausible arrangement of element bounding boxes with optional constraints, such as type or position of a specific element. In this work, we try to solve a broad range of layout generation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Naoto Inoue , Kotaro Kikuchi , Edgar Simo-Serra , Mayu Otani , Kota Yamaguchi

Obtaining accurate estimates of uncertainty in climate scenarios often requires generating large ensembles of high-resolution climate simulations, a computationally expensive and memory intensive process. To address this challenge, we train…

Machine Learning · Computer Science 2024-07-08 Johannes Meuer , Maximilian Witte , Tobias Sebastian Finn , Claudia Timmreck , Thomas Ludwig , Christopher Kadow

We present a framework for learning to guide geometric task and motion planning (GTAMP). GTAMP is a subclass of task and motion planning in which the goal is to move multiple objects to target regions among movable obstacles. A standard…

Robotics · Computer Science 2022-03-10 Beomjoon Kim , Luke Shimanuki , Leslie Pack Kaelbling , Tomás Lozano-Pérez

Addressing real-world optimization problems becomes particularly challenging when analytic objective functions or constraints are unavailable. While numerous studies have addressed the issue of unknown objectives, limited research has…

Limited data is a common problem in remote sensing due to the high cost of obtaining annotated samples. In the few-shot segmentation task, models are typically trained on base classes with abundant annotations and later adapted to novel…

Image and Video Processing · Electrical Eng. & Systems 2025-03-07 Steve Andreas Immanuel , Woojin Cho , Junhyuk Heo , Darongsae Kwon

Diffusion models are state-of-the-art methods in generative modeling when samples from a target probability distribution are available, and can be efficiently sampled, using score matching to estimate score vectors guiding a Langevin…

Machine Learning · Statistics 2024-06-21 Omar Chehab , Anna Korba

Human trajectory data is crucial in urban planning, traffic engineering, and public health. However, directly using real-world trajectory data often faces challenges such as privacy concerns, data acquisition costs, and data quality. A…

Machine Learning · Computer Science 2025-11-05 Qingyue Long , Can Rong , Tong Li , Yong Li

We propose Parallelised Diffeomorphic Sampling-based Motion Planning (PDMP). PDMP is a novel parallelised framework that uses bijective and differentiable mappings, or diffeomorphisms, to transform sampling distributions of sampling-based…

Robotics · Computer Science 2021-09-24 Tin Lai , Weiming Zhi , Tucker Hermans , Fabio Ramos

This paper presents Latent Sampling-based Motion Planning (L-SBMP), a methodology towards computing motion plans for complex robotic systems by learning a plannable latent representation. Recent works in control of robotic systems have…

Robotics · Computer Science 2018-11-07 Brian Ichter , Marco Pavone

As autonomous driving systems being deployed to millions of vehicles, there is a pressing need of improving the system's scalability, safety and reducing the engineering cost. A realistic, scalable, and practical simulator of the driving…

Robotics · Computer Science 2024-07-04 Yihan Hu , Siqi Chai , Zhening Yang , Jingyu Qian , Kun Li , Wenxin Shao , Haichao Zhang , Wei Xu , Qiang Liu

Autonomous driving technology has seen significant advancements, but existing models often fail to fully capture the complexity of multi-agent environments, where interactions between dynamic agents are critical. To address this, we propose…

Artificial Intelligence · Computer Science 2024-11-05 Liu Yunhao , Ding Hong , Zhang Ziming , Wang Huixin , Liu Jinzhao , Xi Suyang

Task and motion planning represents a powerful set of hybrid planning methods that combine reasoning over discrete task domains and continuous motion generation. Traditional reasoning necessitates task domain models and enough information…

Robotics · Computer Science 2024-06-14 Tianyang Pan , Rahul Shome , Lydia E. Kavraki

This study proposes a hierarchically integrated framework for safe task and motion planning (TAMP) of bipedal locomotion in a partially observable environment with dynamic obstacles and uneven terrain. The high-level task planner employs…

Systems and Control · Electrical Eng. & Systems 2023-03-09 Abdulaziz Shamsah , Zhaoyuan Gu , Jonas Warnke , Seth Hutchinson , Ye Zhao

Planning for robotic manipulation requires reasoning about the changes a robot can affect on objects. When such interactions can be modelled analytically, as in domains with rigid objects, efficient planning algorithms exist. However, in…

Robotics · Computer Science 2019-05-14 Angelina Wang , Thanard Kurutach , Kara Liu , Pieter Abbeel , Aviv Tamar

We introduce a novel state-space architecture for diffusion models, effectively harnessing spatial and frequency information to enhance the inductive bias towards local features in input images for image generation tasks. While state-space…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Hao Phung , Quan Dao , Trung Dao , Hoang Phan , Dimitris Metaxas , Anh Tran