English
Related papers

Related papers: Visual Foresight for Robotic Stow: A Diffusion-Bas…

200 papers

Persistent monitoring of a spatiotemporal fluid process requires data sampling and predictive modeling of the process being monitored. In this paper we present PASST algorithm: Predictive-model based Adaptive Sampling of a Spatio-Temporal…

Robotics · Computer Science 2023-04-04 Sandeep Manjanna , Tom Z. Jiahao , M. Ani Hsieh

Diffusion models, which leverage stochastic processes to capture complex data distributions effectively, have shown their performance as generative models, achieving notable success in image-related tasks through iterative denoising…

Machine Learning · Computer Science 2024-08-21 Toshihide Ubukata , Jialong Li , Kenji Tei

World models have recently gained prominence for action-conditioned visual prediction in complex environments. However, relying on only a few recent observations causes them to lose long-term context. Consequently, within a few steps, the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Nedko Savov , Naser Kazemi , Deheng Zhang , Danda Pani Paudel , Xi Wang , Luc Van Gool

Predicting human motion plays a crucial role in ensuring a safe and effective human-robot close collaboration in intelligent remanufacturing systems of the future. Existing works can be categorized into two groups: those focusing on…

Robotics · Computer Science 2023-08-01 Sibo Tian , Minghui Zheng , Xiao Liang

Diffusion models have become popular for policy learning in robotics due to their ability to capture high-dimensional and multimodal distributions. However, diffusion policies are stochastic and typically trained offline, limiting their…

Robotics · Computer Science 2025-05-28 Ralf Römer , Alexander von Rohr , Angela P. Schoellig

Simultaneously grasping and delivering multiple objects can significantly enhance robotic work efficiency and has been a key research focus for decades. The primary challenge lies in determining how to push objects, group them, and execute…

Robotics · Computer Science 2025-08-04 Takahiro Yonemaru , Weiwei Wan , Tatsuki Nishimura , Kensuke Harada

We present Context Forest (ConF), a technique for predicting properties of the objects in an image based on its global appearance. Compared to standard nearest-neighbour techniques, ConF is more accurate, fast and memory efficient. We train…

Computer Vision and Pattern Recognition · Computer Science 2015-03-04 Davide Modolo , Alexander Vezhnevets , Vittorio Ferrari

Diffusion Policy has shown great performance in robotic manipulation tasks under stochastic perturbations, due to its ability to model multimodal action distributions. Nonetheless, its reliance on a computationally expensive reverse-time…

Robotics · Computer Science 2025-11-20 Gabriel Lauzier , Alexandre Girard , François Ferland

Adapting a pretrained diffusion model to new objectives at inference time remains an open problem in generative modeling. Existing steering methods suffer from inaccurate value estimation, especially at high noise levels, which biases…

Machine Learning · Computer Science 2025-06-27 Vineet Jain , Kusha Sareen , Mohammad Pedramfar , Siamak Ravanbakhsh

Point processes model the distribution of random point sets in mathematical spaces, such as spatial and temporal domains, with applications in fields like seismology, neuroscience, and economics. Existing statistical and machine learning…

Machine Learning · Computer Science 2024-10-31 David Lüdke , Enric Rabasseda Raventós , Marcel Kollovieh , Stephan Günnemann

This paper considers the problem of retrieving an object from many tightly packed objects using a combination of robotic pushing and grasping actions. Object retrieval in dense clutter is an important skill for robots to operate in…

Robotics · Computer Science 2022-03-10 Baichuan Huang , Shuai D. Han , Jingjin Yu , Abdeslam Boularias

Denoising diffusion models are a powerful type of generative models used to capture complex distributions of real-world signals. However, their applicability is limited to scenarios where training samples are readily available, which is not…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ayush Tewari , Tianwei Yin , George Cazenavette , Semon Rezchikov , Joshua B. Tenenbaum , Frédo Durand , William T. Freeman , Vincent Sitzmann

Recent progress in robotic manipulation has dealt with the case of previously unknown objects in the context of relatively simple tasks, such as bin-picking. Existing methods for more constrained problems, however, such as deliberate…

Robotics · Computer Science 2020-06-30 Chaitanya Mitash , Rahul Shome , Bowen Wen , Abdeslam Boularias , Kostas Bekris

Diffusion models have been successfully applied to robotics problems such as manipulation and vehicle path planning. In this work, we explore their application to end-to-end navigation -- including both perception and planning -- by…

Robotics · Computer Science 2024-09-27 L. Lao Beyer , S. Karaman

Diffusion-based robot navigation policies trained on large-scale imitation learning datasets, can generate multi-modal trajectories directly from the robot's visual observations, bypassing the traditional localization-mapping-planning…

Robotics · Computer Science 2026-03-16 Junhe Sheng , Ruofei Bai , Kuan Xu , Ruimeng Liu , Jie Chen , Shenghai Yuan , Wei-Yun Yau , Lihua Xie

Energy conservation in buildings is a paramount concern to combat greenhouse gas emissions and combat climate change. The efficient management of room occupancy, involving actions like lighting control and climate adjustment, is a pivotal…

Machine Learning · Computer Science 2023-12-25 Siqi Mao , Yaping Yuan , Yinpu Li , Ziren Wang , Yuanxin Yao , Yixin Kang

We introduce Diffusion World Model (DWM), a conditional diffusion model capable of predicting multistep future states and rewards concurrently. As opposed to traditional one-step dynamics models, DWM offers long-horizon predictions in a…

Machine Learning · Computer Science 2024-10-17 Zihan Ding , Amy Zhang , Yuandong Tian , Qinqing Zheng

Predicting 3D human poses in real-world scenarios, also known as human pose forecasting, is inevitably subject to noisy inputs arising from inaccurate 3D pose estimations and occlusions. To address these challenges, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Saeed Saadatnejad , Ali Rasekh , Mohammadreza Mofayezi , Yasamin Medghalchi , Sara Rajabzadeh , Taylor Mordan , Alexandre Alahi

Robots often have to operate in discrete partially observable worlds, where the states of world are only observable at runtime. To react to different world states, robots need contingencies. However, computing contingencies is costly and…

Robotics · Computer Science 2023-09-20 Janis Eric Freund , Camille Phiquepal , Andreas Orthey , Marc Toussaint

In today's technology-driven era, the imperative for predictive maintenance and advanced diagnostics extends beyond aviation to encompass the identification of damages, failures, and operational defects in rotating and moving machines.…

Machine Learning · Computer Science 2024-03-18 Saket Maheshwari , Sambhav Tiwari , Shyam Rai , Satyam Vinayak Daman Pratap Singh