English
Related papers

Related papers: Cutting Sequence Diffuser: Sim-to-Real Transferabl…

200 papers

Diffusion models have exhibited remarkable prowess in visual generalization. Building on this success, we introduce an instruction-based object addition pipeline, named Add-SD, which automatically inserts objects into realistic scenes with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Lingfeng Yang , Xinyu Zhang , Xiang Li , Jinwen Chen , Kun Yao , Gang Zhang , Errui Ding , Lingqiao Liu , Jingdong Wang , Jian Yang

Deep denoising models require extensive real-world training data, which is challenging to acquire. Current noise synthesis techniques struggle to accurately model complex noise distributions. We propose a novel Realistic Noise Synthesis…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Qi Wu , Mingyan Han , Ting Jiang , Chengzhi Jiang , Jinting Luo , Man Jiang , Haoqiang Fan , Shuaicheng Liu

Diffusion models have enabled remarkably high-quality medical image generation, yet it is challenging to enforce anatomical constraints in generated images. To this end, we propose a diffusion model-based method that supports…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Nicholas Konz , Yuwen Chen , Haoyu Dong , Maciej A. Mazurowski

The ability to manipulate objects in a desired configurations is a fundamental requirement for robots to complete various practical applications. While certain goals can be achieved by picking and placing the objects of interest directly,…

Robotics · Computer Science 2023-09-18 Utkarsh A. Mishra , Yongxin Chen

Recent advances in diffusion models have opened new avenues for research into embodied AI agents and robotics. Despite significant achievements in complex robotic locomotion and skills, mobile manipulation-a capability that requires the…

Robotics · Computer Science 2025-04-03 Sixu Yan , Zeyu Zhang , Muzhi Han , Zaijin Wang , Qi Xie , Zhitian Li , Zhehan Li , Hangxin Liu , Xinggang Wang , Song-Chun Zhu

Safe trajectory planning in complex environments must balance stringent collision avoidance with real-time efficiency, which is a long-standing challenge in robotics. In this work, we present a diffusion-based trajectory planning framework…

Robotics · Computer Science 2025-11-27 Wule Mao , Zhouheng Li , Yunhao Luo , Yilun Du , Lei Xie

Synthetic dataset generation in Computer Vision, particularly for industrial applications, is still underexplored. Industrial defect segmentation, for instance, requires highly accurate labels, yet acquiring such data is costly and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Emanuele Caruso , Alessandro Simoni , Francesco Pelosin

Manipulation of large objects over long horizons (such as carts in a warehouse) is an essential skill for deployable robotic systems. Large objects require mobile manipulation which involves simultaneous manipulation, navigation, and…

Robotics · Computer Science 2024-10-10 Yajvan Ravan , Zhutian Yang , Tao Chen , Tomás Lozano-Pérez , Leslie Pack Kaelbling

We present GSD, a diffusion model approach based on Gaussian Splatting (GS) representation for 3D object reconstruction from a single view. Prior works suffer from inconsistent 3D geometry or mediocre rendering quality due to improper…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Yuxuan Mu , Xinxin Zuo , Chuan Guo , Yilin Wang , Juwei Lu , Xiaofeng Wu , Songcen Xu , Peng Dai , Youliang Yan , Li Cheng

Robot learning requires adaptation methods that improve reliably from limited, mixed-quality interaction data. This is especially challenging in long-horizon, contact-rich tasks, where end-to-end policy finetuning remains inefficient and…

Curved objects pose a fundamental challenge for skill transfer in robotics: unlike planar surfaces, they do not admit a global reference frame. As a result, task-relevant directions such as "toward" or "along" the surface vary with position…

Robotics · Computer Science 2025-11-25 Cem Bilaloglu , Tobias Löw , Sylvain Calinon

This paper introduces an approach for learning to solve continuous constraint satisfaction problems (CCSP) in robotic reasoning and planning. Previous methods primarily rely on hand-engineering or learning generators for specific constraint…

The recent success of transformer-based image generative models in object-centric learning highlights the importance of powerful image generators for handling complex scenes. However, despite the high expressiveness of diffusion models in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Jindong Jiang , Fei Deng , Gautam Singh , Sungjin Ahn

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Differentiable rendering is a key ingredient for inverse rendering and machine learning, as it allows to optimize scene parameters (shape, materials, lighting) to best fit target images. Differentiable rendering requires that each scene…

Graphics · Computer Science 2024-09-10 Haocheng Yuan , Adrien Bousseau , Hao Pan , Chengquan Zhang , Niloy J. Mitra , Changjian Li

The goal of general-purpose robotics is to create agents that can seamlessly adapt to and operate in diverse, unstructured human environments. Imitation learning has become a key paradigm for robotic manipulation, yet collecting large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Liu Liu , Xiaofeng Wang , Guosheng Zhao , Keyu Li , Wenkang Qin , Jiagang Zhu , Jiaxiong Qiu , Zheng Zhu , Guan Huang , Zhizhong Su

Conditional diffusion models have demonstrated impressive performance in image manipulation tasks. The general pipeline involves adding noise to the image and then denoising it. However, this method faces a trade-off problem: adding too…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Luozhou Wang , Shuai Yang , Shu Liu , Ying-cong Chen

Precise geometric control in image generation is essential for engineering \& product design and creative industries to control 3D object features accurately in image space. Traditional 3D editing approaches are time-consuming and demand…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Phillip Mueller , Talip Uenlue , Sebastian Schmidt , Marcel Kollovieh , Jiajie Fan , Stephan Guennemann , Lars Mikelsons

Efficient planning in high-dimensional spaces, such as those involving deformable objects, requires computationally tractable yet sufficiently expressive dynamics models. This paper introduces a method that automatically generates…

Robotics · Computer Science 2025-08-27 Alex LaGrassa , Zixuan Huang , Dmitry Berenson , Oliver Kroemer

Robots operating in human environments must be able to rearrange objects into semantically-meaningful configurations, even if these objects are previously unseen. In this work, we focus on the problem of building physically-valid structures…

Robotics · Computer Science 2023-04-26 Weiyu Liu , Yilun Du , Tucker Hermans , Sonia Chernova , Chris Paxton