English
Related papers

Related papers: S$^2$-Diffusion: Generalizing from Instance-level …

200 papers

Style transfer aims to fuse the artistic representation of a style image with the structural information of a content image. Existing methods train specific networks or utilize pre-trained models to learn content and style features.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ying Hu , Chenyi Zhuang , Pan Gao

Recently, diffusion models have made remarkable progress in text-to-image (T2I) generation, synthesizing images with high fidelity and diverse contents. Despite this advancement, latent space smoothness within diffusion models remains…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Jiayi Guo , Xingqian Xu , Yifan Pu , Zanlin Ni , Chaofei Wang , Manushree Vasu , Shiji Song , Gao Huang , Humphrey Shi

Building generic robotic manipulation systems often requires large amounts of real-world data, which can be dificult to collect. Synthetic data generation offers a promising alternative, but limiting the sim-to-real gap requires significant…

Robotics · Computer Science 2024-11-18 Thomas Lips , Francis wyffels

Evaluating robotics policies across thousands of environments and thousands of tasks is infeasible with existing approaches. This motivates the need for a new methodology for scalable robotics policy evaluation. In this paper, we propose…

Robotics · Computer Science 2026-04-27 Yaxuan Li , Zhongyi Zhou , Yefei Chen , Yaokai Xue , Yichen Zhu

We propose Image-to-Image Schr\"odinger Bridge (I$^2$SB), a new class of conditional diffusion models that directly learn the nonlinear diffusion processes between two given distributions. These diffusion bridges are particularly useful for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Guan-Horng Liu , Arash Vahdat , De-An Huang , Evangelos A. Theodorou , Weili Nie , Anima Anandkumar

Diffusion models have shown impressive performance for generative modelling of images. In this paper, we present a novel semantic segmentation method based on diffusion models. By modifying the training and sampling scheme, we show that…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Julia Wolleb , Robin Sandkühler , Florentin Bieder , Philippe Valmaggia , Philippe C. Cattin

Humans possess a large reachable space in the 3D world, enabling interaction with objects at varying heights and distances. However, realizing such large-space reaching on humanoids is a complex whole-body control problem and requires the…

Robotics · Computer Science 2025-12-19 Zhikai Zhang , Chao Chen , Han Xue , Jilong Wang , Sikai Liang , Yun Liu , Zongzhang Zhang , He Wang , Li Yi

This paper presents a new technique for learning category-level manipulation from raw RGB-D videos of task demonstrations, with no manual labels or annotations. Category-level learning aims to acquire skills that can be generalized to new…

Robotics · Computer Science 2022-09-15 Junchi Liang , Abdeslam Boularias

Diffusion models have recently emerged as powerful learners for simulation-based inference (SBI), enabling fast and accurate estimation of latent parameters from simulated and real data. Their score-based formulation offers a flexible way…

Machine Learning · Statistics 2026-01-30 Jonas Arruda , Niels Bracher , Ullrich Köthe , Jan Hasenauer , Stefan T. Radev

Learning from demonstrations faces challenges in generalizing beyond the training data and often lacks collision awareness. This paper introduces Lan-o3dp, a language-guided object-centric diffusion policy framework that can adapt to unseen…

Robotics · Computer Science 2025-03-18 Hang Li , Qian Feng , Zhi Zheng , Jianxiang Feng , Zhaopeng Chen , Alois Knoll

General-purpose object placement is a fundamental capability of an intelligent generalist robot: being capable of rearranging objects following precise human instructions even in novel environments. This work is dedicated to achieving…

Robotics · Computer Science 2025-07-22 Jianyang Wu , Jie Gu , Xiaokang Ma , Fangzhou Qiu , Chu Tang , Jingmin Chen

Diffusion-based methods have been acknowledged as a powerful paradigm for end-to-end visuomotor control in robotics. Most existing approaches adopt a Diffusion Policy in U-Net architecture (DP-U), which, while effective, suffers from…

Robotics · Computer Science 2025-09-30 Linzhi Wu , Aoran Mei , Xiyue Wang , Guo-Niu Zhu , Zhongxue Gan

Diffusion policies excel at robotic manipulation by naturally modeling multimodal action distributions in high-dimensional spaces. Nevertheless, diffusion policies suffer from diffusion representation collapse: semantically similar…

Artificial Intelligence · Computer Science 2026-04-23 Guowei Zou , Weibing Li , Hejun Wu , Yukun Qian , Yuhang Wang , Haitao Wang

Diffusion frameworks have achieved comparable performance with previous state-of-the-art image generation models. Researchers are curious about its variants in discriminative tasks because of its powerful noise-to-image denoising pipeline.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Zhangxuan Gu , Haoxing Chen , Zhuoer Xu , Jun Lan , Changhua Meng , Weiqiang Wang

Cross-modal alignment is an effective approach to improving visual classification. Existing studies typically enforce a one-step mapping that uses deep neural networks to project the visual features to mimic the distribution of textual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zixuan Li , Lei Meng , Guoqing Chao , Wei Wu , Xiaoshuo Yan , Yimeng Yang , Zhuang Qi , Xiangxu Meng

Video-diffusion models have recently set the standard in video generation, inpainting, and domain translation thanks to their training stability and high perceptual fidelity. Building on these strengths, we repurpose conditional video…

Computational Engineering, Finance, and Science · Computer Science 2025-07-28 Jaewan Park , Farid Ahmed , Kazuma Kobayashi , Seid Koric , Syed Bahauddin Alam , Iwona Jasiuk , Diab Abueidda

We address the challenge of acquiring real-world manipulation skills with a scalable framework. We hold the belief that identifying an appropriate prediction target capable of leveraging large-scale datasets is crucial for achieving…

Robotics · Computer Science 2024-09-24 Chengbo Yuan , Chuan Wen , Tong Zhang , Yang Gao

Diffusion policies have recently emerged as a powerful paradigm for visuomotor control in robotic manipulation due to their ability to model the distribution of action sequences and capture multimodality. However, iterative denoising leads…

Robotics · Computer Science 2026-05-05 Jinhao Li , Yuxuan Cong , Yingqiao Wang , Hao Xia , Shan Huang , Yijia Zhang , Ningyi Xu , Guohao Dai

Diffusion policies have demonstrated strong performance in generative modeling, making them promising for robotic manipulation guided by natural language instructions. However, generalizing language-conditioned diffusion policies to…

Robotics · Computer Science 2025-08-20 Ce Hao , Kelvin Lin , Zhiwei Xue , Siyuan Luo , Harold Soh

The goal of general-purpose robotics is to create agents that can seamlessly adapt to and operate in diverse, unstructured human environments. Imitation learning has become a key paradigm for robotic manipulation, yet collecting large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Liu Liu , Xiaofeng Wang , Guosheng Zhao , Keyu Li , Wenkang Qin , Jiagang Zhu , Jiaxiong Qiu , Zheng Zhu , Guan Huang , Zhizhong Su