English
Related papers

Related papers: Scaling Diffusion Policy in Transformer to 1 Billi…

200 papers

Recent developments in offline reinforcement learning have uncovered the immense potential of diffusion modeling, which excels at representing heterogeneous behavior policies. However, sampling from diffusion policies is considerably slow…

Machine Learning · Computer Science 2024-03-18 Huayu Chen , Cheng Lu , Zhengyi Wang , Hang Su , Jun Zhu

Learning domain adaptive policies that can generalize to unseen transition dynamics, remains a fundamental challenge in learning-based control. Substantial progress has been made through domain representation learning to capture…

Machine Learning · Computer Science 2026-03-31 Pengcheng Wang , Qinghang Liu , Haotian Lin , Yiheng Li , Guojian Zhan , Masayoshi Tomizuka , Yixiao Wang

Diffusion policies excel at robotic manipulation by naturally modeling multimodal action distributions in high-dimensional spaces. Nevertheless, diffusion policies suffer from diffusion representation collapse: semantically similar…

Artificial Intelligence · Computer Science 2026-04-23 Guowei Zou , Weibing Li , Hejun Wu , Yukun Qian , Yuhang Wang , Haitao Wang

Multitask learning poses significant challenges due to the highly multimodal and diverse nature of robot action distributions. However, effectively fitting policies to these complex task distributions is often difficult, and existing…

Robotics · Computer Science 2026-04-27 Chaoqi Liu , Haonan Chen , Sigmund H. Høeg , Shaoxiong Yao , Yunzhu Li , Kris Hauser , Yilun Du

Remote sensing image change description represents an innovative multimodal task within the realm of remote sensing processing.This task not only facilitates the detection of alterations in surface conditions, but also provides…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Dongwei Sun , Jing Yao , Wu Xue , Changsheng Zhou , Pedram Ghamisi , Xiangyong Cao

Diffusion models have been widely employed in the field of 3D manipulation due to their efficient capability to learn distributions, allowing for precise prediction of action trajectories. However, diffusion models typically rely on large…

Diffusion policies, widely adopted in decision-making scenarios such as robotics, gaming and autonomous driving, are capable of learning diverse skills from demonstration data due to their high representation power. However, the sub-optimal…

Machine Learning · Computer Science 2025-09-30 Ningyuan Yang , Jiaxuan Gao , Feng Gao , Yi Wu , Chao Yu

Due to network operation and maintenance relying heavily on network traffic monitoring, traffic matrix analysis has been one of the most crucial issues for network management related tasks. However, it is challenging to reliably obtain the…

Networking and Internet Architecture · Computer Science 2024-12-02 Xinyu Yuan , Yan Qiao , Zhenchun Wei , Zeyu Zhang , Minyue Li , Pei Zhao , Rongyao Hu , Wenjing Li

Many real-world problems require trading off multiple competing objectives. However, these objectives are often in different units and/or scales, which can make it challenging for practitioners to express numerical preferences over…

Diffusion Policy has shown great performance in robotic manipulation tasks under stochastic perturbations, due to its ability to model multimodal action distributions. Nonetheless, its reliance on a computationally expensive reverse-time…

Robotics · Computer Science 2025-11-20 Gabriel Lauzier , Alexandre Girard , François Ferland

One important property of DIstribution Correction Estimation (DICE) methods is that the solution is the optimal stationary distribution ratio between the optimized and data collection policy. In this work, we show that DICE-based methods…

Machine Learning · Computer Science 2024-11-01 Liyuan Mao , Haoran Xu , Xianyuan Zhan , Weinan Zhang , Amy Zhang

Transformers deliver outstanding performance across a wide range of tasks and are now a dominant backbone architecture for large language models (LLMs). Their task-solving performance is improved by increasing parameter size, as shown in…

Computation and Language · Computer Science 2025-06-10 Hidetaka Kamigaito , Ying Zhang , Jingun Kwon , Katsuhiko Hayashi , Manabu Okumura , Taro Watanabe

Multi-agent robotic manipulation remains challenging due to the combined demands of coordination, grasp stability, and collision avoidance in shared workspaces. To address these challenges, we propose the Adaptive Dynamic Modality Diffusion…

Robotics · Computer Science 2026-02-26 Enyi Wang , Wen Fan , Dandan Zhang

Learning-based 3D Scanning plays a crucial role in enabling efficient and accurate scanning of target objects. However, recent reinforcement learning-based methods often require large-scale training data and still struggle to generalize to…

Robotics · Computer Science 2026-03-12 Itsuki Hirako , Ryo Hakoda , Yubin Liu , Matthew Hwang , Yoshihiro Sato , Takeshi Oishi

Striking a balance between efficiency and transparent motion is a core challenge in human-robot collaboration, as highly expressive movements often incur unnecessary time and energy costs. In collaborative environments, legibility allows a…

Robotics · Computer Science 2026-05-07 Adrien Jacquet Crétides , Mouad Abrini , Hamed Rahimi , Mohamed Chetouani

Hybrid action space, which combines discrete choices and continuous parameters, is prevalent in domains such as robot control and game AI. However, efficiently modeling and optimizing hybrid discrete-continuous action space remains a…

Artificial Intelligence · Computer Science 2026-01-12 Bingyi Liu , Jinbo He , Haiyong Shi , Enshu Wang , Weizhen Han , Jingxiang Hao , Peixi Wang , Zhuangzhuang Zhang

Modern LLM pre-training consumes vast amounts of compute and training data, making the scaling behavior, or scaling laws, of different models a key distinguishing factor. Discrete diffusion language models (DLMs) have been proposed as an…

Machine Learning · Computer Science 2026-02-17 Dimitri von Rütte , Janis Fluri , Omead Pooladzandi , Bernhard Schölkopf , Thomas Hofmann , Antonio Orvieto

Bimanual manipulation has been widely applied in household services and manufacturing, which enables the complex task completion with coordination requirements. Recent diffusion-based policy learning approaches have achieved promising…

Robotics · Computer Science 2025-08-26 Haoyuan Deng , Wenkai Guo , Qianzhun Wang , Zhenyu Wu , Ziwei Wang

Diffusion policies (DP) have demonstrated significant potential in visual navigation by capturing diverse multi-modal trajectory distributions. However, standard imitation learning (IL), which most DP methods rely on for training, often…

Robotics · Computer Science 2026-02-02 Runhua Zhang , Junyi Hou , Changxu Cheng , Qiyi Chen , Tao Wang , Wuyue Zhao

Spiking Neural Networks (SNNs) has the ability to extract spatio-temporal features due to their spiking sequence. While previous research has primarily foucus on the classification of image and reinforcement learning. In our paper, we put…

Robotics · Computer Science 2025-03-18 Qianhao Wang , Yinqian Sun , Enmeng Lu , Qian Zhang , Yi Zeng