English
Related papers

Related papers: Decoupled Action Expert: Confining Task Knowledge …

200 papers

Recent advances in multi-agent reinforcement learning have been largely limited in training one model from scratch for every new task. The limitation is due to the restricted model architecture related to fixed input and output dimensions.…

Machine Learning · Computer Science 2021-02-09 Siyi Hu , Fengda Zhu , Xiaojun Chang , Xiaodan Liang

Identity-preserved image generation is typically built on many-step diffusion backbones, making personalized generation expensive at deployment time. We show that this cost is often unnecessary for identity-conditioned FLUX generation. A…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Dongqi Zheng

Diffusion language models, as a promising alternative to traditional autoregressive (AR) models, enable faster generation and richer conditioning on bidirectional context. However, they suffer from a key discrepancy between training and…

Machine Learning · Computer Science 2025-09-26 Haoyu He , Katrin Renz , Yong Cao , Andreas Geiger

Unified multimodal models can encode visual understanding and image generation within a shared backbone, yet understanding does not automatically translate into control: models may infer objects, relations, or knowledge cues but fail to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Fuxiang Zhai , Sixiang Chen , Yingjin Li , Shuaibo Li , Jianyu Lai , Tengjun Huang , Lei Zhu

Embodied agents face a fundamental limitation: once deployed in real-world environments, they cannot easily acquire new knowledge to improve task performance. In this paper, we propose Dejavu, a general post-deployment learning framework…

Learning robot policies that capture multimodality in the training data has been a long-standing open challenge for behavior cloning. Recent approaches tackle the problem by modeling the conditional action distribution with generative…

Robotics · Computer Science 2025-11-11 Andrea Rosasco , Federico Ceola , Giulia Pasquale , Lorenzo Natale

Diffusion models have advanced from text-to-image (T2I) to image-to-image (I2I) generation by incorporating structured inputs such as depth maps, enabling fine-grained spatial control. However, existing methods either train separate models…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Yucheng Xie , Fu Feng , Ruixiao Shi , Jing Wang , Yong Rui , Xin Geng

Large pretrained diffusion models have demonstrated impressive generation capabilities and have been adapted to various downstream tasks. However, unlike Large Language Models (LLMs) that can learn multiple tasks in a single model based on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Ming Tao , Bing-Kun Bao , Yaowei Wang , Changsheng Xu

Diffusion Q-Learning (DQL) has established diffusion policies as a high-performing paradigm for offline reinforcement learning, but its reliance on multi-step denoising for action generation renders both training and inference slow and…

Machine Learning · Computer Science 2026-02-25 Thanh Nguyen , Chang D. Yoo

A generalist robot should perform effectively across various environments. However, most existing approaches heavily rely on scaling action-annotated data to enhance their capabilities. Consequently, they are often limited to single…

Robotics · Computer Science 2025-11-04 Qingwen Bu , Yanting Yang , Jisong Cai , Shenyuan Gao , Guanghui Ren , Maoqing Yao , Ping Luo , Hongyang Li

A fairly reliable trend in deep reinforcement learning is that the performance scales with the number of parameters, provided a complimentary scaling in amount of training data. As the appetite for large models increases, it is imperative…

Machine Learning · Computer Science 2023-06-14 Bogdan Mazoure , Walter Talbott , Miguel Angel Bautista , Devon Hjelm , Alexander Toshev , Josh Susskind

Reinforcement learning (RL) struggles to scale to large, combinatorial action spaces common in many real-world problems. This paper introduces a novel framework for training discrete diffusion models as highly effective policies in these…

Machine Learning · Computer Science 2026-05-21 Haitong Ma , Ofir Nabati , Aviv Rosenberg , Bo Dai , Oran Lang , Craig Boutilier , Na Li , Shie Mannor , Lior Shani , Guy Tenneholtz

Vision-Language-Action (VLA) models have recently demonstrated strong performance across embodied tasks. Modern VLAs commonly employ diffusion action experts to efficiently generate high-precision continuous action chunks, while…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Chen Zhao , Zhuoran Wang , Haoyang Li , Shifeng Bao , Guanlin Li , Youhe Feng , Yang Li , Jie Tang , Jing Zhang

Embodied intelligence is often studied through specialized models for individual tasks such as manipulation or navigation, resulting in fragmented capabilities and limited generalization across tasks, environments, and robot embodiments. In…

End-to-end backpropagation requires storing activations throughout all layers, creating memory bottlenecks that limit model scalability. Existing block-wise training methods offer means to alleviate this problem, but they rely on ad-hoc…

Machine Learning · Computer Science 2026-02-19 Makoto Shing , Masanori Koyama , Takuya Akiba

Vision-Language-Action (VLA) models for autonomous driving increasingly adopt generative planners trained with imitation learning followed by reinforcement learning. Diffusion-based planners suffer from modality alignment difficulties, low…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Chenxu Dang , Sining Ang , Yongkang Li , Haochen Tian , Jie Wang , Guang Li , Hangjun Ye , Jie Ma , Long Chen , Yan Wang

Recent vision-language-action (VLA) systems have demonstrated strong capabilities in embodied manipulation. However, most existing VLA policies rely on limited observation windows and end-to-end action prediction, which makes them brittle…

Robotics · Computer Science 2026-04-16 Zhen Liu , Xinyu Ning , Zhe Hu , Xinxin Xie , Weize Li , Zhipeng Tang , Chongyu Wang , Zejun Yang , Hanlin Wang , Yitong Liu , Zhongzhu Pu

Large pre-trained models have transformed machine learning, yet adapting these models effectively to exhibit precise, concept-specific behaviors remains a significant challenge. Task vectors, defined as the difference between fine-tuned and…

Machine Learning · Computer Science 2025-12-30 Hamed Damirchi , Ehsan Abbasnejad , Zhen Zhang , Javen Shi

Language-conditioned manipulation policies typically process instructions and observations through shared network parameters. This task-state entanglement provides a pathway for observation leakage -- networks learn scene-to-action…

Robotics · Computer Science 2026-05-21 Hanxiang Ren , Pei Zhou , Xunzhe Zhou , Yanchao Yang

Generalizing locomotion policies across diverse legged robots with varying morphologies is a key challenge due to differences in observation/action dimensions and system dynamics. In this work, we propose Multi-Loco, a novel unified…

Robotics · Computer Science 2025-06-16 Shunpeng Yang , Zhen Fu , Zhefeng Cao , Guo Junde , Patrick Wensing , Wei Zhang , Hua Chen