English
Related papers

Related papers: ADAPT: Zero-Shot Adaptive Policy Transfer for Stoc…

200 papers

Agile humanoid locomotion in complex 3D en- vironments requires balancing perceptual fidelity with com- putational efficiency, yet existing methods typically rely on rigid sensing configurations. We propose ADAPT (Adaptive dual-projection…

Robotics · Computer Science 2026-03-18 Shuo Shao , Tianchen Huang , Wei Gao , Shiwu Zhang

Test-time adaptation (TTA) enhances the zero-shot robustness under distribution shifts by leveraging unlabeled test data during inference. Despite notable advances, several challenges still limit its broader applicability. First, most…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Youjia Zhang , Youngeun Kim , Young-Geun Choi , Hongyeob Kim , Huiling Liu , Sungeun Hong

We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems…

Systems and Control · Electrical Eng. & Systems 2022-12-05 Rohan Sinha , James Harrison , Spencer M. Richards , Marco Pavone

Diffusion models excel at creating images and videos thanks to their multimodal generative capabilities. These same capabilities have made diffusion models increasingly popular in robotics research, where they are used for generating robot…

Robotics · Computer Science 2025-04-29 Jean-Baptiste Bouvier , Kanghyun Ryu , Kartik Nagpal , Qiayuan Liao , Koushil Sreenath , Negar Mehr

Using deep reinforcement learning, we train control policies for autonomous vehicles leading a platoon of vehicles onto a roundabout. Using Flow, a library for deep reinforcement learning in micro-simulators, we train two policies, one…

Systems and Control · Computer Science 2019-02-26 Kathy Jang , Eugene Vinitsky , Behdad Chalaki , Ben Remer , Logan Beaver , Andreas Malikopoulos , Alexandre Bayen

Continual learning is one of the key components of human learning and a necessary requirement of artificial intelligence. As dialogue can potentially span infinitely many topics and tasks, a task-oriented dialogue system must have the…

Computation and Language · Computer Science 2022-10-11 Christian Geishauser , Carel van Niekerk , Nurul Lubis , Michael Heck , Hsien-Chin Lin , Shutong Feng , Milica Gašić

Diffusion policies trained via offline behavioral cloning have recently gained traction in robotic motion generation. While effective, these policies typically require a large number of trainable parameters. This model size affords powerful…

Robotics · Computer Science 2025-04-29 Xiatao Sun , Shuo Yang , Yinxing Chen , Francis Fan , Yiyan Liang , Daniel Rakita

This paper proposes a data-driven method for learning convergent control policies from offline data using Contraction theory. Contraction theory enables constructing a policy that makes the closed-loop system trajectories inherently…

Machine Learning · Computer Science 2022-02-04 Navid Rezazadeh , Maxwell Kolarich , Solmaz S. Kia , Negar Mehr

Generalizing policies across different domains with dynamics mismatch poses a significant challenge in reinforcement learning. For example, a robot learns the policy in a simulator, but when it is deployed in the real world, the dynamics of…

Machine Learning · Computer Science 2023-10-16 Kang Xu , Chenjia Bai , Xiaoteng Ma , Dong Wang , Bin Zhao , Zhen Wang , Xuelong Li , Wei Li

Offline reinforcement learning (RL) enables agents to learn optimal policies from pre-collected datasets. However, datasets containing suboptimal and fragmented trajectories present challenges for reward propagation, resulting in inaccurate…

Machine Learning · Computer Science 2025-12-17 Hang Yu , Di Zhang , Qiwei Du , Yanping Zhao , Hai Zhang , Guang Chen , Eduardo E. Veas , Junqiao Zhao

We study off-dynamics offline reinforcement learning, where the goal is to learn a policy from offline source and limited target datasets with mismatched dynamics. Existing methods either penalize the reward or discard source transitions…

Machine Learning · Computer Science 2026-03-19 Yihong Guo , Yu Yang , Pan Xu , Anqi Liu

Diffusion-based policies have achieved remarkable results in robotic manipulation but often struggle to adapt rapidly in dynamic scenarios, leading to delayed responses or task failures. We present DCDP, a Dynamic Closed-Loop Diffusion…

Robotics · Computer Science 2026-03-18 Pengyuan Wu , Pingrui Zhang , Zhigang Wang , Dong Wang , Bin Zhao , Xuelong Li

Diffusion policies have recently emerged as a powerful class of visuomotor controllers for robot manipulation, offering stable training and expressive multi-modal action modeling. However, existing approaches typically treat action…

Robotics · Computer Science 2025-10-01 Zezeng Li , Rui Yang , Ruochen Chen , ZhongXuan Luo , Liming Chen

Quadrotor control policies can be trained with high performance using the exact gradients of the rewards to directly optimize policy parameters via backpropagation-through-time (BPTT). However, designing a fully differentiable reward…

Robotics · Computer Science 2025-05-22 Fanxing Li , Fangyu Sun , Tianbao Zhang , Danping Zou

Offline reinforcement learning methods hold the promise of learning policies from pre-collected datasets without the need to query the environment for new transitions. This setting is particularly well-suited for continuous control robotic…

Machine Learning · Computer Science 2022-03-18 Xi Chen , Ali Ghadirzadeh , Tianhe Yu , Yuan Gao , Jianhao Wang , Wenzhe Li , Bin Liang , Chelsea Finn , Chongjie Zhang

Deep reinforcement learning has proven to be a powerful approach to solving control tasks, but its characteristic high-frequency oscillations make it difficult to apply in real-world environments. While prior methods have addressed action…

Machine Learning · Computer Science 2026-01-27 Kyoleen Kwak , Hyoseok Hwang

Despite recent advances in learning-based controllers for legged robots, deployments in human-centric environments remain limited by safety concerns. Most of these approaches use position-based control, where policies output target joint…

This paper proposes a simulation-based reinforcement learning algorithm for controlling systems with uncertain and varying system parameters. While simulators are useful for safely learning control policies, the reality gap remains a major…

Systems and Control · Electrical Eng. & Systems 2026-05-14 Junya Ikemoto

In recent years, domain randomization over dynamics parameters has gained a lot of traction as a method for sim-to-real transfer of reinforcement learning policies in robotic manipulation; however, finding optimal randomization…

Robotics · Computer Science 2023-01-13 Gabriele Tiboni , Karol Arndt , Ville Kyrki

We study the problem of Online Convex Optimization (OCO) with memory, which allows loss functions to depend on past decisions and thus captures temporal effects of learning problems. In this paper, we introduce dynamic policy regret as the…

Machine Learning · Computer Science 2023-08-16 Peng Zhao , Yu-Hu Yan , Yu-Xiang Wang , Zhi-Hua Zhou