English
Related papers

Related papers: Preparing for the Unknown: Learning a Universal Po…

200 papers

Traditional robotic approaches rely on an accurate model of the environment, a detailed description of how to perform the task, and a robust perception system to keep track of the current state. On the other hand, reinforcement learning…

Off-policy learning plays a pivotal role in optimizing and evaluating policies prior to the online deployment. However, during the real-time serving, we observe varieties of interventions and constraints that cause inconsistency between the…

Machine Learning · Computer Science 2022-03-01 Da Xu , Yuting Ye , Chuanwei Ruan , Bo Yang

Sim2real transfer is primarily concerned with transferring policies trained in simulation to potentially noisy real world environments. A common problem associated with sim2real transfer is estimating the real-world environmental parameters…

Machine Learning · Computer Science 2022-02-15 Buddhika Laknath Semage , Thommen George Karimpanal , Santu Rana , Svetha Venkatesh

In this paper, we propose an online learning-based predictive control (LPC) approach designed for nonlinear systems that lack explicit system dynamics. Unlike traditional model predictive control (MPC) algorithms that rely on known system…

Optimization and Control · Mathematics 2025-03-17 Yuanqing Zhang , Huanshui Zhang

As we enter into the big data age and an avalanche of images have become readily available, recognition systems face the need to move from close, lab settings where the number of classes and training data are fixed, to dynamic scenarios…

Computer Vision and Pattern Recognition · Computer Science 2016-04-11 Rocco De Rosa , Thomas Mensink , Barbara Caputo

Modern decision-making systems, from robots to web recommendation engines, are expected to adapt: to user preferences, changing circumstances or even new tasks. Yet, it is still uncommon to deploy a dynamically learning agent (rather than a…

Machine Learning · Computer Science 2022-11-15 Shengpu Tang , Felipe Vieira Frujeri , Dipendra Misra , Alex Lamb , John Langford , Paul Mineiro , Sebastian Kochman

Formation control algorithms for multi-agent systems have gained much attention in the recent years due to the increasing amount of mobile and aerial robotic swarms. The design of safe controllers for these vehicles is a substantial aspect…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Thomas Beckers , Sandra Hirche , Leonardo Colombo

We approach the fundamental problem of obstacle avoidance for robotic systems via the lens of online learning. In contrast to prior work that either assumes worst-case realizations of uncertainty in the environment or a stationary…

Robotics · Computer Science 2023-11-07 David Snyder , Meghan Booker , Nathaniel Simon , Wenhan Xia , Daniel Suo , Elad Hazan , Anirudha Majumdar

This paper addresses the problem of planning a safe (i.e., collision-free) trajectory from an initial state to a goal region when the obstacle space is a-priori unknown and is incrementally revealed online, e.g., through line-of-sight…

Robotics · Computer Science 2018-04-17 Lucas Janson , Tommy Hu , Marco Pavone

A self-learning adaptive system (SLAS) uses machine learning to enable and enhance its adaptability. Such systems are expected to perform well in dynamic situations. For learning high-performance adaptation policy, some assumptions must be…

Software Engineering · Computer Science 2021-05-12 Mingyue Zhang , Jialong Li , Haiyan Zhao , Kenji Tei , Shinichi Honiden , Zhi Jin

Control policy learning for modular robot locomotion has previously been limited to proprioceptive feedback and flat terrain. This paper develops policies for modular systems with vision traversing more challenging environments. These…

Robotics · Computer Science 2023-05-02 Julian Whitman , Howie Choset

Autonomous robots operating in complex, unstructured environments face significant challenges due to latent, unobserved factors that obscure their understanding of both their internal state and the external world. Addressing this challenge…

Robotics · Computer Science 2026-04-02 Alejandro Murillo-Gonzalez , Lantao Liu

Identifying the dynamic properties of manipulated objects is essential for safe and accurate robot control. Most methods rely on low noise force torque sensors, long exciting signals, and solving nonlinear optimization problems, making the…

Robotics · Computer Science 2024-08-22 Donghoon Baek , Bo Peng , Saurabh Gupta , Joao Ramos

Learning control policies in simulation enables rapid, safe, and cost-effective development of advanced robotic capabilities. However, transferring these policies to the real world remains difficult due to the sim-to-real gap, where…

Robotics · Computer Science 2026-01-16 Jiahe Pan , Jiaxu Xing , Rudolf Reiter , Yifan Zhai , Elie Aljalbout , Davide Scaramuzza

Modern unmanned systems, including aerial, terrestrial, and underwater vehicles, are increasingly utilized in dynamic and unpredictable environments, where the presence of modeling uncertainties necessitates the development of robust and…

Systems and Control · Electrical Eng. & Systems 2026-03-11 Maryam Norouzi , Mingxi Zhou , Chengzhi Yuan

Deep reinforcement learning has great potential to acquire complex, adaptive behaviors for autonomous agents automatically. However, the underlying neural network polices have not been widely deployed in real-world applications, especially…

Robotics · Computer Science 2020-06-04 Tingxiang Fan , Pinxin Long , Wenxi Liu , Jia Pan , Ruigang Yang , Dinesh Manocha

Training general robotic policies from heterogeneous data for different tasks is a significant challenge. Existing robotic datasets vary in different modalities such as color, depth, tactile, and proprioceptive information, and collected in…

Robotics · Computer Science 2024-12-03 Lirui Wang , Jialiang Zhao , Yilun Du , Edward H. Adelson , Russ Tedrake

Imitation learning is a data-driven approach to learning policies from expert behavior, but it is prone to unreliable outcomes in out-of-sample (OOS) regions. While previous research relying on stable dynamical systems guarantees…

Machine Learning · Computer Science 2025-03-27 Amin Abyaneh , Mahrokh G. Boroujeni , Hsiu-Chin Lin , Giancarlo Ferrari-Trecate

We consider the problem of online learning of optimal control for repeatedly operated systems in the presence of parametric uncertainty. During each round of operation, environment selects system parameters according to a fixed but unknown…

Machine Learning · Computer Science 2016-09-20 Theja Tulabandhula

In this paper, we present a decentralized sensor-level collision avoidance policy for multi-robot systems, which shows promising results in practical applications. In particular, our policy directly maps raw sensor measurements to an…

Robotics · Computer Science 2018-08-14 Tingxiang Fan , Pinxin Long , Wenxi Liu , Jia Pan