English
Related papers

Related papers: A Framework for Few-Shot Policy Transfer through O…

200 papers

This paper presents the World-Action Model (WAM), an action-regularized world model that jointly reasons over future visual observations and the actions that drive state transitions. Unlike conventional world models trained solely via image…

Artificial Intelligence · Computer Science 2026-04-01 Yuci Han , Alper Yilmaz

Letting robots emulate human behavior has always posed a challenge, particularly in scenarios involving multiple robots. In this paper, we presented a framework aimed at achieving multi-agent reinforcement learning for robot control in…

Robotics · Computer Science 2023-05-25 Kangkang Duan , Christine Wun Ki Suen , Zhengbo Zou

While visuomotor policy has made advancements in recent years, contact-rich tasks still remain a challenge. Robotic manipulation tasks that require continuous contact demand explicit handling of compliance and force. However, most…

Robotics · Computer Science 2026-04-17 Tianyu Li , Yihan Li , Zizhe Zhang , Nadia Figueroa

Reinforcement Learning (RL) algorithms are known to scale poorly to environments with many available actions, requiring numerous samples to learn an optimal policy. The traditional approach of considering the same fixed action space in…

Machine Learning · Computer Science 2023-05-15 Leo Ardon , Alberto Pozanco , Daniel Borrajo , Sumitra Ganesh

Real-world robotics problems often occur in domains that differ significantly from the robot's prior training environment. For many robotic control tasks, real world experience is expensive to obtain, but data is easy to collect in either…

Computer Vision and Pattern Recognition · Computer Science 2017-05-29 Eric Tzeng , Coline Devin , Judy Hoffman , Chelsea Finn , Pieter Abbeel , Sergey Levine , Kate Saenko , Trevor Darrell

For a robot to learn a good policy, it often requires expensive equipment (such as sophisticated sensors) and a prepared training environment conducive to learning. However, it is seldom possible to perfectly equip robots for economic…

Artificial Intelligence · Computer Science 2019-07-19 Hélène Plisnier , Denis Steckelmacher , Diederik Roijers , Ann Nowé

Training robots with reinforcement learning (RL) typically involves heavy interactions with the environment, and the acquired skills are often sensitive to changes in task environments and robot kinematics. Transfer RL aims to leverage…

Robotics · Computer Science 2023-09-26 Pingcheng Jian , Easop Lee , Zachary Bell , Michael M. Zavlanos , Boyuan Chen

Imitation learning trains control policies by mimicking pre-recorded expert demonstrations. In partially observable settings, imitation policies must rely on observation histories, but many seemingly paradoxical results show better…

Machine Learning · Computer Science 2021-06-14 Chuan Wen , Jierui Lin , Jianing Qian , Yang Gao , Dinesh Jayaraman

GANs largely increases the potential impact of generative models. Therefore, we propose a novel knowledge transfer method for generative models based on mining the knowledge that is most beneficial to a specific target domain, either from a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yaxing Wang , Abel Gonzalez-Garcia , Chenshen Wu , Luis Herranz , Fahad Shahbaz Khan , Shangling Jui , Joost van de Weijer

Learning complex manipulation tasks in realistic, obstructed environments is a challenging problem due to hard exploration in the presence of obstacles and high-dimensional visual observations. Prior work tackles the exploration problem by…

Machine Learning · Computer Science 2021-11-12 I-Chun Arthur Liu , Shagun Uppal , Gaurav S. Sukhatme , Joseph J. Lim , Peter Englert , Youngwoon Lee

Transfer learning is a useful technique for achieving improved performance and reducing training costs by leveraging the knowledge gained from source tasks and applying it to target tasks. Assessing the effectiveness of transfer learning…

Machine Learning · Computer Science 2023-06-12 Peizhong Ju , Sen Lin , Mark S. Squillante , Yingbin Liang , Ness B. Shroff

Few-shot action recognition aims at quickly adapting a pre-trained model to the novel data with a distribution shift using only a limited number of samples. Key challenges include how to identify and leverage the transferable knowledge…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Yuke Li , Guangyi Chen , Ben Abramowitz , Stefano Anzellott , Donglai Wei

Value iteration networks (VINs) have been demonstrated to have a good generalization ability for reinforcement learning tasks across similar domains. However, based on our experiments, a policy learned by VINs still fail to generalize well…

Machine Learning · Computer Science 2019-11-28 Junyi Shen , Hankz Hankui Zhuo , Jin Xu , Bin Zhong , Sinno Jialin Pan

In this work, we study vision-based end-to-end reinforcement learning on vehicle control problems, such as lane following and collision avoidance. Our controller policy is able to control a small-scale robot to follow the right-hand lane of…

Machine Learning · Computer Science 2020-12-15 András Kalapos , Csaba Gór , Róbert Moni , István Harmati

While deep learning has had significant successes in computer vision thanks to the abundance of visual data, collecting sufficiently large real-world datasets for robot learning can be costly. To increase the practicality of these…

Robotics · Computer Science 2017-12-20 Fangyi Zhang , Jürgen Leitner , Michael Milford , Peter Corke

Deep learning is known to be data-hungry, which hinders its application in many areas of science when datasets are small. Here, we propose to use transfer learning methods to migrate knowledge between different physical scenarios and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Yurui Qu , Li Jing , Yichen Shen , Min Qiu , Marin Soljacic

Scene transfer for vision-based mobile robotics applications is a highly relevant and challenging problem. The utility of a robot greatly depends on its ability to perform a task in the real world, outside of a well-controlled lab…

Robotics · Computer Science 2024-03-01 Jiaxu Xing , Leonard Bauersfeld , Yunlong Song , Chunwei Xing , Davide Scaramuzza

The ability to transfer knowledge gained in previous tasks into new contexts is one of the most important mechanisms of human learning. Despite this, adapting autonomous behavior to be reused in partially similar settings is still an open…

Robotics · Computer Science 2016-08-03 Shreyansh Daftry , J. Andrew Bagnell , Martial Hebert

Reinforcement Learning (RL) provides a framework in which agents can be trained, via trial and error, to solve complex decision-making problems. Learning with little supervision causes RL methods to require large amounts of data, rendering…

Machine Learning · Computer Science 2024-11-22 Sergio A. Serrano , Jose Martinez-Carranza , L. Enrique Sucar

The effects of policy sharing between agents in a multi-agent dynamical system has not been studied extensively. I simulate a system of agents optimizing the same task using reinforcement learning, to study the effects of different…

Multiagent Systems · Computer Science 2008-12-10 Jake Ellowitz