English
Related papers

Related papers: Train Offline, Test Online: A Real Robot Learning …

200 papers

Prior work has established Test-Time Training (TTT) as a general framework to further improve a trained model at test time. Before making a prediction on each test instance, the model is first trained on the same instance using a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Renhao Wang , Yu Sun , Arnuv Tandon , Yossi Gandelsman , Xinlei Chen , Alexei A. Efros , Xiaolong Wang

Predictive human models often need to adapt their parameters online from human data. This raises previously ignored safety-related questions for robots relying on these models such as what the model could learn online and how quickly could…

Robotics · Computer Science 2021-10-01 Andrea Bajcsy , Anand Siththaranjan , Claire J. Tomlin , Anca D. Dragan

Offline reinforcement learning (RL) is a learning paradigm where an agent learns from a fixed dataset of experience. However, learning solely from a static dataset can limit the performance due to the lack of exploration. To overcome it,…

Machine Learning · Computer Science 2024-07-23 Kai Zhao , Jianye Hao , Yi Ma , Jinyi Liu , Yan Zheng , Zhaopeng Meng

Understanding the continuous states of objects is essential for task learning and planning in the real world. However, most existing task learning benchmarks assume discrete (e.g., binary) object goal states, which poses challenges for the…

Open-ended learning is a core research field of developmental robotics and AI aiming to build learning machines and robots that can autonomously acquire knowledge and skills incrementally as infants and children. The first contribution of…

Robotics · Computer Science 2022-03-03 Emilio Cartoni , Davide Montella , Jochen Triesch , Gianluca Baldassarre

This paper presents a joint effort towards the development of a data-driven Social Robot Navigation metric to facilitate benchmarking and policy optimization for ground robots. We compiled a dataset with 4427 trajectories -- 182 real and…

Sample efficiency is critical when applying learning-based methods to robotic manipulation due to the high cost of collecting expert demonstrations and the challenges of on-robot policy learning through online Reinforcement Learning (RL).…

Machine Learning · Computer Science 2024-06-21 Arsh Tangri , Ondrej Biza , Dian Wang , David Klee , Owen Howell , Robert Platt

Equity is a core concern of learning analytics. However, applications that teach and assess equity skills, particularly at scale are lacking, often due to barriers in evaluating language. Advances in generative AI via large language models…

Human-Computer Interaction · Computer Science 2024-12-17 Danielle R. Thomas , Conrad Borchers , Sanjit Kakarla , Jionghao Lin , Shambhavi Bhushan , Boyuan Guo , Erin Gatz , Kenneth R. Koedinger

Learning robotic tasks in the real world is still highly challenging and effective practical solutions remain to be found. Traditional methods used in this area are imitation learning and reinforcement learning, but they both have…

Machine Learning · Computer Science 2022-08-02 Abdalkarim Mohtasib , Gerhard Neumann , Heriberto Cuayahuitl

Imitation learning is an effective and safe technique to train robot policies in the real world because it does not depend on an expensive random exploration process. However, due to the lack of exploration, learning policies that…

Robotics · Computer Science 2021-06-24 Ajay Mandlekar , Danfei Xu , Roberto Martín-Martín , Silvio Savarese , Li Fei-Fei

We study the problem of learning a range of vision-based manipulation tasks from a large offline dataset of robot interaction. In order to accomplish this, humans need easy and effective ways of specifying tasks to the robot. Goal images…

Robotics · Computer Science 2021-11-02 Suraj Nair , Eric Mitchell , Kevin Chen , Brian Ichter , Silvio Savarese , Chelsea Finn

This study provides a systematic review of the recent advances in designing the intelligent tutoring robot (ITR), and summarises the status quo of applying artificial intelligence (AI) techniques. We first analyse the environment of the ITR…

Artificial Intelligence · Computer Science 2019-03-11 Jinyu Yang , Bo Zhang

Collecting data online via crowdsourcing platforms has proven to be a very efficient way to recruit a large and diverse sample. Studies of motor learning, however, have been largely confined to the lab due to the need for special equipment…

Neurons and Cognition · Quantitative Biology 2022-12-12 Jonathan S. Tsay , Alan Lee , Richard B. Ivry , Guy Avraham

Simulators are a critical component of modern robotics research. Strategies for both perception and decision making can be studied in simulation first before deployed to real world systems, saving on time and costs. Despite significant…

Machine Learning · Computer Science 2020-11-19 Bhairav Mehta , Ankur Handa , Dieter Fox , Fabio Ramos

Shared control systems aim to combine human and robot abilities to improve task performance. However, achieving optimal performance requires that the robot's level of assistance adjusts the operator's cognitive workload in response to the…

Robotics · Computer Science 2025-04-22 Jiahe Pan , Jonathan Eden , Denny Oetomo , Wafa Johal

Recent advances in predicting 6D grasp poses from a single depth image have led to promising performance in robotic grasping. However, previous grasping models face challenges in cluttered environments where nearby objects impact the target…

Robotics · Computer Science 2024-07-09 Yan Xia , Ran Ding , Ziyuan Qin , Guanqi Zhan , Kaichen Zhou , Long Yang , Hao Dong , Daniel Cremers

The increasing level of autonomy of robots poses challenges of trust and social acceptance, especially in human-robot interaction scenarios. This requires an interpretable implementation of robotic cognitive capabilities, possibly based on…

Artificial Intelligence · Computer Science 2025-01-14 Daniele Meli , Paolo Fiorini

Offline-to-online reinforcement learning (O2O RL) aims to obtain a continually improving policy as it interacts with the environment, while ensuring the initial policy behaviour is satisficing. This satisficing behaviour is necessary for…

Robotics · Computer Science 2025-01-24 Bryan Chan , Anson Leung , James Bergstra

Learning to optimize (L2O) is an emerging approach that leverages machine learning to develop optimization methods, aiming at reducing the laborious iterations of hand engineering. It automates the design of an optimization method based on…

Optimization and Control · Mathematics 2021-07-05 Tianlong Chen , Xiaohan Chen , Wuyang Chen , Howard Heaton , Jialin Liu , Zhangyang Wang , Wotao Yin

A long-standing goal in robot learning is to develop methods for robots to acquire new skills autonomously. While reinforcement learning (RL) comes with the promise of enabling autonomous data collection, it remains challenging to scale in…

Robotics · Computer Science 2024-11-05 Suvir Mirchandani , Suneel Belkhale , Joey Hejna , Evelyn Choi , Md Sazzad Islam , Dorsa Sadigh