English
Related papers

Related papers: A New Autoregressive Neural Network Model with Com…

200 papers

Mainstream visuomotor policies predominantly rely on generative models for holistic action prediction, while current autoregressive policies, predicting the next token or chunk, have shown suboptimal results. This motivates a search for…

Robotics · Computer Science 2025-03-18 Yue Su , Xinyu Zhan , Hongjie Fang , Han Xue , Hao-Shu Fang , Yong-Lu Li , Cewu Lu , Lixin Yang

Human brain and behavior provide a rich venue that can inspire novel control and learning methods for robotics. In an attempt to exemplify such a development by inspiring how humans acquire knowledge and transfer skills among tasks, we…

Robotics · Computer Science 2025-01-10 Suzan Ece Ada , Hanne Say , Emre Ugur , Erhan Oztop

Robots can learn to imitate humans by inferring what the human is optimizing for. One common framework for this is Bayesian reward learning, where the robot treats the human's demonstrations and corrections as observations of their…

Robotics · Computer Science 2023-10-20 Joshua Hoegerman , Dylan P. Losey

In recent years, imitation learning using neural networks has enabled robots to perform flexible tasks. However, since neural networks operate in a feedforward structure, they do not possess a mechanism to compensate for output errors. To…

Robotics · Computer Science 2024-11-20 Hiroshi Sato , Masashi Konosu , Sho Sakaino , Toshiaki Tsuji

This paper introduces a new method for safety-aware robot learning, focusing on repairing policies using predictive models. Our method combines behavioral cloning with neural network repair in a two-step supervised learning framework. It…

Robotics · Computer Science 2024-11-08 Keyvan Majd , Geoffrey Clark , Georgios Fainekos , Heni Ben Amor

Forward and inverse kinematics models are fundamental to robot arms, serving as the basis for the robot arm's operational tasks. However, in model learning of robot arms, especially in the presence of redundant degrees of freedom, inverse…

Robotics · Computer Science 2025-04-24 Qu Weiming , Liu Tianlin , Wu Xihong , Luo Dingsheng

Modern robots face challenges shared by humans, where machines must learn multiple sensorimotor skills and express them adaptively. Equipping robots with a human-like memory of how it feels to do multiple stereotypical movements can make…

Robotics · Computer Science 2026-05-14 Pranav Mahajan , Mufeng Tang , T. Ed Li , Ioannis Havoutis , Ben Seymour

For model-free reinforcement learning, one of the main difficulty of stochastic Bellman residual minimization is the double sampling problem, i.e., while only one single sample for the next state is available in the model-free setting, two…

Optimization and Control · Mathematics 2020-09-30 Yuhua Zhu , Lexing Ying

Recent years have witnessed many successful trials in the robot learning field. For contact-rich robotic tasks, it is challenging to learn coordinated motor skills by reinforcement learning. Imitation learning solves this problem by using a…

Robotics · Computer Science 2023-11-02 Linqi Ye , Jiayi Li , Yi Cheng , Xianhao Wang , Bin Liang , Yan Peng

Deep learning techniques have been widely applied, achieving state-of-the-art results in various fields of study. This survey focuses on deep learning solutions that target learning control policies for robotics applications. We carry out…

Robotics · Computer Science 2018-04-10 Lei Tai , Jingwei Zhang , Ming Liu , Joschka Boedecker , Wolfram Burgard

Hippocampal reverse replay is thought to contribute to learning, and particularly reinforcement learning, in animals. We present a computational model of learning in the hippocampus that builds on a previous model of the…

Neurons and Cognition · Quantitative Biology 2021-02-25 Matthew T. Whelan , Tony J. Prescott , Eleni Vasilaki

As the embodiment gap between a robot and a human narrows, new opportunities arise to leverage datasets of humans interacting with their surroundings for robot learning. We propose a novel technique for training sensorimotor policies with…

Robotics · Computer Science 2025-08-27 Himanshu Gaurav Singh , Pieter Abbeel , Jitendra Malik , Antonio Loquercio

As robots increasingly enter human-centered environments, they must not only be able to navigate safely around humans, but also adhere to complex social norms. Humans often rely on non-verbal communication through gestures and facial…

Accurately modeling robot dynamics is crucial to safe and efficient motion control. In this paper, we develop and apply an iterative learning semi-parametric model, with a neural network, to the task of autonomous racing with a Model…

Robotics · Computer Science 2020-11-18 Ignat Georgiev , Christoforos Chatzikomis , Timo Völkl , Joshua Smith , Michael Mistry

In recent years, reinforcement learning and imitation learning have shown great potential for controlling humanoid robots' motion. However, these methods typically create simulation environments and rewards for specific tasks, resulting in…

Robotics · Computer Science 2024-08-01 Jingkai Sun , Qiang Zhang , Yiqun Duan , Xiaoyang Jiang , Chong Cheng , Renjing Xu

A properly designed controller can help improve the quality of experimental measurements or force a dynamical system to follow a completely new time-evolution path. Recent developments in deep reinforcement learning have made steep advances…

Statistical Mechanics · Physics 2025-02-26 Ruslan Mukhamadiarov

Operating directly from raw high dimensional sensory inputs like images is still a challenge for robotic control. Recently, Reinforcement Learning methods have been proposed to solve specific tasks end-to-end, from pixels to torques.…

Machine Learning · Computer Science 2019-01-07 Carlos Florensa , Jonas Degrave , Nicolas Heess , Jost Tobias Springenberg , Martin Riedmiller

Imitation learning is a popular method for teaching robots new behaviors. However, most existing methods focus on teaching short, isolated skills rather than long, multi-step tasks. To bridge this gap, imitation learning algorithms must not…

Artificial Intelligence · Computer Science 2025-11-04 Leon Keller , Daniel Tanneberg , Jan Peters

State-space models (SSMs) offer a powerful framework for dynamical system analysis, wherein the temporal dynamics of the system are assumed to be captured through the evolution of the latent states, which govern the values of the…

Machine Learning · Statistics 2024-12-17 Jiahe Lin , George Michailidis

The goal of imitation learning is to mimic expert behavior from demonstrations, without access to an explicit reward signal. A popular class of approach infers the (unknown) reward function via inverse reinforcement learning (IRL) followed…

Machine Learning · Computer Science 2022-04-19 Carl Qi , Pieter Abbeel , Aditya Grover