English
Related papers

Related papers: Imitation Learning with Human Eye Gaze via Multi-O…

200 papers

Imitation learning is an effective and safe technique to train robot policies in the real world because it does not depend on an expensive random exploration process. However, due to the lack of exploration, learning policies that…

Robotics · Computer Science 2021-06-24 Ajay Mandlekar , Danfei Xu , Roberto Martín-Martín , Silvio Savarese , Li Fei-Fei

Current lane detection methods are struggling with the invisibility lane issue caused by heavy shadows, severe road mark degradation, and serious vehicle occlusion. As a result, discriminative lane features can be barely learned by the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Yue He , Minyue Jiang , Xiaoqing Ye , Liang Du , Zhikang Zou , Wei Zhang , Xiao Tan , Errui Ding

Electromyography (EMG)-based gesture recognition is a promising approach for designing intuitive human-computer interfaces. However, while these systems typically perform well in controlled laboratory settings, their usability in real-world…

Human-Computer Interaction · Computer Science 2025-05-12 Gabriel Gagné , Anisha Azad , Thomas Labbé , Evan Campbell , Xavier Isabel , Erik Scheme , Ulysse Côté-Allard , Benoit Gosselin

Interactive imitation learning is an efficient, model-free method through which a robot can learn a task by repetitively iterating an execution of a learning policy and a data collection by querying human demonstrations. However, deploying…

Robotics · Computer Science 2024-02-22 Hanbit Oh , Takamitsu Matsubara

Imitation learning targets deriving a mapping from states to actions, a.k.a. policy, from expert demonstrations. Existing methods for imitation learning typically require any actions in the demonstrations to be fully available, which is…

Machine Learning · Computer Science 2019-06-25 Mingfei Sun , Xiaojuan Ma

Interactive Imitation Learning (IIL) is a branch of Imitation Learning (IL) where human feedback is provided intermittently during robot execution allowing an online improvement of the robot's behavior. In recent years, IIL has increasingly…

Appearance-based gaze estimation, aiming to predict accurate 3D gaze direction from a single facial image, has made promising progress in recent years. However, most methods suffer significant performance degradation in cross-domain…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Qida Tan , Hongyu Yang , Wenchao Du

In recent years, the development of robotics and artificial intelligence (AI) systems has been nothing short of remarkable. As these systems continue to evolve, they are being utilized in increasingly complex and unstructured environments,…

Machine Learning · Computer Science 2024-10-28 Maryam Zare , Parham M. Kebria , Abbas Khosravi , Saeid Nahavandi

Imitation learning has been a trend recently, yet training a generalist agent across multiple tasks still requires large-scale expert demonstrations, which are costly and labor-intensive to collect. To address the challenge of limited…

Robotics · Computer Science 2025-09-25 Yifan Ye , Jun Cen , Jing Chen , Zhihe Lu

Vision-based imitation learning has shown promise for robotic manipulation; however, its generalization remains limited in practical agricultural tasks. This limitation stems from scarce demonstration data and substantial visual domain gaps…

Robotics · Computer Science 2026-03-06 Shun Hattori , Hikaru Sasaki , Takumi Hachimine , Yusuke Mizutani , Takamitsu Matsubara

Generative adversarial imitation learning (GAIL) is a popular inverse reinforcement learning approach for jointly optimizing policy and reward from expert trajectories. A primary question about GAIL is whether applying a certain policy…

Machine Learning · Computer Science 2020-06-26 Ziwei Guan , Tengyu Xu , Yingbin Liang

Eye-tracking applications that utilize the human gaze in video understanding tasks have become increasingly important. To effectively automate the process of video analysis based on eye-tracking data, it is important to accurately replicate…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Suleyman Ozdel , Yao Rong , Berat Mert Albaba , Yen-Ling Kuo , Xi Wang , Enkelejda Kasneci

Imitation Learning (IL) enables robots to learn complex skills from demonstrations without explicit task modeling, but it typically requires large amounts of demonstrations, creating significant collection costs. Prior work has investigated…

Robotics · Computer Science 2026-03-02 Runze Tang , Penny Sweetser

Human gaze is known to be a strong indicator of underlying human intentions and goals during manipulation tasks. This work studies gaze patterns of human teachers demonstrating tasks to robots and proposes ways in which such patterns can be…

Robotics · Computer Science 2021-11-30 Akanksha Saran , Elaine Schaertl Short , Andrea Thomaz , Scott Niekum

Recent years have seen substantial progress in neural generation of text, images, and audio, supported by mature training pipelines and large-scale optimization. For graphs, however, comparable progress has been more limited. We attribute…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 André Eberhard , Gerhard Neumann , Pascal Friederich

In-context imitation learning enables robots to adapt to new tasks from a small number of demonstrations without additional training. However, existing approaches typically condition only on state-action trajectories and lack explicit…

Robotics · Computer Science 2026-03-10 Toan Nguyen , Weiduo Yuan , Songlin Wei , Hui Li , Daniel Seita , Yue Wang

Learning motor skills for sports or performance driving is often done with professional instruction from expert human teachers, whose availability is limited. Our goal is to enable automated teaching via a learned model that interacts with…

The goal of imitation learning (IL) is to learn a good policy from high-quality demonstrations. However, the quality of demonstrations in reality can be diverse, since it is easier and cheaper to collect demonstrations from a mix of experts…

Machine Learning · Computer Science 2019-09-17 Voot Tangkaratt , Bo Han , Mohammad Emtiyaz Khan , Masashi Sugiyama

Generative adversarial imitation learning (GAIL) demonstrates tremendous success in practice, especially when combined with neural networks. Different from reinforcement learning, GAIL learns both policy and reward function from expert…

Machine Learning · Computer Science 2020-06-26 Yufeng Zhang , Qi Cai , Zhuoran Yang , Zhaoran Wang

Graph-based Active Learning (AL) leverages the structure of graphs to efficiently prioritize label queries, reducing labeling costs and user burden in applications like health monitoring, human behavior analysis, and sensor networks. By…

Machine Learning · Computer Science 2025-06-13 Maryam Khalid , Akane Sano