English
Related papers

Related papers: Beyond the Majority: Long-tail Imitation Learning …

200 papers

When cast into the Deep Reinforcement Learning framework, many robotics tasks require solving a long horizon and sparse reward problem, where learning algorithms struggle. In such context, Imitation Learning (IL) can be a powerful approach…

Artificial Intelligence · Computer Science 2023-04-14 Alexandre Chenu , Nicolas Perrin-Gilbert , Olivier Sigaud

How to train a generalizable meta-policy by continually learning a sequence of tasks? It is a natural human skill yet challenging to achieve by current reinforcement learning: the agent is expected to quickly adapt to new tasks (plasticity)…

Machine Learning · Computer Science 2023-06-06 Yijun Yang , Tianyi Zhou , Jing Jiang , Guodong Long , Yuhui Shi

Memory is critical for long-horizon and history-dependent robotic manipulation. Such tasks often involve counting repeated actions or manipulating objects that become temporarily occluded. Recent vision-language-action (VLA) models have…

Robotics · Computer Science 2026-05-27 Yinpei Dai , Hongze Fu , Jayjun Lee , Yuejiang Liu , Haoran Zhang , Jianing Yang , Chelsea Finn , Nima Fazeli , Joyce Chai

Real-world data usually couples the label ambiguity and heavy imbalance, challenging the algorithmic robustness of partial label learning (PLL) and long-tailed learning (LT). The straightforward combination of LT and PLL, i.e., LT-PLL,…

Machine Learning · Computer Science 2023-02-13 Feng Hong , Jiangchao Yao , Zhihan Zhou , Ya Zhang , Yanfeng Wang

Imitation learning (IL) enables robots to acquire skills quickly by transferring expert knowledge, which is widely adopted in reinforcement learning (RL) to initialize exploration. However, in long-horizon motion planning tasks, a…

Robotics · Computer Science 2021-03-30 Sha Luo , Hamidreza Kasaei , Lambert Schomaker

Reinforcement learning (RL) is a promising avenue for post-training vision-language-action (VLA) models, but practical deployment is hindered by sparse rewards and unstable training. This work mitigates these challenges by introducing an…

Shared autonomy holds promise for improving the usability and accessibility of assistive robotic arms, but current methods often rely on costly expert demonstrations and remain static after pretraining, limiting their ability to handle…

Robotics · Computer Science 2025-07-28 Yiran Tao , Guixiu Qiao , Dan Ding , Zackory Erickson

Reinforcement learning in partially observable domains is challenging due to the lack of observable state information. Thankfully, learning offline in a simulator with such state information is often possible. In particular, we propose a…

Robotics · Computer Science 2022-11-11 Hai Nguyen , Andrea Baisero , Dian Wang , Christopher Amato , Robert Platt

Long-tailed data is a special type of multi-class imbalanced data with a very large amount of minority/tail classes that have a very significant combined influence. Long-tailed learning aims to build high-performance models on datasets with…

Machine Learning · Computer Science 2024-08-02 Chongsheng Zhang , George Almpanidis , Gaojuan Fan , Binquan Deng , Yanbo Zhang , Ji Liu , Aouaidjia Kamel , Paolo Soda , João Gama

In this work, we introduce a novel strategy for long-tail recognition that addresses the tail classes' few-shot problem via training-free knowledge transfer. Our objective is to transfer knowledge acquired from information-rich common…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Sarah Parisot , Pedro M. Esperanca , Steven McDonagh , Tamas J. Madarasz , Yongxin Yang , Zhenguo Li

Latent Dirichlet allocation (LDA) is a popular topic modeling technique in academia but less so in industry, especially in large-scale applications involving search engine and online advertising systems. A main underlying reason is that the…

Information Retrieval · Computer Science 2015-12-08 Yi Wang , Xuemin Zhao , Zhenlong Sun , Hao Yan , Lifeng Wang , Zhihui Jin , Liubin Wang , Yang Gao , Ching Law , Jia Zeng

We propose a decentralized, learning-based framework for dynamic coalition formation in Multi-Robot Task Allocation (MRTA). Our approach extends MAPPO by integrating spatial action maps, robot motion planning, intention sharing, and task…

Robotics · Computer Science 2025-07-18 Lucas C. D. Bezerra , Ataíde M. G. dos Santos , Shinkyu Park

Humans routinely rely on memory to perform tasks, yet most robot policies lack this capability; our goal is to endow robot policies with the same ability. Naively conditioning on long observation histories is computationally expensive and…

Robotics · Computer Science 2025-10-24 Ajay Sridhar , Jennifer Pan , Satvik Sharma , Chelsea Finn

Class-incremental learning is dedicated to the development of deep learning models that are capable of acquiring new knowledge while retaining previously learned information. Most methods focus on balanced data distribution for each task,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Linjie Li , Zhenyu Wu , Jiaming Liu , Yang Ji

Data Augmentation is a common technique used to enhance the performance of deep learning models by expanding the training dataset. Automatic Data Augmentation (ADA) methods are getting popular because of their capacity to generate policies…

Machine Learning · Computer Science 2024-04-02 Tien-Yu Chang , Hao Dai , Vincent S. Tseng

Reinforcement learning (RL) has emerged as an effective approach for enhancing the reasoning capabilities of large language models (LLMs), especially in scenarios where supervised fine-tuning (SFT) falls short due to limited…

Machine Learning · Computer Science 2026-04-15 Jian Xiong , Jingbo Zhou , Jingyong Ye , Qiang Huang , Dejing Dou

In recent years, imitation learning has made progress in the field of robotic manipulation. However, it still faces challenges when addressing complex long-horizon tasks with deformable objects, such as high-dimensional state spaces,…

Robotics · Computer Science 2025-03-14 Wendi Chen , Han Xue , Fangyuan Zhou , Yuan Fang , Cewu Lu

Learning to coordinate is a daunting problem in multi-agent reinforcement learning (MARL). Previous works have explored it from many facets, including cognition between agents, credit assignment, communication, expert demonstration, etc.…

Multiagent Systems · Computer Science 2022-05-24 Yue Jin , Shuangqing Wei , Jian Yuan , Xudong Zhang

Adversarial imitation learning (AIL) has become a popular alternative to supervised imitation learning that reduces the distribution shift suffered by the latter. However, AIL requires effective exploration during an online reinforcement…

Machine Learning · Computer Science 2023-10-16 Trevor Ablett , Bryan Chan , Jonathan Kelly

Imitation learning (IL) has proven to be an effective method for learning good policies from expert demonstrations. Adversarial imitation learning (AIL), a subset of IL methods, is particularly promising, but its theoretical foundation in…

Machine Learning · Computer Science 2023-06-14 Tian Xu , Ziniu Li , Yang Yu , Zhi-Quan Luo