English
Related papers

Related papers: SEAR: Sample Efficient Action Chunking Reinforceme…

200 papers

In this paper, we propose to combine imitation and reinforcement learning via the idea of reward shaping using an oracle. We study the effectiveness of the near-optimal cost-to-go oracle on the planning horizon and demonstrate that the…

Machine Learning · Computer Science 2018-05-30 Wen Sun , J. Andrew Bagnell , Byron Boots

Sim-and-real training is a promising alternative to sim-to-real training for robot manipulations. However, the current sim-and-real training is neither efficient, i.e., slow convergence to the optimal policy, nor effective, i.e., sizeable…

Robotics · Computer Science 2023-09-19 Wenxing Liu , Hanlin Niu , Wei Pan , Guido Herrmann , Joaquin Carrasco

Predicting and executing a sequence of actions without intermediate replanning, known as action chunking, is increasingly used in robot learning from human demonstrations. Yet, its effects on the learned policy remain inconsistent: some…

Robotics · Computer Science 2025-04-28 Yuejiang Liu , Jubayer Ibn Hamid , Annie Xie , Yoonho Lee , Maximilian Du , Chelsea Finn

Modern robotic policies increasingly rely on action chunking to execute complex tasks in the physical world. While action chunking improves temporal consistency at moderate action frequencies, it becomes insufficient when the action…

Robotics · Computer Science 2026-05-26 Kunyun Wang , Yuhang Zheng , Yupeng Zheng , Jieru Zhao , Wenchao Ding

Increasing the size of embedding layers has shown to be effective in improving the performance of recommendation models, yet gradually causing their sizes to exceed terabytes in industrial recommender systems, and hence the increase of…

Information Retrieval · Computer Science 2023-08-21 Beichuan Zhang , Chenggen Sun , Jianchao Tan , Xinjun Cai , Jun Zhao , Mengqi Miao , Kang Yin , Chengru Song , Na Mou , Yang Song

Reinforcement Learning (RL) has achieved remarkable success in various continuous control tasks, such as robot manipulation and locomotion. Different to mainstream RL which makes decisions at individual steps, recent studies have…

Machine Learning · Computer Science 2025-03-07 Buqing Nie , Yangqing Fu , Yue Gao

Diffusion and flow models have emerged as powerful generative approaches capable of modeling diverse and multimodal behavior. However, applying these models to offline reinforcement learning (RL) remains challenging due to the iterative…

Machine Learning · Computer Science 2025-05-30 Nicolas Espinosa-Dice , Yiyi Zhang , Yiding Chen , Bradley Guo , Owen Oertell , Gokul Swamy , Kiante Brantley , Wen Sun

The capability of continuously learning new skills via a sequence of pre-collected offline datasets is desired for an agent. However, consecutively learning a sequence of offline tasks likely leads to the catastrophic forgetting issue under…

Machine Learning · Computer Science 2024-04-23 Sibo Gai , Donglin Wang , Li He

While deep reinforcement learning methods have shown impressive results in robot learning, their sample inefficiency makes the learning of complex, long-horizon behaviors with real robot systems infeasible. To mitigate this issue,…

Machine Learning · Computer Science 2022-04-26 Taewook Nam , Shao-Hua Sun , Karl Pertsch , Sung Ju Hwang , Joseph J Lim

Recent advances in Retrieval-Augmented Generation (RAG) systems have popularized semantic chunking, which aims to improve retrieval performance by dividing documents into semantically coherent segments. Despite its growing adoption, the…

Computation and Language · Computer Science 2024-10-18 Renyi Qu , Ruixuan Tu , Forrest Bao

Even though reinforcement-learning-based algorithms achieved superhuman performance in many domains, the field of robotics poses significant challenges as the state and action spaces are continuous, and the reward function is predominantly…

Reinforcement Learning algorithms can learn complex behavioral patterns for sequential decision making tasks wherein an agent interacts with an environment and acquires feedback in the form of rewards sampled from it. Traditionally, such…

Machine Learning · Computer Science 2020-09-23 Sahil Sharma , Aravind Srinivas , Balaraman Ravindran

Although dense local spatial-temporal features with bag-of-features representation achieve state-of-the-art performance for action recognition, the huge feature number and feature size prevent current methods from scaling up to real size…

Computer Vision and Pattern Recognition · Computer Science 2015-01-29 Youjie Zhou , Hongkai Yu , Song Wang

The history of learning for control has been an exciting back and forth between two broad classes of algorithms: planning and reinforcement learning. Planning algorithms effectively reason over long horizons, but assume access to a local…

Artificial Intelligence · Computer Science 2019-06-13 Benjamin Eysenbach , Ruslan Salakhutdinov , Sergey Levine

Efficiently allocating incoming jobs to nodes in large-scale clusters can lead to substantial improvements in both cluster utilization and job performance. In order to allocate incoming jobs, cluster schedulers usually rely on a set of…

Machine Learning · Computer Science 2026-03-12 Martin Asenov , Qiwen Deng , Gingfung Yeung , Adam Barker

Malicious server (MS) attacks have enabled the scaling of data stealing in federated learning to large batch sizes and secure aggregation, settings previously considered private. However, many concerns regarding the client-side…

Cryptography and Security · Computer Science 2024-04-16 Kostadin Garov , Dimitar I. Dimitrov , Nikola Jovanović , Martin Vechev

Methods that extract policy primitives from offline demonstrations using deep generative models have shown promise at accelerating reinforcement learning(RL) for new tasks. Intuitively, these methods should also help to trainsafeRLagents…

Machine Learning · Computer Science 2022-07-04 Dylan Slack , Yinlam Chow , Bo Dai , Nevan Wichers

User queries in e-commerce search are often vague, short, and underspecified, making it difficult for retrieval systems to match them accurately against structured product catalogs. This challenge is amplified by the one-to-many nature of…

Information Retrieval · Computer Science 2025-09-11 Yipeng Zhang , Bowen Liu , Xiaoshuang Zhang , Aritra Mandal , Canran Xu , Zhe Wu

Vision-Language-Action (VLA) models demonstrate significant potential for developing generalized policies in real-world robotic control. This progress inspires researchers to explore fine-tuning these models with Reinforcement Learning…

Robotics · Computer Science 2025-08-05 Dongchi Huang , Zhirui Fang , Tianle Zhang , Yihang Li , Lin Zhao , Chunhe Xia

As Multimodal Large Language Models (MLLMs) mature, GUI agents are evolving from static interactions to complex navigation. While Reinforcement Learning (RL) has emerged as a promising paradigm for training MLLM agents on dynamic GUI tasks,…