English
Related papers

Related papers: Introspective Experience Replay: Look Back When Su…

200 papers

Neural Collaborative Filtering models are widely used in recommender systems but are typically trained under static settings, assuming fixed data distributions. This limits their applicability in dynamic environments where user preferences…

Information Retrieval · Computer Science 2025-09-10 Yunxiao Shi , Shuo Yang , Haimin Zhang , Li Wang , Yongze Wang , Qiang Wu , Min Xu

Model-based strategies for control are critical to obtain sample efficient learning. Dyna is a planning paradigm that naturally interleaves learning and planning, by simulating one-step experience to update the action-value function. This…

Artificial Intelligence · Computer Science 2018-06-13 Yangchen Pan , Muhammad Zaheer , Adam White , Andrew Patterson , Martha White

We introduce inverse reinforcement learning (IRL) as an effective paradigm for training abstractive summarization models, imitating human summarization behaviors. Our IRL model estimates the reward function using a suite of important…

Computation and Language · Computer Science 2023-12-06 Yu Fu , Deyi Xiong , Yue Dong

We present the extension of the Remember and Forget for Experience Replay (ReF-ER) algorithm to Multi-Agent Reinforcement Learning (MARL). ReF-ER was shown to outperform state of the art algorithms for continuous control in problems ranging…

Machine Learning · Computer Science 2022-09-05 Pascal Weber , Daniel Wälchli , Mustafa Zeqiri , Petros Koumoutsakos

This paper proposes a sample-efficient yet simple approach to learning closed-loop policies for nonprehensile manipulation. Although reinforcement learning (RL) can learn closed-loop policies without requiring access to underlying physics…

Robotics · Computer Science 2018-10-26 Lerrel Pinto , Aditya Mandalika , Brian Hou , Siddhartha Srinivasa

Catastrophic forgetting remains a key challenge in Continual Learning (CL). In replay-based CL with severe memory constraints, performance critically depends on the sample selection strategy for the replay buffer. Most existing approaches…

Machine Learning · Computer Science 2026-04-10 Danit Yanowsky , Daphna Weinshall

Reinforcement Learning (RL) has achieved impressive success in post-training Large Language Models (LLMs) and Vision-Language Models (VLMs), with on-policy algorithms such as PPO, GRPO, and REINFORCE++ serving as the dominant paradigm.…

Computation and Language · Computer Science 2026-04-21 Weiyu Ma , Yongcheng Zeng , Yan Song , Xinyu Cui , Jian Zhao , Xuhui Liu , Mohamed Elhoseiny

While the ``deep reasoning'' paradigm has spurred significant advances in verifiable domains like mathematics, its application to open-ended, creative generation remains a critical challenge. The two dominant methods for instilling…

Artificial Intelligence · Computer Science 2025-09-09 Haozhe Wang , Haoran Que , Qixin Xu , Minghao Liu , Wangchunshu Zhou , Jiazhan Feng , Wanjun Zhong , Wei Ye , Tong Yang , Wenhao Huang , Ge Zhang , Fangzhen Lin

Emotional support conversations require more than fluent responses. Supporters need to understand the seeker's situation and emotions, adopt an appropriate strategy, and respond in a natural, human-like manner. Despite advances in large…

Computation and Language · Computer Science 2026-04-10 Yunxiao Wang , Meng Liu , Kaiyu Jiang , Bin Wen , Fan Yang , Tingting Gao , Lizi Liao

Process mining is a methodology for the derivation and analysis of process models based on the event log. When process mining is employed to analyze business processes, the process discovery step, the conformance checking step, and the…

Machine Learning · Computer Science 2022-12-01 Sunghyun Sim , Ling Liu , Hyerim Bae

We propose $\textit{iterative inversion}$ -- an algorithm for learning an inverse function without input-output pairs, but only with samples from the desired output distribution and access to the forward function. The key challenge is a…

Machine Learning · Computer Science 2023-05-31 Gal Leibovich , Guy Jacob , Or Avner , Gal Novik , Aviv Tamar

In multi-goal reinforcement learning (RL) settings, the reward for each goal is sparse, and located in a small neighborhood of the goal. In large dimension, the probability of reaching a reward vanishes and the agent receives little…

Machine Learning · Computer Science 2021-06-17 Léonard Blier , Yann Ollivier

This paper introduces a novel perspective to significantly mitigate catastrophic forgetting in continuous learning (CL), which emphasizes models' capacity to preserve existing knowledge and assimilate new information. Current replay-based…

Machine Learning · Computer Science 2024-04-10 Jianshu Zhang , Yankai Fu , Ziheng Peng , Dongyu Yao , Kun He

State of the art deep reinforcement learning algorithms are sample inefficient due to the large number of episodes they require to achieve asymptotic performance. Episodic Reinforcement Learning (ERL) algorithms, inspired by the mammalian…

Machine Learning · Computer Science 2024-06-07 Ismael T. Freire , Adrián F. Amil , Paul F. M. J. Verschure

Dealing with sparse rewards is one of the biggest challenges in Reinforcement Learning (RL). We present a novel technique called Hindsight Experience Replay which allows sample-efficient learning from rewards which are sparse and binary and…

We introduce REPRISE, a REtrospective and PRospective Inference SchEme, which learns temporal event-predictive models of dynamical systems. REPRISE infers the unobservable contextual event state and accompanying temporal predictive models…

Machine Learning · Computer Science 2019-05-03 Martin V. Butz , David Bilkey , Dania Humaidan , Alistair Knott , Sebastian Otte

Unified Multimodal Models (UMMs) exhibit strong understanding, yet this capability often fails to effectively guide generation. We identify this as a Cognitive Gap: the model lacks the understanding of how to enhance its own generation…

Artificial Intelligence · Computer Science 2026-01-29 Zhenchen Tang , Songlin Yang , Zichuan Wang , Bo Peng , Yang Li , Beibei Dong , Jing Dong

Online Reinforcement Learning (RL) offers a promising paradigm for enhancing GUI agents through direct environment interaction. However, its effectiveness is severely hindered by inefficient credit assignment in long-horizon tasks and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Han Xiao , Guozhi Wang , Hao Wang , Shilong Liu , Yuxiang Chai , Yue Pan , Yufeng Zhou , Xiaoxin Chen , Yafei Wen , Hongsheng Li

Recent studies in reinforcement learning (RL) have made significant progress by leveraging function approximation to alleviate the sample complexity hurdle for better performance. Despite the success, existing provably efficient algorithms…

Machine Learning · Computer Science 2023-11-07 Nikki Lijing Kuang , Ming Yin , Mengdi Wang , Yu-Xiang Wang , Yi-An Ma

Multi-goal reinforcement learning is widely applied in planning and robot manipulation. Two main challenges in multi-goal reinforcement learning are sparse rewards and sample inefficiency. Hindsight Experience Replay (HER) aims to tackle…

Machine Learning · Computer Science 2022-09-27 Rui Yang , Jiafei Lyu , Yu Yang , Jiangpeng Yan , Feng Luo , Dijun Luo , Lanqing Li , Xiu Li
‹ Prev 1 8 9 10 Next ›