English
Related papers

Related papers: SuS: Strategy-aware Surprise for Intrinsic Explora…

200 papers

Reinforcement Learning (RL) has emerged as a powerful paradigm for advancing Large Language Models (LLMs), achieving remarkable performance in complex reasoning domains such as mathematics and code generation. However, current RL methods…

Machine Learning · Computer Science 2025-12-10 Jingyu Xing , Chenwei Tang , Xinyu Liu , Deng Xiong , Shudong Huang , Wei Ju , Jiancheng Lv , Ziyue Qiao

Intrinsic motivation enables reinforcement learning (RL) agents to explore when rewards are very sparse, where traditional exploration heuristics such as Boltzmann or e-greedy would typically fail. However, intrinsic exploration is…

Machine Learning · Computer Science 2020-04-07 Philippe Morere , Fabio Ramos

Recent research on structured exploration placed emphasis on identifying novel states in the state space and incentivizing the agent to revisit them through intrinsic reward bonuses. In this study, we question whether the performance boost…

Machine Learning · Computer Science 2020-11-12 Sneha Aenugu

As machine learning models become more capable, they have exhibited increased potential in solving complex tasks. One of the most promising directions uses deep reinforcement learning to train autonomous agents in computer network defense…

Machine Learning · Computer Science 2023-10-23 Elizabeth Bates , Vasilios Mavroudis , Chris Hicks

Exploration is essential in reinforcement learning as an agent relies on trial and error to learn an optimal policy. However, when rewards are sparse, naive exploration strategies, like noise injection, are often insufficient. Intrinsic…

Machine Learning · Computer Science 2026-01-30 Minjae Cho , Huy Trong Tran

Sparse-reward domains are challenging for reinforcement learning algorithms since significant exploration is needed before encountering reward for the first time. Hierarchical reinforcement learning can facilitate exploration by reducing…

Machine Learning · Computer Science 2020-11-13 Lorenzo Steccanella , Simone Totaro , Damien Allonsius , Anders Jonsson

Supervised machine learning often encounters concept drift, where the data distribution changes over time, degrading model performance. Existing drift detection methods focus on identifying these shifts but often overlook the challenge of…

Machine Learning · Computer Science 2024-11-06 Christofer Fellicious , Lorenz Wendlinger , Mario Gancarski , Jelena Mitrovic , Michael Granitzer

Modern chess engines achieve superhuman performance through deep tree search and regressive evaluation, while human players rely on intuition to select candidate moves followed by a shallow search to validate them. To model this…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Andrew Hamara , Greg Hamerly , Pablo Rivas , Andrew C. Freeman

Sparse attention reduces the quadratic complexity of full self-attention but faces two challenges: (1) an attention gap, where applying sparse attention to full-attention-trained models causes performance degradation due to train-inference…

Computation and Language · Computer Science 2026-02-02 Zhenyi Shen , Junru Lu , Lin Gui , Jiazheng Li , Yulan He , Di Yin , Xing Sun

Q-learning and SARSA are foundational reinforcement learning algorithms whose practical success depends critically on step-size calibration. Step-sizes that are too large can cause numerical instability, while step-sizes that are too small…

Machine Learning · Statistics 2026-01-28 Hwanwoo Kim , Eric Laber

How have individuals of social animals in nature evolved to learn from each other, and what would be the optimal strategy for such learning in a specific environment? Here, we address both problems by employing a deep reinforcement learning…

Machine Learning · Computer Science 2023-02-17 Seungwoong Ha , Hawoong Jeong

Exploring in environments with high-dimensional observations is hard. One promising approach for exploration is to use intrinsic rewards, which often boils down to estimating "novelty" of states, transitions, or trajectories with deep…

Machine Learning · Computer Science 2023-05-17 Toru Lin , Allan Jabri

Learning in environments with sparse rewards remains a fundamental challenge in reinforcement learning. Artificial curiosity addresses this limitation through intrinsic rewards to guide exploration, however, the precise formulation of these…

Machine Learning · Computer Science 2026-04-20 Alexander Nedergaard , Pablo A. Morales

Due to increasing privacy concerns, neural network (NN) based secure inference (SI) schemes that simultaneously hide the client inputs and server models attract major research interests. While existing works focused on developing secure…

Cryptography and Security · Computer Science 2020-02-18 Song Bian , Weiwen Jiang , Qing Lu , Yiyu Shi , Takashi Sato

Background: Exploration of the physical environment is an indispensable precursor to information acquisition and knowledge consolidation for living organisms. Yet, current artificial intelligence models lack these autonomy capabilities…

Artificial Intelligence · Computer Science 2025-09-10 Gustavo Assunção , Miguel Castelo-Branco , Paulo Menezes

We conduct an incentivized lab experiment to test participants' ability to understand the DA matching mechanism and the strategyproofness property, conveyed in different ways. We find that while many participants can (using a novel GUI)…

General Economics · Economics 2024-09-30 Yannai A. Gonczarowski , Ori Heffetz , Guy Ishai , Clayton Thomas

Offline reinforcement learning (RL) has emerged as a prevalent and effective methodology for real-world recommender systems, enabling learning policies from historical data and capturing user preferences. In offline RL, reward shaping…

Information Retrieval · Computer Science 2025-07-01 Wenzheng Shu , Yanxiang Zeng , Yongxiang Tang , Teng Sha , Ning Luo , Yanhua Cheng , Xialong Liu , Fan Zhou , Peng Jiang

Learning effective pricing strategies is crucial in digital marketplaces, especially when buyers' valuations are unknown and must be inferred through interaction. We study the online contextual pricing problem, where a seller observes a…

Computer Science and Game Theory · Computer Science 2026-02-18 Joon Suk Huh , Kirthevasan Kandasamy

Learning effective policies for sparse objectives is a key challenge in Deep Reinforcement Learning (RL). A common approach is to design task-related dense rewards to improve task learnability. While such rewards are easily interpreted,…

Machine Learning · Computer Science 2020-10-12 Hassam Sheikh , Shauharda Khadka , Santiago Miret , Somdeb Majumdar

Understanding the agent's learning process, particularly the factors that contribute to its success or failure post-training, is crucial for comprehending the rationale behind the agent's decision-making process. Prior methods clarify the…

Artificial Intelligence · Computer Science 2024-10-15 Shuang Ao , Simon Khan , Haris Aziz , Flora D. Salim