English
Related papers

Related papers: Variable-Agnostic Causal Exploration for Reinforce…

200 papers

Model-based reinforcement learning (RL) methods are appealing in the offline setting because they allow an agent to reason about the consequences of actions without interacting with the environment. Prior methods learn a 1-step dynamics…

Machine Learning · Computer Science 2022-11-07 Bogdan Mazoure , Benjamin Eysenbach , Ofir Nachum , Jonathan Tompson

Recent advancements in agentic test-time scaling allow models to gather environmental feedback before committing to final actions. A key limitation of existing methods is that they typically employ undifferentiated exploration strategies,…

Artificial Intelligence · Computer Science 2026-05-13 Xingyuan Hua , Sheng Yue , Ju Ren

Despite progress in visual perception tasks such as image classification and detection, computers still struggle to understand the interdependency of objects in the scene as a whole, e.g., relations between objects or their attributes.…

Computer Vision and Pattern Recognition · Computer Science 2017-03-10 Xiaodan Liang , Lisa Lee , Eric P. Xing

Reinforcement learning is an essential paradigm for solving sequential decision problems under uncertainty. Despite many remarkable achievements in recent decades, applying reinforcement learning methods in the real world remains…

Machine Learning · Computer Science 2023-11-22 Zhihong Deng , Jing Jiang , Guodong Long , Chengqi Zhang

Reinforcement Learning (RL) has achieved significant success in solving single-goal tasks. However, uniform goal selection often results in sample inefficiency in multi-goal settings where agents must learn a universal goal-conditioned…

Machine Learning · Computer Science 2025-12-30 Gaurav Chaudhary , Laxmidhar Behera

The alignment between humans and machines is a critical challenge in artificial intelligence today. Reinforcement learning, which aims to maximize a reward function, is particularly vulnerable to the risks associated with poorly designed…

Artificial Intelligence · Computer Science 2025-10-29 Valentin Cuzin-Rambaud , Emilien Komlenovic , Alexandre Faure , Bruno Yun

We introduce CausaLab, a scalable environment for evaluating interactive causal discovery by LLM agents. Unlike prior evaluations, CausaLab evaluates both whether an agent can solve a problem using causal evidence and whether its answer is…

Artificial Intelligence · Computer Science 2026-05-29 Junlin Yang , Dylan Zhang , Xiangchen Song , Qirun Dai , Xiao Liu , Yuen Chen , Aniket Vashishtha , Jing Shi , Chenhao Tan , Hao Peng

Audio-visual speech recognition (AVSR) has gained remarkable success for ameliorating the noise-robustness of speech recognition. Mainstream methods focus on fusing audio and visual inputs to obtain modality-invariant representations.…

Sound · Computer Science 2023-02-03 Chen Chen , Yuchen Hu , Qiang Zhang , Heqing Zou , Beier Zhu , Eng Siong Chng

Reinforcement learning (RL) in real-world safety-critical target settings like urban driving is hazardous, imperiling the RL agent, other agents, and the environment. To overcome this difficulty, we propose a "safety-critical adaptation"…

Machine Learning · Computer Science 2021-01-19 Jesse Zhang , Brian Cheung , Chelsea Finn , Sergey Levine , Dinesh Jayaraman

Online reinforcement learning (RL) with complex function approximations such as transformers and deep neural networks plays a significant role in the modern practice of artificial intelligence. Despite its popularity and importance,…

Machine Learning · Computer Science 2025-06-30 Tong Yang , Bo Dai , Lin Xiao , Yuejie Chi

We introduce Random Reward Perturbation (RRP), a novel exploration strategy for reinforcement learning (RL). Our theoretical analyses demonstrate that adding zero-mean noise to environmental rewards effectively enhances policy diversity…

Machine Learning · Computer Science 2025-06-11 Haozhe Ma , Guoji Fu , Zhengding Luo , Jiele Wu , Tze-Yun Leong

Reinforcement learning (RL) is a powerful tool for solving complex decision-making problems, but its lack of transparency and interpretability has been a major challenge in domains where decisions have significant real-world consequences.…

Artificial Intelligence · Computer Science 2023-09-12 Muzhe Guo , Feixu Yu , Tian Lan , Fang Jin

Latent world models allow agents to reason about complex environments with high-dimensional observations. However, adapting to new environments and effectively leveraging previous knowledge remain significant challenges. We present…

Machine Learning · Computer Science 2022-06-23 Anson Lei , Bernhard Schölkopf , Ingmar Posner

Efficiently tackling multiple tasks within complex environment, such as those found in robot manipulation, remains an ongoing challenge in robotics and an opportunity for data-driven solutions, such as reinforcement learning (RL).…

Robotics · Computer Science 2024-04-03 Carlos Plou , Ana C. Murillo , Ruben Martinez-Cantin

One of the bottlenecks preventing Deep Reinforcement Learning algorithms (DRL) from real-world applications is how to explore the environment and collect informative transitions efficiently. The present paper describes bounded exploration,…

Machine Learning · Computer Science 2024-12-10 Ting Qiao , Henry Williams , David Valencia , Bruce MacDonald

While Reinforcement Learning ( RL) has made great strides towards solving increasingly complicated problems, many algorithms are still brittle to even slight environmental changes. Contextual Reinforcement Learning (cRL) provides a…

We present an approach for reconfiguration of dynamic visual sensor networks with deep reinforcement learning (RL). Our RL agent uses a modified asynchronous advantage actor-critic framework and the recently proposed Relational Network…

Machine Learning · Computer Science 2018-08-14 Paul Jasek , Bernard Abayowa

We study the problem of experiment design to learn causal structures from interventional data. We consider an active learning setting in which the experimenter decides to intervene on one of the variables in the system in each step and uses…

Artificial Intelligence · Computer Science 2020-09-09 Amir Amirinezhad , Saber Salehkaleybar , Matin Hashemi

Prevalent theories in cognitive science propose that humans understand and represent the knowledge of the world through causal relationships. In making sense of the world, we build causal models in our mind to encode cause-effect relations…

Machine Learning · Computer Science 2019-11-21 Prashan Madumal , Tim Miller , Liz Sonenberg , Frank Vetere

Learning physical dynamics in a series of non-stationary environments is a challenging but essential task for model-based reinforcement learning (MBRL) with visual inputs. It requires the agent to consistently adapt to novel tasks without…

Machine Learning · Computer Science 2025-07-08 Minting Pan , Wendong Zhang , Geng Chen , Xiangming Zhu , Siyu Gao , Yunbo Wang , Xiaokang Yang