中文
相关论文

相关论文: Dynamic Bottleneck for Robust Self-Supervised Expl…

200 篇论文

We consider an agent's uncertainty about its environment and the problem of generalizing this uncertainty across observations. Specifically, we focus on the problem of exploration in non-tabular reinforcement learning. Drawing inspiration…

人工智能 · 计算机科学 2018-07-11 Marc G. Bellemare , Sriram Srinivasan , Georg Ostrovski , Tom Schaul , David Saxton , Remi Munos

Efficient exploration remains a challenging problem in reinforcement learning, especially for those tasks where rewards from environments are sparse. A commonly used approach for exploring such environments is to introduce some "intrinsic"…

机器学习 · 计算机科学 2020-07-16 Neale Ratzlaff , Qinxun Bai , Li Fuxin , Wei Xu

Multimodal sentiment analysis has received significant attention across diverse research domains. Despite advancements in algorithm design, existing approaches suffer from two critical limitations: insufficient learning of…

人工智能 · 计算机科学 2025-11-04 Huiting Huang , Tieliang Gong , Kai He , Jialun Wu , Erik Cambria , Mengling Feng

Efficient exploration remains a challenging research problem in reinforcement learning, especially when an environment contains large state spaces, deceptive local optima, or sparse rewards. To tackle this problem, we present a…

人工智能 · 计算机科学 2018-10-30 Zhang-Wei Hong , Tzu-Yun Shann , Shih-Yang Su , Yi-Hsiang Chang , Chun-Yi Lee

Several self-supervised representation learning methods have been proposed for reinforcement learning (RL) with rich observations. For real-world applications of RL, recovering underlying latent states is crucial, particularly when sensory…

Identifying the dynamical state variables of a system from high-dimensional observations is a central problem across physical sciences. The challenge is that the state variables are not directly observable and must be inferred from raw…

数据分析、统计与概率 · 物理学 2026-04-28 K. Michael Martini , Eslam Abdelaleem , Paarth Gulati , Ilya Nemenman

The existence of external (``side'') semantic knowledge has been shown to result in more expressive computational event models. To enable the use of side information that may be noisy or missing, we propose a semi-supervised information…

机器学习 · 计算机科学 2023-02-15 Mehdi Rezaee , Francis Ferraro

Deep Neural Nets (DNNs) learn latent representations induced by their downstream task, objective function, and other parameters. The quality of the learned representations impacts the DNN's generalization ability and the coherence of the…

机器学习 · 计算机科学 2024-02-13 Nir Weingarten , Zohar Yakhini , Moshe Butman , Ran Gilad-Bachrach

Despite its notable success in adversarial learning approaches to multi-domain task-oriented dialog system, training the dialog policy via adversarial inverse reinforcement learning often fails to balance the performance of the policy…

人工智能 · 计算机科学 2020-06-02 Jeiyoon Park , Chanhee Lee , Kuekyeng Kim , Heuiseok Lim

Bidirectional language models have better context understanding and perform better than unidirectional models on natural language understanding tasks, yet the theoretical reasons behind this advantage remain unclear. In this work, we…

计算与语言 · 计算机科学 2025-10-10 Md Kowsher , Nusrat Jahan Prottasha , Shiyun Xu , Shetu Mohanto , Ozlem Garibay , Niloofar Yousefi , Chen Chen

The information bottleneck (IB) method is a feasible defense solution against adversarial attacks in deep learning. However, this method suffers from the spurious correlation, which leads to the limitation of its further improvement of…

机器学习 · 计算机科学 2022-10-27 Huan Hua , Jun Yan , Xi Fang , Weiquan Huang , Huilin Yin , Wancheng Ge

Advanced biological intelligence learns efficiently from an information-rich stream of stimulus information, even when feedback on behaviour quality is sparse or absent. Such learning exploits implicit assumptions about task domains. We…

神经与进化计算 · 计算机科学 2024-08-05 Solvi Arnold , Reiji Suzuki , Takaya Arita , Kimitoshi Yamazaki

Efficient exploration is necessary to achieve good sample efficiency for reinforcement learning in general. From small, tabular settings such as gridworlds to large, continuous and sparse reward settings such as robotic object manipulation…

机器学习 · 计算机科学 2019-06-20 Zhaohan Daniel Guo , Emma Brunskill

Reinforcement Learning enables to train an agent via interaction with the environment. However, in the majority of real-world scenarios, the extrinsic feedback is sparse or not sufficient, thus intrinsic reward formulations are needed to…

机器学习 · 计算机科学 2022-06-07 Patrik Reizinger , Márton Szemenyei

In the past decade, deep neural networks have seen unparalleled improvements that continue to impact every aspect of today's society. With the development of high performance GPUs and the availability of vast amounts of data, learning…

机器学习 · 计算机科学 2021-05-12 Mohammad Ali Alomrani

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) for Large Language Model (LLM) reasoning have been hindered by a persistent challenge: exploration collapse. The semantic homogeneity of random rollouts often traps…

机器学习 · 计算机科学 2026-01-12 Huilin Deng , Hongchen Luo , Yue Zhu , Long Li , Zhuoyue Chen , Xinghao Zhao , Ming Li , Jihai Zhang , Mengchang Wang , Yang Cao , Yu Kang

Reinforcement learning with sparse rewards is still an open challenge. Classic methods rely on getting feedback via extrinsic rewards to train the agent, and in situations where this occurs very rarely the agent learns slowly or cannot…

机器学习 · 计算机科学 2022-03-04 Simone Parisi , Davide Tateo , Maximilian Hensel , Carlo D'Eramo , Jan Peters , Joni Pajarinen

Active learning provides a framework to adaptively query the most informative experiments towards learning an unknown black-box function. Various approaches of active learning have been proposed in the literature, however, they either focus…

机器学习 · 计算机科学 2023-10-03 Upala Junaida Islam , Kamran Paynabar , George Runger , Ashif Sikandar Iquebal

Effective adaptation to distribution shifts in training data is pivotal for sustaining robustness in neural networks, especially when removing specific biases or outdated information, a process known as machine unlearning. Traditional…

机器学习 · 计算机科学 2024-05-24 Ling Han , Hao Huang , Dustin Scheinost , Mary-Anne Hartley , María Rodríguez Martínez

In supervised learning, understanding an input's proximity to the training data can help a model decide whether it has sufficient evidence for reaching a reliable prediction. While powerful probabilistic models such as Gaussian Processes…

机器学习 · 计算机科学 2024-06-19 Ifigeneia Apostolopoulou , Benjamin Eysenbach , Frank Nielsen , Artur Dubrawski