中文
相关论文

相关论文: State-Aware Variational Thompson Sampling for Deep…

200 篇论文

In this note, we present a version of the Thompson sampling algorithm for the problem of online linear generalization with full information (i.e., the experts setting), studied by Kalai and Vempala, 2005. The algorithm uses a Gaussian prior…

机器学习 · 统计学 2013-11-05 Aditya Gopalan

Stochastic approximation is a powerful class of algorithms with celebrated success. However, a large body of previous analysis focuses on stochastic approximations driven by contractive operators, which is not applicable in some important…

机器学习 · 计算机科学 2025-11-21 Ethan Blaser , Shangtong Zhang

Variational methods have proven to be excellent tools to approximate ground states of complex many body Hamiltonians. Generic tools like neural networks are extremely powerful, but their parameters are not necessarily physically motivated.…

强关联电子 · 物理学 2022-03-04 Agnes Valenti , Eliska Greplova , Netanel H. Lindner , Sebastian D. Huber

This paper addresses the challenge of a particular class of noisy state observations in Markov Decision Processes (MDPs), a common issue in various real-world applications. We focus on modeling this uncertainty through a confusion matrix…

机器学习 · 计算机科学 2023-12-15 Amirhossein Afsharrad , Sanjay Lall

Deep reinforcement learning agents for continuous control are known to exhibit significant instability in their performance over time. In this work, we provide a fresh perspective on these behaviors by studying the return landscape: the…

机器学习 · 计算机科学 2024-04-12 Nate Rahn , Pierluca D'Oro , Harley Wiltzer , Pierre-Luc Bacon , Marc G. Bellemare

Action advising endeavors to leverage supplementary guidance from expert teachers to alleviate the issue of sampling inefficiency in Deep Reinforcement Learning (DRL). Previous agent-specific action advising methods are hindered by…

人工智能 · 计算机科学 2023-11-29 Yaoquan Wei , Shunyu Liu , Jie Song , Tongya Zheng , Kaixuan Chen , Yong Wang , Mingli Song

Uncertainty estimation is crucial in scientific data for machine learning. Current uncertainty estimation methods mainly focus on the model's inherent uncertainty, while neglecting the explicit modeling of noise in the data. Furthermore,…

机器学习 · 计算机科学 2024-09-13 Guangxuan Song , Dongmei Fu , Zhongwei Qiu , Jintao Meng , Dawei Zhang

Boson sampling is one of the main quantum computation models to demonstrate the quantum computational advantage. However, this aim may be hard to realize considering two main kinds of noises, which are photon distinguishability and photon…

量子物理 · 物理学 2024-08-20 Yang Ji , Yongzheng Wu , Shi Wang , Jie Hou , Meiling Chen , Ming Ni

One of the most critical challenges in deep reinforcement learning is to maintain the long-term exploration capability of the agent. To tackle this problem, it has been recently proposed to provide intrinsic rewards for the agent to…

机器学习 · 计算机科学 2022-06-02 Mingqi Yuan , Man-on Pun , Dong Wang

The continuous variable quantum computing platform constitutes a promising candidate for realizing quantum advantage, as exemplified in Gaussian Boson Sampling. While noise in the experiments makes the computation attainable for classical…

量子物理 · 物理学 2025-08-11 Jonas Vinther , Michael James Kastoryano

State-space models are a popular statistical framework for analysing sequential data. Within this framework, particle filters are often used to perform inference on non-linear state-space models. We introduce a new method, StateMixNN, that…

机器学习 · 计算机科学 2025-03-28 Benjamin Cox , Santiago Segarra , Victor Elvira

In addition to their undisputed success in solving classical optimization problems, neuroevolutionary and population-based algorithms have become an alternative to standard reinforcement learning methods. However, evolutionary methods often…

神经与进化计算 · 计算机科学 2021-05-18 Jörg Stork , Martin Zaefferer , Nils Eisler , Patrick Tichelmann , Thomas Bartz-Beielstein , A. E. Eiben

Exploration is critical for good results in deep reinforcement learning and has attracted much attention. However, existing multi-agent deep reinforcement learning algorithms still use mostly noise-based techniques. Very recently,…

人工智能 · 计算机科学 2021-07-27 Iou-Jen Liu , Unnat Jain , Raymond A. Yeh , Alexander G. Schwing

We study the policy evaluation problem in multi-agent reinforcement learning, modeled by a Markov decision process. In this problem, the agents operate in a common environment under a fixed control policy, working together to discover the…

最优化与控制 · 数学 2020-01-13 Thinh T. Doan , Siva Theja Maguluri , Justin Romberg

We initiate the study of active learning algorithms for classifying strategic agents. Active learning is a well-established framework in machine learning in which the learner selectively queries labels, often achieving substantially higher…

机器学习 · 计算机科学 2025-12-03 Maria-Florina Balcan , Hedyeh Beyhaghi

Deep neural networks often suffer from poor generalization due to complex and non-convex loss landscapes. Sharpness-Aware Minimization (SAM) is a popular solution that smooths the loss landscape by minimizing the maximized change of…

人工智能 · 计算机科学 2023-07-03 Peng Mi , Li Shen , Tianhe Ren , Yiyi Zhou , Tianshuo Xu , Xiaoshuai Sun , Tongliang Liu , Rongrong Ji , Dacheng Tao

The performance of learning-based control techniques crucially depends on how effectively the system is explored. While most exploration techniques aim to achieve a globally accurate model, such approaches are generally unsuited for systems…

机器学习 · 计算机科学 2020-06-11 Alexandre Capone , Jonas Umlauft , Thomas Beckers , Armin Lederer , Sandra Hirche

Reinforcement learning agents need exploratory behaviors to escape from local optima. These behaviors may include both immediate dithering perturbation and temporally consistent exploration. To achieve these, a stochastic policy model that…

机器学习 · 计算机科学 2018-12-27 Sirui Xie , Junning Huang , Lanxin Lei , Chunxiao Liu , Zheng Ma , Wei Zhang , Liang Lin

Efficiently exploring complex loss landscapes is key to the performance of deep neural networks. While momentum-based optimizers are widely used in state-of-the-art setups, classical momentum can still struggle with large, misaligned…

Adaptive decision-making in biological and artificial intelligence requires balancing the exploitation of known outcomes with the exploration of uncertain alternatives. Although prior work suggests that uncertainty generally promotes…

人工智能 · 计算机科学 2026-05-20 Payam Piray