English
Related papers

Related papers: Regime-Conditioned Evaluation in Multi-Context Bay…

200 papers

Sequential Bayesian optimal experimental design (SBOED) for PDE-governed inverse problems is computationally challenging, especially for infinite-dimensional random field parameters. High-fidelity approaches require repeated forward and…

Optimization and Control · Mathematics 2026-01-12 Kaichen Shen , Peng Chen

Contextual Bayesian optimization (CBO) is a powerful framework for sequential decision-making given side information, with important applications, e.g., in wind energy systems. In this setting, the learner receives context (e.g., weather…

Machine Learning · Statistics 2022-10-18 Shyam Sundhar Ramesh , Pier Giuseppe Sessa , Andreas Krause , Ilija Bogunovic

Reinforcement learning (RL) in non-stationary environments is challenging, as changing dynamics and rewards quickly make past experiences outdated. Traditional experience replay (ER) methods, especially those using TD-error prioritization,…

Machine Learning · Computer Science 2025-09-19 Tianyang Duan , Zongyuan Zhang , Songxiao Guo , Yuanye Zhao , Zheng Lin , Zihan Fang , Yi Liu , Dianxin Luan , Dong Huang , Heming Cui , Yong Cui

Peer review is the most common mechanism in place for assessing requests for resources in a large variety of scientific disciplines. One of the strongest criticisms to this paradigm is the limited reproducibility of the process, especially…

Physics and Society · Physics 2018-07-04 Ferdinando Patat

There has been a long history for studying randomized greedy matching algorithms since the work by Dyer and Frieze~(RSA 1991). We follow this trend and consider the problem formulated in the oblivious setting, in which the algorithm makes…

Data Structures and Algorithms · Computer Science 2020-03-10 Zhihao Gavin Tang , Xiaowei Wu , Yuhao Zhang

Policy optimization for large language models often suffers from sparse reward signals in multi-step reasoning tasks. Critic-free methods like GRPO assign a single normalized outcome reward to all tokens, providing limited guidance for…

Machine Learning · Computer Science 2026-02-04 Ruiyi Ding , Yongxuan Lv , Xianhui Meng , Jiahe Song , Chao Wang , Chen Jiang , Yuan Cheng

Robust Markov Decision Processes (MDPs) address environmental shift through distributionally robust optimization (DRO) by finding an optimal worst-case policy within an uncertainty set of transition kernels. However, standard DRO approaches…

Machine Learning · Statistics 2026-03-10 Akram S. Awad , Shihab Ahmed , Yue Wang , George K. Atia

This paper examines the ability of greedy algorithms to estimate a block sparse parameter vector from noisy measurements. In particular, block sparse versions of the orthogonal matching pursuit and thresholding algorithms are analyzed under…

Information Theory · Computer Science 2015-05-19 Zvika Ben-Haim , Yonina C. Eldar

Existing LLM-based policy optimizers see only scalar rewards: that a policy scored 0.45, but not whether the agent got stuck in a loop, fell into a hole on the third step, or performed well on 19 out of 20 rollouts and failed…

Machine Learning · Computer Science 2026-05-12 Rahaf Abu Hara , Vaibbhav Murarri , Claudio Zito

Algorithmic trading relies on machine learning models to make trading decisions. Despite strong in-sample performance, these models often degrade when confronted with evolving real-world market regimes, which can shift dramatically due to…

Machine Learning · Computer Science 2026-01-27 Haochong Xia , Simin Li , Ruixiao Xu , Zhixia Zhang , Hongxiang Wang , Zhiqian Liu , Teng Yao Long , Molei Qin , Chuqiao Zong , Bo An

Group Relative Policy Optimization (GRPO) has emerged as an effective method for training reasoning models. While it computes advantages based on group mean, GRPO treats each output as an independent sample during the optimization and…

Artificial Intelligence · Computer Science 2026-03-16 Yu Li , Tian Lan , Zhengling Qi

Contextual bandits are canonical models for sequential decision-making under uncertainty in environments with time-varying components. In this setting, the expected reward of each bandit arm consists of the inner product of an unknown…

Machine Learning · Statistics 2022-05-27 Hongju Park , Mohamad Kazem Shirani Faradonbeh

Bayesian optimisation requires fitting a Gaussian process model, which in turn requires specifying prior on the unknown black-box function -- most of the theoretical literature assumes this prior is known. However, it is common to have more…

Machine Learning · Computer Science 2025-02-25 Juliusz Ziomek , Masaki Adachi , Michael A. Osborne

In this paper,we consider the restless bandit problem, which is one of the most well-studied generalizations of the celebrated stochastic multi-armed bandit problem in decision theory. However, it is known be PSPACE-Hard to approximate to…

Machine Learning · Computer Science 2011-04-29 Quan Liu , Kehao Wang , Lin Chen

Objective: SNP heritability estimates vary substantially across estimation strategies, yet the downstream consequences for polygenic risk score (PRS) construction remain poorly characterised. We systematically benchmarked heritability…

Genomics · Quantitative Biology 2026-04-06 Muhammad Muneeb , David B. Ascher

In preference-based reinforcement learning (RL), an agent interacts with the environment while receiving preferences instead of absolute feedback. While there is increasing research activity in preference-based RL, the design of formal…

Machine Learning · Computer Science 2020-06-30 Ellen R. Novoseller , Yibing Wei , Yanan Sui , Yisong Yue , Joel W. Burdick

Radio resource management in modern cellular networks often calls for the optimization of complex utility functions that are potentially conflicting between different base stations (BSs). Coordinating the resource allocation strategies…

Signal Processing · Electrical Eng. & Systems 2025-12-02 Yunchuan Zhang , Jiechen Chen , Junshuo Liu , Robert C. Qiu

We investigate modifications to Bayesian Optimization for a resource-constrained setting of sequential experimental design where changes to certain design variables of the search space incur a switching cost. This models the scenario where…

Machine Learning · Computer Science 2024-05-16 Stefan Pricopie , Richard Allmendinger , Manuel Lopez-Ibanez , Clyde Fare , Matt Benatan , Joshua Knowles

It is commonly believed that Bayesian optimization (BO) algorithms are highly efficient for optimizing numerically costly functions. However, BO is not often compared to widely different alternatives, and is mostly tested on narrow sets of…

Optimization and Control · Mathematics 2021-10-01 Rodolphe Le Riche , Victor Picheny

We present a control method for improved repetitive path following for a ground vehicle that is geared towards long-term operation where the operating conditions can change over time and are initially unknown. We use weighted Bayesian…

Robotics · Computer Science 2019-04-10 Christopher D. McKinnon , Angela P. Schoellig