English
Related papers

Related papers: Hyperparameter Selection Methods for Fitted Q-Eval…

200 papers

Variational Quantum Algorithms (VQAs) are a leading approach for near-term quantum computing but face major optimization challenges from noise, barren plateaus, and complex energy landscapes. We benchmarked more than fifty metaheuristic…

Quantum Physics · Physics 2025-09-30 Vojtěch Novák , Ivan Zelinka , Václav Snášel

Off-policy evaluation (OPE) in reinforcement learning is an important problem in settings where experimentation is limited, such as education and healthcare. But, in these very same settings, observed actions are often confounded by…

Machine Learning · Computer Science 2020-07-29 Andrew Bennett , Nathan Kallus , Lihong Li , Ali Mousavi

Considerable research effort has been guided towards algorithmic fairness but real-world adoption of bias reduction techniques is still scarce. Existing methods are either metric- or model-specific, require access to sensitive attributes at…

Machine Learning · Computer Science 2022-07-13 André F. Cruz , Pedro Saleiro , Catarina Belém , Carlos Soares , Pedro Bizarro

As the advances in quantum hardware bring us into the noisy intermediate-scale quantum (NISQ) era, one possible task we can perform without quantum error correction using NISQ machines is the variational quantum eigensolver (VQE) due to its…

Quantum Physics · Physics 2020-07-29 Zhenyu Cai

Numerous offline and model-based reinforcement learning systems incorporate world models to emulate the inherent environments. A world model is particularly important in scenarios where direct interactions with the real environment is…

Machine Learning · Computer Science 2026-01-19 Rajat Ghosh , Debojyoti Dutta

We offer a theoretical characterization of off-policy evaluation (OPE) in reinforcement learning using function approximation for marginal importance weights and $q$-functions when these are estimated using recent minimax methods. Under…

Machine Learning · Computer Science 2022-07-26 Masatoshi Uehara , Masaaki Imaizumi , Nan Jiang , Nathan Kallus , Wen Sun , Tengyang Xie

Variational Quantum Eigensolver (VQE) is a hybrid algorithm for finding the minimum eigenvalue/vector of a given Hamiltonian by optimizing a parametrized quantum circuit (PQC) using a classical computer. Sequential optimization methods,…

Quantum Physics · Physics 2024-05-17 Katsuhiro Endo , Yuki Sato , Rudy Raymond , Kaito Wada , Naoki Yamamoto , Hiroshi C. Watanabe

We study the Active Simple Hypothesis Testing (ASHT) problem, a simpler variant of the Fixed Budget Best Arm Identification problem. In this work, we provide novel game theoretic formulation of the upper bounds of the ASHT problem. This…

Machine Learning · Computer Science 2025-04-29 Sushant Vijayan

We conduct an exhaustive survey of adaptive selection of operators (AOS) in Evolutionary Algorithms (EAs). We simplified the AOS structure by adding more components to the framework to built upon the existing categorisation of AOS methods.…

Neural and Evolutionary Computing · Computer Science 2020-05-13 Mudita Sharma , Manuel Lopez-Ibanez , Dimitar Kazakov

Multi-objective feature selection is one of the most significant issues in the field of pattern recognition. It is challenging because it maximizes the classification performance and, at the same time, minimizes the number of selected…

Artificial Intelligence · Computer Science 2022-11-11 Motahare Namakin , Modjtaba Rouhani , Mostafa Sabzekar

Reward models trained on aggregate preferences often fail to capture individual users' values, but existing adaptation methods such as fine-tuning or long-context conditioning are too costly for real-time personalization. We propose…

Machine Learning · Computer Science 2026-04-21 Yoonho Lee , Jonathan Williams , Henrik Marklund , Archit Sharma , Eric Mitchell , Anikait Singh , Chelsea Finn

The off-policy paradigm casts recommendation as a counterfactual decision-making task, allowing practitioners to unbiasedly estimate online metrics using offline data. This leads to effective evaluation metrics, as well as learning…

Machine Learning · Computer Science 2024-09-17 Olivier Jeunen , Aleksei Ustimenko

We study representation learning for Offline Reinforcement Learning (RL), focusing on the important task of Offline Policy Evaluation (OPE). Recent work shows that, in contrast to supervised learning, realizability of the Q-function is not…

Machine Learning · Computer Science 2022-07-14 Jonathan D. Chang , Kaiwen Wang , Nathan Kallus , Wen Sun

The ultimate goal of any numerical scheme for partial differential equations (PDEs) is to compute an approximation of user-prescribed accuracy at quasi-minimal computational time. To this end, algorithmically, the standard adaptive finite…

Numerical Analysis · Mathematics 2025-01-30 Philipp Bringmann , Michael Feischl , Ani Miraci , Dirk Praetorius , Julian Streitberger

Since deep neural networks were developed, they have made huge contributions to everyday lives. Machine learning provides more rational advice than humans are capable of in almost every aspect of daily life. However, despite this…

Machine Learning · Computer Science 2020-03-13 Tong Yu , Hong Zhu

Hyperparameter selection is a critical step in the deployment of artificial intelligence (AI) models, particularly in the current era of foundational, pre-trained, models. By framing hyperparameter selection as a multiple hypothesis testing…

Machine Learning · Computer Science 2025-02-07 Amirmohammad Farzaneh , Osvaldo Simeone

As all physical adaptive quantum-enhanced metrology schemes operate under noisy conditions with only partially understood noise characteristics, so a practical control policy must be robust even for unknown noise. We aim to devise a test to…

Quantum Physics · Physics 2019-07-18 Pantita Palittapongarnpim , Barry C. Sanders

How should we gather information to make effective decisions? We address Bayesian active learning and experimental design problems, where we sequentially select tests to reduce uncertainty about a set of hypotheses. Instead of minimizing…

Machine Learning · Computer Science 2014-02-25 Shervin Javdani , Yuxin Chen , Amin Karbasi , Andreas Krause , J. Andrew Bagnell , Siddhartha Srinivasa

We consider a model-based approach to perform batch off-policy evaluation in reinforcement learning. Our method takes a mixture-of-experts approach to combine parametric and non-parametric models of the environment such that the final value…

Machine Learning · Computer Science 2020-02-19 Omer Gottesman , Yao Liu , Scott Sussex , Emma Brunskill , Finale Doshi-Velez

Parameter identification is crucial in virtual engineering processes, yet determining appropriate system excitations for identifying specific parameters remains challenging. In practice, extensive experimental programs often fail to…

Optimization and Control · Mathematics 2026-05-07 Kevin Schmidt , Nicola Henkelmann , Christoph Mark , Johannes von Keler