English
Related papers

Related papers: Modeling and Active Learning for Experiments with …

200 papers

Sequential experimental design to discover interventions that achieve a desired outcome is a key problem in various domains including science, engineering and public policy. When the space of possible interventions is large, making an…

Machine Learning · Computer Science 2023-08-17 Jiaqi Zhang , Louis Cammarata , Chandler Squires , Themistoklis P. Sapsis , Caroline Uhler

Q-learning is a stochastic approximation version of the classic value iteration. The literature has established that Q-learning suffers from both maximization bias and slower convergence. Recently, multi-step algorithms have shown practical…

Machine Learning · Computer Science 2024-07-03 Antony Vijesh , Shreyas S R

Optimizing the properties of molecules (materials or drugs) for stronger toughness, lower toxicity, or better bioavailability has been a long-standing challenge. In this context, we propose a molecular optimization framework called Q-Drug…

Quantum Physics · Physics 2023-08-28 Zhaoping Xiong , Xiaopeng Cui , Xinyuan Lin , Feixiao Ren , Bowen Liu , Yunting Li , Manhong Yung , Nan Qiao

We develop methodology for a multistage decision problem with flexible number of stages in which the rewards are survival times that are subject to censoring. We present a novel Q-learning algorithm that is adjusted for censored data and…

Statistics Theory · Mathematics 2012-05-31 Yair Goldberg , Michael R. Kosorok

Q-learning, which seeks to learn the optimal Q-function of a Markov decision process (MDP) in a model-free fashion, lies at the heart of reinforcement learning. When it comes to the synchronous setting (such that independent samples for all…

Machine Learning · Statistics 2025-03-18 Gen Li , Changxiao Cai , Yuxin Chen , Yuting Wei , Yuejie Chi

To know which operators to apply and in which order, as well as attributing good values to their parameters is a challenge for users of computer vision. This paper proposes a solution to this problem as a multi-agent system modeled…

Artificial Intelligence · Computer Science 2013-11-26 Issam Qaffou , Mohamed Sadgal , Abdelaziz Elfazziki

We investigate the learning of quantitative structure activity relationships (QSARs) as a case-study of meta-learning. This application area is of the highest societal importance, as it is a key step in the development of new medicines. The…

Artificial Intelligence · Computer Science 2017-09-13 Ivan Olier , Noureddin Sadawi , G. Richard Bickerton , Joaquin Vanschoren , Crina Grosan , Larisa Soldatova , Ross D. King

Applying Q-learning to high-dimensional or continuous action spaces can be difficult due to the required maximization over the set of possible actions. Motivated by techniques from amortized inference, we replace the expensive maximization…

Machine Learning · Computer Science 2020-01-23 Tom Van de Wiele , David Warde-Farley , Andriy Mnih , Volodymyr Mnih

The Research & Development (R&D) phase of drug development is a lengthy and costly process. To revolutionize this process, we introduce our new concept QMLS to shorten the whole R&D phase to three to six months and decrease the cost to…

Biomolecules · Quantitative Biology 2024-09-06 Yifan Zhou , Yan Shing Liang , Yew Kee Wong , Haichuan Qiu , Yu Xi Wu , Bin He

Molecular design involves an enormous and irregular search space, where traditional optimizers such as Bayesian optimization, genetic algorithms, and generative models struggle to leverage expert knowledge or handle complex feedback.…

Machine Learning · Computer Science 2025-12-09 Nian Ran , Yue Wang , Xiaoyuan Zhang , Zhongzheng Li , Qingsong Ran , Wenhao Li , Richard Allmendinger

Sample complexity bounds are a common performance metric in the Reinforcement Learning literature. In the discounted cost, infinite horizon setting, all of the known bounds have a factor that is a polynomial in $1/(1-\gamma)$, where $\gamma…

Machine Learning · Computer Science 2020-07-09 Adithya M. Devraj , Sean P. Meyn

Active learning is a state-of-art machine learning approach to deal with an abundance of unlabeled data. In the field of Natural Language Processing, typically it is costly and time-consuming to have all the data annotated. This…

Computation and Language · Computer Science 2021-07-19 Yukun Jiang

Active learning is commonly used to train label-efficient models by adaptively selecting the most informative queries. However, most active learning strategies are designed to either learn a representation of the data (e.g., embedding or…

Machine Learning · Computer Science 2022-02-07 Namrata Nadagouda , Austin Xu , Mark A. Davenport

This paper addresses the problem of active learning of a multi-output Gaussian process (MOGP) model representing multiple types of coexisting correlated environmental phenomena. In contrast to existing works, our active learning problem…

Machine Learning · Statistics 2015-11-25 Yehong Zhang , Trong Nghia Hoang , Kian Hsiang Low , Mohan Kankanhalli

An emulator is a fast-to-evaluate statistical approximation of a detailed mathematical model (simulator). When used in lieu of simulators, emulators can expedite tasks that require many repeated evaluations, such as sensitivity analyses,…

Quantum machine learning, as an extension of classical machine learning that harnesses quantum mechanics, facilitates effiient learning from data encoded in quantum states. Training a quantum neural network typically demands a substantial…

Quantum Physics · Physics 2026-02-17 Yongcheng Ding , Yue Ban , Mikel Sanz , José D. Martín-Guerrero , Xi Chen

Recent advancements in quantum computing (QC) and machine learning (ML) have garnered significant attention, leading to substantial efforts toward the development of quantum machine learning (QML) algorithms to address a variety of complex…

Quantum Physics · Physics 2024-12-18 Samuel Yen-Chi Chen

Deep Q-learning has achieved significant success in single-agent decision making tasks. However, it is challenging to extend Q-learning to large-scale multi-agent scenarios, due to the explosion of action space resulting from the complex…

Multiagent Systems · Computer Science 2019-10-14 Ming Zhou , Yong Chen , Ying Wen , Yaodong Yang , Yufeng Su , Weinan Zhang , Dell Zhang , Jun Wang

The field of quickest change detection (QCD) focuses on the design and analysis of online algorithms that estimate the time at which a significant event occurs. In this paper, design and analysis are cast in a Bayesian framework, where QCD…

Optimization and Control · Mathematics 2025-12-30 Austin Cooper , Sean Meyn

A dynamic treatment regime effectively incorporates both accrued information and long-term effects of treatment from specially designed clinical trials. As these become more and more popular in conjunction with longitudinal data from…

Methodology · Statistics 2011-08-29 Rui Song , Weiwei Wang , Donglin Zeng , Michael R. Kosorok