English
Related papers

Related papers: Estimating Optimal Active Learning via Model Retra…

200 papers

Inverse reinforcement learning (IRL) is the problem of finding a reward function that generates a given optimal policy for a given Markov Decision Process. This paper looks at an algorithmic-independent geometric analysis of the IRL problem…

Machine Learning · Computer Science 2021-02-19 Abi Komanduru , Jean Honorio

Machine learning models are increasingly being utilized across various fields and tasks due to their outstanding performance and strong generalization capabilities. Nonetheless, their success hinges on the availability of large volumes of…

Machine Learning · Computer Science 2024-11-26 Shreen Gul , Mohamed Elmahallawy , Sanjay Madria , Ardhendu Tripathy

Meta-reinforcement learning (meta-RL) aims to learn from multiple training tasks the ability to adapt efficiently to unseen test tasks. Despite the success, existing meta-RL algorithms are known to be sensitive to the task distribution…

Machine Learning · Computer Science 2021-03-02 Zichuan Lin , Garrett Thomas , Guangwen Yang , Tengyu Ma

We propose an active learning algorithm for linear system identification with optimal centered noise excitation. Notably, our algorithm, based on ordinary least squares and semidefinite programming, attains the minimal sample complexity…

Optimization and Control · Mathematics 2026-04-08 Kaito Ito , Alexandre Proutiere

Active learning (AL) has emerged as a crucial strategy for reducing the prohibitive costs associated with medical image segmentation. However, standard uncertainty-based AL methods typically focus on maximizing performance metrics, ignoring…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Ghazal Danaee , Mélanie Gaillochet , Christian Desrosiers , Herve Lombaert , Sylvain Bouix

Building a good predictive model requires an array of activities such as data imputation, feature transformations, estimator selection, hyper-parameter search and ensemble construction. Given the large, complex and heterogenous space of…

Machine Learning · Computer Science 2019-03-06 Udayan Khurana , Horst Samulowitz

Developed to alleviate prohibitive labeling costs, active learning (AL) methods aim to reduce label complexity in supervised learning. While recent work has demonstrated the benefit of using AL in combination with large pre-trained language…

Machine Learning · Computer Science 2023-10-24 Josip Jukić , Jan Šnajder

Central to active learning (AL) is what data should be selected for annotation. Existing works attempt to select highly uncertain or informative data for annotation. Nevertheless, it remains unclear how selected data impacts the test…

Machine Learning · Computer Science 2022-01-25 Tianyang Wang , Xingjian Li , Pengkun Yang , Guosheng Hu , Xiangrui Zeng , Siyu Huang , Cheng-Zhong Xu , Min Xu

When we can not assume a large amount of annotated data , active learning is a good strategy. It consists in learning a model on a small amount of annotated data (annotation budget) and in choosing the best set of points to annotate in…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Umang Aggarwal , Adrian Popescu , Céline Hudelot

Active learning (AL) strategies aim to train high-performance models with minimal labeling efforts, only selecting the most informative instances for annotation. Current approaches to evaluating data informativeness predominantly focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Zhixuan Liang , Xingyu Zeng , Rui Zhao , Ping Luo

The aim of Inverse Reinforcement Learning (IRL) is to infer a reward function $R$ from a policy $\pi$. To do this, we need a model of how $\pi$ relates to $R$. In the current literature, the most common models are optimality, Boltzmann…

Machine Learning · Computer Science 2023-03-27 Joar Skalse , Alessandro Abate

Active Learning (AL) is a family of machine learning (ML) algorithms that predates the current era of artificial intelligence. Unlike traditional approaches that require labeled samples for training, AL iteratively selects unlabeled samples…

Quantum Physics · Physics 2023-10-31 Yongcheng Ding , José D. Martín-Guerrero , Yolanda Vives-Gilabert , Xi Chen

A framework is introduced for actively and adaptively solving a sequence of machine learning problems, which are changing in bounded manner from one time step to the next. An algorithm is developed that actively queries the labels of the…

Machine Learning · Computer Science 2018-05-31 Yuheng Bu , Jiaxun Lu , Venugopal V. Veeravalli

Machine Learning (ML) is widely used to automatically extract meaningful information from Electronic Health Records (EHR) to support operational, clinical, and financial decision-making. However, ML models require a large number of…

Machine Learning · Computer Science 2021-04-14 Martha Dais Ferreira , Michal Malyska , Nicola Sahar , Riccardo Miotto , Fernando Paulovich , Evangelos Milios

Active learning aims to select a small subset of data for annotation such that a classifier learned on the data is highly accurate. This is usually done using heuristic selection methods, however the effectiveness of such methods is limited…

Computation and Language · Computer Science 2017-08-09 Meng Fang , Yuan Li , Trevor Cohn

Designing recommendation systems with limited or no available training data remains a challenge. To that end, a new combinatorial optimization problem is formulated to generate optimized item selection for experimentation with the goal to…

Information Retrieval · Computer Science 2021-12-07 Bernard Kleynhans , Xin Wang , Serdar Kadıoğlu

In the last years decision-focused learning framework, also known as predict-and-optimize, have received increasing attention. In this setting, the predictions of a machine learning model are used as estimated cost coefficients in the…

Machine Learning · Computer Science 2022-06-20 Jayanta Mandi , Víctor Bucarey , Maxime Mulamba , Tias Guns

Standard reinforcement learning (RL) algorithms assume that the observation of the next state comes instantaneously and at no cost. In a wide variety of sequential decision making tasks ranging from medical treatment to scientific…

Artificial Intelligence · Computer Science 2020-05-27 Colin Bellinger , Rory Coles , Mark Crowley , Isaac Tamblyn

Active learning (AL) algorithms may achieve better performance with fewer data because the model guides the data selection process. While many algorithms have been proposed, there is little study on what the optimal AL algorithm looks like,…

Machine Learning · Computer Science 2021-02-23 Yilun Zhou , Adithya Renduchintala , Xian Li , Sida Wang , Yashar Mehdad , Asish Ghoshal

The problem of reinforcement learning is considered where the environment or the model undergoes a change. An algorithm is proposed that an agent can apply in such a problem to achieve the optimal long-time discounted reward. The algorithm…

Systems and Control · Electrical Eng. & Systems 2023-04-25 Wuxia Chen , Taposh Banerjee , Jemin George , Carl Busart