English
Related papers

Related papers: Estimating Optimal Active Learning via Model Retra…

200 papers

Active learning (AL) is for optimizing the selection of unlabeled data for annotation (labeling), aiming to enhance model performance while minimizing labeling effort. The key question in AL is which unlabeled data should be selected for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yingrui Ji , Vijaya Sindhoori Kaza , Nishanth Artham , Tianyang Wang

Active learning strategies aim to train high-performance models with minimal labeled data by selecting the most informative instances for labeling. However, existing methods for assessing data informativeness often fail to align directly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Zhixuan Liang , Xingyu Zeng , Rui Zhao , Ping Luo

Statistics and Optimization are foundational to modern Machine Learning. Here, we propose an alternative foundation based on Abstract Algebra, with mathematics that facilitates the analysis of learning. In this approach, the goal of the…

Machine Learning · Computer Science 2025-02-28 Fernando Martin-Maroto , Nabil Abderrahaman , David Mendez , Gonzalo G. de Polavieja

A recent goal in the Reinforcement Learning (RL) framework is to choose a sequence of actions or a policy to maximize the reward collected or minimize the regret incurred in a finite time horizon. For several RL problems in operation…

Machine Learning · Computer Science 2016-08-18 K J Prabuchandran , Tejas Bodas , Theja Tulabandhula

Active learning (AL) algorithms aim to identify an optimal subset of data for annotation, such that deep neural networks (DNN) can achieve better performance when trained on this labeled subset. AL is especially impactful in industrial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Zeyad Ali Sami Emam , Hong-Min Chu , Ping-Yeh Chiang , Wojciech Czaja , Richard Leapman , Micah Goldblum , Tom Goldstein

A model among many may only be best under certain states of the world. Switching from a model to another can also be costly. Finding a procedure to dynamically choose a model in these circumstances requires to solve a complex estimation…

Machine Learning · Computer Science 2023-10-10 Francesco Cordoni , Alessio Sancetta

This paper introduces an active learning approach to the fitting of machine learning interatomic potentials. Our approach is based on the D-optimality criterion for selecting atomic configurations on which the potential is fitted. It is…

Computational Physics · Physics 2017-09-19 Evgeny V. Podryabinkin , Alexander V. Shapeev

We study the problem of online model selection in reinforcement learning, where the selector has access to a class of reinforcement learning agents and learns to adaptively select the agent with the right configuration. Our goal is to…

Machine Learning · Computer Science 2025-12-03 Aida Afshar , Aldo Pacchiano

Pool-based active learning (AL) aims to optimize the annotation process (i.e., labeling) as the acquisition of annotations is often time-consuming and therefore expensive. For this purpose, an AL strategy queries annotations intelligently…

Machine Learning · Computer Science 2022-01-06 Marek Herde , Denis Huseljic , Bernhard Sick , Adrian Calma

Matrix-based optimizers have attracted growing interest for improving LLM training efficiency, with significant progress centered on orthogonalization/whitening based methods. While yielding substantial performance gains, a fundamental…

Machine Learning · Computer Science 2026-02-10 Wenbo Gong , Javier Zazo , Qijun Luo , Puqian Wang , James Hensman , Chao Ma

We develop an online learning algorithm for identifying unlabeled data points that are most informative for training (i.e., active learning). By formulating the active learning problem as the prediction with sleeping experts problem, we…

Machine Learning · Computer Science 2022-02-24 Cenk Baykal , Lucas Liebenwein , Dan Feldman , Daniela Rus

Automated machine learning (AutoML) methods improve upon existing models by optimizing various aspects of their design. While present methods focus on hyperparameters and neural network topologies, other aspects of neural network design can…

Machine Learning · Computer Science 2023-04-10 Garrett Bingham

We present an active learning algorithm for the problem of body schema learning, i.e. estimating a kinematic model of a serial robot. The learning process is done online using Recursive Least Squares (RLS) estimation, which outperforms…

Robotics · Computer Science 2024-02-12 Ruben Martinez-Cantin , Manuel Lopes , Luis Montesano

Active learning (AL) seeks to reduce annotation costs by selecting the most informative samples for labeling, making it particularly valuable in resource-constrained settings. However, traditional evaluation methods, which focus solely on…

Machine Learning · Computer Science 2025-07-22 Julia Machnio , Mads Nielsen , Mostafa Mehdipour Ghazi

Reinforcement Learning (RL) remains a central optimisation framework in machine learning. Although RL agents can converge to optimal solutions, the definition of ``optimality'' depends on the environment's statistical properties. The…

Machine Learning · Computer Science 2026-01-14 Bert Verbruggen , Arne Vanhoyweghen , Vincent Ginis

For AI systems to be useful to humans, they must understand and act in accordance with our values and preferences. Since specifying preferences is a hard task, inverse reinforcement learning (IRL) aims to develop methods that allow for…

Artificial Intelligence · Computer Science 2026-05-12 Karim Abdel Sadek , Mark Bedaywi , Rhys Gould , Stuart Russell

Machine learning (ML) is the field of training machines to achieve high level of cognition and perform human-like analysis. Since ML is a data-driven approach, it seemingly fits into our daily lives and operations as well as complex and…

Machine Learning · Computer Science 2021-11-25 M. Z. Naser , Amir Alavi

Machine Learning requires large amounts of labeled data to fit a model. Many datasets are already publicly available, nevertheless forcing application possibilities of machine learning to the domains of those public datasets. The…

Machine Learning · Computer Science 2021-08-13 Thorben Werner

Reinforcement Learning and, recently, Deep Reinforcement Learning are popular methods for solving sequential decision-making problems modeled as Markov Decision Processes. RL modeling of a problem and selecting algorithms and…

Machine Learning · Computer Science 2026-03-10 Reza Refaei Afshar , Joaquin Vanschoren , Uzay Kaymak , Rui Zhang , Yaoxin Wu , Wen Song , Yingqian Zhang

Robust reinforcement learning (RL) aims to find a policy that optimizes the worst-case performance in the face of uncertainties. In this paper, we focus on action robust RL with the probabilistic policy execution uncertainty, in which,…

Machine Learning · Computer Science 2023-07-21 Guanlin Liu , Zhihan Zhou , Han Liu , Lifeng Lai