English
Related papers

Related papers: Efficient Online Decision Tree Learning with Activ…

200 papers

The alignment of autonomous agents with human values is a pivotal challenge when deploying these agents within physical environments, where safety is an important concern. However, defining the agent's objective as a reward and/or cost…

Machine Learning · Computer Science 2023-12-15 Mattijs Baert , Sam Leroux , Pieter Simoens

The task of determining labels of all network nodes based on the knowledge about network structure and labels of some training subset of nodes is called the within-network classification. It may happen that none of the labels of the nodes…

Machine Learning · Statistics 2015-10-06 Tomasz Kajdanowicz , Radosław Michalski , Katarzyna Musiał , Przemysław Kazienko

The cost of drawing object bounding boxes (i.e. labeling) for millions of images is prohibitively high. For instance, labeling pedestrians in a regular urban image could take 35 seconds on average. Active learning aims to reduce the cost of…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Hamed H. Aghdam , Abel Gonzalez-Garcia , Joost van de Weijer , Antonio M. López

Offline reinforcement-learning (RL) algorithms learn to make decisions using a given, fixed training dataset without online data collection. This problem setting is captivating because it holds the promise of utilizing previously collected…

Machine Learning · Computer Science 2022-12-07 Dan Elbaz , Gal Novik , Oren Salzman

We present an approach to adaptively utilize deep neural networks in order to reduce the evaluation time on new examples without loss of accuracy. Rather than attempting to redesign or approximate existing networks, we propose two schemes…

Machine Learning · Computer Science 2017-09-20 Tolga Bolukbasi , Joseph Wang , Ofer Dekel , Venkatesh Saligrama

As large language models (LLMs) become increasingly versatile, numerous large scale benchmarks have been developed to thoroughly assess their capabilities. These benchmarks typically consist of diverse datasets and prompts to evaluate…

Machine Learning · Computer Science 2024-10-10 Yang Li , Jie Ma , Miguel Ballesteros , Yassine Benajiba , Graham Horwood

We propose a general framework for sequential and dynamic acquisition of useful information in order to solve a particular task. While our goal could in principle be tackled by general reinforcement learning, our particular setting is…

Machine Learning · Statistics 2016-02-09 He He , Paul Mineiro , Nikos Karampatziakis

This paper investigates the problem of online prediction learning, where learning proceeds continuously as the agent interacts with an environment. The predictions made by the agent are contingent on a particular way of behaving,…

Machine Learning · Computer Science 2018-11-08 Sina Ghiassian , Andrew Patterson , Martha White , Richard S. Sutton , Adam White

Optimal design for model training is a critical topic in machine learning. Active Learning aims at obtaining improved models by querying samples with maximum uncertainty according to the estimation model for artificially labeling; this has…

Advances in machine learning methods for computer vision tasks have led to their consideration for safety-critical applications like autonomous driving. However, effectively integrating these methods into the automotive development…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Youssef Shoeb , Azarm Nowzad , Hanno Gottschalk

Labeled data are critical to modern machine learning applications, but obtaining labels can be expensive. To mitigate this cost, machine learning methods, such as transfer learning, semi-supervised learning and active learning, aim to be…

Online learning holds the promise of enabling efficient long-term credit assignment in recurrent neural networks. However, current algorithms fall short of offline backpropagation by either not being scalable or failing to learn long-range…

Machine Learning · Computer Science 2023-11-08 Nicolas Zucchet , Robert Meier , Simon Schug , Asier Mujika , João Sacramento

Some of the most severe bottlenecks preventing widespread development of machine learning models for human behavior include a dearth of labeled training data and difficulty of acquiring high quality labels. Active learning is a paradigm for…

Intelligent agents must pursue their goals in complex environments with partial information and often limited computational capacity. Reinforcement learning methods have achieved great success by creating agents that optimize engineered…

Machine Learning · Computer Science 2021-06-07 Alejandro Daniel Noel , Charel van Hoof , Beren Millidge

Modern machine learning has achieved remarkable success on many problems, but this success often depends on the existence of large, labeled datasets. While active learning can dramatically reduce labeling cost when annotations are…

Machine Learning · Computer Science 2026-02-03 Vivienne Pelletier , Daniel J. Rivera , Obinna Nwokonkwo , Steven A. Wilson , Christopher L. Muhich

In many real-world learning scenarios, features are only acquirable at a cost constrained under a budget. In this paper, we propose a novel approach for cost-sensitive feature acquisition at the prediction-time. The suggested method…

Machine Learning · Computer Science 2019-02-19 Mohammad Kachuee , Orpaz Goldstein , Kimmo Karkkainen , Sajad Darabi , Majid Sarrafzadeh

Predictive models are often used for real-time decision making. However, typical machine learning techniques ignore feature evaluation cost, and focus solely on the accuracy of the machine learning models obtained utilizing all the features…

Machine Learning · Computer Science 2014-08-19 Leilani Battle , Edward Benson , Aditya Parameswaran , Eugene Wu

Given a pre-trained classifier and multiple human experts, we investigate the task of online classification where model predictions are provided for free but querying humans incurs a cost. In this practical but under-explored setting,…

Machine Learning · Computer Science 2023-12-14 Sam Showalter , Alex Boyd , Padhraic Smyth , Mark Steyvers

Decision trees are widely used for interpretable machine learning due to their clearly structured reasoning process. However, this structure belies a challenge we refer to as predictive equivalence: a given tree's decision boundary can be…

Machine Learning · Computer Science 2025-10-15 Hayden McTavish , Zachery Boner , Jon Donnelly , Margo Seltzer , Cynthia Rudin

Active learning is a type of sequential design for supervised machine learning, in which the learning algorithm sequentially requests the labels of selected instances from a large pool of unlabeled data points. The objective is to produce a…

Statistics Theory · Mathematics 2019-11-14 Steve Hanneke , Liu Yang