English
Related papers

Related papers: Adaptive Active Learning for Regression via Reinfo…

200 papers

Active deep learning classification of hyperspectral images is considered in this paper. Deep learning has achieved success in many applications, but good-quality labeled samples are needed to construct a deep learning network. It is…

Machine Learning · Computer Science 2016-12-04 Peng Liu , Hui Zhang , Kie B. Eom

Annotating data for supervised learning can be costly. When the annotation budget is limited, active learning can be used to select and annotate those observations that are likely to give the most gain in model performance. We propose an…

Machine Learning · Statistics 2024-08-19 Amanda Olmin , Jakob Lindqvist , Lennart Svensson , Fredrik Lindsten

The central tenet of reinforcement learning (RL) is that agents seek to maximize the sum of cumulative rewards. In contrast, active inference, an emerging framework within cognitive and computational neuroscience, proposes that agents act…

Machine Learning · Computer Science 2020-03-02 Alexander Tschantz , Beren Millidge , Anil K. Seth , Christopher L. Buckley

Learning in deep weight spaces (DWS), where neural networks process the weights of other neural networks, is an emerging research direction, with applications to 2D and 3D neural fields (INRs, NeRFs), as well as making inferences about…

Machine Learning · Computer Science 2024-11-12 Aviv Shamsian , Aviv Navon , David W. Zhang , Yan Zhang , Ethan Fetaya , Gal Chechik , Haggai Maron

We propose a data-driven sensor-selection algorithm for accurate estimation of the target variables from the selected measurements. The target variables are assumed to be estimated by a ridge-regression estimator which is trained based on…

Signal Processing · Electrical Eng. & Systems 2025-04-22 Yasuo Sasaki , Keigo Yamada , Takayuki Nagata , Yuji Saito , Taku Nonomura

Balancing exploration and exploitation is a fundamental part of reinforcement learning, yet most state-of-the-art algorithms use a naive exploration protocol like $\epsilon$-greedy. This contributes to the problem of high sample complexity,…

Machine Learning · Computer Science 2019-11-21 Tom Blau , Lionel Ott , Fabio Ramos

The availability of labelled data is one of the main limitations in machine learning. We can alleviate this using weak supervision: a framework that uses expert-defined rules $\boldsymbol{\lambda}$ to estimate probabilistic labels…

Machine Learning · Computer Science 2021-05-03 Samantha Biegel , Rafah El-Khatib , Luiz Otavio Vilas Boas Oliveira , Max Baak , Nanne Aben

Incrementally training deep neural networks to recognize new classes is a challenging problem. Most existing class-incremental learning methods store data or use generative replay, both of which have drawbacks, while 'rehearsal-free'…

Machine Learning · Computer Science 2023-11-10 Gido M. van de Ven , Zhe Li , Andreas S. Tolias

We propose a simple, statistically principled, and theoretically justified method to improve supervised learning when the training set is not representative, a situation known as covariate shift. We build upon a well-established methodology…

Machine Learning · Statistics 2025-03-12 Maximilian Autenrieth , David A. van Dyk , Roberto Trotta , David C. Stenning

We propose Active Surrogate Estimators (ASEs), a new method for label-efficient model evaluation. Evaluating model performance is a challenging and important problem when labels are expensive. ASEs address this active testing problem using…

Machine Learning · Computer Science 2022-10-20 Jannik Kossen , Sebastian Farquhar , Yarin Gal , Tom Rainforth

Active learning aims to develop label-efficient algorithms by querying the most informative samples to be labeled by an oracle. The design of efficient training methods that require fewer labels is an important research direction that…

Computer Vision and Pattern Recognition · Computer Science 2019-12-23 Ali Mottaghi , Serena Yeung

Active learning is relevant and challenging for high-dimensional regression models when the annotation of the samples is expensive. Yet most of the existing sampling methods cannot be applied to large-scale problems, consuming too much time…

Machine Learning · Computer Science 2020-01-24 Evgenii Tsymbalov , Maxim Panov , Alexander Shapeev

Aligning Large Language Models (LLMs) to cater to different human preferences, learning new skills, and unlearning harmful behavior is an important problem. Search-based methods, such as Best-of-N or Monte-Carlo Tree Search, are performant,…

Machine Learning · Computer Science 2024-05-13 Seungwook Han , Idan Shenfeld , Akash Srivastava , Yoon Kim , Pulkit Agrawal

Sampling-based motion planning is a well-established approach in autonomous driving, valued for its modularity and analytical tractability. In complex urban scenarios, however, uniform or heuristic sampling often produces many infeasible or…

Robotics · Computer Science 2026-03-24 Korbinian Moller , Roland Stroop , Mattia Piccinini , Alexander Langmann , Johannes Betz

Deep learning systems are prone to catastrophic forgetting when learning from a sequence of tasks, as old data from previous tasks is unavailable when learning a new task. To address this, some methods propose replaying data from previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chenyang Wang , Junjun Jiang , Xingyu Hu , Xianming Liu , Xiangyang Ji

Learning from imbalanced data is one of the most significant challenges in real-world classification tasks. In such cases, neural networks performance is substantially impaired due to preference towards the majority class. Existing…

Machine Learning · Computer Science 2022-11-13 Bronislav Yasinnik , Moshe Salhov , Ofir Lindenbaum , Amir Averbuch

With the increasing penetration of machine learning applications in critical decision-making areas, calls for algorithmic fairness are more prominent. Although there have been various modalities to improve algorithmic fairness through…

Machine Learning · Computer Science 2024-05-21 Zhihao Hu , Yiran Xu , Mengnan Du , Jindong Gu , Xinmei Tian , Fengxiang He

Generative adversarial network (GAN) has become one of the most important neural network models for classical unsupervised machine learning. A variety of discriminator loss functions have been developed to train GAN's discriminators and…

Machine Learning · Computer Science 2021-05-31 Vasily Zadorozhnyy , Qiang Cheng , Qiang Ye

In many areas of science and engineering, discovering the governing differential equations from the noisy experimental data is an essential challenge. It is also a critical step in understanding the physical phenomena and prediction of the…

Methodology · Statistics 2026-05-12 Jiuhai Chen , Lulu Kang , Guang Lin

Data selection seeks to identify a compact yet informative subset from large-scale training corpora, balancing sample quality against collection diversity. We formulate this problem as a Weighted Independent Set (WIS) on a similarity graph,…

Machine Learning · Computer Science 2026-05-21 Yuan Zhang , Lifeng Guo , Junwen Pan , Wenzhao Zheng , Wen Zhou , Kuan Cheng , Kurt Keutzer , Shanghang Zhang