English
Related papers

Related papers: Active Learning Based Sampling for High-Dimensiona…

200 papers

Deep metric learning maps visually similar images onto nearby locations and visually dissimilar images apart from each other in an embedding manifold. The learning process is mainly based on the supplied image negative and positive training…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Chang-Hui Liang , Wan-Lei Zhao , Run-Qing Chen

We investigate active learning in the context of deep neural network models for change detection and map updating. Active learning is a natural choice for a number of remote sensing tasks, including the detection of local surface changes:…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Vít Růžička , Stefano D'Aronco , Jan Dirk Wegner , Konrad Schindler

Active learning has been studied extensively as a method for efficient data collection. Among the many approaches in literature, Expected Error Reduction (EER) (Roy and McCallum) has been shown to be an effective method for active learning:…

Machine Learning · Computer Science 2022-11-18 Stephen Mussmann , Julia Reisler , Daniel Tsai , Ehsan Mousavi , Shayne O'Brien , Moises Goldszmidt

This paper proposes an active learning (AL) algorithm to solve regression problems based on inverse-distance weighting functions for selecting the feature vectors to query. The algorithm has the following features: (i) supports both…

Machine Learning · Computer Science 2022-12-15 Alberto Bemporad

Annotating the right data for training deep neural networks is an important challenge. Active learning using uncertainty estimates from Bayesian Neural Networks (BNNs) could provide an effective solution to this. Despite being theoretically…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Kashyap Chitta , Jose M. Alvarez , Adam Lesnikowski

Solving time-dependent partial differential equations (PDEs) that exhibit sharp gradients or local singularities is computationally demanding, as traditional physics-informed neural networks (PINNs) often suffer from inefficient point…

Numerical Analysis · Mathematics 2026-01-27 Beining Xu , Haijun Yu , Jiayu Zhai , Kejun Tang , Xiaoliang Wan

Active learning is relevant and challenging for high-dimensional regression models when the annotation of the samples is expensive. Yet most of the existing sampling methods cannot be applied to large-scale problems, consuming too much time…

Machine Learning · Computer Science 2020-01-24 Evgenii Tsymbalov , Maxim Panov , Alexander Shapeev

In this paper, a sparsity-aware adaptive algorithm for distributed learning in diffusion networks is developed. The algorithm follows the set-theoretic estimation rationale. At each time instance and at each node of the network, a closed…

Information Theory · Computer Science 2015-06-03 Symeon Chouvardas , Konstantinos Slavakis , Yannis Kopsinis , Sergios Theodoridis

Active learning is a machine learning paradigm that aims to improve the performance of a model by strategically selecting and querying unlabeled data. One effective selection strategy is to base it on the model's predictive uncertainty,…

Machine Learning · Computer Science 2024-05-17 Seong Jin Cho , Gwangsu Kim , Junghyun Lee , Jinwoo Shin , Chang D. Yoo

Active learning aims to reduce the high labeling cost involved in training machine learning models on large datasets by efficiently labeling only the most informative samples. Recently, deep active learning has shown success on various…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Sudhanshu Mittal , Maxim Tatarchenko , Özgün Çiçek , Thomas Brox

In this paper, we propose a new adaptive technique, named adaptive trajectories sampling (ATS), which is used to select training points for the numerical solution of partial differential equations (PDEs) with deep learning methods. The key…

Numerical Analysis · Mathematics 2023-03-29 Xingyu Chen , Jianhuan Cen , Qingsong Zou

Recent years have witnessed a growth in mathematics for deep learning--which seeks a deeper understanding of the concepts of deep learning with mathematics and explores how to make it more robust--and deep learning for mathematics, where…

Machine Learning · Computer Science 2023-10-31 Derick Nganyu Tanyu , Jianfeng Ning , Tom Freudenberg , Nick Heilenkötter , Andreas Rademacher , Uwe Iben , Peter Maass

Active learning enables efficient model training by leveraging interactions between machine learning agents and human annotators. We study and propose a novel framework that formulates batch active learning from the sparse approximation's…

Machine Learning · Computer Science 2022-11-08 Maohao Shen , Bowen Jiang , Jacky Yibo Zhang , Oluwasanmi Koyejo

We utilize extreme-learning machines for the prediction of partial differential equations (PDEs). Our method splits the state space into multiple windows that are predicted individually using a single model. Despite requiring only few data…

Machine Learning · Computer Science 2024-08-20 Hans Harder , Jean Rabault , Ricardo Vinuesa , Mikael Mortensen , Sebastian Peitz

Deep Neural Networks (DNNs) often rely on very large datasets for training. Given the large size of such datasets, it is conceivable that they contain certain samples that either do not contribute or negatively impact the DNN's…

Machine Learning · Computer Science 2020-11-10 Kashyap Chitta , Jose M. Alvarez , Elmar Haussmann , Clement Farabet

Active Learning aims to optimize performance while minimizing annotation costs by selecting the most informative samples from an unlabelled pool. Traditional uncertainty sampling often leads to sampling bias by choosing similar uncertain…

Machine Learning · Computer Science 2024-11-27 Tejaswi Kasarla , Abhishek Jha , Faye Tervoort , Rita Cucchiara , Pascal Mettes

Vulnerability detection is crucial for identifying security weaknesses in software systems. However, training effective machine learning models for this task is often constrained by the high cost and expertise required for data annotation.…

Cryptography and Security · Computer Science 2025-08-19 Xiang Lan , Tim Menzies , Bowen Xu

In modern data analysis, random sampling is an efficient and widely-used strategy to overcome the computational difficulties brought by large sample size. In previous studies, researchers conducted random sampling which is according to the…

Machine Learning · Statistics 2018-03-05 Rong Zhu

Developing efficient numerical algorithms for the solution of high dimensional random Partial Differential Equations (PDEs) has been a challenging task due to the well-known curse of dimensionality. We present a new solution framework for…

Machine Learning · Computer Science 2019-10-17 Mohammad Amin Nabian , Hadi Meidani

Active Learning is concerned with the question of how to identify the most useful samples for a Machine Learning algorithm to be trained with. When applied correctly, it can be a very powerful tool to counteract the immense data…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Lukas Hahn , Lutz Roese-Koerner , Peet Cremer , Urs Zimmermann , Ori Maoz , Anton Kummert