English
Related papers

Related papers: Robust Active Learning: Sample-Efficient Training …

200 papers

Constructing decision trees online is a classical machine learning problem. Existing works often assume that features are readily available for each incoming data point. However, in many real world applications, both feature values and the…

Machine Learning · Computer Science 2025-06-18 Arman Rahbar , Ziyu Ye , Yuxin Chen , Morteza Haghir Chehreghani

Deep Neural Networks (DNN) have been shown to be vulnerable to adversarial examples. Adversarial training (AT) is a popular and effective strategy to defend against adversarial attacks. Recent works (Benz et al., 2020; Xu et al., 2021; Tian…

Machine Learning · Computer Science 2023-02-09 Boqi Li , Weiwei Liu

Supervised machine learning relies on the availability of good labelled data for model training. Labelled data is acquired by human annotation, which is a cumbersome and costly process, often requiring subject matter experts. Active…

Machine Learning · Computer Science 2023-10-31 Sharath M Shankaranarayana

Deep learning models have demonstrated great potential in medical 3D imaging, but their development is limited by the expensive, large volume of annotated data required. Active learning (AL) addresses this by training a model on a subset of…

Transfer learning, in which a network is trained on one task and re-purposed on another, is often used to produce neural network classifiers when data is scarce or full-scale training is too costly. When the goal is to produce a model that…

Machine Learning · Computer Science 2020-02-24 Ali Shafahi , Parsa Saadatpanah , Chen Zhu , Amin Ghiasi , Christoph Studer , David Jacobs , Tom Goldstein

In this paper, we propose a method of human activity recognition with high throughput from raw accelerometer data applying a deep recurrent neural network (DRNN), and investigate various architectures and its combination to find the best…

Computer Vision and Pattern Recognition · Computer Science 2016-11-14 Masaya Inoue , Sozo Inoue , Takeshi Nishida

Batch active learning is a popular approach for efficiently training machine learning models on large, initially unlabelled datasets by repeatedly acquiring labels for batches of data points. However, many recent batch active learning…

Machine Learning · Computer Science 2023-07-10 Andreas Kirsch

Active learning aims to select a small subset of data for annotation such that a classifier learned on the data is highly accurate. This is usually done using heuristic selection methods, however the effectiveness of such methods is limited…

Computation and Language · Computer Science 2017-08-09 Meng Fang , Yuan Li , Trevor Cohn

Active Learning is concerned with the question of how to identify the most useful samples for a Machine Learning algorithm to be trained with. When applied correctly, it can be a very powerful tool to counteract the immense data…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Lukas Hahn , Lutz Roese-Koerner , Peet Cremer , Urs Zimmermann , Ori Maoz , Anton Kummert

Annotating training data for sequence tagging of texts is usually very time-consuming. Recent advances in transfer learning for natural language processing in conjunction with active learning open the possibility to significantly reduce the…

Deep active learning (DAL) seeks to reduce annotation costs by enabling the model to actively query instance annotations from which it expects to learn the most. Despite extensive research, there is currently no standardized evaluation…

Machine Learning · Computer Science 2023-06-21 Lukas Rauch , Matthias Aßenmacher , Denis Huseljic , Moritz Wirth , Bernd Bischl , Bernhard Sick

Active learning aims to reduce labeling efforts by selectively asking humans to annotate the most important data points from an unlabeled pool and is an example of human-machine interaction. Though active learning has been extensively…

Machine Learning · Computer Science 2020-01-31 Hongjing Zhang , S. S. Ravi , Ian Davidson

Adversarial training is a widely-applied approach to training deep neural networks to be robust against adversarial perturbation. However, although adversarial training has achieved empirical success in practice, it still remains unclear…

Machine Learning · Computer Science 2025-02-10 Binghui Li , Yuanzhi Li

The usage of deep learning is being escalated in many applications. Due to its outstanding performance, it is being used in a variety of security and privacy-sensitive areas in addition to conventional applications. One of the key aspects…

Cryptography and Security · Computer Science 2022-05-17 Zhaoxi Zhang , Leo Yu Zhang , Xufei Zheng , Bilal Hussain Abbasi , Shengshan Hu

While deep neural networks (DNNs) have revolutionized many fields, their fragility to carefully designed adversarial attacks impedes the usage of DNNs in safety-critical applications. In this paper, we strive to explore the robust features…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hong Wang , Yuefan Deng , Shinjae Yoo , Yuewei Lin

Adversarial training is an effective method to improve the machine learning (ML) model robustness. Most existing studies typically consider the Rectified linear unit (ReLU) activation function and centralized training environments. In this…

Machine Learning · Computer Science 2025-12-05 Long Dang , Thushari Hapuarachchi , Kaiqi Xiong , Jing Lin

Robustness of deep neural networks (DNNs) to malicious perturbations is a hot topic in trustworthy AI. Existing techniques obtain robust models given fixed datasets, either by modifying model structures, or by optimizing the process of…

Machine Learning · Computer Science 2022-03-11 Yiqi Zhong , Lei Wu , Xianming Liu , Junjun Jiang

Active deep learning classification of hyperspectral images is considered in this paper. Deep learning has achieved success in many applications, but good-quality labeled samples are needed to construct a deep learning network. It is…

Machine Learning · Computer Science 2016-12-04 Peng Liu , Hui Zhang , Kie B. Eom

Transfer learning is a widely-used paradigm in deep learning, where models pre-trained on standard datasets can be efficiently adapted to downstream tasks. Typically, better pre-trained models yield better transfer results, suggesting that…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Hadi Salman , Andrew Ilyas , Logan Engstrom , Ashish Kapoor , Aleksander Madry

Understanding how the brain responds to sensory inputs is challenging: brain recordings are partial, noisy, and high dimensional; they vary across sessions and subjects and they capture highly nonlinear dynamics. These challenges have led…

Neurons and Cognition · Quantitative Biology 2022-10-03 Omar Chehab , Alexandre Defossez , Jean-Christophe Loiseau , Alexandre Gramfort , Jean-Remi King