English
Related papers

Related papers: Statistical Active Learning Algorithms for Noise T…

200 papers

In non-stationary environments, learning machines usually confront the domain adaptation scenario where the data distribution does change over time. Previous domain adaptation works have achieved great success in theory and practice.…

Machine Learning · Computer Science 2020-05-06 Zhongyi Han , Xian-Jin Gui , Chaoran Cui , Yilong Yin

Machine learning models are increasingly used in high-stakes decision-making systems. In such applications, a major concern is that these models sometimes discriminate against certain demographic groups such as individuals with certain…

Machine Learning · Computer Science 2023-06-06 Andrew Lowy , Devansh Gupta , Meisam Razaviyayn

When applying differential privacy to sensitive data, we can often improve performance using external information such as other sensitive data, public data, or human priors. We propose to use the learning-augmented algorithms (or algorithms…

Cryptography and Security · Computer Science 2023-05-09 Mikhail Khodak , Kareem Amin , Travis Dick , Sergei Vassilvitskii

Audio events are quite often overlapping in nature, and more prone to noise than visual signals. There has been increasing evidence for the superior performance of representations learned using sparse dictionaries for applications like…

Machine Learning · Computer Science 2017-12-05 Vaisakh Shaj , Puranjoy Bhattacharya

Differentially private (DP) mechanisms face the challenge of providing accurate results while protecting their inputs: the privacy-utility trade-off. A simple but powerful technique for DP adds noise to sensitivity-bounded query outputs to…

Cryptography and Security · Computer Science 2021-07-28 David M. Sommer , Lukas Abfalterer , Sheila Zingg , Esfandiar Mohammadi

We construct algorithms with optimal error for learning with adversarial noise. The overarching theme of this work is that the use of \textsl{randomized} hypotheses can substantially improve upon the best error rates achievable with…

Data Structures and Algorithms · Computer Science 2026-04-06 Guy Blanc

Traditional energy-based learning models associate a single energy metric to each configuration of variables involved in the underlying optimization process. Such models associate the lowest energy state to the optimal configuration of…

Machine Learning · Computer Science 2020-04-10 Oindrila Chatterjee , Shantanu Chakrabartty

Discriminative learning machines often need a large set of labeled samples for training. Active learning (AL) settings assume that the learner has the freedom to ask an oracle to label its desired samples. Traditional AL algorithms…

Machine Learning · Statistics 2018-05-24 Arash Mehrjou , Mehran Khodabandeh , Greg Mori

This paper introduces a new imitation learning framework based on energy-based generative models capable of learning complex, physics-dependent, robot motion policies through state-only expert motion trajectories. Our algorithm, called…

Robotics · Computer Science 2025-02-13 Anish Abhijit Diwan , Julen Urain , Jens Kober , Jan Peters

Neural Architecture Search (NAS) is the game changer in designing robust neural architectures. Architectures designed by NAS outperform or compete with the best manual network designs in terms of accuracy, size, memory footprint and FLOPs.…

Machine Learning · Computer Science 2021-10-26 Christian Simon , Piotr Koniusz , Lars Petersson , Yan Han , Mehrtash Harandi

Many deep learning algorithms can be easily fooled with simple adversarial examples. To address the limitations of existing defenses, we devised a probabilistic framework that can generate an exponentially large ensemble of models from a…

Machine Learning · Computer Science 2018-09-11 George A. Adam , Petr Smirnov , David Duvenaud , Benjamin Haibe-Kains , Anna Goldenberg

Accurate noise modelling is important for training of deep learning reconstruction algorithms. While noise models are well known for traditional imaging techniques, the noise distribution of a novel sensor may be difficult to determine a…

Machine Learning · Computer Science 2018-07-11 Felix Horger , Tobias Würfl , Vincent Christlein , Andreas Maier

Robust loss minimization is an important strategy for handling robust learning issue on noisy labels. Current approaches for designing robust losses involve the introduction of noise-robust factors, i.e., hyperparameters, to control the…

Machine Learning · Computer Science 2023-09-06 Kehui Ding , Jun Shu , Deyu Meng , Zongben Xu

We study the problem of learning adversarially robust halfspaces in the distribution-independent setting. In the realizable setting, we provide necessary and sufficient conditions on the adversarial perturbation sets under which halfspaces…

Machine Learning · Computer Science 2020-05-18 Omar Montasser , Surbhi Goel , Ilias Diakonikolas , Nathan Srebro

In recent years, non-monotonic Inductive Logic Programming has received growing interest. Specifically, several new learning frameworks and algorithms have been introduced for learning under the answer set semantics, allowing the learning…

Artificial Intelligence · Computer Science 2018-08-28 Mark Law , Alessandra Russo , Krysia Broda

The cost of annotating transcriptions for large speech corpora becomes a bottleneck to maximally enjoy the potential capacity of deep neural network-based automatic speech recognition models. In this paper, we present a new training…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-06 Jihwan Bang , Heesu Kim , YoungJoon Yoo , Jung-Woo Ha

We present a discrete-time formulation for the autonomous learning conjecture. The main feature of this formulation is the possibility to apply the autonomous learning scheme to systems in which the errors with respect to target functions…

Adaptation and Self-Organizing Systems · Physics 2017-06-07 Agustín M. Bilen , Pablo Kaluza

In addition to high accuracy, robustness is becoming increasingly important for machine learning models in various applications. Recently, much research has been devoted to improving the model robustness by training with noise…

Machine Learning · Computer Science 2021-03-30 Kun-Peng Ning , Lue Tao , Songcan Chen , Sheng-Jun Huang

To collect large scale annotated data, it is inevitable to introduce label noise, i.e., incorrect class labels. To be robust against label noise, many successful methods rely on the noisy classifiers (i.e., models trained on the noisy…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Songzhu Zheng , Pengxiang Wu , Aman Goswami , Mayank Goswami , Dimitris Metaxas , Chao Chen

Meta-learning methods typically learn tasks under the assumption that all tasks are equally important. However, this assumption is often not valid. In real-world applications, tasks can vary both in their importance during different…

Machine Learning · Computer Science 2024-05-14 Donglin Zhan , James Anderson