English
Related papers

Related papers: Mind the Nuisance: Gaussian Process Classification…

200 papers

It has been shown that perturbing the input during training implicitly regularises the gradient of the learnt function, leading to smoother models and enhancing generalisation. However, previous research mostly considered the addition of…

Machine Learning · Computer Science 2025-12-09 Albert Kjøller Jacobsen , Johanna Marie Gegenfurtner , Georgios Arvanitidis

The label noise transition matrix $T$, reflecting the probabilities that true labels flip into noisy ones, is of vital importance to model label noise and design statistically consistent classifiers. The traditional transition matrix is…

Machine Learning · Computer Science 2020-12-03 Xiaobo Xia , Tongliang Liu , Bo Han , Nannan Wang , Jiankang Deng , Jiatong Li , Yinian Mao

Machine unlearning seeks to efficiently remove the influence of selected data while preserving generalization. Significant progress has been made in low dimensions $(p \ll n)$, but high dimensions pose serious theoretical challenges as…

Machine Learning · Statistics 2025-10-16 Aaradhya Pandey , Arnab Auddy , Haolin Zou , Arian Maleki , Sanjeev Kulkarni

In machine learning (ML) security, attacks like evasion, model stealing or membership inference are generally studied in individually. Previous work has also shown a relationship between some attacks and decision function curvature of the…

Cryptography and Security · Computer Science 2020-12-01 Kathrin Grosse , Michael T. Smith , Michael Backes

Gradient perturbation, widely used for differentially private optimization, injects noise at every iterative update to guarantee differential privacy. Previous work first determines the noise level that can satisfy the privacy requirement…

Machine Learning · Computer Science 2020-10-27 Da Yu , Huishuai Zhang , Wei Chen , Tie-Yan Liu , Jian Yin

In recent years, Gaussian noise has become a popular tool in differentially private algorithms, often replacing Laplace noise which dominated the early literature. Gaussian noise is the standard approach to $\textit{approximate}$…

Cryptography and Security · Computer Science 2024-11-19 Joel Daniel Andersson , Rasmus Pagh , Teresa Anna Steiner , Sahel Torkamani

The availability of large labeled datasets has allowed Convolutional Network models to achieve impressive recognition results. However, in many settings manual annotation of the data is impractical; instead our data has noisy labels, i.e.…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Sainbayar Sukhbaatar , Joan Bruna , Manohar Paluri , Lubomir Bourdev , Rob Fergus

We are interested in representation learning from labeled or unlabeled data. Inspired by recent success of self-supervised learning (SSL), we develop a non-contrastive representation learning method that can exploit additional knowledge.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Ajinkya Tejankar , Soroush Abbasi Koohpayegani , Hamed Pirsiavash

Data-driven Model Predictive Control (MPC), where the system model is learned from data with machine learning, has recently gained increasing interests in the control community. Gaussian Processes (GP), as a type of statistical models, are…

Systems and Control · Computer Science 2019-10-03 Truong X. Nghiem

Understanding noise tolerance of machine learning algorithms is a central quest in learning theory. In this work, we study the problem of computationally efficient PAC learning of halfspaces in the presence of malicious noise, where an…

Machine Learning · Computer Science 2025-02-18 Jie Shen

The identification of the constrained dynamics of mechanical systems is often challenging. Learning methods promise to ease an analytical analysis, but require considerable amounts of data for training. We propose to combine insights from…

Machine Learning · Computer Science 2020-09-16 A. Rene Geist , Sebastian Trimpe

To collect large scale annotated data, it is inevitable to introduce label noise, i.e., incorrect class labels. To be robust against label noise, many successful methods rely on the noisy classifiers (i.e., models trained on the noisy…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Songzhu Zheng , Pengxiang Wu , Aman Goswami , Mayank Goswami , Dimitris Metaxas , Chao Chen

To ensure that the data collected from human subjects is entrusted with a secret, rival labels are introduced to conceal the information provided by the participants on purpose. The corresponding learning task can be formulated as a noisy…

Machine Learning · Computer Science 2023-04-04 Cheng Chen , Yueming Lyu , Ivor W. Tsang

We consider differentially private algorithms for reinforcement learning in continuous spaces, such that neighboring reward functions are indistinguishable. This protects the reward information from being exploited by methods such as…

Machine Learning · Statistics 2019-11-12 Baoxiang Wang , Nidhi Hegde

The data-centric machine learning aims to find effective ways to build appropriate datasets which can improve the performance of AI models. In this paper, we mainly focus on designing an efficient data-centric scheme to improve robustness…

Machine Learning · Computer Science 2022-03-09 Xiaogeng Liu , Haoyu Wang , Yechao Zhang , Fangzhou Wu , Shengshan Hu

Federated learning, in which training data is distributed among users and never shared, has emerged as a popular approach to privacy-preserving machine learning. Cryptographic techniques such as secure aggregation are used to aggregate…

Machine Learning · Computer Science 2022-03-08 Rasmus Pagh , Nina Mesing Stausholm

We introduce a simple framework for designing private boosting algorithms. We give natural conditions under which these algorithms are differentially private, efficient, and noise-tolerant PAC learners. To demonstrate our framework, we use…

Machine Learning · Computer Science 2020-02-05 Mark Bun , Marco Leandro Carmosino , Jessica Sorrell

We investigate the impact of entropy change in deep learning systems by noise injection at different levels, including the embedding space and the image. The series of models that employ our methodology are collectively known as Noisy…

Artificial Intelligence · Computer Science 2025-09-09 Xiaowei Yu , Zhe Huang , Minheng Chen , Lu Zhang , Tianming Liu , Dajiang Zhu

In machine learning, classifiers are typically susceptible to noise in the training data. In this work, we aim at reducing intra-class noise with the help of graph filtering to improve the classification performance. Considered graphs are…

Machine Learning · Statistics 2021-01-26 Mounia Hamidouche , Carlos Lassance , Yuqing Hu , Lucas Drumetz , Bastien Pasdeloup , Vincent Gripon

Learning with noisy labels is a common challenge in supervised learning. Existing approaches often require practitioners to specify noise rates, i.e., a set of parameters controlling the severity of label noises in the problem, and the…

Machine Learning · Computer Science 2020-08-18 Yang Liu , Hongyi Guo