English
Related papers

Related papers: Impact of Discretization Noise of the Dependent va…

200 papers

Learning from multiple annotators aims to induce a high-quality classifier from training instances, where each of them is associated with a set of possibly noisy labels provided by multiple annotators under the influence of their varying…

Machine Learning · Computer Science 2021-06-30 Jingzheng Li , Hailong Sun , Jiyi Li , Zhijun Chen , Renshuai Tao , Yufei Ge

Training classification models on imbalanced data tends to result in bias towards the majority class. In this paper, we demonstrate how variable discretization and cost-sensitive logistic regression help mitigate this bias on an imbalanced…

Applications · Statistics 2019-07-29 Lili Zhang , Herman Ray , Jennifer Priestley , Soon Tan

Any classifier can be "smoothed out" under Gaussian noise to build a new classifier that is provably robust to $\ell_2$-adversarial perturbations, viz., by averaging its predictions over the noise via randomized smoothing. Under the…

Machine Learning · Computer Science 2022-12-21 Jongheon Jeong , Seojin Kim , Jinwoo Shin

We examine the influence of input data representations on learning complexity. For learning, we posit that each model implicitly uses a candidate model distribution for unexplained variations in the data, its noise model. If the model…

Machine Learning · Computer Science 2019-12-21 Julian Zilly , Lorenz Hetzel , Andrea Censi , Emilio Frazzoli

The goal of this paper is to investigate an approach for derivative-free optimization that has not received sufficient attention in the literature and is yet one of the simplest to implement and parallelize. It consists of computing…

Optimization and Control · Mathematics 2021-02-22 Hao-Jun Michael Shi , Melody Qiming Xuan , Figen Oztoprak , Jorge Nocedal

Adversarial attacks dramatically change the output of an otherwise accurate learning system using a seemingly inconsequential modification to a piece of input data. Paradoxically, empirical evidence indicates that even systems which are…

Machine Learning · Computer Science 2024-09-13 Oliver J. Sutton , Qinghua Zhou , Ivan Y. Tyukin , Alexander N. Gorban , Alexander Bastounis , Desmond J. Higham

In the field of medical image analysis, deep learning models have demonstrated remarkable success in enhancing diagnostic accuracy and efficiency. However, the reliability of these models is heavily dependent on the quality of training…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Maolin Li , Giacomo Tarroni

In non-stationary environments, learning machines usually confront the domain adaptation scenario where the data distribution does change over time. Previous domain adaptation works have achieved great success in theory and practice.…

Machine Learning · Computer Science 2020-05-06 Zhongyi Han , Xian-Jin Gui , Chaoran Cui , Yilong Yin

Speaker diarization systems segment a conversation recording based on the speakers' identity. Such systems can misclassify the speaker of a portion of audio due to a variety of factors, such as speech pattern variation, background noise,…

Sound · Computer Science 2024-06-26 Anurag Chowdhury , Abhinav Misra , Mark C. Fuhs , Monika Woszczyna

The interest in analog computation has grown tremendously in recent years due to its fast computation speed and excellent energy efficiency, which is very important for edge and IoT devices in the sub-watt power envelope for deep learning…

Machine Learning · Computer Science 2022-05-18 Omobayode Fagbohungbe , Lijun Qian

Speech emotion recognition is an important component of any human centered system. But speech characteristics produced and perceived by a person can be influenced by a multitude of reasons, both desirable such as emotion, and undesirable…

Sound · Computer Science 2023-09-04 Mimansa Jaiswal , Emily Mower Provost

Uncertainty quantification is vital for decision-making and risk assessment in machine learning. Mean-variance regression models, which predict both a mean and residual noise for each data point, provide a simple approach to uncertainty…

Machine Learning · Statistics 2025-12-01 Eliot Wong-Toi , Alex Boyd , Vincent Fortuin , Stephan Mandt

Label noise and class imbalance commonly coexist in real-world data. Previous works for robust learning, however, usually address either one type of the data biases and underperform when facing them both. To mitigate this gap, this work…

Machine Learning · Computer Science 2023-09-06 Shenwang Jiang , Jianan Li , Jizhou Zhang , Ying Wang , Tingfa Xu

Often, the data used to train ranking models is subject to label noise. For example, in web-search, labels created from clickstream data are noisy due to issues such as insufficient information in item descriptions on the SERP, query…

Information Retrieval · Computer Science 2022-08-18 Dany Haddad

Despite the success of deep neural networks (DNNs) in image classification tasks, the human-level performance relies on massive training data with high-quality manual annotations, which are expensive and time-consuming to collect. There…

Machine Learning · Computer Science 2019-04-15 Junnan Li , Yongkang Wong , Qi Zhao , Mohan Kankanhalli

Large datasets often have unreliable labels-such as those obtained from Amazon's Mechanical Turk or social media platforms-and classifiers trained on mislabeled datasets often exhibit poor performance. We present a simple, effective…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Ishan Jindal , Matthew Nokleby , Xuewen Chen

Randomly perturbing networks during the training process is a commonly used approach to improving generalization performance. In this paper, we present a theoretical study of one particular way of random perturbation, which corresponds to…

Machine Learning · Computer Science 2021-02-16 Oussama Dhifallah , Yue M. Lu

In most practical problems of classifier learning, the training data suffers from the label noise. Hence, it is important to understand how robust is a learning algorithm to such label noise. This paper presents some theoretical analysis to…

Machine Learning · Computer Science 2016-08-29 Aritra Ghosh , Naresh Manwani , P. S. Sastry

We use gradient sparsification to reduce the adverse effect of differential privacy noise on performance of private machine learning models. To this aim, we employ compressed sensing and additive Laplace noise to evaluate…

Machine Learning · Computer Science 2020-12-03 Farhad Farokhi

Differentially private Stochastic Gradient Descent (DP-SGD) has become integral to privacy-preserving machine learning, ensuring robust privacy guarantees in sensitive domains. Despite notable empirical advances leveraging features from…

Machine Learning · Computer Science 2025-11-25 Meng Ding , Mingxi Lei , Shaopeng Fu , Shaowei Wang , Di Wang , Jinhui Xu