English
Related papers

Related papers: Learning Geometric Concepts with Nasty Noise

200 papers

Noisy correspondence that refers to mismatches in cross-modal data pairs, is prevalent on human-annotated or web-crawled datasets. Prior approaches to leverage such data mainly consider the application of uni-modal noisy label learning…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Zihua Zhao , Mengxi Chen , Tianjie Dai , Jiangchao Yao , Bo han , Ya Zhang , Yanfeng Wang

Label noise may affect the generalization of classifiers, and the effective learning of main patterns from samples with noisy labels is an important challenge. Recent studies have shown that deep neural networks tend to prioritize the…

Machine Learning · Computer Science 2019-12-06 Yi Sun , Yan Tian , Yiping Xu , Jianxiang Li

In many applications, data is collected in batches, some of which are corrupt or even adversarial. Recent work derived optimal robust algorithms for estimating discrete distributions in this setting. We consider a general framework of…

Machine Learning · Statistics 2020-02-26 Ayush Jain , Alon Orlitsky

We study the problem of learning directed acyclic graphs from continuous observational data, generated according to a linear Gaussian structural equation model. State-of-the-art structure learning methods for this setting have at least one…

Methodology · Statistics 2025-04-03 Tong Xu , Armeen Taeb , Simge Küçükyavuz , Ali Shojaie

Understanding quantum noise is an essential step towards building practical quantum information processing systems. Pauli noise is a useful model that has been widely applied in quantum benchmarking, error mitigation, and error correction.…

Quantum Physics · Physics 2026-01-13 Senrui Chen , Zhihan Zhang , Liang Jiang , Steven T. Flammia

In recent years crowdsourcing has become the method of choice for gathering labeled training data for learning algorithms. Standard approaches to crowdsourcing view the process of acquiring labeled data separately from the process of…

Machine Learning · Computer Science 2017-04-17 Pranjal Awasthi , Avrim Blum , Nika Haghtalab , Yishay Mansour

In non-stationary environments, learning machines usually confront the domain adaptation scenario where the data distribution does change over time. Previous domain adaptation works have achieved great success in theory and practice.…

Machine Learning · Computer Science 2020-05-06 Zhongyi Han , Xian-Jin Gui , Chaoran Cui , Yilong Yin

In linear distance metric learning, we are given data in one Euclidean metric space and the goal is to find an appropriate linear map to another Euclidean metric space which respects certain distance conditions as much as possible. In this…

Machine Learning · Computer Science 2023-12-22 Meysam Alishahi , Anna Little , Jeff M. Phillips

Semi-supervised learning based methods are current SOTA solutions to the noisy-label learning problem, which rely on learning an unsupervised label cleaner first to divide the training samples into a labeled set for clean data and an…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Jingjia Huang , Yuanqi Chen , Jiashi Feng , Xinglong Wu

Despite their exceptional performance in vision tasks, deep learning models often struggle when faced with domain shifts during testing. Test-Time Training (TTT) methods have recently gained popularity by their ability to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 David Osowiechi , Gustavo A. Vargas Hakim , Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Moslem Yazdanpanah , Ismail Ben Ayed , Christian Desrosiers

Low-dimensional chaotic systems such as the Lorenz-63 model are commonly used to benchmark system-agnostic methods for learning dynamics from data. Here we show that learning from noise-free observations in such systems can be achieved up…

Chaotic Dynamics · Physics 2025-07-15 Christof Schötz , Niklas Boers

While there has been a surge of recent interest in learning differential equation models from time series, methods in this area typically cannot cope with highly noisy data. We break this problem into two parts: (i) approximating the…

Machine Learning · Statistics 2020-12-08 Harish S. Bhat , Majerle Reeves , Ramin Raziperchikolaei

We initiate the study of stochastic optimization with oblivious noise, broadly generalizing the standard heavy-tailed noise setup. In our setting, in addition to random observation noise, the stochastic gradient may be subject to…

Data Structures and Algorithms · Computer Science 2024-08-06 Ilias Diakonikolas , Sushrut Karmalkar , Jongho Park , Christos Tzamos

We study the power of query access for the task of agnostic learning under the Gaussian distribution. In the agnostic model, no assumptions are made on the labels and the goal is to compute a hypothesis that is competitive with the {\em…

Machine Learning · Computer Science 2023-12-29 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

Sparse attacks are to optimize the magnitude of adversarial perturbations for fooling deep neural networks (DNNs) involving only a few perturbed pixels (i.e., under the l0 constraint), suitable for interpreting the vulnerability of DNNs.…

Machine Learning · Computer Science 2025-06-24 Fudong Lin , Jiadong Lou , Hao Wang , Brian Jalaian , Xu Yuan

We introduce a Noise-based prior Learning (NoL) approach for training neural networks that are intrinsically robust to adversarial attacks. We find that the implicit generative modeling of random noise with the same loss function used…

Machine Learning · Computer Science 2019-06-04 Priyadarshini Panda , Kaushik Roy

In this paper we revisit some classic problems on classification under misspecification. In particular, we study the problem of learning halfspaces under Massart noise with rate $\eta$. In a recent work, Diakonikolas, Goulekakis, and Tzamos…

Machine Learning · Computer Science 2023-09-21 Sitan Chen , Frederic Koehler , Ankur Moitra , Morris Yau

Noisy labels (NL) and adversarial examples both undermine trained models, but interestingly they have hitherto been studied independently. A recent adversarial training (AT) study showed that the number of projected gradient descent (PGD)…

Machine Learning · Computer Science 2021-02-10 Jianing Zhu , Jingfeng Zhang , Bo Han , Tongliang Liu , Gang Niu , Hongxia Yang , Mohan Kankanhalli , Masashi Sugiyama

In real-world applications, perfect labels are rarely available, making it challenging to develop robust machine learning algorithms that can handle noisy labels. Recent methods have focused on filtering noise based on the discrepancy…

Machine Learning · Computer Science 2023-08-01 Mingcai Chen , Yuntao Du , Wei Tang , Baoming Zhang , Hao Cheng , Shuwei Qian , Chongjun Wang

We study the problem of supervised learning a metric space under discriminative constraints. Given a universe $X$ and sets ${\cal S}, {\cal D}\subset {X \choose 2}$ of similar and dissimilar pairs, we seek to find a mapping $f:X\to Y$, into…

Computational Geometry · Computer Science 2019-03-20 Diego Ihara Centurion , Neshat Mohammadi , Anastasios Sidiropoulos