English
Related papers

Related papers: Beyond Moments: Robustly Learning Affine Transform…

200 papers

Unsupervised domain adaptation (UDA) plays a crucial role in addressing distribution shifts in machine learning. In this work, we improve the theoretical foundations of UDA proposed in Acuna et al. (2021) by refining their…

Machine Learning · Statistics 2024-10-29 Ziqiao Wang , Yongyi Mao

We develop efficient algorithms for estimating low-degree moments of unknown distributions in the presence of adversarial outliers. The guarantees of our algorithms improve in many cases significantly over the best previous ones, obtained…

Data Structures and Algorithms · Computer Science 2017-12-27 Pravesh K. Kothari , David Steurer

The seminal work of Linial, Mansour, and Nisan gave a quasipolynomial-time algorithm for learning constant-depth circuits ($\mathsf{AC}^0$) with respect to the uniform distribution on the hypercube. Extending their algorithm to the setting…

Data Structures and Algorithms · Computer Science 2024-11-07 Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

A fundamental notion of distance between train and test distributions from the field of domain adaptation is discrepancy distance. While in general hard to compute, here we provide the first set of provably efficient algorithms for testing…

Data Structures and Algorithms · Computer Science 2024-06-14 Gautam Chandrasekaran , Adam R. Klivans , Vasilis Kontonis , Konstantinos Stavropoulos , Arsen Vasilyan

Most estimators collapse all uncertainty modes into a single confidence score, preventing reliable reasoning about when to allocate more compute or adjust inference. We introduce Uncertainty-Guided Inference-Time Selection, a lightweight…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Divake Kumar , Patrick Poggi , Sina Tayebati , Devashri Naik , Nilesh Ahuja , Amit Ranjan Trivedi

Defect detection is a critical research area in artificial intelligence. Recently, synthetic data-based self-supervised learning has shown great potential on this task. Although many sophisticated synthesizing strategies exist, little…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Yuxuan Cai , Dingkang Liang , Dongliang Luo , Xinwei He , Xin Yang , Xiang Bai

Unsupervised anomaly detection (UAD) learns one-class classifiers exclusively with normal (i.e., healthy) images to detect any abnormal (i.e., unhealthy) samples that do not conform to the expected normal patterns. UAD has two main…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Yu Tian , Guansong Pang , Fengbei Liu , Yuanhong chen , Seon Ho Shin , Johan W. Verjans , Rajvinder Singh , Gustavo Carneiro

A method for learning local affine-covariant regions is presented. We show that maximizing geometric repeatability does not lead to local regions, a.k.a features,that are reliably matched and this necessitates descriptor-based learning. We…

Computer Vision and Pattern Recognition · Computer Science 2018-08-29 Dmytro Mishkin , Filip Radenovic , Jiri Matas

We devise the fast adjoint response algorithm for the gradient of physical measures (long-time-average statistics) of discrete-time hyperbolic chaos with respect to many system parameters. Its cost is independent of the number of…

Dynamical Systems · Mathematics 2022-09-13 Angxiu Ni

Robust estimation is much more challenging in high dimensions than it is in one dimension: Most techniques either lead to intractable optimization problems or estimators that can tolerate only a tiny fraction of errors. Recent work in…

Machine Learning · Computer Science 2018-03-14 Ilias Diakonikolas , Gautam Kamath , Daniel M. Kane , Jerry Li , Ankur Moitra , Alistair Stewart

Time series forecasting under distribution shift remains challenging, as existing deep learning models often rely on local statistical normalization (e.g., mean and variance) that fails to capture global distribution shift. Methods like…

Machine Learning · Computer Science 2025-11-18 Yujie Li , Zezhi Shao , Chengqing Yu , Yisong Fu , Tao Sun , Yongjun Xu , Fei Wang

We consider a basic problem in unsupervised learning: learning an unknown \emph{Poisson Binomial Distribution}. A Poisson Binomial Distribution (PBD) over $\{0,1,\dots,n\}$ is the distribution of a sum of $n$ independent Bernoulli random…

Data Structures and Algorithms · Computer Science 2015-02-18 Constantinos Daskalakis , Ilias Diakonikolas , Rocco A. Servedio

The core challenge in unsupervised anomaly detection is identifying abnormal patterns without prior knowledge of their characteristics. While existing methods have addressed aspects of this problem, they often struggle to learn a robust…

Machine Learning · Computer Science 2026-05-12 Prithul Sarker , Sushmita Sarker , Nicholas G. Murray , Alireza Tavakkoli

This paper is concerned with the inverse obstacle scattering problem with phaseless far-field data at a fixed frequency. The main difficulty of this problem is the so-called translation invariance property of the modulus of the far-field…

Numerical Analysis · Mathematics 2018-08-29 Bo Zhang , Haiwen Zhang

Robust uncertainty quantification is increasingly important in modern data analysis and is often formalized under Huber's model, which allows an $\varepsilon$-fraction of arbitrary corruptions. In many experimental sciences, however, the…

Statistics Theory · Mathematics 2026-05-06 Qiaosen Wang , Shuwen Chai , Chao Gao

Inverse scattering focuses on recovering unknown scatterers from wave measurements. A fundamental challenge is determining whether an inverse obstacle problem can be resolved from a single far-field measurement, a task particularly…

Analysis of PDEs · Mathematics 2026-04-15 Huaian Diao , Hongyu Liu , Longyue Tao

The application of machine learning in safety-critical systems requires a reliable assessment of uncertainty. However, deep neural networks are known to produce highly overconfident predictions on out-of-distribution (OOD) data. Even if…

Machine Learning · Computer Science 2022-10-19 Alexander Meinke , Julian Bitterwolf , Matthias Hein

A set of high dimensional points $X=\{x_1, x_2,\ldots, x_n\} \subset R^d$ in isotropic position is said to be $\delta$-anti concentrated if for every direction $v$, the fraction of points in $X$ satisfying $|\langle x_i,v \rangle |\leq…

Data Structures and Algorithms · Computer Science 2024-10-29 Ainesh Bakshi , Pravesh Kothari , Goutham Rajendran , Madhur Tulsiani , Aravindan Vijayaraghavan

We study the problem of learning Bayesian networks where an $\epsilon$-fraction of the samples are adversarially corrupted. We focus on the fully-observable case where the underlying graph structure is known. In this work, we present the…

Machine Learning · Computer Science 2021-05-13 Yu Cheng , Honghao Lin

Independent Component Analysis (ICA) is the problem of learning a square matrix $A$, given samples of $X=AS$, where $S$ is a random vector with independent coordinates. Most existing algorithms are provably efficient only when each $S_i$…

Machine Learning · Computer Science 2017-02-24 Joseph Anderson , Navin Goyal , Anupama Nandi , Luis Rademacher