English
Related papers

Related papers: Average-case complexity without the black swans

200 papers

Progress in machine learning is measured by careful evaluation on problems of outstanding common interest. However, the proliferation of benchmark suites and environments, adversarial attacks, and other complications has diluted the basic…

Machine Learning · Computer Science 2018-11-01 David Balduzzi , Karl Tuyls , Julien Perolat , Thore Graepel

In this short note, we provide a sample complexity lower bound for learning linear predictors with respect to the squared loss. Our focus is on an agnostic setting, where no assumptions are made on the data distribution. This contrasts with…

Machine Learning · Computer Science 2021-11-23 Ohad Shamir

The conditional distribution of the next outcome given the infinite past of a stationary process can be inferred from finite but growing segments of the past. Several schemes are known for constructing pointwise consistent estimates, but…

Statistics Theory · Mathematics 2016-11-17 G. Morvai , S. Yakowitz , P. Algoet

This article is a short introduction to generic case complexity, which is a recently developed way of measuring the difficulty of a computational problem while ignoring atypical behavior on a small set of inputs. Generic case complexity…

Computational Complexity · Computer Science 2007-07-11 Robert Gilman , Alexei G. Miasnikov , Alexey D. Myasnikov , Alexander Ushakov

We prove that iid random vectors that satisfy a rather weak moment assumption can be used as measurement vectors in Compressed Sensing, and the number of measurements required for exact reconstruction is the same as the best possible…

Statistics Theory · Mathematics 2016-02-22 Guillaume Lecué , Shahar Mendelson

We study adaptive approximation algorithms for general multivariate linear problems where the sets of input functions are non-convex cones. While it is known that adaptive algorithms perform essentially no better than non-adaptive…

Numerical Analysis · Mathematics 2019-03-27 Yuhan Ding , Fred J. Hickernell , Peter Kritzer , Simon Mak

The nonnegative inverse eigenvalue problem (NIEP) asks which lists of $n$ complex numbers (counting multiplicity) occur as the eigenvalues of some $n$-by-$n$ entry-wise nonnegative matrix. The NIEP has a long history and is a known hard…

Spectral Theory · Mathematics 2017-08-02 Charles R. Johnson , Carlos Marijuán , Pietro Paparella , Miriam Pisonero

Modern classification algorithms are susceptible to adversarial examples--perturbations to inputs that cause the algorithm to produce undesirable behavior. In this work, we seek to understand and extend adversarial examples across domains…

Machine Learning · Computer Science 2021-12-14 Volodymyr Kuleshov , Evgenii Nikishin , Shantanu Thakoor , Tingfung Lau , Stefano Ermon

In time series analysis, statistics based on collections of estimators computed from sub-samples play a crucial role in an increasing variety of important applications. Proving results about the joint asymptotic distribution of such…

Statistics Theory · Mathematics 2013-05-27 Stanislav Volgushev , Xiaofeng Shao

Regression problems assume every instance is annotated (labeled) with a real value, a form of annotation we call \emph{strong guidance}. In order for these annotations to be accurate, they must be the result of a precise experiment or…

Machine Learning · Computer Science 2018-04-06 Aubrey Gress , Ian Davidson

The article recapitulates the concept of weak measurement in its broader sense encapsulating the trade between asymptotically weak measurement precision and asymptotically large measurement statistics. Essential applications in…

Quantum Physics · Physics 2007-05-23 Lajos Diosi

In quantum optics, measurement statistics -- for example, photocounting statistics -- are considered nonclassical if they cannot be reproduced with statistical mixtures of classical radiation fields. We have formulated a necessary and…

Quantum Physics · Physics 2024-09-02 V. S. Kovtoniuk , E. V. Stolyarov , O. V. Kliushnichenko , A. A. Semenov

Assuming that $(X_t)_{t\in\Z}$ is a vector valued time series with a common marginal distribution admitting a density $f$, our aim is to provide a wide range of consistent estimators of $f$. We consider different methods of estimation of…

Statistics Theory · Mathematics 2007-06-13 Nicolas Ragache , Olivier Wintenberger

Two notions of nonclassicality that have been investigated intensively are: (i) negativity, that is, the need to posit negative values when representing quantum states by quasiprobability distributions such as the Wigner representation, and…

Quantum Physics · Physics 2008-07-07 Robert W. Spekkens

Annotating datasets is one of the main costs in nowadays supervised learning. The goal of weak supervision is to enable models to learn using only forms of labelling which are cheaper to collect, as partial labelling. This is a type of…

Machine Learning · Computer Science 2021-02-02 Vivien Cabannes , Alessandro Rudi , Francis Bach

Intercurrent events, common in clinical trials and observational studies, affect the existence or interpretation of final outcomes. Principal stratification addresses this challenge by defining local average treatment effect estimands…

Methodology · Statistics 2025-09-22 Jiaqi Tong , Brennan Kahan , Michael O. Harhay , Fan Li

Sample-average approximations (SAA) are a practical means of finding approximate solutions of stochastic programming problems involving an extremely large (or infinite) number of scenarios. SAA can also be used to find estimates of a lower…

Other Statistics · Statistics 2014-05-08 Jiajie Chen , Cong Han Lim , Peter Z. G. Qian , Jeff Linderoth , Stephen J. Wright

Weak values are quantities accessed through quantum experiments involving weak measurements and post-selection. It has been shown that 'anomalous' weak values (those lying beyond the eigenvalue range of the corresponding operator) defy…

Quantum Physics · Physics 2019-10-23 Ravi Kunjwal , Matteo Lostaglio , Matthew F. Pusey

We present a weakest-precondition-style calculus for reasoning about the expected values (pre-expectations) of \emph{mixed-sign unbounded} random variables after execution of a probabilistic program. The semantics of a while-loop is…

Logic in Computer Science · Computer Science 2017-04-19 Benjamin Lucien Kaminski , Joost-Pieter Katoen

Blind inverse problems arise in many experimental settings where both the signal of interest and the forward operator are (partially) unknown. In this context, methods developed for the non-blind case cannot be adapted in a straightforward…

Machine Learning · Computer Science 2026-04-21 Nathan Buskulic , Luca Calatroni , Lorenzo Rosasco , Silvia Villa