English
Related papers

Related papers: Robustness to unknown error in sparse regularizati…

200 papers

Several key questions remain unanswered regarding overparameterized learning models. It is unclear how (stochastic) gradient descent finds solutions that generalize well, and in particular the role of small random initializations. Matrix…

Machine Learning · Computer Science 2025-08-25 Johan S. Wind

This paper describes performance bounds for compressed sensing in the presence of Poisson noise when the underlying signal, a vector of Poisson intensities, is sparse or compressible (admits a sparse approximation). The signal-independent…

Information Theory · Computer Science 2009-04-30 Rebecca M. Willett , Maxim Raginsky

We provide a general framework for studying recurrent neural networks (RNNs) trained by injecting noise into hidden states. Specifically, we consider RNNs that can be viewed as discretizations of stochastic differential equations driven by…

Machine Learning · Statistics 2021-12-02 Soon Hoe Lim , N. Benjamin Erichson , Liam Hodgkinson , Michael W. Mahoney

Errors occurring on noisy hardware pose a key challenge to reliable quantum computing. Existing techniques such as error correction, mitigation, or suppression typically separate the error handling from the algorithm analysis and design. In…

Quantum Physics · Physics 2026-01-21 Julian Berberich , Tobias Fellner , Robert L. Kosut , Christian Holm

In this paper, we consider a stabilization problem of an uncertain system in a networked control setting. Due to the network, the measurements are quantized to finite-bit signals and may be randomly lost in the communication. We study…

Systems and Control · Computer Science 2017-03-07 Kunihisa Okano , Hideaki Ishii

The generalisation and robustness properties of policies learnt through Maximum-Entropy Reinforcement Learning are investigated on chaotic dynamical systems with Gaussian noise on the observable. First, the robustness under noise…

Machine Learning · Computer Science 2026-02-25 Rémy Hosseinkhan-Boucher , Onofrio Semeraro , Lionel Mathelin

We consider the problem of robust compressed sensing whose objective is to recover a high-dimensional sparse signal from compressed measurements corrupted by outliers. A new sparse Bayesian learning method is developed for robust compressed…

Machine Learning · Statistics 2016-10-24 Qian Wan , Huiping Duan , Jun Fang , Hongbin Li

Quantization has emerged as an essential technique for deploying deep neural networks (DNNs) on devices with limited resources. However, quantized models exhibit vulnerabilities when exposed to various noises in real-world applications.…

Machine Learning · Computer Science 2023-04-11 Yisong Xiao , Tianyuan Zhang , Shunchang Liu , Haotong Qin

Applications of compressed sensing motivate the possibility of using different operators to encode and decode a signal of interest. Since it is clear that the operators cannot be too different, we can view the discrepancy between the two…

Numerical Analysis · Mathematics 2010-04-02 Matthew A. Herman , Deanna Needell

We are motivated by problems that arise in a number of applications such as Online Marketing and explosives detection, where the observations are usually modeled using Poisson statistics. We model each observation as a Poisson random…

Statistics Theory · Mathematics 2016-11-17 D. Motamedvaziri , M. H. Rohban , V. Saligrama

We present a robust generalization of the synthetic control method for comparative case studies. Like the classical method, we present an algorithm to estimate the unobservable counterfactual of a treatment unit. A distinguishing feature of…

Econometrics · Economics 2017-11-21 Muhammad Jehangir Amjad , Devavrat Shah , Dennis Shen

We study the information-theoretic limits of exactly recovering the support of a sparse signal using noisy projections defined by various classes of measurement matrices. Our analysis is high-dimensional in nature, in which the number of…

Statistics Theory · Mathematics 2008-06-04 Wei Wang , Martin J. Wainwright , Kannan Ramchandran

This paper considers the problem of robust stability for a class of uncertain nonlinear quantum systems subject to unknown perturbations in the system Hamiltonian. The case of a nominal linear quantum system is considered with non-quadratic…

Quantum Physics · Physics 2013-03-26 Ian R. Petersen

In the problem of learning mixtures of linear regressions, the goal is to learn a collection of signal vectors from a sequence of (possibly noisy) linear measurements, where each measurement is evaluated on an unknown signal drawn uniformly…

Machine Learning · Computer Science 2019-11-01 Akshay Krishnamurthy , Arya Mazumdar , Andrew McGregor , Soumyabrata Pal

Generalization is one of the fundamental issues in machine learning. However, traditional techniques like uniform convergence may be unable to explain generalization under overparameterization. As alternative approaches, techniques based on…

Machine Learning · Computer Science 2022-03-22 Jiaye Teng , Jianhao Ma , Yang Yuan

Model compression techniques allow to significantly reduce the computational cost associated with data processing by deep neural networks with only a minor decrease in average accuracy. Simultaneously, reducing the model size may have a…

Machine Learning · Computer Science 2021-09-28 Sebastian Cygert , Andrzej Czyżewski

A recent technique of randomized smoothing has shown that the worst-case (adversarial) $\ell_2$-robustness can be transformed into the average-case Gaussian-robustness by "smoothing" a classifier, i.e., by considering the averaged…

Machine Learning · Computer Science 2021-01-11 Jongheon Jeong , Jinwoo Shin

Sparse linear regression methods such as Lasso require a tuning parameter that depends on the noise variance, which is typically unknown and difficult to estimate in practice. In the presence of heavy-tailed noise or adversarial outliers,…

Statistics Theory · Mathematics 2025-06-17 Takeyuki Sasai , Hironori Fujisawa

Robust signal detection in colored noise with unknown covariance is essential in radar, cognitive radio, integrated sensing and communication (ISAC), and quantum sensing applications. This paper develops a unified analytical framework for…

Signal Processing · Electrical Eng. & Systems 2026-05-20 Tharindu Udupitiya , Saman Atapattu , Prathapasinghe Dharmawansa , Chintha Tellambura , Merouane Debbah

We consider the reconstruction problem in compressed sensing in which the observations are recorded in a finite number of bits. They may thus contain quantization errors (from being rounded to the nearest representable value) and saturation…

Machine Learning · Statistics 2013-10-11 Ji Liu , Stephen J. Wright
‹ Prev 1 4 5 6 7 8 10 Next ›