English
Related papers

Related papers: The Spark Randomizer: a learned randomized framewo…

200 papers

The best subset selection (or "best subsets") estimator is a classic tool for sparse regression, and developments in mathematical optimization over the past decade have made it more computationally tractable than ever. Notwithstanding its…

Methodology · Statistics 2022-01-11 Ryan Thompson

We investigate adversarial robustness of Gaussian Process Classification (GPC) models. Given a compact subset of the input space $T\subseteq \mathbb{R}^d$ enclosing a test point $x^*$ and a GPC trained on a dataset $\mathcal{D}$, we aim to…

Machine Learning · Statistics 2020-03-12 Arno Blaas , Andrea Patane , Luca Laurenti , Luca Cardelli , Marta Kwiatkowska , Stephen Roberts

We study the problem of estimating the fixed point of a contractive operator defined on a separable Banach space. Focusing on a stochastic query model that provides noisy evaluations of the operator, we analyze a variance-reduced stochastic…

Statistics Theory · Mathematics 2022-11-30 Wenlong Mou , Koulik Khamaru , Martin J. Wainwright , Peter L. Bartlett , Michael I. Jordan

Over the past decade, the Gr\"obner basis theory and automatic solver generation have lead to a large number of solutions to geometric vision problems. In practically all cases, the derived solvers apply a fixed elimination template to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Wanting Xu , Lan Hu , Manolis C. Tsakiris , Laurent Kneip

We propose a strategy for greedy sampling in the context of non-intrusive interpolation-based surrogate modeling for frequency-domain problems. We rely on a non-intrusive and cheap error indicator to drive the adaptive selection of the…

Numerical Analysis · Mathematics 2023-12-06 Davide Pradovera

This paper discusses the problem of estimating the state of a linear time-invariant system when some of its sensors and actuators are compromised by an adversarial agent. In the model considered in this paper, the malicious agent attacks an…

Optimization and Control · Mathematics 2019-04-04 Mehrdad Showkatbakhsh , Yasser Shoukry , Suhas Diggavi , Paulo Tabuada

Spectral approximation and variational inducing learning for the Gaussian process are two popular methods to reduce computational complexity. However, in previous research, those methods always tend to adopt the orthonormal basis functions,…

Machine Learning · Statistics 2021-07-15 Wenqi Fang , Guanlin Wu , Jingjing Li , Zheng Wang , Jiang Cao , Yang Ping

Many statistical estimators are defined as the fixed point of a data-dependent operator, with estimators based on minimizing a cost function being an important special case. The limiting performance of such estimators depends on the…

Machine Learning · Computer Science 2022-03-22 Nhat Ho , Koulik Khamaru , Raaz Dwivedi , Martin J. Wainwright , Michael I. Jordan , Bin Yu

A cumbersome operation in numerical analysis and linear algebra, optimization, machine learning and engineering algorithms; is inverting large full-rank matrices which appears in various processes and applications. This has both numerical…

Numerical Analysis · Mathematics 2022-06-24 Neophytos Charalambides , Mert Pilanci , Alfred O. Hero

The Wegner orbital model is a class of random operators introduced by Wegner to model the motion of a quantum particle with many internal degrees of freedom (orbitals) in a disordered medium. We consider the case when the matrix potential…

Mathematical Physics · Physics 2017-09-22 Jeffrey Schenker , Ron Peled , Mira Shamis , Sasha Sodin

With the growing interest in quantum machine learning, the perceptron -- a fundamental building block in traditional machine learning -- has emerged as a valuable model for exploring quantum advantages. Two quantum perceptron algorithms…

Quantum Physics · Physics 2025-03-24 Xiaoyu Sun , Mathieu Roget , Giuseppe Di Molfetta , Hachem Kadri

We propose an estimator for the mean of random variables in separable real Banach spaces using the empirical characteristic function. Assuming that the covariance operator of the random variable is bounded in a precise sense, we show that…

Statistics Theory · Mathematics 2020-11-04 Sohail Bahmani

Designing sparse sampling strategies is one of the important components in having resilient estimation and control in networked systems as they make network design problems more cost-effective due to their reduced sampling requirements and…

Systems and Control · Computer Science 2019-07-22 Hossein K. Mousavi , Qiyu Sun , Nader Motee

This paper considers the problem of approximating the inverse of the wave-equation Hessian, also called normal operator, in seismology and other types of wave-based imaging. An expansion scheme for the pseudodifferential symbol of the…

Numerical Analysis · Mathematics 2015-03-17 Laurent Demanet , Pierre-David Létourneau , Nicolas Boumal , Henri Calandra , Jiawei Chiu , Stanley Snelson

Due to computational barriers, the effects of parity violation have so far been grossly neglected in gravitational model-building, leading to a serious gap in the space of prior models. We present a new algorithm for efficiently computing…

High Energy Physics - Theory · Physics 2025-06-04 Will Barker , Georgios K. Karananas , Haochen Tu

We investigate the optimal performance of dense sensor networks by studying the joint source-channel coding problem. The overall goal of the sensor network is to take measurements from an underlying random process, code and transmit those…

Information Theory · Computer Science 2007-07-13 Nan Liu , Sennur Ulukus

We introduce a general framework for analyzing learning algorithms based on the notion of self-regularization, which captures implicit complexity control without requiring explicit regularization. This is motivated by previous observations…

Machine Learning · Statistics 2026-03-19 Max Schölpple , Liu Fanghui , Ingo Steinwart

In high-dimensional statistics, variable selection recovers the latent sparse patterns from all possible covariate combinations. This paper proposes a novel optimization method to solve the exact L0-regularized regression problem, which is…

Methodology · Statistics 2022-06-02 Mingzhang Yin , Nhat Ho , Bowei Yan , Xiaoning Qian , Mingyuan Zhou

Distributed algorithms are often beset by the straggler effect, where the slowest compute nodes in the system dictate the overall running time. Coding-theoretic techniques have been recently proposed to mitigate stragglers via algorithmic…

Machine Learning · Statistics 2017-11-21 Zachary Charles , Dimitris Papailiopoulos , Jordan Ellenberg

Importance sampling is a widely used technique to estimate properties of a distribution. This paper investigates trading-off some bias for variance by adaptively winsorizing the importance sampling estimator. The novel winsorizing…

Computation · Statistics 2021-02-10 Paulo Orenstein