English
Related papers

Related papers: On the connection between least squares, regulariz…

200 papers

Partial Least Squares (PLS) is a widely used method for data integration, designed to extract latent components shared across paired high-dimensional datasets. Despite decades of practical success, a precise theoretical understanding of its…

Machine Learning · Statistics 2025-12-18 Victor Léger , Florent Chatelain

We address the problem of sparse recovery in an online setting, where random linear measurements of a sparse signal are revealed sequentially and the objective is to recover the underlying signal. We propose a reweighted least squares (RLS)…

Machine Learning · Computer Science 2017-06-30 Subhadip Mukherjee , Deepak R. , Huaijin Chen , Ashok Veeraraghavan , Chandra Sekhar Seelamantula

Predicting properties of complex, large-scale quantum systems is essential for developing quantum technologies. We present an efficient method for constructing an approximate classical description of a quantum state using very few…

Quantum Physics · Physics 2021-04-20 Hsin-Yuan Huang , Richard Kueng , John Preskill

Five simple soft sensor methodologies with two update conditions were compared on two experimentally-obtained datasets and one simulated dataset. The soft sensors investigated were moving window partial least squares regression (and a…

Machine Learning · Statistics 2019-08-13 Casey Kneale , Steven D. Brown

Classical shadow tomography has emerged as a powerful framework for predicting properties of quantum many-body systems with favorable sample complexity. Standard theoretical guarantees, however, rely on the assumption that experimental…

Quantum Physics · Physics 2026-03-06 Leonardo Zambrano

Randomized experiments are the gold standard for causal inference, and justify simple comparisons across treatment groups. Regression adjustment provides a convenient way to incorporate covariate information for additional efficiency. This…

Methodology · Statistics 2022-10-25 Anqi Zhao , Peng Ding

In quantum information theory, the accurate estimation of observables is pivotal for quantum information processing, playing a crucial role in compute and communication protocols. This work introduces a novel technique for estimating such…

Quantum Physics · Physics 2024-09-17 Andrea Caprotti , Joshua Morris , Borivoje Dakić

Bayesian $l_0$-regularized least squares is a variable selection technique for high dimensional predictors. The challenge is optimizing a non-convex objective function via search over model space consisting of all possible predictor…

Machine Learning · Statistics 2018-12-19 Nicholas G. Polson , Lei Sun

Partial least squares regression (PLSR) has been a popular technique to explore the linear relationship between two datasets. However, most of algorithm implementations of PLSR may only achieve a suboptimal solution through an optimization…

Computer Vision and Pattern Recognition · Computer Science 2016-09-22 Haoran Chen , Yanfeng Sun , Junbin Gao , Yongli Hu , Baocai Yin

We consider the problem of reconstructing rank-one matrices from random linear measurements, a task that appears in a variety of problems in signal processing, statistics, and machine learning. In this paper, we focus on the Alternating…

Machine Learning · Computer Science 2022-04-26 Kiryung Lee , Dominik Stöger

Total least squares (TLS) methods have been widely used in data fitting. Compared with the least squares method, for TLS problem we takes into account not only the observation errors, but also the errors in the measurement matrix. This is…

Numerical Analysis · Mathematics 2022-05-03 Qian Zuo , Yimin Wei , Hua Xiang

Nowadays, Non-Linear Least-Squares embodies the foundation of many Robotics and Computer Vision systems. The research community deeply investigated this topic in the last years, and this resulted in the development of several open-source…

Efficiently learning expectation values of a quantum state using classical shadow tomography has become a fundamental task in quantum information theory. In a classical shadows protocol, one measures a state in a chosen basis W after it has…

Quantum Physics · Physics 2025-06-04 Maxwell West , Antonio Anna Mele , Martin Larocca , M. Cerezo

The ability to extract general laws from a few known examples depends on the complexity of the problem and on the amount of training data. In the quantum setting, the learner's generalization performance is further challenged by the…

Quantum Physics · Physics 2024-11-12 Leonardo Banchi , Jason Pereira , Marco Zamboni

This papers presents a novel quantised transform (the Sinclair-Town or ST transform for short) that subsumes the rolls of both edge-detector, MSER style region detector and corner detector. The transform is similar to the $unsharp$…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Dr David Sinclair , Dr Christopher Town

Stochastic rounding (SR) is a probabilistic rounding mode that mitigates errors in large-scale numerical computations, especially when prone to stagnation effects. Beyond numerical analysis, SR has shown significant benefits in practical…

Numerical Analysis · Mathematics 2026-03-26 El-Mehdi El Arar , Massimiliano Fasi , Silviu-Ioan Filip , Mantas Mikaitis

We consider the problem of recursively and causally reconstructing time sequences of sparse signals (with unknown and time-varying sparsity patterns) from a limited number of noisy linear measurements. The sparsity pattern is assumed to…

Information Theory · Computer Science 2010-07-28 Namrata Vaswani

We provide practical and powerful schemes for learning many properties of an unknown n-qubit quantum state using a sparing number of copies of the state. Specifically, we present a depth-modulated randomized measurement scheme that…

Ordinary least-squares (OLS) estimators for a linear model are very sensitive to unusual values in the design space or outliers among y values. Even one single atypical value may have a large effect on the parameter estimates. This article…

Methodology · Statistics 2014-04-28 Chun Yu , Weixin Yao , Xue Bai

Classical least squares estimators are well-known to be robust with respect to moment assumptions concerning the error distribution in a wide variety of finite-dimensional statistical problems; generally only a second moment assumption is…

Statistics Theory · Mathematics 2018-05-08 Qiyang Han , Jon A. Wellner