English
Related papers

Related papers: Least square fitting with one parameter less

200 papers

To optimize a neural network one often thinks of optimizing its parameters, but it is ultimately a matter of optimizing the function that maps inputs to outputs. Since a change in the parameters might serve as a poor proxy for the change in…

Neural and Evolutionary Computing · Computer Science 2019-06-28 Ari S. Benjamin , David Rolnick , Konrad Kording

In this paper, we propose and analyze the least squares finite element methods for the linear elasticity interface problem in the stress-displacement system on unfitted meshes. We consider the cases that the interface is $C^2$ or polygonal,…

Numerical Analysis · Mathematics 2023-06-16 Fanyi Yang

Matrix factorization is a popular approach to solving matrix estimation problems based on partial observations. Existing matrix factorization is based on least squares and aims to yield a low-rank matrix to interpret the conditional sample…

Machine Learning · Statistics 2017-03-06 Rui Zhu , Di Niu , Linglong Kong , Zongpeng Li

Functional partial least squares (FPLS) is commonly used for fitting scalar-on-function regression models. For the sake of accuracy, FPLS demands that each realization of the functional predictor is recorded as densely as possible over the…

Methodology · Statistics 2020-07-14 Zhiyang Zhou , Richard A. Lockhart

Squared tensor networks (TNs) and their extension as computational graphs--squared circuits--have been used as expressive distribution estimators, yet supporting closed-form marginalization. However, the squaring operation introduces…

Machine Learning · Computer Science 2026-05-27 Lorenzo Loconte , Adrián Javaloy , Antonio Vergari

For an initially well designed but imperfect quantum information system, the process matrix is almost sparse in an appropriate basis. Existing theory and associated computational methods (L1-norm minimization) for reconstructing sparse…

Quantum Physics · Physics 2009-03-06 Robert L. Kosut

Modelling, parameter identification, and simulation play an important role in systems biology. Usually, the goal is to determine parameter values that minimise the difference between experimental measurement values and model predictions in…

Mathematical Software · Computer Science 2013-04-10 Thomas Dierkes , Susanna Röblitz , Moritz Wade , Peter Deuflhard

Through a simple procedure based on the Lu-Chipman decomposition [S-Y. Lu and R. C. Chipman, J. Opt. Soc. Am A 13, 1106 (1996)] any depolarizing Mueller matrix can be transformed into a reduced form which accumulates the depolarization and…

Optics · Physics 2016-03-15 Jose J. Gil , Ignacio San Jose

The least squares method provides the best-fit curve by minimizing the total squares error. In this work, we provide the modified least squares method based on the fractional orthogonal polynomials that belong to the space $M_{n}^{\lambda}…

Numerical Analysis · Mathematics 2024-05-02 Abhishek Kumar Singh , Mani Mehra , Anatoly A. Alikhanov

We provide a simple proof of the radial symmetry of any nonnegative minimizer for a general class of quasi-linear minimization problems

Functional Analysis · Mathematics 2010-04-21 H. Hjaiej , M. Squassina

In this paper, we derive minimax rates for estimating both parametric and nonparametric components in partially linear additive models with high dimensional sparse vectors and smooth functional components. The minimax lower bound for…

Statistics Theory · Mathematics 2018-01-16 Zhuqing Yu , Michael Levine , Guang Cheng

We describe a new scheme for optimizing many-electron trial wave functions by minimizing the unreweighted variance of the energy using stochastic integration and correlated-sampling techniques. The scheme is restricted to parameters that…

Computational Physics · Physics 2010-02-11 N. D. Drummond , R. J. Needs

We consider a polynomial reconstruction of smooth functions from their noisy values at discrete nodes on the unit sphere by a variant of the regularized least-squares method of An et al., SIAM J. Numer. Anal. 50 (2012), 1513--1534. As nodes…

Numerical Analysis · Mathematics 2015-01-12 Sergei. V. Pereverzyev , Ian. H. Sloan , Pavlo Tkachenko

A Bayesian approach termed BAyesian Least Squares Optimization with Nonnegative L1-norm constraint (BALSON) is proposed. The error distribution of data fitting is described by Gaussian likelihood. The parameter distribution is assumed to be…

Machine Learning · Computer Science 2018-07-10 Jiyang Xie , Zhanyu Ma , Guoqiang Zhang , Jing-Hao Xue , Jen-Tzung Chien , Zhiqing Lin , Jun Guo

Least-squares fits are an important tool in many data analysis applications. In this paper, we review theoretical results, which are relevant for their application to data from counting experiments. Using a simple example, we illustrate the…

Data Analysis, Statistics and Probability · Physics 2019-06-07 Hans Dembinski , Michael Schmelling , Roland Waldi

Squared tensor networks (TNs) and their generalization as parameterized computational graphs -- squared circuits -- have been recently used as expressive distribution estimators in high dimensions. However, the squaring operation introduces…

Machine Learning · Computer Science 2025-01-22 Lorenzo Loconte , Antonio Vergari

Controlling the parameters' norm often yields good generalisation when training neural networks. Beyond simple intuitions, the relation between regularising parameters' norm and obtained estimators remains theoretically misunderstood. For…

Machine Learning · Statistics 2025-04-09 Etienne Boursier , Nicolas Flammarion

It is widely believed that a neural network can fit a training set containing at least as many samples as it has parameters, underpinning notions of overparameterized and underparameterized models. In practice, however, we only find…

Machine Learning · Computer Science 2024-06-18 Ravid Shwartz-Ziv , Micah Goldblum , Arpit Bansal , C. Bayan Bruss , Yann LeCun , Andrew Gordon Wilson

In most (weakly interacting) extensions of the Standard Model the relation mapping the parameter values onto experimentally measurable quantities can be computed (with some uncertainties), but the inverse relation is usually not known. In…

High Energy Physics - Phenomenology · Physics 2013-10-30 Nicki Bornhauser , Manuel Drees

In this paper, new methods for smoothing gamma-ray spectra measured by NaI detector are derived. Least squares fitting method with B-spline basis functions is used to reduce the influence of statistical fluctuations. The derived procedures…

Spectral Theory · Mathematics 2008-08-12 M. H. Zhu , L. G. Liu , Z. You , A. A. Xu