English
Related papers

Related papers: Feasibility study on the least square method for f…

200 papers

We propose a nonconvexly regularized convex model for linear regression problems under non-Gaussian noise. The cost function of the proposed model is designed with a possibly non-quadratic data fidelity term and a nonconvex regularizer via…

Optimization and Control · Mathematics 2025-09-04 Wataru Yata , Keita Kume , Isao Yamada

This paper presents and analyses a new family of linear subdivision schemes to refine noisy data given on triangular meshes. The subdivision rules consist of locally fitting and evaluating a weighted least squares approximating first-degree…

Numerical Analysis · Mathematics 2026-02-03 Costanza Conti , Sergio López-Ureña , Dionisio F. Yáñez

In a recent paper we described a novel approach to the detection and parameter estimation of a non-Gaussian stochastic background of gravitational waves. In this work we propose an improved version of the detection procedure, preserving…

General Relativity and Quantum Cosmology · Physics 2023-08-22 Matteo Ballelli , Riccardo Buscicchio , Barbara Patricelli , Anirban Ain , Giancarlo Cella

This paper considers the problem of robust adaptive efficient estimating of a periodic function in a continuous time regression model with the dependent noises given by a general square integrable semimartingale with a conditionally…

Statistics Theory · Mathematics 2019-09-24 Evgeny Pchelintsev , Serguei Pergamenshchikov

I present here a generalization of the maximum likelihood method and the $\chi^2$ method to the cases in which the data are {\it not} assumed to be Gaussian distributed. The method, based on the multivariate Edgeworth expansion, can find…

Astrophysics · Physics 2007-05-23 Luca Amendola

For many applications with multivariate data, random field models capturing departures from Gaussianity within realisations are appropriate. For this reason, we formulate a new class of multivariate non-Gaussian models based on systems of…

Methodology · Statistics 2020-01-01 David Bolin , Jonas Wallin

We develop a computational procedure to estimate the covariance hyperparameters for semiparametric Gaussian process regression models with additive noise. Namely, the presented method can be used to efficiently estimate the variance of the…

Machine Learning · Computer Science 2022-06-22 Siavash Ameli , Shawn C. Shadden

Consider a process satisfying a stochastic differential equation with unknown drift parameter, and suppose that discrete observations are given. It is known that a simple least squares estimator (LSE) can be consistent, but numerically…

Statistics Theory · Mathematics 2017-03-17 Yasutaka Shimizu

A continuous-time regression model with a jointly strictly sub-Gaussian random noise is considered in the paper. Upper exponential bounds for probabilities of large deviations of the least squares estimator for the regression parameter are…

Probability · Mathematics 2018-06-12 Alexander V. Ivanov , Igor V. Orlovskyi

This paper proposes a stochastic gradient descent method with an adaptive Gaussian noise term for the global minimization of nearly convex functions, which are nonconvex and possess multiple strict local minimizers. The noise term,…

Optimization and Control · Mathematics 2025-08-05 Chenglong Bao , Liang Chen , Weizhi Shao

Motivated by the need for efficient estimation of conditional expectations, we consider a least-squares function approximation problem with heavily polluted data. Existing methods that are effective in the small-noise regime are suboptimal…

Machine Learning · Statistics 2026-05-26 Ben Adcock , Bernhard Hientzsch , Akil Narayan , Yiming Xu

Given $n$ samples of a function $f\colon D\to\mathbb C$ in random points drawn with respect to a measure $\varrho_S$ we develop theoretical analysis of the $L_2(D, \varrho_T)$-approximation error. For a parituclar choice of $\varrho_S$…

Numerical Analysis · Mathematics 2024-08-29 Felix Bartel

The most common way of estimating the anomalous diffusion exponent from single-particle trajectories consists in a linear fitting of the dependence of the time averaged mean square displacement on the lag time at the log-log scale. However,…

Data Analysis, Statistics and Probability · Physics 2019-01-02 Yann Lanoiselée , Denis S. Grebenkov , Grzegorz Sikora , Aleksandra Grzesiek , Agnieszka Wyłomańska

We describe stochastic Newton and stochastic quasi-Newton approaches to efficiently solve large linear least-squares problems where the very large data sets present a significant computational burden (e.g., the size may exceed computer…

Numerical Analysis · Mathematics 2017-02-27 Julianne Chung , Matthias Chung , J. Tanner Slagel , Luis Tenorio

This paper first establishes a fundamental mean-square convergence theorem for general one-step numerical approximations of L\'{e}vy noise driven stochastic differential equations with non-globally Lipschitz coefficients. Then two novel…

Numerical Analysis · Mathematics 2019-07-24 Ziheng Chen , Siqing Gan , Xiaojie Wang

In this paper, we consider possibly misspecified stochastic differential equation models driven by L\'{e}vy processes. Regardless of whether the driving noise is Gaussian or not, Gaussian quasi-likelihood estimator can estimate unknown…

Statistics Theory · Mathematics 2021-10-11 Yuma Uehara

Previously, we derived exact relationships between the properties of a linear time-invariant control system and properties of an anomaly detector that quantified the impact an attacker can have on the system if that attacker aims to remain…

Systems and Control · Electrical Eng. & Systems 2019-09-05 Navid Hashemi , Justin Ruths

The method of quasi-optimal weights provides a comprehensive, asymptotically optimal, transparent and flexible alternative to the least squares method. The optimality holds for a general non-linear, non-gaussian case.

Data Analysis, Statistics and Probability · Physics 2009-12-16 Fyodor V. Tkachov

Wavelet shrinkage estimators are widely applied in several fields of science for denoising data in wavelet domain by reducing the magnitudes of empirical coefficients. In nonparametric regression problem, most of the shrinkage rules are…

Methodology · Statistics 2021-09-14 Alex Rodrigo dos Santos Sousa , Nancy Lopes Garcia

We consider the problem of fitting a relationship (e.g. a potential scientific law) to data involving multiple variables. Ordinary (least squares) regression is not suitable for this because the estimated relationship will differ according…

Methodology · Statistics 2024-09-05 Chris Tofallis