English
Related papers

Related papers: Asymptotic Theory for Regularized Estimation in Fu…

200 papers

AutoRegressive Conditional Heteroscedasticity (ARCH) models are standard for modeling time series exhibiting volatility, with a rich literature in univariate and multivariate settings. In recent years, these models have been extended to…

Methodology · Statistics 2026-03-19 Alexander Aue , Sebastian Kühnert , Gregory Rice , Jeremy VanderDoes

Conditional stability estimates allow us to characterize the degree of ill-posedness of many inverse problems, but without further assumptions they are not sufficient for the stable solution in the presence of data perturbations. We here…

Numerical Analysis · Mathematics 2018-10-17 Herbert Egger , Bernd Hofmann

In recent years, functional linear models have attracted growing attention in statistics and machine learning, with the aim of recovering the slope function or its functional predictor. This paper considers online regularized learning…

Machine Learning · Statistics 2022-11-28 Yuan Mao , Zheng-Chu Guo

The local regularity of functional time series is studied under $L^p-m-$appro\-ximability assumptions. The sample paths are observed with error at possibly random design points. Non-asymptotic concentration bounds of the regularity…

Statistics Theory · Mathematics 2024-03-21 Hassan Maissoro , Valentin Patilea , Myriam Vimond

This paper develops a unified finite-time theory for the ordinary least squares estimation of possibly unstable and even slightly explosive vector autoregressive models under linear restrictions, with the applicable region $\rho(A)\leq…

Statistics Theory · Mathematics 2020-05-19 Yao Zheng , Guang Cheng

In this work, we consider the linear inverse problem $y=Ax+\epsilon$, where $A\colon X\to Y$ is a known linear operator between the separable Hilbert spaces $X$ and $Y$, $x$ is a random variable in $X$ and $\epsilon$ is a zero-mean random…

Machine Learning · Statistics 2021-11-23 Giovanni S. Alberti , Ernesto De Vito , Matti Lassas , Luca Ratti , Matteo Santacesaria

Autoregressive (AR) models for image generation typically adopt a two-stage paradigm of vector quantization and raster-scan ``next-token prediction", inspired by its great success in language modeling. However, due to the huge modality gap,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Hu Yu , Hao Luo , Hangjie Yuan , Yu Rong , Jie Huang , Feng Zhao

Tikhonov regularization with square-norm penalty for linear forward operators has been studied extensively in the literature. However, the results on convergence theory are based on technical proofs and difficult to interpret. It is also…

Numerical Analysis · Mathematics 2021-07-07 Daniel Gerth

Random variables in metric spaces indexed by time and observed at equally spaced time points are receiving increased attention due to their broad applicability. The absence of inherent structure in metric spaces has resulted in a literature…

Methodology · Statistics 2024-09-24 Matthieu Bulté , Helle Sørensen

In a real Hilbert space setting, we investigate the asymptotic behavior of the solutions of the classical Arrow-Hurwicz differential system combined with Tikhonov regularizing terms. Under some newly proposed conditions on the Tikhonov…

Optimization and Control · Mathematics 2025-09-03 Fouad Battahi , Zaki Chbani , Simon K. Niederländer , Hassan Riahi

High-frequency financial data can be collected as a sequence of curves over time; for example, as intra-day price, currently one of the topics of greatest interest in finance. The Functional Data Analysis framework provides a suitable tool…

Conditional stability estimates require additional regularization for obtaining stable approximate solutions if the validity area of such estimates is not completely known. In this context, we consider ill-posed nonlinear inverse problems…

Numerical Analysis · Mathematics 2020-01-29 Frank Werner , Bernd Hofmann

We study in this paper a smoothness regularization method for functional linear regression and provide a unified treatment for both the prediction and estimation problems. By developing a tool on simultaneous diagonalization of two positive…

Statistics Theory · Mathematics 2012-11-13 Ming Yuan , T. Tony Cai

Statistical analysis of high-dimensional functional times series arises in various applications. Under this scenario, in addition to the intrinsic infinite-dimensionality of functional data, the number of functional variables can grow with…

Statistics Theory · Mathematics 2022-01-14 Qin Fang , Shaojun Guo , Xinghao Qiao

In Optimal Recovery, the task of learning a function from observational data is tackled deterministically by adopting a worst-case perspective tied to an explicit model assumption made on the functions to be learned. Working in the…

Optimization and Control · Mathematics 2021-11-05 Simon Foucart , Chunyang Liao

Regularized kernel methods such as support vector machines (SVM) and support vector regression (SVR) constitute a broad and flexible class of methods which are theoretically well investigated and commonly used in nonparametric…

Methodology · Statistics 2013-05-07 Robert Hable

Identifying an appropriate covariance function is one of the primary interests in spatial and spatio-temporal statistics because it allows researchers to analyze the dependence structure of the random process. For this purpose, spatial…

Methodology · Statistics 2025-02-04 Jongwook Kim , Chunfeng Huang , Nicholas Bussberg

This paper develops the asymptotic theory for parametric and nonparametric regression models when the errors have a fractional local to unity root (FLUR) model structure. FLUR models are stationary time series with semi-long range…

Statistics Theory · Mathematics 2020-02-25 Farzad Sabzikar , Kris De Brabanter

As a special infinite-order vector autoregressive (VAR) model, the vector autoregressive moving average (VARMA) model can capture much richer temporal patterns than the widely used finite-order VAR model. However, its practicality has long…

Methodology · Statistics 2024-02-27 Yao Zheng

For estimating the unknown parameters in an unstable autoregressive AR(p), the paper proposes sequential least squares estimates with a special stopping time defined by the trace of the observed Fisher information matrix. The limiting…

Statistics Theory · Mathematics 2008-10-07 Leonid Galtchouk , Victor Konev