English
Related papers

Related papers: Forward-backward kernel-based state and parameter …

200 papers

We propose a pointwise inference algorithm for high-dimensional linear models with time-varying coefficients. The method is based on a novel combination of the nonparametric kernel smoothing technique and a Lasso bias-corrected ridge…

Methodology · Statistics 2017-03-17 Xiaohui Chen , Yifeng He

We constuct a sequential adaptive procedure for estimating the autoregressive function at a given point in nonparametric autoregression models with Gaussian noise. We make use of the sequential kernel estimators. The optimal adaptive…

Statistics Theory · Mathematics 2010-11-12 Ouerdia Arkoun

This study is concerned with the problem of partial state estimation for linear time-invariant (LTI) distributed state-space systems. A necessary and sufficient condition is established in terms of a simple rank criterion involving the…

Optimization and Control · Mathematics 2026-04-02 Juhi Jaiswal , Thomas Berger , Nutan Kumar Tomar

We develop a non-parametric, data-driven, tractable approach for solving multistage stochastic optimization problems in which decisions do not affect the uncertainty. The proposed framework represents the decision variables as elements of a…

Optimization and Control · Mathematics 2023-03-14 Dimitris Bertsimas , Kimberly Villalobos Carballo

Many scientific problems involve data exhibiting both temporal and cross-sectional dependencies. While linear dependencies have been extensively studied, the theoretical analysis of regression estimators under nonlinear dependencies remains…

Statistics Theory · Mathematics 2025-02-27 Marie-Christine Düker , Adam Waterbury

This paper proposes a novel kernel-based optimization scheme to handle tasks in the analysis, e.g., signal spectral estimation and single-channel source separation of 1D non-stationary oscillatory data. The key insight of our optimization…

Machine Learning · Statistics 2022-12-12 Jieren Xu , Yitong Li , Haizhao Yang , David Dunson , Ingrid Daubechies

We introduce a fast algorithm for Gaussian process regression in low dimensions, applicable to a widely-used family of non-stationary kernels. The non-stationarity of these kernels is induced by arbitrary spatially-varying vertical and…

Numerical Analysis · Mathematics 2025-03-28 P. Michael Kielstra , Michael Lindsey

We propose a novel iterative algorithm for estimating a deterministic but unknown parameter vector in the presence of model uncertainties. This iterative algorithm is based on a system model where an overall noise term describes both, the…

Statistics Theory · Mathematics 2017-11-27 Oliver Lang , Michael Lunglmayr , Mario Huemer

A low-dimensional dynamical system is observed in an experiment as a high-dimensional signal; for example, a video of a chaotic pendulums system. Assuming that we know the dynamical model up to some unknown parameters, can we estimate the…

Machine Learning · Statistics 2021-11-24 Ofir Lindenbaum , Amir Sagiv , Gal Mishne , Ronen Talmon

In this paper, a quantum algorithm based on gaussian process regression model is proposed. The proposed quantum algorithm consists of three sub-algorithms. One is the first quantum subalgorithm to efficiently generate mean predictor. The…

Quantum Physics · Physics 2022-07-20 Menghan Chen , Gongde Guo , Song Lin , Jing Li

The parameter fit from a model grid is limited by our capability to reduce the number of models, taking into account the number of parameters and the non linear variation of the models with the parameters. The Local MultiLinear Regression…

Astrophysics · Physics 2009-11-13 A. Bijaoui , A. Recio-Blanco , P. de Laverny

Recovering the digital input of a time-discrete linear system from its (noisy) output is a significant challenge in the fields of data transmission, deconvolution, channel equalization, and inverse modeling. A variety of algorithms have…

Optimization and Control · Mathematics 2020-12-03 Sophie M. Fosson

Sinusoidal parameter estimation is a computationally-intensive task, which can pose problems for real-time implementations. In this paper, we propose a low-complexity iterative method for estimating sinusoidal parameters that is based on…

In Bayesian inverse problems, it is common to consider several hyperparameters that define the prior and the noise model that must be estimated from the data. In particular, we are interested in linear inverse problems with additive…

Numerical Analysis · Mathematics 2024-12-05 Julianne Chung , Scot M. Miller , Malena Sabate Landman , Arvind K. Saibaba

This paper describes how to specify probability models for data analysis via a backward induction procedure. The new approach yields coherent, prior-free uncertainty assessment. After presenting some intuition-building examples, the new…

Methodology · Statistics 2015-02-24 P. Richard Hahn

Gaussian processes regression models are an appealing machine learning method as they learn expressive non-linear models from exemplar data with minimal parameter tuning and estimate both the mean and covariance of unseen points. However,…

Machine Learning · Computer Science 2020-08-25 Vladimir Joukov , Dana Kulić

In system identification, estimating parameters of a model using limited observations results in poor identifiability. To cope with this issue, we propose a new method to simultaneously select and estimate sensitive parameters as key model…

Complex-valued signals are used in the modeling of many systems in engineering and science, hence being of fundamental interest. Often, random complex-valued signals are considered to be proper. A proper complex random variable or process…

Machine Learning · Computer Science 2015-02-19 Rafael Boloix-Tortosa , F. Javier Payán-Somet , Eva Arias-de-Reyna , Juan José Murillo-Fuentes

A l1-norm penalized orthogonal forward regression (l1-POFR) algorithm is proposed based on the concept of leaveone- out mean square error (LOOMSE). Firstly, a new l1-norm penalized cost function is defined in the constructed orthogonal…

Machine Learning · Computer Science 2015-09-07 Xia Hong , Sheng Chen , Yi Guo , Junbin Gao

We derive finite time error bounds for estimating general linear time-invariant (LTI) systems from a single observed trajectory using the method of least squares. We provide the first analysis of the general case when eigenvalues of the LTI…

Systems and Control · Computer Science 2019-02-14 Tuhin Sarkar , Alexander Rakhlin