English
Related papers

Related papers: Asymptotic Theory for Regularized System Identific…

200 papers

Although approximate Bayesian computation (ABC) has become a popular technique for performing parameter estimation when the likelihood functions are analytically intractable there has not as yet been a complete investigation of the…

Statistics Theory · Mathematics 2011-05-19 Thomas A. Dean , Sumeetpal S. Singh

We consider the asymptotic properties of Approximate Bayesian Computation (ABC) for the realistic case of summary statistics with heterogeneous rates of convergence. We allow some statistics to converge faster than the ABC tolerance, other…

Computation · Statistics 2023-11-17 Caroline Lawless , Christian P. Robert , Judith Rousseau , Robin J. Ryder

High-dimensional limit theorems have been shown useful to derive tuning rules for finding the optimal scaling in random-walk Metropolis algorithms. The assumptions under which weak convergence results are proved are however restrictive: the…

Methodology · Statistics 2022-02-16 Sebastian M Schmon , Philippe Gagnon

We investigate the nonparametric, composite hypothesis testing problem for arbitrary unknown distributions in the asymptotic regime where both the sample size and the number of hypotheses grow exponentially large. Such asymptotic analysis…

Information Theory · Computer Science 2019-01-30 Qunwei Li , Tiexing Wang , Donald J. Bucci , Yingbin Liang , Biao Chen , Pramod K. Varshney

In this work, we present a new class of models, called uncertain-input models, that allows us to treat system-identification problems in which a linear system is subject to a partially unknown input signal. To encode prior information about…

Systems and Control · Computer Science 2017-09-12 Riccardo Sven Risuleo , Giulio Bottegal , Håkan Hjalmarsson

In this paper, we develop an asymptotic expansion-regularization (AER) method for inverse source problems in two-dimensional nonlinear and nonstationary singularly perturbed partial differential equations (PDEs). The key idea of this…

Numerical Analysis · Mathematics 2022-10-14 Dmitrii Chaikovskii , Aleksei Liubavin , Ye Zhang

In this paper we revisit random linear under-determined systems with sparse solutions. We consider $\ell_1$ optimization heuristic known to work very well when used to solve these systems. A collection of fundamental results that relate to…

Optimization and Control · Mathematics 2016-12-20 Mihailo Stojnic

This paper is concerned with asymptotic theory for penalized spline estimator in bivariate additive model. The focus of this paper is put upon the penalized spline estimator obtained by the backfitting algorithm. The convergence of the…

Statistics Theory · Mathematics 2011-04-28 T. Yoshida , K. Naito

A distributed average consensus algorithm in which every sensor transmits with bounded peak power is proposed. In the presence of communication noise, it is shown that the nodes reach consensus asymptotically to a finite random variable…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-15 Sivaraman Dasarathan , Cihan Tepedelenlioglu , Mahesh Banavar , Andreas Spanias

The major problem in information theoretic analysis of neural responses and other biological data is the reliable estimation of entropy--like quantities from small samples. We apply a recently introduced Bayesian entropy estimator to…

Data Analysis, Statistics and Probability · Physics 2009-09-29 Ilya Nemenman , William Bialek , Rob de Ruyter van Steveninck

We provide another look at the statistical calibration problem in computer models. This viewpoint is inspired by two overarching practical considerations of computer models: (i) many computer models are inadequate for perfectly modeling…

Methodology · Statistics 2018-09-26 Xiaowu Dai , Peter Chien

Recently, the stochastic asymptotical regularization (SAR) has been developed in (\emph{Inverse Problems}, 39: 015007, 2023) for the uncertainty quantification of the stable approximate solution of linear ill-posed inverse problems. In this…

Numerical Analysis · Mathematics 2024-08-27 Haie Long , Ye Zhang

We propose an iterative estimating equations procedure for analysis of longitudinal data. We show that, under very mild conditions, the probability that the procedure converges at an exponential rate tends to one as the sample size…

Statistics Theory · Mathematics 2007-12-18 Jiming Jiang , Yihui Luan , You-Gan Wang

One of the primary challenges of system identification is determining how much data is necessary to adequately fit a model. Non-asymptotic characterizations of the performance of system identification methods provide this knowledge. Such…

Systems and Control · Electrical Eng. & Systems 2019-09-06 Bruce Lee , Andrew Lamperski

In the present paper, we derive lower bounds for the risk of the nonparametric empirical Bayes estimators. In order to attain the optimal convergence rate, we propose generalization of the linear empirical Bayes estimation method which…

Statistics Theory · Mathematics 2013-06-12 Rida Benhaddou , Marianna Pensky

This work is concerned with the estimation of multidimensional regression and the asymptotic behaviour of the test involved in selecting models. The main problem with such models is that we need to know the covariance matrix of the noise to…

Statistics Theory · Mathematics 2008-02-20 Joseph Rynkiewicz

Neural networks are one of the most popularly used methods in machine learning and artificial intelligence nowadays. Due to the universal approximation theorem (Hornik et al. (1989)), a neural network with one hidden layer can approximate…

Statistics Theory · Mathematics 2019-09-18 Xiaoxi Shen , Chang Jiang , Lyudmila Sakhanenko , Qing Lu

In a smooth semi-parametric model, the marginal posterior distribution for a finite dimensional parameter of interest is expected to be asymptotically equivalent to the sampling distribution of any efficient point-estimator. The assertion…

Statistics Theory · Mathematics 2018-03-26 Minwoo Chae , Yongdai Kim , Bas Kleijn

The vast majority of the literature on learning dynamical systems or stochastic processes from time series has focused on stable or ergodic systems, for both Bayesian and frequentist inference procedures. However, most real-world systems…

Machine Learning · Statistics 2025-07-02 Zachary P Adams , Sayan Mukherjee

When a mathematical or computational model is used to analyse some system, it is usual that some parameters resp.\ functions or fields in the model are not known, and hence uncertain. These parametric quantities are then identified by…

Probability · Mathematics 2016-07-01 Hermann G. Matthies , Elmar Zander , Bojana Rosic , Alexander Litvinenko