English
Related papers

Related papers: Large-Scale Shrinkage Estimation under Markovian D…

200 papers

A class of random graph models is considered, combining features of exponential-family models and latent structure models, with the goal of retaining the strengths of both of them while reducing the weaknesses of each of them. An open…

Computation · Statistics 2020-07-21 Sergii Babkin , Jonathan Stewart , Xiaochen Long , Michael Schweinberger

This paper formed part of a preliminary research report for a risk consultancy and academic research. Stochastic Programming models provide a powerful paradigm for decision making under uncertainty. In these models the uncertainties are…

Computational Finance · Quantitative Finance 2009-04-08 Sovan Mitra

Bayesian nonparametric regression with dependent wavelets has dual shrinkage properties: there is shrinkage through a dependent prior put on functional differences, and shrinkage through the setting of most of the wavelet coefficients to…

Methodology · Statistics 2012-03-22 James Berger , William H. Jefferys , Peter Müller

This paper addresses distributed parameter estimation in randomized one-hidden-layer neural networks. A group of agents sequentially receive measurements of an unknown parameter that is only partially observable to them. In this paper, we…

Systems and Control · Electrical Eng. & Systems 2020-03-23 Yinsong Wang , Shahin Shahrampour

We consider Markov models of stochastic processes where the next-step conditional distribution is defined by a kernel density estimator (KDE), similar to Markov forecast densities and certain time-series bootstrap schemes. The KDE Markov…

Machine Learning · Computer Science 2018-07-31 Gustav Eje Henter , Arne Leijon , W. Bastiaan Kleijn

We consider a class of stochastic programming problems where the implicitly decision-dependent random variable follows a nonparametric regression model with heteroscedastic error. The Clarke subdifferential and surrogate functions are not…

Optimization and Control · Mathematics 2025-05-13 Boyang Shen , Junyi Liu

Asymptotic properties of Markov Processes, such as steady state probabilities or hazard rate for absorbing states can be efficiently calculated by means of linear algebra even for large-scale problems. This paper discusses the methods for…

Performance · Computer Science 2017-05-17 Vitali Volovoi

Motivated by techniques developed in recent progress on lower bounds for sublinear time algorithms (Behnezhad, Roghani and Rubinstein, STOC 2023, FOCS 2023, and STOC 2024) we introduce and study a new class of randomized algorithmic…

Data Structures and Algorithms · Computer Science 2026-03-19 Amir Azarmehr , Soheil Behnezhad , Alma Ghafari , Madhu Sudan

In this paper we consider the parameter estimation problem associated to partially-observed time changed SDEs, with observations that are given at discrete times. In particular we consider both likelihood and Bayesian estimation. We develop…

Numerical Analysis · Mathematics 2026-05-12 Ke Zhao , Ajay Jasra

Heteroskedastic errors can lead to inaccurate statistical conclusions if they are not properly handled. We introduce a test for heteroskedasticity for the nonparametric regression model with multiple covariates. It is based on a suitable…

Methodology · Statistics 2018-02-21 Justin Chown , Ursula U. Müller

This paper presents two schemes to jointly estimate parameters and states of discrete-time nonlinear systems in the presence of bounded disturbances and noise and where the parameters belong to a known compact set. The schemes are based on…

Optimization and Control · Mathematics 2022-03-23 T. J. Meijer , V. S. Dolk , M. S. Chong , R. Postoyan , B. de Jager , D. Nešić , W. P. M. H. Heemels

We present a new method for inferring hidden Markov models from noisy time sequences without the necessity of assuming a model architecture, thus allowing for the detection of degenerate states. This is based on the statistical prediction…

Quantitative Methods · Quantitative Biology 2012-01-24 David Kelly , Mark Dillingham , Andrew Hudson , Karoline Wiesner

Data-driven modeling of non-Markovian dynamics is a recent topic of research with applications in many fields such as climate research, molecular dynamics, biophysics, or wind power modeling. In the frequently used standard Langevin…

Data Analysis, Statistics and Probability · Physics 2022-07-22 Clemens Willers , Oliver Kamps

This paper presents new theory and methodology for the Bayesian estimation of overfitted hidden Markov models, with finite state space. The goal is then to achieve posterior emptying of extra states. A prior configuration is constructed…

Methodology · Statistics 2016-02-09 Zoé van Havre , Judith Rousseau , Nicole White , Kerrie Mengersen

Hidden variables are ubiquitous in practical data analysis, and therefore modeling marginal densities and doing inference with the resulting models is an important problem in statistics, machine learning, and causal inference. Recently, a…

Machine Learning · Computer Science 2013-09-27 Ilya Shpitser , Robin J. Evans , Thomas S. Richardson , James M. Robins

Likelihood-free inference methods based on neural conditional density estimation were shown to drastically reduce the simulation burden in comparison to classical methods such as ABC. When applied in the context of any latent variable…

Machine Learning · Statistics 2024-05-06 Sanmitra Ghosh , Paul J. Birrell , Daniela De Angelis

Power systems that need to integrate renewables at a large scale must account for the high levels of uncertainty introduced by these power sources. This can be accomplished with a system of many distributed grid-level storage devices.…

Optimization and Control · Mathematics 2020-02-04 Joseph L. Durante , Juliana Nascimento , Warren B. Powell

This paper considers improved forecasting in possibly nonlinear dynamic settings, with high-dimension predictors ("big data" environments). To overcome the curse of dimensionality and manage data and model complexity, we examine shrinkage…

Econometrics · Economics 2019-04-26 Ali Habibnia , Esfandiar Maasoumi

We investigate the parameter recovery of Markov-switching ordinary differential processes from discrete observations, where the differential equations are nonlinear additive models. This framework has been widely applied in biological…

Methodology · Statistics 2025-01-03 Katherine Tsai , Mladen Kolar , Sanmi Koyejo

A rich literature exists on constructing non-parametric estimators with optimal asymptotic properties. In addition to asymptotic guarantees, it is often of interest to design estimators with desirable finite-sample properties; such as…

Methodology · Statistics 2025-05-14 Herbert P. Susmann , Yiting Li , Mara A. McAdams-DeMarco , Wenbo Wu , Iván Díaz