English
Related papers

Related papers: Robust extrapolation problem for stochastic sequen…

200 papers

We consider a non-stationary variant of a sequential stochastic optimization problem, in which the underlying cost functions may change along the horizon. We propose a measure, termed variation budget, that controls the extent of said…

Probability · Mathematics 2019-06-07 O. Besbes , Y. Gur , A. Zeevi

We consider the rate of piecewise constant approximation to a locally stationary process $X(t),t\in [0,1]$, having a variable smoothness index $\alpha(t)$. Assuming that $\alpha(\cdot)$ attains its unique minimum at zero and satisfies the…

Probability · Mathematics 2015-11-19 Enkelejd Hashorva , Mikhail Lifshits , Oleg Seleznjev

We study a problem of estimation of smooth functionals of parameter $\theta $ of Gaussian shift model $$ X=\theta +\xi,\ \theta \in E, $$ where $E$ is a separable Banach space and $X$ is an observation of unknown vector $\theta$ in Gaussian…

Statistics Theory · Mathematics 2019-11-19 Vladimir Koltchinskii , Mayya Zhilova

We propose a variational method to solve all three estimation problems for nonlinear stochastic dynamical systems: prediction, filtering, and smoothing. Our new approach is based upon a proper choice of cost function, termed the {\it…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Gregory L. Eyink

Computational multi-scale methods capitalize on a large time-scale separation to efficiently simulate slow dynamics over long time intervals. For stochastic systems, one often aims at resolving the statistics of the slowest dynamics. This…

Numerical Analysis · Mathematics 2021-05-14 Kristian Debrabant , Giovanni Samaey , Przemysław Zieliński

The stochastic solution with Gaussian stationary increments is establihsed for the symmetric space-time fractional diffusion equation when $0 < \beta < \alpha \le 2$, where $0 < \beta \le 1$ and $0 < \alpha \le 2$ are the fractional…

Statistical Mechanics · Physics 2016-03-18 Gianni Pagnini , Paolo Paradisi

In this paper, we present a unified approach to function approximation in reproducing kernel Hilbert spaces (RKHS) that establishes a previously unrecognized optimality property for several well-known function approximation techniques, such…

Statistics Theory · Mathematics 2013-01-08 Richard J. Barton

Any performance analysis based on stochastic simulation is subject to the errors inherent in misspecifying the modeling assumptions, particularly the input distributions. In situations with little support from data, we investigate the use…

Probability · Mathematics 2018-04-12 Soumyadip Ghosh , Henry Lam

Consider the problem of estimating the Shannon entropy of a distribution over $k$ elements from $n$ independent samples. We show that the minimax mean-square error is within universal multiplicative constant factors of $$\Big(\frac{k }{n…

Information Theory · Computer Science 2016-02-19 Yihong Wu , Pengkun Yang

Multi-time-scale stochastic approximation is an iterative algorithm for finding the fixed point of a set of $N$ coupled operators given their noisy samples. It has been observed that due to the coupling between the decision variables and…

Optimization and Control · Mathematics 2024-09-13 Sihan Zeng , Thinh T. Doan

We present a numerical algorithm that allows the approximation of optimal controls for stochastic reaction-diffusion equations with additive noise by first reducing the problem to controls of feedback form and then approximating the…

Optimization and Control · Mathematics 2023-09-15 Wilhelm Stannat , Alexander Vogler , Lukas Wessels

In this paper, we derive minimax rates for estimating both parametric and nonparametric components in partially linear additive models with high dimensional sparse vectors and smooth functional components. The minimax lower bound for…

Statistics Theory · Mathematics 2018-01-16 Zhuqing Yu , Michael Levine , Guang Cheng

The core of the classical block maxima method consists of fitting an extreme value distribution to a sample of maxima over blocks extracted from an underlying series. In asymptotic theory, it is usually postulated that the block maxima are…

Statistics Theory · Mathematics 2014-05-09 Axel Bücher , Johan Segers

We consider the estimation of a structural function which models a non-parametric relationship between a response and an endogenous regressor given an instrument in presence of dependence in the data generating process. Assuming an…

Statistics Theory · Mathematics 2016-04-08 Nicolas Asin , Jan Johannes

The problem of accurate nonparametric estimation of distributional functionals (integral functionals of one or more probability distributions) has received recent interest due to their wide applicability in signal processing, information…

Information Theory · Computer Science 2017-07-12 Kevin R. Moon , Kumar Sricharan , Alfred O. Hero

In this paper, we propose a novel approach to fit a functional linear regression in which both the response and the predictor are functions of a common variable such as time. We consider the case that the response and the predictor…

Methodology · Statistics 2017-11-15 Behdad Mostafaiy , MohammadReza FaridRohani , Shojaeddin Chenouri

We propose a method for learning linear models whose predictive performance is robust to causal interventions on unobserved variables, when noisy proxies of those variables are available. Our approach takes the form of a regularization term…

Machine Learning · Computer Science 2021-06-29 Michael Oberst , Nikolaj Thams , Jonas Peters , David Sontag

Statistical inference for time series such as curve estimation for time-varying models or testing for existence of change-point have garnered significant attention. However, these works are generally restricted to the assumption of…

Statistics Theory · Mathematics 2024-08-08 Soham Bonnerjee , Sayar Karmakar , Wei Biao Wu

This work studies an experimental design problem where {the values of a predictor variable, denoted by $x$}, are to be determined with the goal of estimating a function $m(x)$, which is observed with noise. A linear model is fitted to…

Statistics Theory · Mathematics 2023-05-03 David Azriel

The need to estimate a particular quantile of a distribution is an important problem which frequently arises in many computer vision and signal processing applications. For example, our work was motivated by the requirements of many…

Computer Vision and Pattern Recognition · Computer Science 2015-04-22 Ognjen Arandjelovic , Duc-Son Pham , Svetha Venkatesh