English
Related papers

Related papers: Deterministic Finite-Memory Bias Estimation

200 papers

In this paper we consider stochastic multiarmed bandit problems. Recently a policy, DMED, is proposed and proved to achieve the asymptotic bound for the model that each reward distribution is supported in a known bounded interval, e.g.…

Statistics Theory · Mathematics 2012-02-20 Junya Honda , Akimichi Takemura

Hybrid mechanistic models, physical priors with learned residuals, promise to reduce the data required for good decisions, but have no computable criterion to test this. We characterize the value of mechanistic priors in sequential…

Machine Learning · Computer Science 2026-05-12 Itai Shufaro , Gal Benor , Shie Mannor

We consider the typical asymptotic behaviour of cellular automata of higher dimension (greater than 2). That is, we take an initial configuration at random according to a Bernoulli (i.i.d) probability measure, iterate some cellular…

Dynamical Systems · Mathematics 2017-02-21 Martin Delacourt , Benjamin Hellouin de Menibus

The sharpest known high probability generalization bounds for uniformly stable algorithms (Feldman, Vondr\'{a}k, 2018, 2019), (Bousquet, Klochkov, Zhivotovskiy, 2020) contain a generally inevitable sampling error term of order…

Machine Learning · Computer Science 2021-11-19 Yegor Klochkov , Nikita Zhivotovskiy

We derive a bound on the precision of state estimation for finite dimensional quantum systems and prove its attainability in the generic case where the spectrum is non-degenerate. Our results hold under an assumption called local asymptotic…

Quantum Physics · Physics 2019-05-09 Yuxiang Yang , Giulio Chiribella , Masahito Hayashi

In this paper, we consider the nonasymptotic sequential estimation of means of random variables bounded in between zero and one. We have rigorously demonstrated that, in order to guarantee prescribed relative precision and confidence level,…

Statistics Theory · Mathematics 2013-11-05 Xinjia Chen

Continuing the computations of the previous paper,[1], we calculate another approximation to the expectation value of the product of two permanents in the ensemble of 0-1 n x n matrices with like row and column sums equal r uniformly…

Combinatorics · Mathematics 2016-04-13 Paul Federbush

The problem of determining the intrinsic quality of a signal processing system with respect to the inference of an unknown deterministic parameter $\theta$ is considered. While the Fisher information measure $F(\theta)$ forms a classical…

Information Theory · Computer Science 2018-05-30 Manuel Stein , Josef A. Nossek

One of the main problem in prediction theory of discrete-time second-order stationary processes $X(t)$ is to describe the asymptotic behavior of the best linear mean squared prediction error in predicting $X(0)$ given $ X(t),$ $-n\le…

Statistics Theory · Mathematics 2022-10-14 Nikolay M. Babayan , Mamikon S. Ginovyan

We develop minimax optimal risk bounds for the general learning task consisting in predicting as well as the best function in a reference set G up to the smallest possible additive term, called the convergence rate. When the reference set…

Statistics Theory · Mathematics 2008-03-04 Jean-Yves Audibert

Data-driven methods for modeling dynamic systems have received considerable attention as they provide a mechanism for control synthesis directly from the observed time-series data. In the absence of prior assumptions on how the time-series…

Optimization and Control · Mathematics 2018-09-24 Atiye Alaeddini , Siavash Alemzadeh , Afshin Mesbahi , Mehran Mesbahi

In this paper, we develop asymptotic theories for a class of latent variable models for large-scale multi-relational networks. In particular, we establish consistency results and asymptotic error bounds for the (penalized) maximum…

Statistics Theory · Mathematics 2020-09-01 Zhi Wang , Xueying Tang , Jingchen Liu

Long Short-Term Memory (LSTM) neural network models have become the cornerstone for sequential data modeling in numerous applications, ranging from natural language processing to time series forecasting. Despite their success, the problem…

Machine Learning · Statistics 2026-05-26 Fahad Mostafa

M-estimators are ubiquitous in machine learning and statistical learning theory. They are used both for defining prediction strategies and for evaluating their precision. In this paper, we propose the first non-asymptotic "any-time"…

Statistics Theory · Mathematics 2019-05-27 Victor-Emmanuel Brunel , Arnak S. Dalalyan , Nicolas Schreuder

The estimation law of unknown parameters vector ${\theta}$ is proposed for one class of nonlinearly parametrized regression equations $y\left( t \right) = \Omega \left( t \right)\Theta \left( \theta \right)$. We restrict our attention to…

Systems and Control · Electrical Eng. & Systems 2023-08-22 Anton Glushchenko , Konstantin Lastochkin

This paper investigates MDPs with intermittent state information. We consider a scenario where the controller perceives the state information of the process via an unreliable communication channel. The transmissions of state information…

Artificial Intelligence · Computer Science 2025-02-17 Gongpu Chen , Soung-Chang Liew

In this note we consider the finite-dimensional parameter estimation problem associated to inverse problems. In such scenarios, one seeks to maximize the marginal likelihood associated to a Bayesian model. This latter model is connected to…

Numerical Analysis · Mathematics 2025-04-10 Ajay Jasra , Abylay Zhumekenov

A general lower bound is developed for the minimax risk when estimating an arbitrary functional. The bound is based on testing two composite hypotheses and is shown to be effective in estimating the nonsmooth functional…

Statistics Theory · Mathematics 2011-05-17 T. Tony Cai , Mark G. Low

Moving from univariate to bivariate jointly dependent long-memory time series introduces a phase parameter $(\gamma)$, at the frequency of principal interest, zero; for short-memory series $\gamma=0$ automatically. The latter case has also…

Statistics Theory · Mathematics 2008-11-07 P. M. Robinson

We undertake a detailed study of the performance of maximum likelihood (ML) estimators of the density matrix of finite-dimensional quantum systems, in order to interrogate generic properties of frequentist quantum state estimation. Existing…

Quantum Physics · Physics 2011-11-16 Raj Chakrabarti , Anisha Ghosh