English
Related papers

Related papers: A Bernstein-type Inequality for Some Mixing Proces…

200 papers

We study model-based reinforcement learning in an unknown finite communicating Markov decision process. We propose a simple algorithm that leverages a variance based confidence interval. We show that the proposed algorithm, UCRL-V, achieves…

Machine Learning · Computer Science 2019-12-12 Aristide Tossou , Debabrota Basu , Christos Dimitrakakis

This paper studies offline policy learning, which aims at utilizing observations collected a priori (from either fixed or adaptively evolving behavior policies) to learn an optimal individualized decision rule that achieves the best overall…

Machine Learning · Computer Science 2025-06-06 Ying Jin , Zhimei Ren , Zhuoran Yang , Zhaoran Wang

A generalization of the Bernstein matrix concentration inequality to random tensors of general order is proposed. This generalization is based on the use of Einstein products between tensors, from which a strong link can be established…

Statistics Theory · Mathematics 2021-05-31 Z. Luo , L. Qi , Ph. L. Toint

Probabilistic regression techniques in control and robotics applications have to fulfill different criteria of data-driven adaptability, computational efficiency, scalability to high dimensions, and the capacity to deal with different…

Machine Learning · Computer Science 2021-03-31 Hany Abdulsamad , Peter Nickl , Pascal Klink , Jan Peters

Stochastic gradient methods are the workhorse (algorithms) of large-scale optimization problems in machine learning, signal processing, and other computational sciences and engineering. This paper studies Markov chain gradient descent, a…

Optimization and Control · Mathematics 2018-09-13 Tao Sun , Yuejiao Sun , Wotao Yin

The problem of learning Boolean linear functions from quantum examples w.r.t. the uniform distribution can be solved on a quantum computer using the Bernstein-Vazirani algorithm. A similar strategy can be applied in the case of noisy…

Quantum Physics · Physics 2020-04-22 Matthias C. Caro

Recent work has leveraged the popular distributionally robust optimization paradigm to combat overfitting in classical logistic regression. While the resulting classification scheme displays a promising performance in numerical experiments,…

Optimization and Control · Mathematics 2023-01-18 Aras Selvi , Mohammad Reza Belbasi , Martin B Haugh , Wolfram Wiesemann

Bayesian probabilistic numerical methods for numerical integration offer significant advantages over their non-Bayesian counterparts: they can encode prior information about the integrand, and can quantify uncertainty over estimates of an…

Machine Learning · Statistics 2023-09-12 Katharina Ott , Michael Tiemann , Philipp Hennig , François-Xavier Briol

We view sequential design as a model selection problem to determine which new observation is expected to be the most informative, given the existing set of observations. For estimating a probability distribution on a bounded interval, we…

Methodology · Statistics 2018-07-19 Madhurima Nath , Stephen Eubank

The Bernstein operator is known as a typical example of positive linear operators which uniformly approximates continuous functions on $[0, 1]$. In the present paper, we introduce a multidimensional extension of the Bernstein operator which…

Probability · Mathematics 2023-10-24 Takatoshi Hirano , Ryuya Namba

Gaussian processes (GP) provide a prior over functions and allow finding complex regularities in data. Gaussian processes are successfully used for classification/regression problems and dimensionality reduction. In this work we consider…

Machine Learning · Computer Science 2016-11-21 Pavel Izmailov , Dmitry Kropotov

In this paper, we propose an Anderson-accelerated stochastic extragradient algorithm for solving a class of stochastic variational inequalities, by incorporating Anderson acceleration into the stochastic extragradient method under a…

Optimization and Control · Mathematics 2026-05-27 Xin Qu , Wei Bian , Xiaojun Chen

We prove that several forms of the Bernstein polynomials with integer coefficients possess the property of simultaneous approximation, that is, they approximate not only the function but also its derivatives. We establish direct estimates…

Classical Analysis and ODEs · Mathematics 2019-04-23 Borislav R. Draganov

The paper considers the problem of robust estimating a periodic function in a continuous time regression model with dependent disturbances given by a general square integrable semimartingale with unknown distribution. An example of such a…

Statistics Theory · Mathematics 2010-10-20 Victor Konev , Serguei Pergamenchtchikov

In this paper we obtain Berry-Esse\'en bounds on partial sums of functionals of heavy-tailed moving averages, including the linear fractional stable noise, stable fractional ARIMA processes and stable Ornstein-Uhlenbeck processes. Our rates…

Probability · Mathematics 2019-04-15 Andreas Basse-O'Connor , Mark Podolskij , Christoph Thäle

This paper presents a new model called infinite mixtures of multivariate Gaussian processes, which can be used to learn vector-valued functions and applied to multitask learning. As an extension of the single multivariate Gaussian process,…

Machine Learning · Computer Science 2013-07-29 Shiliang Sun

Gaussian mixture models form a flexible and expressive parametric family of distributions that has found applications in a wide variety of applications. Unfortunately, fitting these models to data is a notoriously hard problem from a…

Statistics Theory · Mathematics 2023-01-05 Yuling Yan , Kaizheng Wang , Philippe Rigollet

In this article we define and investigate statistical operators and an entropy functional for Bernstein stochastic processes associated with hierarchies of forward-backward systems of decoupled deterministic linear parabolic partial…

Analysis of PDEs · Mathematics 2020-03-25 Pierre-A Vuillermot

We present a new concentration of measure inequality for sums of independent bounded random variables, which we name a split-kl inequality. The inequality is particularly well-suited for ternary random variables, which naturally show up in…

Machine Learning · Statistics 2023-01-18 Yi-Shan Wu , Yevgeny Seldin

We propose a simple method that combines neural networks and Gaussian processes. The proposed method can estimate the uncertainty of outputs and flexibly adjust target functions where training data exist, which are advantages of Gaussian…

Machine Learning · Statistics 2017-07-20 Tomoharu Iwata , Zoubin Ghahramani