English
Related papers

Related papers: A simple randomized algorithm for sequential predi…

200 papers

This work proposes a Bayesian inference method for the reduced-order modeling of time-dependent systems. Informed by the structure of the governing equations, the task of learning a reduced-order model from data is posed as a Bayesian…

Numerical Analysis · Mathematics 2023-01-18 Mengwu Guo , Shane A. McQuarrie , Karen E. Willcox

We propose simple randomized strategies for sequential prediction under imperfect monitoring, that is, when the forecaster does not have access to the past outcomes but rather to a feedback signal. The proposed strategies are consistent in…

Statistics Theory · Mathematics 2008-01-07 Gabor Lugosi , Shie Mannor , Gilles Stoltz

The purpose of this paper is to study the time average behavior of Markov chains with transition probabilities being kernels of completely continuous operators, and therefore to provide a sufficient condition for a class of Markov chains…

Probability · Mathematics 2018-11-16 Shizhou Xu

We consider selection of random predictors for high-dimensional regression problem with binary response for a general loss function. Important special case is when the binary model is semiparametric and the response function is misspecified…

Statistics Theory · Mathematics 2020-02-19 Mariusz Kubkowski , Jan Mielniczuk

We present an optimizer which uses Bayesian optimization to tune the system parameters of distributed stochastic gradient descent (SGD). Given a specific context, our goal is to quickly find efficient configurations which appropriately…

Machine Learning · Statistics 2016-12-04 Valentin Dalibard , Michael Schaarschmidt , Eiko Yoneki

Linear mixed models are a versatile statistical tool to study data by accounting for fixed effects and random effects from multiple sources of variability. In many situations, a large number of candidate fixed effects is available and it is…

Methodology · Statistics 2022-09-09 Emanuele Degani , Luca Maestrini , Dorota Toczydłowska , Matt P. Wand

We consider the problem of sequential evaluation, in which an evaluator observes candidates in a sequence and assigns scores to these candidates in an online, irrevocable fashion. Motivated by the psychology literature that has studied…

Machine Learning · Statistics 2023-11-20 Jingyan Wang , Ashwin Pananjady

In this work, we propose an ensemble forecasting approach based on randomized neural networks. Improved randomized learning streamlines the fitting abilities of individual learners by generating network parameters in accordance with the…

Machine Learning · Computer Science 2021-07-12 Grzegorz Dudek , Paweł Pełka

Decision theories offer principled methods for making choices under various types of uncertainty. Algorithms that implement these theories have been successfully applied to a wide range of real-world problems, including materials and drug…

Machine Learning · Computer Science 2026-05-26 Agustinus Kristiadi

The Bayesian Mallows model is a flexible tool for analyzing data in the form of complete or partial rankings, and transitive or intransitive pairwise preferences. In many potential applications of preference learning, data arrive…

Computation · Statistics 2025-11-26 Øystein Sørensen , Anja Stein , Waldir Leoncio Netto , David S. Leslie

We consider the problem of finding confidence intervals for the risk of forecasting the future of a stationary, ergodic stochastic process, using a model estimated from the past of the process. We show that a bootstrap procedure provides…

Statistics Theory · Mathematics 2017-12-01 Robert Lunde , Cosma Rohilla Shalizi

Recovering the digital input of a time-discrete linear system from its (noisy) output is a significant challenge in the fields of data transmission, deconvolution, channel equalization, and inverse modeling. A variety of algorithms have…

Optimization and Control · Mathematics 2020-12-03 Sophie M. Fosson

Bayesian optimization is a sequential method for minimizing objective functions that are expensive to evaluate and about which few assumptions can be made. By using all gathered data to train a Gaussian process model for the function and…

Machine Learning · Computer Science 2026-05-07 Jesse Schneider , William J. Welch

The use of numerical simulation for prediction of characteristics of chaotic dynamical systems inherently involves unpredictable processes. In this work, we develop a model for the expected error in the simulation of ergodic, chaotic ODE…

Dynamical Systems · Mathematics 2022-10-17 Cory Frontin , David Darmofal

This paper describes a simple and efficient asynchronous Binary Byzantine faulty tolerant consensus algorithm. In the algorithm, non-faulty nodes perform an initial broadcast followed by a executing a series of rounds each consisting of a…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-12 Tyler Crain

In the following article we consider approximate Bayesian parameter inference for observation driven time series models. Such statistical models appear in a wide variety of applications, including econometrics and applied mathematics. This…

Computation · Statistics 2013-04-01 Ajay Jasra , Nikolas Kantas , Elena Ehrlich

Genetic fitness optimization using small populations or small population updates across generations generally suffers from randomly diverging evolutions. We propose a notion of highly probable fitness optimization through feasible…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Paul Vitanyi

We address the problem of sequentially selecting and observing processes from a given set to find the anomalies among them. The decision-maker observes one process at a time and obtains a noisy binary indicator of whether or not the…

Machine Learning · Computer Science 2021-05-14 Geethu Joseph , M. Cenk Gursoy , Pramod K. Varshney

The generic identification problem is to decide whether a stochastic process $(X_t)$ is a hidden Markov process and if yes to infer its parameters for all but a subset of parametrizations that form a lower-dimensional subvariety in…

Statistics Theory · Mathematics 2015-01-14 Alexander Schönhuth

We present a Bayesian inference methodology for the estimation of orbital parameters on single-line spectroscopic binaries with astrometric data, based on the No-U-Turn sampler Markov chain Monte Carlo algorithm. Our approach is designed to…

Solar and Stellar Astrophysics · Physics 2022-04-27 Miguel Videla , Rene A. Mendez , Ruben M. Claveria , Jorge F. Silva , Marcos E. Orchard