English
Related papers

Related papers: Dynamic Structure Estimation from Bandit Feedback …

200 papers

Bandit structured prediction describes a stochastic optimization framework where learning is performed from partial feedback. This feedback is received in the form of a task loss evaluation to a predicted output structure, without having…

Machine Learning · Statistics 2018-12-14 Julia Kreutzer , Artem Sokolov , Stefan Riezler

We study the problem of estimating the sum of $n$ elements, each with weight $w(i)$, in a structured universe. Our goal is to estimate $W = \sum_{i=1}^n w(i)$ within a $(1 \pm \epsilon)$ factor using a sublinear number of samples, assuming…

Data Structures and Algorithms · Computer Science 2025-04-22 Pinki Pradhan , Sampriti Roy

We propose a novel framework for structured bandits, which we call an influence diagram bandit. Our framework captures complex statistical dependencies between actions, latent variables, and observations; and thus unifies and extends many…

Machine Learning · Computer Science 2020-07-10 Tong Yu , Branislav Kveton , Zheng Wen , Ruiyi Zhang , Ole J. Mengshoel

Advancing quantum information processors and building fault-tolerant architectures rely on the ability to accurately characterize the noise sources and suppress their impact on quantum devices. In practice, noise often drifts over time,…

Quantum Physics · Physics 2025-11-13 Devansh Bhardwaj , Evangelia Takou , Yingjia Lin , Kenneth R. Brown

This paper introduces new techniques for using convex optimization to fit input-output data to a class of stable nonlinear dynamical models. We present an algorithm that guarantees consistent estimates of models in this class when a small…

Optimization and Control · Mathematics 2013-03-19 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski

We present a statistical analysis of a variant of the periodogram method that forms power spectral density estimates by cross-correlating the discrete Fourier transforms of adjacent time windows. The proposed estimator is closely related to…

Statistics Theory · Mathematics 2026-03-24 Mark Magsino

Motivated by the need to secure cyber-physical systems against attacks, we consider the problem of estimating the state of a noisy linear dynamical system when a subset of sensors is arbitrarily corrupted by an adversary. We propose a…

Optimization and Control · Mathematics 2015-04-24 Shaunak Mishra , Yasser Shoukry , Nikhil Karamchandani , Suhas Diggavi , Paulo Tabuada

Geophysical inverse problems are often ill-posed and admit multiple solutions. Conventional discriminative methods typically yield a single deterministic solution, which fails to model the posterior distribution, cannot generate diverse…

Analysis of experimental data must sometimes deal with abrupt changes in the distribution of measured values. Setting upper limits on signals usually involves a veto procedure that excludes data not described by an assumed statistical…

General Relativity and Quantum Cosmology · Physics 2015-03-20 Vladimir Dergachev

The concerns to autonomous vehicles have been becoming more intriguing in coping with the more environmentally dynamics non-linear systems under some constraints and disturbances. These vehicles connect not only to the self-instruments yet…

Systems and Control · Electrical Eng. & Systems 2023-04-12 Bambang L. Widjiantoro , Moh Kamalul Wafi , Katherin Indriawati

In this paper we prove the existence of Extreme Value Laws for dynamical systems perturbed by instrument-like-error, also called observational noise. An orbit perturbed with observational noise mimics the behavior of an instrumentally…

Dynamical Systems · Mathematics 2015-06-17 Davide Faranda , Sandro Vaienti

One of the pivotal tasks in scientific machine learning is to represent underlying dynamical systems from time series data. Many methods for such dynamics learning explicitly require the derivatives of state data, which are not directly…

Machine Learning · Computer Science 2024-04-17 Dongwei Ye , Mengwu Guo

Despite their wide-scale deployment and ability to make accurate high-frequency voltage measurements, communication network limitations have largely precluded the use of smart meters for real-time monitoring purposes in electric…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Samuel Talkington , Rahul Gupta , Richard Asiamah , Paprapee Buason , Daniel K. Molzahn

One of the main unsolved problems of cosmology is how to maximize the extraction of information from nonlinear data. If the data are nonlinear the usual approach is to employ a sequence of statistics (N-point statistics, counting statistics…

Cosmology and Nongalactic Astrophysics · Physics 2018-03-07 Uros Seljak , Grigor Aslanyan , Yu Feng , Chirag Modi

Distributional ambiguity sets provide quantifiable ways to characterize the uncertainty about the true probability distribution of random variables of interest. This makes them a key element in data-driven robust optimization by exploiting…

Optimization and Control · Mathematics 2019-09-26 Dimitris Boskos , Jorge Cortés , Sonia Martínez

In the study of complex dynamical systems, understanding and accurately modeling the underlying physical processes is crucial for predicting system behavior and designing effective interventions. Yet real-world systems exhibit pronounced…

Machine Learning · Statistics 2025-07-15 Ridwan Olabiyi , Han Hu , Ashif Iquebal

We study a bandit problem where observations from each arm have an exponential family distribution and different arms are assigned independent conjugate priors. At each of n stages, one arm is to be selected based on past observations. The…

Statistics Theory · Mathematics 2011-03-29 Yaming Yu

We consider a situation where the distribution of a random variable is being estimated by the empirical distribution of noisy measurements of that variable. This is common practice in, for example, teacher value-added models and other…

Econometrics · Economics 2021-12-08 Koen Jochmans , Martin Weidner

This article reports on a new approach to properly analyze time series of dynamical systems which are spoilt by the simultaneous presence of dynamical noise and measurement noise. It is shown that even strong external measurement noise as…

Chaotic Dynamics · Physics 2009-11-11 Frank Boettcher , Joachim Peinke , David Kleinhans , Rudolf Friedrich , Pedro G. Lind , Maria Haase

In the infinite-armed bandit problem, each arm's average reward is sampled from an unknown distribution, and each arm can be sampled further to obtain noisy estimates of the average reward of that arm. Prior work focuses on identifying the…

Machine Learning · Computer Science 2022-11-04 Yifei Wang , Tavor Baharav , Yanjun Han , Jiantao Jiao , David Tse