English
Related papers

Related papers: Speed, Accuracy, and Complexity

200 papers

This paper presents a class of Dynamic Multi-Armed Bandit problems where the reward can be modeled as the noisy output of a time varying linear stochastic dynamic system that satisfies some boundedness constraints. The class allows many…

Machine Learning · Computer Science 2017-10-10 T. W. U. Madhushani , D. H. S. Maithripala , N. E. Leonard

In a constantly changing world, animals must account for environmental volatility when making decisions. To appropriately discount older, irrelevant information, they need to learn the rate at which the environment changes. We develop an…

Neurons and Cognition · Quantitative Biology 2017-01-12 Adrian E Radillo , Alan Veliz-Cuba , Kresimir Josic , Zachary P Kilpatrick

Real-life parallel machine scheduling problems can be characterized by: (i) limited information about the exact task duration at scheduling time, and (ii) an opportunity to reschedule the remaining tasks each time a task processing is…

Optimization and Control · Mathematics 2023-11-22 Izack Cohen , Krzysztof Postek , Shimrit Shtern

This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error…

Optimization and Control · Mathematics 2021-11-18 Joseph E. Gaudio , Anuradha M. Annaswamy , Eugene Lavretsky , Michael A. Bolender

Finding interdependency relations between (possibly multivariate) time series provides valuable knowledge about the processes that generate the signals. Information theory sets a natural framework for non-parametric measures of several…

Information Theory · Computer Science 2016-02-09 German Gomez-Herrero , Wei Wu , Kalle Rutanen , Miguel C. Soriano , Gordon Pipa , Raul Vicente

We explore a multiple-stage variant of the min-max robust selection problem with budgeted uncertainty that includes queries. First, one queries a subset of items and gets the exact values of their uncertain parameters. Given this…

Optimization and Control · Mathematics 2025-01-07 Xiaoyu Chen , Marc Goerigk , Michael Poss

In this paper, a mixed integer linear formulation for problems considering time-of-use-type constraints for uninterruptible services is presented. Our work is motivated by demand response problems in power systems, in which certain devices…

Optimization and Control · Mathematics 2020-10-16 Ana Batista , David Pozo , Jorge Vera

The problem of estimating the probability p=P(g(X<0) is considered when X represents a multivariate stochastic input of a monotone function g. First, a heuristic method to bound p is formally described, involving a specialized design of…

Statistics Theory · Mathematics 2015-03-17 Nicolas Bousquet

In order to find out the limiting speed of solving a specific problem using computer, this essay provides a method based on information entropy. The relationship between the minimum computational complexity and information entropy change is…

Computational Complexity · Computer Science 2012-03-09 Xue Wu

We make progress on two important problems regarding attribute efficient learnability. First, we give an algorithm for learning decision lists of length $k$ over $n$ variables using $2^{\tilde{O}(k^{1/3})} \log n$ examples and time…

Machine Learning · Computer Science 2007-05-23 Adam R. Klivans , Rocco A. Servedio

We introduce an alternative approach for the analysis and numerical approximation of the optimal feedback control mapping. It consists in looking at a typical optimal control problem in such a way that feasible controls are mappings…

Optimization and Control · Mathematics 2017-06-09 Pablo Pedregal

We introduce an ambidextrous view of stochastic dynamical systems, comparing their forward-time and reverse-time representations and then integrating them into a single time-symmetric representation. The perspective is useful theoretically,…

Statistical Mechanics · Physics 2015-05-13 Christopher J. Ellison , John R. Mahoney , James P. Crutchfield

We consider the problem of learning the inhomogeneous intensity of a counting process, under a sparse segmentation assumption. We introduce a weighted total-variation penalization, using data-driven weights that correctly scale the…

Statistics Theory · Mathematics 2015-07-03 Mokhtar Zahdi Alaya , Stéphane Gaïffas , Agathe Guilloux

We propose a quantitative approach for calibrating and validating key features of traffic instabilities based on speed time series obtained from aggregated data of a series of neighboring stationary detectors. We apply the proposed criteria…

Physics and Society · Physics 2010-08-11 Martin Treiber , Arne Kesting

The quality of consequences in a decision making problem under (severe) uncertainty must often be compared among different targets (goals, objectives) simultaneously. In addition, the evaluations of a consequence's performance under the…

Artificial Intelligence · Computer Science 2022-12-15 Christoph Jansen , Georg Schollmeyer , Thomas Augustin

We study oracle complexity of gradient based methods for stochastic approximation problems. Though in many settings optimal algorithms and tight lower bounds are known for such problems, these optimal algorithms do not achieve the best…

Optimization and Control · Mathematics 2022-06-20 Jingzhao Zhang , Hongzhou Lin , Subhro Das , Suvrit Sra , Ali Jadbabaie

We deal here with the issue of determinism versus randomness in time series. One wishes to identify their relative importance in a given time series. To this end we extend i) the use of ordinal patterns-based probability distribution…

In this paper we characterize sharp time-data tradeoffs for optimization problems used for solving linear inverse problems. We focus on the minimization of a least-squares objective subject to a constraint defined as the sub-level set of a…

Information Theory · Computer Science 2016-01-06 Samet Oymak , Benjamin Recht , Mahdi Soltanolkotabi

This is a paper in the intersection of time series analysis and complexity theory that presents new results on permutation complexity in general and permutation entropy in particular. In this context, permutation complexity refers to the…

Information Theory · Computer Science 2021-11-08 J. M. Amigó , R. Dale , P. Tempesta

We develop a novel framework for costly information acquisition in which a decision-maker learns about an unobserved state by choosing a signal distribution, with the cost of information determined by the distribution of noise in the…

Theoretical Economics · Economics 2025-03-27 Peter Achim , Kemal Ozbek