English
Related papers

Related papers: Probabilistic Loss and its Online Characterization…

200 papers

Attempts to replicate probabilistic reasoning in expert systems have typically overlooked a critical ingredient of that process. Probabilistic analysis typically requires extensive judgments regarding interdependencies among hypotheses and…

Artificial Intelligence · Computer Science 2013-04-15 Marvin S. Cohen

Context: Software engineering has a problem in that when we empirically evaluate competing prediction systems we obtain conflicting results. Objective: To reduce the inconsistency amongst validation study results and provide a more formal…

Software Engineering · Computer Science 2021-01-15 Martin Shepperd , Stephen G. MacDonell

We propose a general framework for studying adaptive regret bounds in the online learning framework, including model selection bounds and data-dependent bounds. Given a data- or model-dependent bound we ask, "Does there exist some algorithm…

Machine Learning · Computer Science 2020-02-14 Dylan J. Foster , Alexander Rakhlin , Karthik Sridharan

Recent advancements in machine learning have emphasized the need for transparency in model predictions, particularly as interpretability diminishes when using increasingly complex architectures. In this paper, we propose leveraging…

Machine Learning · Computer Science 2025-07-18 Chenrui Zhu , Louenas Bounia , Vu Linh Nguyen , Sébastien Destercke , Arthur Hoarau

We propose a new model for augmenting algorithms with predictions by requiring that they are formally learnable and instance robust. Learnability ensures that predictions can be efficiently constructed from a reasonable amount of past data.…

Machine Learning · Computer Science 2021-07-05 Thomas Lavastida , Benjamin Moseley , R. Ravi , Chenyang Xu

Theoretically as well as experimentally it is investigated how people represent their knowledge in order to make decisions or to share their knowledge with others. Experiment 1 probes into the ways how people 6ather information about the…

Artificial Intelligence · Computer Science 2013-04-15 Alf C. Zimmer

We study online algorithms with predictions using distributional advice, a type of prediction that arises when leveraging expert knowledge or historical data. To demonstrate the usefulness and versatility of this framework, we focus on the…

Data Structures and Algorithms · Computer Science 2025-09-09 Clément L. Canonne , Kenny Chen , Julián Mestre

Optimization is offered as an objective approach to resolving complex, real-world decisions involving uncertainty and conflicting interests. It drives business strategies as well as public policies and, increasingly, lies at the heart of…

Artificial Intelligence · Computer Science 2023-08-01 Benjamin Laufer , Thomas Krendl Gilbert , Helen Nissenbaum

We consider the problem of constructing probabilistic predictions that lead to accurate decisions when employed by downstream users to inform actions. For a single decision maker, designing an optimal predictor is equivalent to minimizing a…

Machine Learning · Computer Science 2025-10-15 Isaac Gibbs , Ryan J. Tibshirani

In context-specific applications such as robotics, telecommunications, and healthcare, artificial intelligence systems often face the challenge of limited training data. This scarcity introduces epistemic uncertainty, i.e., reducible…

Information Theory · Computer Science 2026-03-17 Osvaldo Simeone , Yaniv Romano

With the developments in machine learning, there has been a surge in interest and results focused on algorithms utilizing predictions, not least in online algorithms where most new results incorporate the prediction aspect for concrete…

Data Structures and Algorithms · Computer Science 2026-02-02 Magnus Berg , Joan Boyar , Lene M. Favrholdt , Kim S. Larsen

The fast growth of communication technology within the concept of smart grids can provide data and control signals from/to all consumers in an online fashion. This could foster more participation for end-user customers. These types of…

Systems and Control · Electrical Eng. & Systems 2020-09-11 Arman Alahyari , David Pozo

Selective prediction [Dru13, QV19] models the scenario where a forecaster freely decides on the prediction window that their forecast spans. Many data statistics can be predicted to a non-trivial error rate without any distributional…

Machine Learning · Computer Science 2025-08-14 Licheng Liu , Mingda Qiao

This position paper reflects on the state-of-the-art in decision-making under uncertainty. A classical assumption is that probabilities can sufficiently capture all uncertainty in a system. In this paper, the focus is on the uncertainty…

Artificial Intelligence · Computer Science 2023-03-13 Thom Badings , Thiago D. Simão , Marnix Suilen , Nils Jansen

We study the sample complexity of online reinforcement learning in the general \hzyrev{non-episodic} setting of nonlinear dynamical systems with continuous state and action spaces. Our analysis accommodates a large class of dynamical…

Machine Learning · Computer Science 2026-03-02 Michael Muehlebach , Zhiyu He , Michael I. Jordan

Probabilistic classifiers output a probability distribution on target classes rather than just a class prediction. Besides providing a clear separation of prediction and decision making, the main advantage of probabilistic models is their…

Machine Learning · Computer Science 2019-02-20 Juozas Vaicenavicius , David Widmann , Carl Andersson , Fredrik Lindsten , Jacob Roll , Thomas B. Schön

The past century has seen a steady increase in the need of estimating and predicting complex systems and making (possibly critical) decisions with limited information. Although computers have made possible the numerical evaluation of…

Statistics Theory · Mathematics 2017-01-13 Houman Owhadi , Clint Scovel

Thompson sampling has emerged as an effective heuristic for a broad range of online decision problems. In its basic form, the algorithm requires computing and sampling from a posterior distribution over models, which is tractable only for…

Machine Learning · Statistics 2023-04-26 Xiuyuan Lu , Benjamin Van Roy

Recently there has been a surge of interest in operations research (OR) and the machine learning (ML) community in combining prediction algorithms and optimization techniques to solve decision-making problems in the face of uncertainty.…

Optimization and Control · Mathematics 2025-11-11 Utsav Sadana , Abhilash Chenreddy , Erick Delage , Alexandre Forel , Emma Frejinger , Thibaut Vidal

Deep neural networks, when optimized with sufficient data, provide accurate representations of high-dimensional functions; in contrast, function approximation techniques that have predominated in scientific computing do not scale well with…

Data Analysis, Statistics and Probability · Physics 2021-03-15 Grant M. Rotskoff , Andrew R. Mitchell , Eric Vanden-Eijnden