English
Related papers

Related papers: Properization: Constructing Proper Scoring Rules v…

200 papers

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2018-11-14 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek

Machine-learned systems are in widespread use for making decisions about humans, and it is important that they are fair, i.e., not biased against individuals based on sensitive attributes. We present runtime verification of algorithmic…

Computers and Society · Computer Science 2023-05-26 Thomas A. Henzinger , Mahyar Karimi , Konstantin Kueffner , Kaushik Mallik

We propose and analyze a regularization approach for structured prediction problems. We characterize a large class of loss functions that allows to naturally embed structured outputs in a linear space. We exploit this fact to design…

Machine Learning · Computer Science 2017-07-31 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco

Screening rules were recently introduced as a technique for explicitly identifying active structures such as sparsity, in optimization problem arising in machine learning. This has led to new methods of acceleration based on a substantial…

Machine Learning · Statistics 2020-09-08 Eugene Ndiaye , Olivier Fercoq , Joseph Salmon

In an influential paper, Levesque proposed a formal specification for analysing the correctness of program-like plans, such as conditional plans, iterative plans, and knowledge-based plans. He motivated a logical characterisation within the…

Artificial Intelligence · Computer Science 2018-09-17 Vaishak Belle

Empirical analysis serves as an important complement to theoretical analysis for studying practical Bayesian optimization. Often empirical insights expose strengths and weaknesses inaccessible to theoretical analysis. We define two metrics…

Machine Learning · Computer Science 2016-04-01 Ian Dewancker , Michael McCourt , Scott Clark , Patrick Hayes , Alexandra Johnson , George Ke

We examine a controlled school choice model where students are categorized into different types, and the distribution of these types within a school influences its priority structure. This study provides a general framework that integrates…

Theoretical Economics · Economics 2025-03-25 Minoru Kitahara , Yasunori Okumura

As data sets grow in size, the ability of learning methods to find structure in them is increasingly hampered by the time needed to search the large spaces of possibilities and generate a score for each that takes all of the observed data…

Machine Learning · Computer Science 2012-07-03 Benjamin Yackley , Terran Lane

We show that regularizing Bayesian predictive regressions provides a framework for prior sensitivity analysis. We develop a procedure that jointly regularizes expectations and variance-covariance matrices using a pair of shrinkage priors.…

Methodology · Statistics 2017-09-15 Guanhao Feng , Nicholas G. Polson

Recent decades have seen an interest in prediction problems for which Bayesian methodology has been used ubiquitously. Sampling from or approximating the posterior predictive distribution in a Bayesian model allows one to make inferential…

Machine Learning · Statistics 2017-09-12 Giri Gopalan

With recent advances in natural language processing, rationalization becomes an essential self-explaining diagram to disentangle the black box by selecting a subset of input texts to account for the major variation in prediction. Yet,…

Machine Learning · Computer Science 2023-09-12 Wenbo Zhang , Tong Wu , Yunlong Wang , Yong Cai , Hengrui Cai

A set of probabilistic predictions is well calibrated if the events that are predicted to occur with probability p do in fact occur about p fraction of the time. Well calibrated predictions are particularly important when machine learning…

Machine Learning · Statistics 2014-01-14 Mahdi Pakdaman Naeini , Gregory F. Cooper , Milos Hauskrecht

Ranking and scoring are ubiquitous. We consider the setting in which an institution, called a ranker, evaluates a set of individuals based on demographic, behavioral or other characteristics. The final output is a ranking that represents…

Databases · Computer Science 2016-10-28 Ke Yang , Julia Stoyanovich

Measures of accuracy usually score how accurate a specified credence depending on whether the proposition is true or false. A key requirement for such measures is strict propriety; that probabilities expect themselves to be most accurate.…

Probability · Mathematics 2024-12-11 Catrin Campbell-Moore

This paper introduces a novel type theory and logic for probabilistic reasoning. Its logic is quantitative, with fuzzy predicates. It includes normalisation and conditioning of states. This conditioning uses a key aspect that distinguishes…

Logic in Computer Science · Computer Science 2025-04-02 Robin Adams , Bart Jacobs

We analyze boundedly rational updating from aggregate statistics in a model with binary actions and binary states. Agents each take an irreversible action in sequence after observing the unordered set of previous actions. Each agent first…

Machine Learning · Computer Science 2021-01-11 Itai Arieli , Yakov Babichenko , Manuel Mueller-Frank

Probabilistic forecasting relies on past observations to provide a probability distribution for a future outcome, which is often evaluated against the realization using a scoring rule. Here, we perform probabilistic forecasting with…

Machine Learning · Statistics 2024-03-06 Lorenzo Pacchiardi , Rilwan Adewoyin , Peter Dueben , Ritabrata Dutta

The quality of probabilistic forecasts is crucial for decision-making under uncertainty. While proper scoring rules incentivize truthful reporting of precise forecasts, they fall short when forecasters face epistemic uncertainty about their…

Machine Learning · Computer Science 2025-07-18 Anurag Singh , Siu Lun Chau , Krikamol Muandet

This paper presents a new and original first approach to agreement situations as well as to regulations constructions. This is made by giving a mathematical formalization to the set of all possible deals or regulations, such that then, the…

Optimization and Control · Mathematics 2024-02-02 Jon Benito-Ostolaza , María Jesús Campión , Asier Estevan

We revisit the mathematical foundations of proper scoring rules (PSRs) and Bregman divergences and present their characteristic properties in a unified theoretical framework. In many situations it is preferable not to generate a PSR…

Statistics Theory · Mathematics 2015-09-11 Evgeni Y. Ovcharov