English
Related papers

Related papers: On the Unknowable Limits to Prediction

200 papers

In this paper, we reproduce the experimental results presented in our previous work titled "Making Users Indistinguishable: Attribute-wise Unlearning in Recommender Systems," which was published in the proceedings of the 31st ACM…

Information Retrieval · Computer Science 2025-04-01 Yuyuan Li , Junjie Fang , Chaochao Chen , Xiaolin Zheng , Yizhao Zhang , Zhongxuan Han

Algorithmic recourse provides individuals who receive undesirable outcomes from machine learning systems with minimum-cost improvements to achieve a desirable outcome. However, machine learning models often get updated, so the recourse may…

Machine Learning · Computer Science 2026-04-28 Kshitij Kayastha , Vasilis Gkatzelis , Shahin Jabbari

Algorithmic predictions are inherently uncertain: even models with similar aggregate accuracy can produce different predictions for the same individual, raising concerns that high-stakes decisions may become sensitive to arbitrary modeling…

Human-Computer Interaction · Computer Science 2026-05-13 Hansol Lee , AJ Alvero , René F. Kizilcec , Thorsten Joachims

We consider learning a predictor which is non-discriminatory with respect to a "protected attribute" according to the notion of "equalized odds" proposed by Hardt et al. [2016]. We study the problem of learning such a non-discriminatory…

Machine Learning · Computer Science 2017-11-03 Blake Woodworth , Suriya Gunasekar , Mesrob I. Ohannessian , Nathan Srebro

Selective classification allows models to abstain from making predictions (e.g., say "I don't know") when in doubt in order to obtain better effective accuracy. While typical selective models can be effective at producing more accurate…

Machine Learning · Computer Science 2024-06-24 Adam Fisch , Tommi Jaakkola , Regina Barzilay

As inductive inference and machine learning methods in computer science see continued success, researchers are aiming to describe ever more complex probabilistic models and inference algorithms. It is natural to ask whether there is a…

Logic · Mathematics 2019-11-19 Nathanael L. Ackerman , Cameron E. Freer , Daniel M. Roy

This paper deals with the problem of formulating an adaptive Model Predictive Control strategy for constrained uncertain systems. We consider a linear system, in presence of bounded time varying additive uncertainty. The uncertainty is…

Systems and Control · Electrical Eng. & Systems 2021-04-13 Monimoy Bujarbaruah , Xiaojing Zhang , Marko Tanaskovic , Francesco Borrelli

We argue that results produced by a heuristic optimisation algorithm cannot be considered reproducible unless the algorithm fully specifies what should be done with solutions generated outside the domain, even in the case of simple box…

Neural and Evolutionary Computing · Computer Science 2023-05-18 Anna V. Kononova , Diederick Vermetten , Fabio Caraffini , Madalina-A. Mitran , Daniela Zaharie

Empirical investigations into unintended model behavior often show that the algorithm is predicting another outcome than what was intended. These exposes highlight the need to identify when algorithms predict unintended quantities - ideally…

Methodology · Statistics 2026-01-27 Amanda Coston

Data Science and Machine learning have been growing strong for the past decade. We argue that to make the most of this exciting field we should resist the temptation of assuming that forecasting can be reduced to brute-force data analytics.…

Artificial Intelligence · Computer Science 2020-05-12 Hykel Hosni , Angelo Vulpiani

Probabilistic forecasts must sum to unity and cannot express ``I don't know.'' Possibility theory relaxes this constraint: a subnormal distribution explicitly measures how much of the plausibility budget remains unassigned, ignorance signal…

Applications · Statistics 2026-04-03 John R. Lawson

Computational models in chemistry rely on a number of approximations. The effect of such approximations on observables derived from them is often unpredictable. Therefore, it is challenging to quantify the uncertainty of a computational…

Chemical Physics · Physics 2017-04-21 Gregor N. Simm , Jonny Proppe , Markus Reiher

In recent years, there has been increasing interest in explanation methods for neural model predictions that offer precise formal guarantees. These include abductive (respectively, contrastive) methods, which aim to compute minimal subsets…

Machine Learning · Computer Science 2023-05-03 Ouns El Harzli , Bernardo Cuenca Grau , Ian Horrocks

Reliable predictions from systems biology models require knowing whether parameters can be estimated from available data, and with what certainty. Identifiability analysis reveals whether parameters are learnable in principle (structural…

In modern data science, it is often not enough to obtain only a data-driven model with a good prediction quality. On the contrary, it is more interesting to understand the properties of the model, which parts could be replaced to obtain…

Neural and Evolutionary Computing · Computer Science 2021-07-09 Alexander Hvatov , Mikhail Maslyaev , Iana S. Polonskaya , Mikhail Sarafanov , Mark Merezhnikov , Nikolay O. Nikitin

As machine learning systems become ubiquitous, there has been a surge of interest in interpretable machine learning: systems that provide explanation for their outputs. These explanations are often used to qualitatively assess other…

Machine Learning · Statistics 2017-03-06 Finale Doshi-Velez , Been Kim

We consider linear programs involving uncertain parameters and propose a new tractable robust counterpart which contains and generalizes several other models including the existing Affinely Adjustable Robust Counterpart and the Fully…

Optimization and Control · Mathematics 2016-04-12 Walid Ben-Ameur , Adam Ouorou , Guanglei Wang , Mateusz Żotkiewicz

Background: Many published machine learning studies are irreproducible. Issues with methodology and not properly accounting for variation introduced by the algorithm themselves or their implementations are attributed as the main…

Machine Learning · Computer Science 2023-04-17 Odd Erik Gundersen , Kevin Coakley , Christine Kirkpatrick , Yolanda Gil

It is a long-standing objective to ease the computation burden incurred by the decision making process. Identification of this mechanism's sensitivity to simplification has tremendous ramifications. Yet, algorithms for decision making under…

Artificial Intelligence · Computer Science 2021-05-13 Andrey Zhitnikov , Vadim Indelman

We study the feasibility of identifying epistemic uncertainty (reflecting a lack of knowledge), as opposed to aleatoric uncertainty (reflecting entropy in the underlying distribution), in the outputs of large language models (LLMs) over…

Machine Learning · Computer Science 2024-02-28 Gustaf Ahdritz , Tian Qin , Nikhil Vyas , Boaz Barak , Benjamin L. Edelman