English
Related papers

Related papers: Proper-Composite Loss Functions in Arbitrary Dimen…

200 papers

We consider the problem of constructing distribution-free prediction sets with finite-sample conditional guarantees. Prior work has shown that it is impossible to provide exact conditional coverage universally in finite samples. Thus, most…

Methodology · Statistics 2024-09-18 Isaac Gibbs , John J. Cherian , Emmanuel J. Candès

In this work, we consider the problem of distributed approximation of functions over multiple-access channels with additive noise. In contrast to previous works, we take fast fading into account and give explicit probability bounds for the…

Information Theory · Computer Science 2021-03-01 Igor Bjelakovic , Matthias Frey , Slawomir Stanczak

Traditional methods for matching in causal inference are impractical for high-dimensional datasets. They suffer from the curse of dimensionality: exact matching and coarsened exact matching find exponentially fewer matches as the input…

Machine Learning · Statistics 2026-02-12 Oscar Clivio , Fabian Falck , Brieuc Lehmann , George Deligiannidis , Chris Holmes

We consider learning causal relationships under conditional moment restrictions. Unlike causal inference under unconditional moment restrictions, conditional moment restrictions pose serious challenges for causal inference, especially in…

Econometrics · Economics 2022-09-30 Masahiro Kato , Masaaki Imaizumi , Kenichiro McAlinn , Haruo Kakehi , Shota Yasui

Conformal prediction is a general distribution-free approach for constructing prediction sets combined with any machine learning algorithm that achieve valid marginal or conditional coverage in finite samples. Ordinal classification is…

Methodology · Statistics 2024-11-05 Subhrasish Chakraborty , Chhavi Tyagi , Haiyan Qiao , Wenge Guo

Submodular functions are discrete functions that model laws of diminishing returns and enjoy numerous algorithmic applications. They have been used in many areas, including combinatorial optimization, machine learning, and economics. In…

Data Structures and Algorithms · Computer Science 2012-08-24 Maria-Florina Balcan , Nicholas J. A. Harvey

When solving optimization problems under uncertainty with contextual data, utilizing machine learning to predict the uncertain parameters' values is a popular and effective approach. Decision-focused learning (DFL) aims at learning a…

Machine Learning · Computer Science 2026-01-29 Noah Schutte , Grigorii Veviurko , Krzysztof Postek , Neil Yorke-Smith

What does it mean to say that, for example, the probability for rain tomorrow is between 20% and 30%? The theory for the evaluation of precise probabilistic forecasts is well-developed and is grounded in the key concepts of proper scoring…

Machine Learning · Computer Science 2024-10-31 Christian Fröhlich , Robert C. Williamson

Diffusion models are state-of-the-art tools for various generative tasks. Yet training these models involves estimating high-dimensional score functions, which in principle suffers from the curse of dimensionality. It is therefore important…

Machine Learning · Computer Science 2025-09-30 Georg A. Gottwald , Shuigen Liu , Youssef Marzouk , Sebastian Reich , Xin T. Tong

When model predictions inform downstream decision making, a natural question is under what conditions can the decision-makers simply respond to the predictions as if they were the true outcomes. Calibration suffices to guarantee that simple…

Machine Learning · Computer Science 2025-04-23 Jingwu Tang , Jiayun Wu , Zhiwei Steven Wu , Jiahao Zhang

Decision trees are a popular family of models due to their attractive properties such as interpretability and ability to handle heterogeneous data. Concurrently, missing data is a prevalent occurrence that hinders performance of machine…

Machine Learning · Computer Science 2020-07-01 Pasha Khosravi , Antonio Vergari , YooJung Choi , Yitao Liang , Guy Van den Broeck

In this article we propose a general class of risk measures which can be used for data based evaluation of parametric models. The loss function is defined as generalized quadratic distance between the true density and the proposed model.…

Statistics Theory · Mathematics 2007-10-02 Surajit Ray , Bruce G. Lindsay

Machine Learning explainability techniques have been proposed as a means of `explaining' or interrogating a model in order to understand why a particular decision or prediction has been made. Such an ability is especially important at a…

Machine Learning · Statistics 2022-02-28 Matthew J. Vowels

A composite likelihood is an inference function derived by multiplying a set of likelihood components. This approach provides a flexible framework for drawing inference when the likelihood function of a statistical model is computationally…

Methodology · Statistics 2024-12-10 Giuseppe Alfonzetti , Ruggero Bellio , Yunxiao Chen , Irini Moustaki

In this article we recover the distribution function (and possible density) of an arbitrary random variable that is subject to an additive measurement error. This problem is also known as deconvolution and has a long tradition in…

Statistics Theory · Mathematics 2025-10-07 Henrik Kaiser

The aim of this thesis is to determine classes of NP relations for which random generation and approximate counting problems admit an efficient solution. Since efficient rank implies efficient random generation, we first investigate some…

Computational Complexity · Computer Science 2010-12-15 Massimo Santini

High dimensional covariance estimation and graphical models is a contemporary topic in statistics and machine learning having widespread applications. An important line of research in this regard is to shrink the extreme spectrum of the…

Methodology · Statistics 2016-06-28 Sang-Yun Oh , Bala Rajaratnam , Joong-Ho Won

We address the problem of uncertainty quantification and propose measures of total, aleatoric, and epistemic uncertainty based on a known decomposition of (strictly) proper scoring rules, a specific type of loss function, into a divergence…

Machine Learning · Computer Science 2025-05-29 Paul Hofman , Yusuf Sale , Eyke Hüllermeier

We develop a linear-algebraic framework for dimensional analysis in systems with constraints, particularly when variables are numerous or related by implicit relations so that direct elimination is impractical. By expressing both…

Mathematical Physics · Physics 2026-03-31 Umpei Miyamoto

Recent developments in AI have made it ubiquitous, every industry is trying to adopt some form of intelligent processing of their data. Despite so many advances in the field, AIs full capability is yet to be exploited by the industry.…

Machine Learning · Computer Science 2021-11-10 Vishal Rajput