English
Related papers

Related papers: Quantification and cross-fitting inference of asym…

200 papers

Quantifying predictive uncertainty is essential for real world machine learning applications, especially in scenarios requiring reliable and interpretable predictions. Many common parametric approaches rely on neural networks to estimate…

Machine Learning · Statistics 2026-03-31 Yang Yang , Chunlin Ji , Haoyang Li , Ke Deng

Intractable generative models are models for which the likelihood is unavailable but sampling is possible. Most approaches to parameter inference in this setting require the computation of some discrepancy between the data and the…

Computation · Statistics 2022-07-05 Ziang Niu , Johanna Meier , François-Xavier Briol

Weakly Supervised Object Localization is challenging because of the lack of bounding box annotations. Previous works tend to generate a class activation map i.e CAM to localize the object. Unfortunately, the network activates only the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Sabrina Narimene Benassou , Wuzhen Shi , Feng Jiang

The ability to conduct interventions plays a pivotal role in learning causal relationships among variables, thus facilitating applications across diverse scientific disciplines such as genomics, economics, and machine learning. However, in…

Machine Learning · Statistics 2024-11-04 Abhinav Kumar , Kirankumar Shiragur , Caroline Uhler

We study the problem of identifying the causal relationship between two discrete random variables from observational data. We recently proposed a novel framework called entropic causality that works in a very general functional model but…

Information Theory · Computer Science 2017-01-31 Murat Kocaoglu , Alexandros G. Dimakis , Sriram Vishwanath , Babak Hassibi

The standard model (SM) of particle physics represents a theoretical paradigm for the description of the fundamental forces of nature. Despite its broad applicability, the SM does not enable the description of all physically possible…

For the purpose of causal inference we employ a stochastic model of the data generating process, utilizing individual propensity probabilities for the treatment, and also individual and counterfactual prognosis probabilities for the…

Methodology · Statistics 2024-07-15 Brian Knaeble , Mehdi Hakim-Hashemi , Mark A. Abramson

Graphical models are ubiquitous tools to describe the interdependence between variables measured simultaneously such as large-scale gene or protein expression data. Gaussian graphical models (GGMs) are well-established tools for…

Methodology · Statistics 2020-01-09 Nilabja Guha , Veera Baladandayuthapani , Bani K. Mallick

'Causal' direction is of great importance when dealing with complex systems. Often big volumes of data in the form of time series are available and it is important to develop methods that can inform about possible causal connections between…

Statistical Mechanics · Physics 2014-01-24 Fatimah Abdul Razak , Henrik Jeldtoft Jensen

Content is created for a well-defined purpose, often described by a metric or signal represented in the form of structured information. The relationship between the goal (metrics) of target content and the content itself is non-trivial.…

Computation and Language · Computer Science 2022-03-29 Navita Goyal , Roodram Paneri , Ayush Agarwal , Udit Kalani , Abhilasha Sancheti , Niyati Chhaya

This paper proposes $\alpha$-GAN, a generative adversarial network using R\'{e}nyi measures. The value function is formulated, by R\'{e}nyi cross entropy, as an expected certainty measure incurred by the discriminator's soft decision as to…

Machine Learning · Computer Science 2025-05-21 Ni Ding , Miao Qiao , Jiaxing Xu , Yiping Ke , Xiaoyu Zhang

In this paper, we address a longstanding challenge in self-organized criticality (SOC) systems: establishing a connection between sandpiles and complex networks. Our approach employs a similarity-based transfer function characterized by two…

Statistical Mechanics · Physics 2025-01-28 Abbas Shoja-Daliklidash , Morteza Nattagh-Najafi , Nasser Sepehri-Javan

Misclassification detection is an important problem in machine learning, as it allows for the identification of instances where the model's predictions are unreliable. However, conventional uncertainty measures such as Shannon entropy do…

Machine Learning · Statistics 2024-02-09 Eduardo Dadalto , Marco Romanelli , Georg Pichler , Pablo Piantanida

In a previous paper, we introduced a semi-device-independent scheme consisting of an untrusted source sending quantum states to an untrusted measuring device, with the sole assumption that the average energy of the states emitted by the…

Quantum Physics · Physics 2019-05-23 Thomas Van Himbeeck , Stefano Pironio

Diffusion-based generative models have reformed generative AI, and also enabled new capabilities in the science domain, e.g., fast generation of 3D structures of molecules. In such tasks, there is often a symmetry in the system, identifying…

Machine Learning · Computer Science 2026-05-15 Yixian Xu , Yusong Wang , Shengjie Luo , Kaiyuan Gao , Tianyu He , Di He , Chang Liu

Causal discovery methods aim to infer causal direction from observational data. Functional causal discovery approaches use structural asymmetries to identify causal directionality but rely on strong modeling assumptions and provide limited…

Methodology · Statistics 2026-05-14 Shreya Prakash , Fan Xia , Elena A. Erosheva

Human-generated categorical annotations frequently produce empirical response distributions (soft labels) that reflect ambiguity rather than simple annotator error. We introduce an ambiguity measure that maps a discrete response…

Machine Learning · Computer Science 2025-10-07 Christopher Klugmann , Daniel Kondermann

The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…

Information Theory · Computer Science 2017-05-01 Maciej Skorski

Inverse design aims to find design parameters $x$ achieving target performance $y^*$. Generative approaches learn bidirectional mappings between designs and labels, enabling diverse solution sampling. However, standard conditional flow…

Machine Learning · Computer Science 2026-03-18 Miguel de Campos , Werner Krebs , Hanno Gottschalk

The inference of the causal relationship between a pair of observed variables is a fundamental problem in science, and most existing approaches are based on one single causal model. In practice, however, observations are often collected…

Machine Learning · Statistics 2018-11-13 Shoubo Hu , Zhitang Chen , Vahid Partovi Nia , Laiwan Chan , Yanhui Geng