English
Related papers

Related papers: Algebraic Properties of Wyner Common Information S…

200 papers

This paper investigates score-based diffusion models when the underlying target distribution is concentrated on or near low-dimensional manifolds within the higher-dimensional space in which they formally reside, a common characteristic of…

Machine Learning · Computer Science 2025-01-03 Gen Li , Yuling Yan

This paper considers a challenging problem of identifying a causal graphical model under the presence of latent variables. While various identifiability conditions have been proposed in the literature, they often require multiple pure…

Machine Learning · Statistics 2026-02-03 Seunghyun Lee , Yuqi Gu

We consider linear models where $d$ potential causes $X_1,...,X_d$ are correlated with one target quantity $Y$ and propose a method to infer whether the association is causal or whether it is an artifact caused by overfitting or hidden…

Machine Learning · Statistics 2018-03-05 Dominik Janzing , Bernhard Schoelkopf

The problem of minimizing a multilinear function of binary variables is a well-studied NP-hard problem. The set of solutions of the standard linearization of this problem is called the multilinear set. We study a cardinality constrained…

Optimization and Control · Mathematics 2021-08-31 Rui Chen , Sanjeeb Dash , Oktay Gunluk

Causal inference quantifies cause-effect relationships by estimating counterfactual parameters from data. This entails using \emph{identification theory} to establish a link between counterfactual parameters of interest and distributions…

Machine Learning · Statistics 2020-04-17 Jaron J. R. Lee , Ilya Shpitser

Community is a fundamental and critical characteristic of an undirected social network, making community detection be a vital yet thorny issue in network representation learning. A symmetric and non-negative matrix factorization (SNMF)…

Social and Information Networks · Computer Science 2023-02-24 Zhigang Liu , Xin Luo

Graphs are a popular data type found in many domains. Numerous techniques have been proposed to find interesting patterns in graphs to help understand the data and support decision-making. However, there are generally two limitations that…

Artificial Intelligence · Computer Science 2022-04-28 Jiahong Liu , Min Zhou , Philippe Fournier-Viger , Menglin Yang , Lujia Pan , Mourad Nouioua

The path to the solution of Feder-Vardi dichotomy conjecture by Bulatov and Zhuk led through showing that more and more general algebraic conditions imply polynomial-time algorithms for the finite-domain Constraint Satisfaction Problems…

Computational Complexity · Computer Science 2025-02-05 Tomáš Nagy , Michael Pinsker , Michał Wrona

In this paper, we study a class of optimization problems, called Mathematical Programs with Cardinality Constraints (MPCaC). This kind of problem is generally difficult to deal with, because it involves a constraint that is not continuous…

Optimization and Control · Mathematics 2020-08-04 Evelin H. M. Krulikovski , Ademir A. Ribeiro , Mael Sachine

The solution of probabilistic inverse problems for which the corresponding forward problem is constrained by physical principles is challenging. This is especially true if the dimension of the inferred vector is large and the prior…

Machine Learning · Statistics 2023-06-09 Deep Ray , Javier Murgoitio-Esandi , Agnimitra Dasgupta , Assad A. Oberai

This work aims to address the long-established problem of learning diversified representations. To this end, we combine information-theoretic arguments with stochastic competition-based activations, namely Stochastic Local Winner-Takes-All…

Machine Learning · Computer Science 2022-01-12 Konstantinos P. Panousis , Anastasios Antoniadis , Sotirios Chatzis

The inference of causal relationships using observational data from partially observed multivariate systems with hidden variables is a fundamental question in many scientific domains. Methods extracting causal information from conditional…

Machine Learning · Statistics 2020-10-13 Daniel Chicharro , Michel Besserve , Stefano Panzeri

The conventional Cohen's distribution can't meet the requirement of additive noises jamming signals high-performance denoising under the condition of low signal-to-noise ratio, it is necessary to integrate the metaplectic transform for…

Signal Processing · Electrical Eng. & Systems 2024-08-09 Manjun Cui , Zhichao Zhang , Jie Han , Yunjie Chen , Chunzheng Cao

This paper is concerned with the variational problem for the elastic energy defined on symmetric graphs under the unilateral constraint. Assuming that the obstacle function satisfies the symmetric cone condition, we prove (i) uniqueness of…

Analysis of PDEs · Mathematics 2022-08-10 Kensuke Yoshizawa

An important problem in causal inference is to break down the total effect of a treatment on an outcome into different causal pathways and to quantify the causal effect in each pathway. For instance, in causal fairness, the total effect of…

Machine Learning · Statistics 2022-01-10 Lu Cheng , Ruocheng Guo , Huan Liu

Explicit constructions of polar codes and polar lattices for both lossless and lossy Gray-Wyner problems are studied. Polar codes are employed to extract Wyner's common information of doubly symmetric binary source; polar lattices are then…

Information Theory · Computer Science 2016-10-26 Jinwen Shi , Ling Liu , Cong Ling

In this work, we investigate the expressiveness of the "conditional mutual information" (CMI) framework of Steinke and Zakynthinou (2020) and the prospect of using it to provide a unified framework for proving generalization bounds in the…

Information Theory · Computer Science 2021-11-18 Mahdi Haghifam , Gintare Karolina Dziugaite , Shay Moran , Daniel M. Roy

We design a low complexity distributed compression scheme for computing arbitrary functions of sources with discrete alphabets. We use a helper-based method that extends the definition of the G{\'a}cs-K{\"o}rner-Witsenhausen (GKW) common…

Information Theory · Computer Science 2021-04-01 Derya Malak

We investigate whether neighbor-density-weighted marked correlation functions (MCFs) can extract cosmological information beyond the standard redshift-space two-point correlation function (2PCF). Using the Kun suite of 129 $w_0w_a$CDM$+\sum…

Cosmology and Nongalactic Astrophysics · Physics 2026-05-25 Xu Xiao , Xiao-Dong Li , Yiqi Huang , Le Zhang

Problems such as predicting a new shading field (Y) for an image (X) are ambiguous: many very distinct solutions are good. Representing this ambiguity requires building a conditional model P(Y|X) of the prediction, conditioned on the image.…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Jiajun Lu , Aditya Deshpande , David Forsyth