English
Related papers

Related papers: Causally-Aware Information Bottleneck for Domain A…

200 papers

Using both observational and experimental data, a causal discovery process can identify the causal relationships between variables. A unique adaptive intervention design paradigm is presented in this work, where causal directed acyclic…

Machine Learning · Computer Science 2025-05-12 Abdelmonem Elrefaey , Rong Pan

Latent world models allow agents to reason about complex environments with high-dimensional observations. However, adapting to new environments and effectively leveraging previous knowledge remain significant challenges. We present…

Machine Learning · Computer Science 2022-06-23 Anson Lei , Bernhard Schölkopf , Ingmar Posner

Determining causes of deaths (COD) occurred outside of civil registration and vital statistics systems is challenging. A technique called verbal autopsy (VA) is widely adopted to gather information on deaths in practice. A VA consists of…

Methodology · Statistics 2021-12-22 Zhenke Wu , Zehang Richard Li , Irena Chen , Mengbing Li

In this paper, we propose Binarized Change Detection (BiCD), the first binary neural network (BNN) designed specifically for change detection. Conventional network binarization approaches, which directly quantize both weights and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Kaijie Yin , Zhiyuan Zhang , Shu Kong , Tian Gao , Chengzhong Xu , Hui Kong

In this paper, we develop an unsupervised generative clustering framework that combines the Variational Information Bottleneck and the Gaussian Mixture Model. Specifically, in our approach, we use the Variational Information Bottleneck…

Machine Learning · Computer Science 2020-04-22 Yigit Ugur , George Arvanitakis , Abdellatif Zaidi

Unsupervised domain adaptation (UDA) deals with the problem of classifying unlabeled target domain data while labeled data is only available for a different source domain. Unfortunately, commonly used classification methods cannot fulfill…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Tobias Ringwald , Rainer Stiefelhagen

Structural learning, which aims to learn directed acyclic graphs (DAGs) from observational data, is foundational to causal reasoning and scientific discovery. Recent advancements formulate structural learning into a continuous optimization…

Machine Learning · Computer Science 2023-04-18 Song Wei , Yao Xie

We consider the problem of learning causal Directed Acyclic Graphs (DAGs) using combinations of observational and interventional experimental data. Current methods tailored to this setting assume that interventions either destroy…

Methodology · Statistics 2023-12-04 Alessandro Mascaro , Federico Castelletti

Multi-task learning (MTL) is an important subject in machine learning and artificial intelligence. Its applications to computer vision, signal processing, and speech recognition are ubiquitous. Although this subject has attracted…

Machine Learning · Computer Science 2021-03-02 Weizhu Qian , Bowei Chen , Yichao Zhang , Guanghui Wen , Franck Gechter

Data scarcity is a tremendous challenge in causal effect estimation. In this paper, we propose to exploit additional data sources to facilitate estimating causal effects in the target population. Specifically, we leverage additional source…

Machine Learning · Computer Science 2021-06-01 Thanh Vinh Vo , Pengfei Wei , Trong Nghia Hoang , Tze-Yun Leong

Causal representation learning is the task of identifying the underlying causal variables and their relations from high-dimensional observations, such as images. Recent work has shown that one can reconstruct the causal variables from…

Machine Learning · Computer Science 2023-03-09 Phillip Lippe , Sara Magliacane , Sindy Löwe , Yuki M. Asano , Taco Cohen , Efstratios Gavves

Information Bottleneck (IB) is a technique to extract information about one target random variable through another relevant random variable. This technique has garnered significant interest due to its broad applications in information…

Information Theory · Computer Science 2024-04-09 Lingyi Chen , Shitong Wu , Jiachuan Ye , Huihui Wu , Wenyi Zhang , Hao Wu

The standard closed-set domain adaptation approaches seek to mitigate distribution discrepancies between two domains under the constraint of both sharing identical label sets. However, in realistic scenarios, finding an optimal source…

Machine Learning · Computer Science 2022-12-06 Sandipan Choudhuri , Suli Adeniye , Arunabha Sen , Hemanth Venkateswara

Graph data is becoming increasingly prevalent due to the growing demand for relational insights in AI across various domains. Organizations regularly use graph data to solve complex problems involving relationships and connections. Causal…

Machine Learning · Computer Science 2026-02-23 Simi Job , Xiaohui Tao , Taotao Cai , Haoran Xie , Jianming Yong , Xin Wang

Domain adaptive text classification is a challenging problem for the large-scale pretrained language models because they often require expensive additional labeled data to adapt to new domains. Existing works usually fails to leverage the…

Computation and Language · Computer Science 2022-06-22 Tian Li , Xiang Chen , Zhen Dong , Weijiang Yu , Yijun Yan , Kurt Keutzer , Shanghang Zhang

A central problem in unsupervised domain adaptation is determining what to transfer from labeled source domains to an unlabeled target domain. To handle high-dimensional observations (e.g., images), a line of approaches use deep learning to…

Machine Learning · Computer Science 2026-04-28 Ignavier Ng , Yan Li , Zijian Li , Yujia Zheng , Guangyi Chen , Kun Zhang

Querying causal effects from time-series data is important across various fields, including healthcare, economics, climate science, and epidemiology. However, this task becomes complex in the existence of time-varying latent confounders,…

Machine Learning · Computer Science 2024-11-28 Debo Cheng , Ziqi Xu , Jiuyong Li , Lin Liu , Thuc duy Le , Xudong Guo , Shichao Zhang

Causal discovery aims to infer causal relationships among variables from observational data, typically represented by a directed acyclic graph (DAG). Most existing methods assume independent and identically distributed observations, an…

Methodology · Statistics 2026-03-27 Alex Chen , Qing Zhou

Deep neural networks typically learn spatially entangled representations that conflate discriminative foreground features with spurious background correlations, thereby undermining model interpretability and robustness. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Kaixiang Shu , Kai Meng , Junqin Luo

The Information Bottleneck (IB) principle offers a compelling theoretical framework to understand how neural networks (NNs) learn. However, its practical utility has been constrained by unresolved theoretical ambiguities and significant…

Machine Learning · Computer Science 2026-02-02 Charles Westphal , Stephen Hailes , Mirco Musolesi