English
Related papers

Related papers: Information Theoretic Counterfactual Learning from…

200 papers

Multilingual information retrieval (IR) is challenging since annotated training data is costly to obtain in many languages. We present an effective method to train multilingual IR systems when only English IR training data and some parallel…

Information Retrieval · Computer Science 2023-05-29 Xiyang Hu , Xinchi Chen , Peng Qi , Deguang Kong , Kunlun Liu , William Yang Wang , Zhiheng Huang

In this work, we propose Cell Variational Information Bottleneck Network (cellVIB), a convolutional neural network using information bottleneck mechanism, which can be combined with the latest feedforward network architecture in an…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Zhonghua Zhai , Chen Ju , Jinsong Lan , Shuai Xiao

Large Language Models demonstrate strong capabilities in single-turn instruction following but suffer from Lost-in-Conversation (LiC), a degradation in performance as information is revealed progressively in multi-turn settings. Motivated…

Computation and Language · Computer Science 2026-05-01 Ming Li , Pei Chen , Zhenhao Zhang , Tao Yang , Xinyang Zhang , Han Li , Tianyu Cao , Ming Zeng , Zhuofeng Wu , Meng Jiang , Huasheng Li , Lihong Li , Bing Yin

Estimating treatment effects over time holds significance in various domains, including precision medicine, epidemiology, economy, and marketing. This paper introduces a unique approach to counterfactual regression over time, emphasizing…

Machine Learning · Computer Science 2024-10-30 Mouad El Bouchattaoui , Myriam Tami , Benoit Lepetit , Paul-Henry Cournède

Missing data occur frequently in empirical studies in health and social sciences, often compromising our ability to make accurate inferences. An outcome is said to be missing not at random (MNAR) if, conditional on the observed variables,…

Methodology · Statistics 2019-01-23 BaoLuo Sun , Lan Liu , Wang Miao , Kathleen Wirth , James Robins , Eric Tchetgen Tchetgen

Learning-to-rank (LTR) algorithms are ubiquitous and necessary to explore the extensive catalogs of media providers. To avoid the user examining all the results, its preferences are used to provide a subset of relatively small size. The…

When estimating heterogeneous treatment effects, missing outcome data can complicate treatment effect estimation, causing certain subgroups of the population to be poorly represented. In this work, we discuss this commonly overlooked…

Machine Learning · Statistics 2025-04-15 Matthew Pryce , Karla Diaz-Ordaz , Ruth H. Keogh , Stijn Vansteelandt

Contrastive learning has emerged as a cornerstone in recent achievements of unsupervised representation learning. Its primary paradigm involves an instance discrimination task with a mutual information loss. The loss is known as InfoNCE and…

Artificial Intelligence · Computer Science 2023-08-31 Kyungeun Lee , Jaeill Kim , Suhyun Kang , Wonjong Rhee

Information bottleneck (IB) is a method for extracting information from one random variable $X$ that is relevant for predicting another random variable $Y$. To do so, IB identifies an intermediate "bottleneck" variable $T$ that has low…

Machine Learning · Statistics 2022-11-22 Artemy Kolchinsky , Brendan D. Tracey , Steven Van Kuyk

In recent several years, the information bottleneck (IB) principle provides an information-theoretic framework for deep multi-view clustering (MVC) by compressing multi-view observations while preserving the relevant information of multiple…

Information Theory · Computer Science 2024-03-26 Xiaoqiang Yan , Zhixiang Jin , Fengshou Han , Yangdong Ye

We study offline recommender learning from explicit rating feedback in the presence of selection bias. A current promising solution for the bias is the inverse propensity score (IPS) estimation. However, the performance of existing…

Machine Learning · Statistics 2022-04-22 Yuta Saito , Masahiro Nomura

In real-world scenarios, risk-averse learning is valuable for mitigating potential adverse outcomes. However, the delayed feedback makes it challenging to assess and manage risk effectively. In this paper, we investigate risk-averse…

Machine Learning · Computer Science 2025-08-06 Siyi Wang , Zifan Wang , Karl Henrik Johansson , Sandra Hirche

Learning to Rank (LTR) from user interactions is challenging as user feedback often contains high levels of bias and noise. At the moment, two methodologies for dealing with bias prevail in the field of LTR: counterfactual methods that…

Information Retrieval · Computer Science 2019-07-16 Rolf Jagerman , Harrie Oosterhuis , Maarten de Rijke

Counterfactual inference aims to estimate the counterfactual outcome at the individual level given knowledge of an observed treatment and the factual outcome, with broad applications in fields such as epidemiology, econometrics, and…

Machine Learning · Computer Science 2025-10-06 Peng Wu , Haoxuan Li , Chunyuan Zheng , Yan Zeng , Jiawei Chen , Yang Liu , Ruocheng Guo , Kun Zhang

In machine learning we often try to optimise a decision rule that would have worked well over a historical dataset; this is the so called empirical risk minimisation principle. In the context of learning from recommender system logs,…

Information Retrieval · Computer Science 2019-09-19 Olivier Jeunen , Dmytro Mykhaylov , David Rohde , Flavian Vasile , Alexandre Gilotte , Martin Bompaire

Data-driven decision making frequently relies on predicting counterfactual outcomes. In practice, researchers commonly train counterfactual prediction models on a source dataset to inform decisions on a possibly separate target population.…

Machine Learning · Statistics 2026-04-07 Keith Barnatchez , Kevin P. Josey , Rachel C. Nethery , Giovanni Parmigiani

Metal artefact reduction (MAR) techniques aim at removing metal-induced noise from clinical images. In Computed Tomography (CT), supervised deep learning approaches have been shown effective but limited in generalisability, as they mostly…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Marta B. M. Ranzini , Irme Groothuis , Kerstin Kläser , M. Jorge Cardoso , Johann Henckel , Sébastien Ourselin , Alister Hart , Marc Modat

As the core of the Knowledge Tracking (KT) task, assessing students' dynamic mastery of knowledge concepts is crucial for both offline teaching and online educational applications. Since students' mastery of knowledge concepts is often…

Artificial Intelligence · Computer Science 2023-09-06 Moyu Zhang , Xinning Zhu , Chunhong Zhang , Wenchen Qian , Feng Pan , Hui Zhao

Real-word search and recommender systems usually adopt a multi-stage ranking architecture, including matching, pre-ranking, ranking, and re-ranking. Previous works mainly focus on the ranking stage while very few focus on the pre-ranking…

Information Retrieval · Computer Science 2022-07-08 Yue Cao , XiaoJiang Zhou , Peihao Huang , Yao Xiao , Dayao Chen , Sheng Chen

Knowledge tracing (KT) plays a crucial role in computer-aided education and intelligent tutoring systems, aiming to assess students' knowledge proficiency by predicting their future performance on new questions based on their past response…

Computers and Society · Computer Science 2024-06-03 Jiajun Cui , Minghe Yu , Bo Jiang , Aimin Zhou , Jianyong Wang , Wei Zhang