English
Related papers

Related papers: Least Information Modeling for Information Retriev…

200 papers

This paper introduces a novel iterative method for missing data imputation that sequentially reduces the mutual information between data and the corresponding missingness mask. Inspired by GAN-based approaches that train generators to…

Machine Learning · Statistics 2025-11-26 Jiahao Yu , Qizhen Ying , Leyang Wang , Ziyue Jiang , Song Liu

Contemporary theories model language processing as integrating both top-down expectations and bottom-up inputs. One major prediction of such models is that the quality of the bottom-up inputs modulates ease of processing -- noisy inputs…

Computation and Language · Computer Science 2025-10-28 Cui Ding , Yanning Yin , Lena A. Jäger , Ethan Gotlieb Wilcox

Unmeasured covariates constitute one of the important problems in causal inference. Even if there are some unmeasured covariates, some instrumental variable methods such as a two-stage residual inclusion (2SRI) estimator, or a…

Methodology · Statistics 2021-12-30 Shunichiro Orihara

Scientific computer simulations cannot represent all scales in realistic applications. To bridge this model-data gap, parameters are injected into models and constrained with noisy data using Bayesian inversion. To reduce the number of…

Computation · Statistics 2026-05-22 Arne Bouillon , Oliver R. A. Dunbar

The main contribution of this paper is to design an Information Retrieval (IR) technique based on Algorithmic Information Theory (using the Normalized Compression Distance- NCD), statistical techniques (outliers), and novel organization of…

Information Retrieval · Computer Science 2016-11-17 Rafael Martinez , Manuel Cebrian , Francisco de Borja Rodriguez , David Camacho

Information Retrieval (IR) is the task of obtaining pieces of data (such as documents) that are relevant to a particular query or need from a large repository of information. IR is a valuable component of several downstream Natural Language…

Information Retrieval · Computer Science 2020-08-05 Samarth Rawal

This paper proposes a new principled multi-task representation learning framework (InfoMTL) to extract noise-invariant sufficient representations for all tasks. It ensures sufficiency of shared representations for all tasks and mitigates…

Computation and Language · Computer Science 2025-03-07 Dou Hu , Lingwei Wei , Wei Zhou , Songlin Hu

This paper provides a unified account of two schools of thinking in information retrieval modelling: the generative retrieval focusing on predicting relevant documents given a query, and the discriminative retrieval focusing on predicting…

Information Retrieval · Computer Science 2018-02-23 Jun Wang , Lantao Yu , Weinan Zhang , Yu Gong , Yinghui Xu , Benyou Wang , Peng Zhang , Dell Zhang

This study investigates the position bias in information retrieval, where models tend to overemphasize content at the beginning of passages while neglecting semantically relevant information that appears later. To analyze the extent and…

Information Retrieval · Computer Science 2025-09-19 Ziyang Zeng , Dun Zhang , Jiacheng Li , Panxiang Zou , Yudong Zhou , Yuqing Yang

The rapid growth of encryption has significantly enhanced privacy and security while posing challenges for network traffic classification. Recent approaches address these challenges by transforming network traffic into text or image formats…

Cryptography and Security · Computer Science 2025-02-05 Nimesha Wickramasinghe , Arash Shaghaghi , Elena Ferrari , Sanjay Jha

As more content generated by large language models (LLMs) floods into the Internet, information retrieval (IR) systems now face the challenge of distinguishing and handling a blend of human-authored and machine-generated texts. Recent…

Information Retrieval · Computer Science 2025-08-26 Wei Huang , Keping Bi , Yinqiong Cai , Wei Chen , Jiafeng Guo , Xueqi Cheng

Exponential models of distributions are widely used in machine learning for classiffication and modelling. It is well known that they can be interpreted as maximum entropy models under empirical expectation constraints. In this work, we…

Machine Learning · Computer Science 2012-07-19 Amir Globerson , Naftali Tishby

Logical Probability (LP) is strictly distinguished from Statistical Probability (SP). To measure semantic information or confirm hypotheses, we need to use sampling distribution (conditional SP function) to test or confirm fuzzy truth…

Information Theory · Computer Science 2016-09-27 Cheguang Lu

Document indexing is a key component for efficient information retrieval (IR). After preprocessing steps such as stemming and stop-word removal, document indexes usually store term-frequencies (tf). Along with tf (that only reflects the…

Information Retrieval · Computer Science 2020-04-29 Jibril Frej , Phillipe Mulhem , Didier Schwab , Jean-Pierre Chevallet

Question Answering (QA) tasks requiring information from multiple documents often rely on a retrieval model to identify relevant information for reasoning. The retrieval model is typically trained to maximize the likelihood of the labeled…

Computation and Language · Computer Science 2021-09-10 Ansong Ni , Matt Gardner , Pradeep Dasigi

A typical IR system that delivers and stores information is affected by problem of matching between user query and available content on web. Use of Ontology represents the extracted terms in form of network graph consisting of nodes, edges,…

Information Retrieval · Computer Science 2017-03-23 Gagandeep Singh Narula , Vishal Jain

Information Retrieval (IR) is an important application area of Natural Language Processing (NLP) where one encounters the genuine challenge of processing large quantities of unrestricted natural language text. While much effort has been…

cmp-lg · Computer Science 2008-02-03 Chengxiang Zhai

Many computational linguistic methods have been proposed to study the information content of languages. We consider two interesting research questions: 1) how is information distributed over long documents, and 2) how does content…

Computation and Language · Computer Science 2023-09-13 Shaoxiong Ji , Wei Sun , Pekka Marttinen

Framing bias plays a significant role in exacerbating political polarization by distorting the perception of actual events. Media outlets with divergent political stances often use polarized language in their reporting of the same event. We…

Computation and Language · Computer Science 2023-11-06 Yejin Bang , Nayeon Lee , Pascale Fung

Eliciting information to reduce uncertainty about a latent entity is a critical task in many application domains, e.g., assessing individual student learning outcomes, diagnosing underlying diseases, or learning user preferences. Though…

Computation and Language · Computer Science 2025-07-10 Jimmy Wang , Thomas Zollo , Richard Zemel , Hongseok Namkoong