English
Related papers

Related papers: When Documents Disagree: Measuring Institutional V…

200 papers

Extracting structured information from clinical notes requires navigating a dense web of interdependent variables where the value of one attribute logically constrains others. Existing Large Language Model (LLM)-based extraction pipelines…

Language models deployed in high-stakes professional settings face conflicting demands from users, institutional authorities, and professional norms. How models act when these demands conflict reveals a principal hierarchy -- an implicit…

Artificial Intelligence · Computer Science 2026-05-13 Fangyi Yu , Nabeel Seedat , Jonathan Richard Schwarz , Andrew M. Bean

We introduce VAREX (VARied-schema EXtraction), a benchmark for evaluating multimodal foundation models on structured data extraction from government forms. VAREX employs a Reverse Annotation pipeline that programmatically fills PDF…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Udi Barzelay , Ophir Azulai , Inbar Shapira , Idan Friedman , Foad Abo Dahood , Madison Lee , Abraham Daniels

Retrieval-augmented generation (RAG) is a promising paradigm, yet its trustworthiness remains a critical concern. A major vulnerability arises prior to generation: models often fail to balance parametric (internal) and retrieved (external)…

Computation and Language · Computer Science 2026-01-08 Xinbang Dai , Huikang Hu , Yuncheng Hua , Jiaqi Li , Yongrui Chen , Rihui Jin , Nan Hu , Guilin Qi

Large Language Models (LLMs) increasingly mediate access to scholarly information, yet their outputs are typically evaluated at the level of individual statements rather than knowledge structure. This paper introduces structural…

Social and Information Networks · Computer Science 2026-03-03 Moses Boudourides

Asking clarifying questions in response to ambiguous or faceted queries has been recognized as a useful technique for various information retrieval systems, especially conversational search systems with limited bandwidth interfaces.…

Information Retrieval · Computer Science 2020-06-16 Helia Hashemi , Hamed Zamani , W. Bruce Croft

The rapid growth of the large language model (LLM) ecosystem raises a critical question: are seemingly diverse models truly independent? Shared pretraining data, distillation, and alignment pipelines can induce hidden behavioral…

Artificial Intelligence · Computer Science 2026-04-10 Chenchen Kuai , Jiwan Jiang , Zihao Zhu , Hao Wang , Keshu Wu , Zihao Li , Yunlong Zhang , Chenxi Liu , Zhengzhong Tu , Zhiwen Fan , Yang Zhou

Vector search and retrieval-augmented generation (RAG) rest on the assumption that cosine similarity between text embeddings reflects conceptual relatedness. We measure where this assumption breaks. We build an augmented citation graph over…

Information Retrieval · Computer Science 2026-05-11 Junseon Yoo

Retrieval-augmented generation (RAG) based large language models (LLMs) are widely used in finance for their excellent performance on knowledge-intensive tasks. However, standardized documents (e.g., SEC filing) share similar formats such…

Information Retrieval · Computer Science 2025-11-07 Jaeyoung Choe , Jihoon Kim , Woohwan Jung

Expanding existing learning systems to provide high-quality customized models for more domains, such as new users, is challenged by the limited labeled data and the data and device heterogeneities. While knowledge distillation methods could…

Artificial Intelligence · Computer Science 2025-02-10 Gaole Dai , Huatao Xu , Yifan Yang , Rui Tan , Mo Li

Alignment techniques have become central to ensuring that Large Language Models (LLMs) generate outputs consistent with human values. However, existing alignment paradigms often model an averaged or monolithic preference, failing to account…

Computation and Language · Computer Science 2025-06-03 Anudeex Shetty , Amin Beheshti , Mark Dras , Usman Naseem

Large language models (LLMs) often need to balance their internal parametric knowledge with external information, such as user beliefs and content from retrieved documents, in real-world scenarios like RAG or chat-based systems. A model's…

Computation and Language · Computer Science 2026-04-27 Shuowei Li , Haoxin Li , Wenda Chu , Yi Fang

Understanding documents is central to many real-world tasks but remains a challenging topic. Unfortunately, there is no well-established consensus on how to comprehensively evaluate document understanding abilities, which significantly…

Computation and Language · Computer Science 2023-05-17 Ruoxi Xu , Hongyu Lin , Xinyan Guan , Xianpei Han , Yingfei Sun , Le Sun

High throughput sequencing is a technology that allows for the generation of millions of reads of genomic data regarding a study of interest, and data from high throughput sequencing platforms are usually count compositions. Subsequent…

Quantitative Methods · Quantitative Biology 2017-04-07 Jia R. Wu , Jean M. Macklaim , Briana L. Genge , Gregory B. Gloor

Deep learning has achieved significant breakthroughs in medical imaging, but these advancements are often dependent on large, well-annotated datasets. However, obtaining such datasets poses a significant challenge, as it requires…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Siteng Ma , Honghui Du , Yu An , Jing Wang , Qinqin Wang , Haochang Wu , Aonghus Lawlor , Ruihai Dong

In systems biology, it is common to measure biochemical entities at different levels of the same biological system. One of the central problems for the data fusion of such data sets is the heterogeneity of the data. This thesis discusses…

Genomics · Quantitative Biology 2019-08-27 Yipeng Song

Retrieval-augmented Generation (RAG) has demonstrated potential in enhancing medical question-answering systems through the integration of large language models (LLMs) with external medical literature. LLMs can retrieve relevant medical…

Computation and Language · Computer Science 2025-10-29 Mengzhou Sun , Sendong Zhao , Jianyu Chen , Haochun Wang , Bin Qin

Large language model (LLM) agents are increasingly employing retrieval-augmented generation (RAG) to improve the factuality of their responses. However, in practice, these systems often need to handle ambiguous user queries and potentially…

Computation and Language · Computer Science 2025-08-13 Han Wang , Archiki Prasad , Elias Stengel-Eskin , Mohit Bansal

Annotation pipelines in Natural Language Processing (NLP) commonly assume a single latent ground truth per instance and resolve disagreement through label aggregation. Perspectivist approaches challenge this view by treating disagreement as…

Computation and Language · Computer Science 2026-04-23 Olga Kellert , Sriya Kondury , Candice Koo , Nemika Tyagi , Steffen Eikenberry

Older adults commonly experience chronic conditions such as pain and sleep disturbances and may consider cannabidiol for symptom management. Safe use requires appropriate dosing, careful titration, and awareness of drug interactions, yet…

Information Retrieval · Computer Science 2026-04-14 Ali Abedi , Charlene H. Chu , Shehroz S. Khan