English
Related papers

Related papers: Quantifying and Improving the Robustness of Retrie…

200 papers

The advent of Vision-Language Models (VLMs) in medical image analysis has the potential to help process multimodal inputs and increase performance over traditional inference methods. However, when considering the domain in which these…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Sparsh Bansal , Mingyang Wu , Xin Wang , Shu Hu

Retrieval-Augmented Generation (RAG) has been shown to enhance the factual accuracy of Large Language Models (LLMs), but existing methods often suffer from limited reasoning capabilities in effectively using the retrieved evidence,…

Computation and Language · Computer Science 2024-10-03 Shayekh Bin Islam , Md Asib Rahman , K S M Tozammel Hossain , Enamul Hoque , Shafiq Joty , Md Rizwan Parvez

Sparse autoencoders (SAEs) are commonly used to interpret the internal activations of large language models (LLMs) by mapping them to human-interpretable concept representations. While existing evaluations of SAEs focus on metrics such as…

Machine Learning · Computer Science 2026-01-26 Aaron J. Li , Suraj Srinivas , Usha Bhalla , Himabindu Lakkaraju

Large Language Models (LLMs) deployed on edge devices learn through fine-tuning and updating a certain portion of their parameters. Although such learning methods can be optimized to reduce resource utilization, the overall required…

Machine Learning · Computer Science 2024-05-09 Ruiyang Qin , Zheyu Yan , Dewen Zeng , Zhenge Jia , Dancheng Liu , Jianbo Liu , Zhi Zheng , Ningyuan Cao , Kai Ni , Jinjun Xiong , Yiyu Shi

Retrieval-Augmented Generation (RAG) is a technique that enhances the capabilities of large language models (LLMs) by incorporating external knowledge sources. This method addresses common LLM limitations, including outdated information and…

Computation and Language · Computer Science 2024-07-16 Yuanjie Lyu , Zhiyu Li , Simin Niu , Feiyu Xiong , Bo Tang , Wenjin Wang , Hao Wu , Huanyong Liu , Tong Xu , Enhong Chen

Deep neural networks often exploit *spurious* features that are present in the majority of examples within a class during training. This leads to *poor worst-group test accuracy*, i.e., poor accuracy for minority groups that lack these…

Machine Learning · Computer Science 2025-04-18 Siddharth Joshi , Yu Yang , Yihao Xue , Wenhan Yang , Baharan Mirzasoleiman

Machine learning models are known to learn spurious correlations, i.e., features having strong relations with class labels but no causal relation. Relying on those correlations leads to poor performance in the data groups without these…

Machine Learning · Computer Science 2026-04-28 Phuong Quynh Le , Jörg Schlötterer , Christin Seifert

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating their parametric knowledge with external retrieved content. However, knowledge conflicts caused by internal inconsistencies or noisy retrieved content…

Computation and Language · Computer Science 2025-07-03 Juan Chen , Baolong Bi , Wei Zhang , Jingyan Sui , Xiaofei Zhu , Yuanzhuo Wang , Lingrui Mei , Shenghua Liu

Having a clean dataset has been the foundational assumption of most natural language processing (NLP) systems. However, properly written text is rarely found in real-world scenarios and hence, oftentimes invalidates the aforementioned…

Computation and Language · Computer Science 2025-10-08 Ayush Singh , Navpreet Singh , Shubham Vatsal

Robust Anomaly Detection (AD) on time series data is a key component for monitoring many complex modern systems. These systems typically generate high-dimensional time series that can be highly noisy, seasonal, and inter-correlated. This…

Machine Learning · Computer Science 2020-07-29 Farzaneh Khoshnevisan , Zhewen Fan , Vitor R. Carvalho

User authentication and fraud detection face growing challenges as digital systems expand and adversaries adopt increasingly sophisticated tactics. Traditional knowledge-based authentication remains rigid, requiring exact word-for-word…

Cryptography and Security · Computer Science 2026-04-29 Emunah S-S. Chan , Aldar C-F. Chan

Despite the rapid development of machine learning algorithms for domain generalization (DG), there is no clear empirical evidence that the existing DG algorithms outperform the classic empirical risk minimization (ERM) across standard…

Machine Learning · Computer Science 2024-03-19 Rui Qiao , Bryan Kian Hsiang Low

While large language models (LLMs) demonstrate impressive capabilities, their reliance on parametric knowledge often leads to factual inaccuracies. Retrieval-Augmented Generation (RAG) mitigates this by leveraging external documents, yet…

Computation and Language · Computer Science 2025-10-07 Lingnan Xu , Chong Feng , Kaiyuan Zhang , Liu Zhengyong , Wenqiang Xu , Fanqing Meng

Logic provides a controlled testbed for evaluating LLM-based reasoners, yet standard SAT-style benchmarks often conflate surface difficulty (length, wording, clause order) with the structural phenomena that actually determine…

Artificial Intelligence · Computer Science 2026-02-16 Naïm Es-sebbani , Esteban Marquer , Yakoub Salhi , Zied Bouraoui

Recent research in speaker verification has increasingly focused on achieving robust and reliable recognition under challenging channel conditions and noisy environments. Identifying speakers in radio communications is particularly…

Sound · Computer Science 2024-06-18 Wenhao Yang , Jianguo Wei , Wenhuan Lu , Lei Li , Xugang Lu

Retrieval-Augmented Generation (RAG) is a critical technique for grounding Large Language Models (LLMs) in factual evidence, yet evaluating RAG systems in specialized, safety-critical domains remains a significant challenge. Existing…

Computation and Language · Computer Science 2025-11-07 Joshua Gao , Quoc Huy Pham , Subin Varghese , Silwal Saurav , Vedhus Hoskere

Randomized smoothing has shown promising certified robustness against adversaries in classification tasks. Despite such success with only zeroth-order access to base models, randomized smoothing has not been extended to a general form of…

Machine Learning · Computer Science 2024-05-16 Aref Miri Rekavandi , Olga Ohrimenko , Benjamin I. P. Rubinstein

Multimodal Large Language Models demonstrate strong performance on multimodal benchmarks, yet often exhibit poor robustness when exposed to spurious modality interference, such as irrelevant text in vision understanding, or irrelevant…

Machine Learning · Computer Science 2026-01-30 Rui Cai , Bangzheng Li , Xiaofei Wen , Muhao Chen , Zhe Zhao

Large Language Models (LLMs) have demonstrated remarkable performance across various tasks by effectively utilizing a prompting strategy. However, they are highly sensitive to input perturbations, such as typographical errors or slight…

Computation and Language · Computer Science 2026-05-27 Lin Mu , Guowei Chu , Li Ni , Lei Sang , Yiwen Zhang

Retrieval-Augmented Generation (RAG) delivers substantial value in knowledge-intensive applications. However, its generated responses often lack transparent reasoning paths that trace back to source evidence from retrieved documents. This…

Computation and Language · Computer Science 2026-01-30 Jingyi Ren , Yekun Xu , Xiaolong Wang , Weitao Li , Ante Wang , Weizhi Ma , Yang Liu