中文
相关论文

相关论文: All Leaks Count, Some Count More: Interpretable Te…

200 篇论文

Large language models (LLMs) frequently generate confident yet inaccurate responses, introducing significant risks for deployment in safety-critical domains. We present a novel, test-time approach to detecting model hallucination through…

机器学习 · 计算机科学 2025-10-07 Hazel Kim , Tom A. Lamb , Adel Bibi , Philip Torr , Yarin Gal

Recent observations have underscored a disparity between the inflated benchmark scores and the actual performance of LLMs, raising concerns about potential contamination of evaluation benchmarks. This issue is especially critical for…

计算与语言 · 计算机科学 2024-04-05 Chunyuan Deng , Yilun Zhao , Xiangru Tang , Mark Gerstein , Arman Cohan

Data contamination undermines the validity of Large Language Model evaluation by enabling models to rely on memorized benchmark content rather than true generalization. While prior work has proposed contamination detection methods, these…

计算与语言 · 计算机科学 2026-01-22 Chaymaa Abbas , Nour Shamaa , Mariette Awad

The $\textit{LLM-as-a-judge}$ paradigm has become the operational backbone of automated AI evaluation pipelines, yet rests on an unverified assumption: that judges evaluate text strictly on its semantic content, impervious to surrounding…

人工智能 · 计算机科学 2026-04-17 Manan Gupta , Inderjeet Nair , Lu Wang , Dhruv Kumar

Large language models (LLMs) suffer from high inference latency due to the auto-regressive decoding process. Speculative decoding accelerates inference by generating multiple draft tokens using a lightweight model and verifying them in…

机器学习 · 计算机科学 2025-05-27 Yixuan Wang , Yijun Liu , Shiyu ji , Yuzhuang Xu , Yang Xu , Qingfu Zhu , Wanxiang Che

Scientific texts often convey authority due to their technical language and complex data. However, this complexity can sometimes lead to the spread of misinformation. Non-experts are particularly susceptible to misleading claims based on…

We present a variant of ATL with distributed knowledge operators based on a synchronous and perfect recall semantics. The coalition modalities in this logic are based on partial observation of the full history, and incorporate a form of…

计算机科学中的逻辑 · 计算机科学 2010-08-11 Cătălin Dima , Constantin Enea , Dimitar Guelev

Despite their success, Large-Language Models (LLMs) still face criticism due to their lack of interpretability. Traditional post-hoc interpretation methods, based on attention and gradient-based analysis, offer limited insights as they only…

In machine learning, contamination refers to situations where testing data leak into the training set. The issue is particularly relevant for the evaluation of the performance of Large Language Models (LLMs), which are generally trained on…

计算与语言 · 计算机科学 2025-06-23 Nicolas Yax , Pierre-Yves Oudeyer , Stefano Palminteri

Large language models confidently produce outdated answers, and no existing method can detect them. We show this is not an engineering failure but a structural one: temporal drift, whether a stored fact has changed since training, is…

人工智能 · 计算机科学 2026-05-12 Rania Elbadry , Ahmed Heakl , Fan Zhang , Dani Bouch , Yuxia Wang , Preslav Nakov , Zhuohan Xie

LLMs show strong performance in code generation, but their outputs lack correctness guarantees. Sample-based uncertainty estimators address this by generating multiple candidate programs and measuring their disagreement. However, existing…

软件工程 · 计算机科学 2026-05-12 Weilin He , Arindam Sharma , Cristina David

As generated text becomes more commonplace, it is increasingly important to evaluate how well-supported such text is by external knowledge sources. Many approaches for evaluating textual support rely on some method for decomposing text into…

计算与语言 · 计算机科学 2024-03-19 Miriam Wanner , Seth Ebner , Zhengping Jiang , Mark Dredze , Benjamin Van Durme

The advent of tool-using LLM agents shifts safety monitoring from output moderation to auditing long, noisy interaction trajectories, where risk-critical evidence is sparse-making standard binary supervision poorly suited for credit…

机器学习 · 计算机科学 2026-04-07 Lin Wang , Junfeng Fang , Dan Zhang , Fei Shen , Xiang Wang , Tat-Seng Chua

Anti-money laundering (AML) transaction monitoring generates large volumes of alerts that must be rapidly triaged by investigators under strict audit and governance constraints. While large language models (LLMs) can summarize heterogeneous…

人工智能 · 计算机科学 2026-04-23 Dorothy Torres , Wei Cheng , Ke Hu

In long conversations, an LLM can produce a next utterance that sounds plausible but rests on premises the conversation has already abandoned. Context-manipulation attacks against deployed agents now actively exploit this gap. We close it…

人工智能 · 计算机科学 2026-05-15 Qisong He , Yi Dong , Xiaowei Huang

We introduce time-to-unsafe-sampling, a novel safety measure for generative models, defined as the number of generations required by a large language model (LLM) to trigger an unsafe (e.g., toxic) response. While providing a new dimension…

机器学习 · 计算机科学 2026-02-17 Hen Davidov , Shai Feldman , Gilad Freidkin , Yaniv Romano

Arguments are a fundamental aspect of human reasoning, in which claims are supported, challenged, and weighed against one another. We present an end-to-end large language model (LLM)-based system for reconstructing arguments from natural…

计算与语言 · 计算机科学 2026-05-20 Paulo Pirozelli , Victor Hugo Nascimento Rocha , Fabio G. Cozman , Douglas Aldred

LLM-based financial agents have attracted widespread excitement for their ability to trade like human experts. However, most systems exhibit a "profit mirage": dazzling back-tested returns evaporate once the model's knowledge window ends,…

人工智能 · 计算机科学 2025-10-10 Xiangyu Li , Yawen Zeng , Xiaofen Xing , Jin Xu , Xiangmin Xu

Modern large language model (LLM) inference engines optimize throughput and latency under fixed decoding rules, treating generation as a linear progression in token time. We propose a fundamentally different paradigm: entropic\-time…

计算与语言 · 计算机科学 2026-03-05 Andrew Kiruluta

Machine learning (ML) explainability is central to algorithmic transparency in high-stakes settings such as predictive diagnostics and loan approval. However, these same domains require rigorous privacy guaranties, creating tension between…

密码学与安全 · 计算机科学 2026-01-08 Firas Ben Hmida , Zain Sbeih , Philemon Hailemariam , Birhanu Eshete