English
Related papers

Related papers: DeepTRACE: Auditing Deep Research AI Systems for T…

200 papers

Recent advances in Large Language Models (LLMs) have driven interest in automating cybersecurity penetration testing workflows, offering the promise of faster and more consistent vulnerability assessment for enterprise systems. Existing LLM…

Cryptography and Security · Computer Science 2025-11-19 Katsuaki Nakano , Reza Fayyazi , Shanchieh Jay Yang , Michael Zuzak

Retrieval-Augmented Generation (RAG) has emerged as a way to complement the in-context knowledge of Large Language Models (LLMs) by integrating external documents. However, real-world applications demand not only accuracy but also…

Computation and Language · Computer Science 2025-07-31 Kazuki Hayashi , Hidetaka Kamigaito , Shinya Kouda , Taro Watanabe

Argument mining (AM) is an interdisciplinary research field focused on the automatic identification and classification of argumentative components, such as claims and premises, and the relationships between them. Recent advances in large…

Computation and Language · Computer Science 2026-03-23 Marcin Pietroń , Filip Gampel , Jakub Gomułka , Andrzej Tomski , Rafał Olszowski

We introduce DRBench, a benchmark for evaluating AI agents on complex, open-ended deep research tasks in enterprise settings. Unlike prior benchmarks that focus on simple questions or web-only queries, DRBench evaluates agents on multi-step…

The surge in scientific submissions has placed increasing strain on the traditional peer-review process, prompting the exploration of large language models (LLMs) for automated review generation. While LLMs demonstrate competence in…

Computation and Language · Computer Science 2025-09-25 Ruochi Li , Haoxuan Zhang , Edward Gehringer , Ting Xiao , Junhua Ding , Haihua Chen

Community-based moderation offers a scalable alternative to centralized fact-checking, yet it faces significant structural challenges, and existing AI-based methods fail in "cold start" scenarios. To tackle these challenges, we introduce…

Computation and Language · Computer Science 2026-02-10 Sahajpreet Singh , Kokil Jaidka , Min-Yen Kan

Trustworthiness is a core research challenge for agentic AI systems built on Large Language Models (LLMs). To enhance trust, natural language claims from diverse sources, including human-written text, web content, and model outputs, are…

Thanks to advancements in deep learning, speech generation systems now power a variety of real-world applications, such as text-to-speech for individuals with speech disorders, voice chatbots in call centers, cross-linguistic speech…

Systematic reviews and meta-analyses rely on converting narrative articles into structured, numerically grounded study records. Despite rapid advances in large language models (LLMs), it remains unclear whether they can meet the structural…

Computation and Language · Computer Science 2026-02-12 Zhiyin Tan , Jennifer D'Souza

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Citations provide the basis for trusting scientific claims; when they are invalid or fabricated, this trust collapses. With the advent of Large Language Models (LLMs), this risk has intensified: LLMs are increasingly used for academic…

Cryptography and Security · Computer Science 2026-05-15 Zuyao Xu , Yuqi Qiu , Lu Sun , Fasheng Miao , Fubin Wu , Xiang Li , Xinyi Wang , Haozhe Lu , Zhengze Zhang , Yuxin Hu , Jialu Li , Luo Jin , Feng Zhang , Rui Luo , Xinran Liu , Yingxian Li , Jiaji Liu

In collaborative systems with complex tasks relying on distributed resources, trust evaluation of potential collaborators has emerged as an effective mechanism for task completion. However, due to the network dynamics and varying…

Artificial Intelligence · Computer Science 2025-08-04 Botao Zhu , Xianbin Wang , Lei Zhang , Xuemin , Shen

Scientific research relies on citation integrity, yet large language models (LLMs) have introduced a critical risk: fabricated references that appear plausible but correspond to no real publications. As manual verification becomes…

Computation and Language · Computer Science 2026-05-05 Kaiwen Shi , Weixiang Sun , Zheyuan Zhang , Lichao Sun , Nitesh V. Chawla , Yanfang Ye

Large language models (LLMs) have shown impressive promise in code generation, yet their progress remains limited by the shortage of large-scale datasets that are both diverse and well-aligned with human reasoning. Most existing resources…

Machine Learning · Computer Science 2025-10-28 Amal Abed , Ivan Lukic , Jörg K. H. Franke , Frank Hutter

Retrieval-Augmented Generation (RAG) grounds Large Language Models (LLMs) in external knowledge but often suffers from flat context representations and stateless retrieval, leading to unstable performance. We propose Stateful…

Computation and Language · Computer Science 2026-04-17 Qi Dong , Ziheng Lin , Ning Ding

Large language models (LLMs) are increasingly expected to go beyond simple factual queries toward Deep Research-tasks that require decomposing questions into sub-problems, coordinating multi-step reasoning, and synthesizing evidence from…

Computation and Language · Computer Science 2025-09-03 Ziyi Xia , Kun Luo , Hongjin Qian , Zheng Liu

Incorporating specific knowledge into large language models via retrieval-augmented generation (RAG) is a widespread technique that fuels many of today's industry AI applications. A fundamental problem is to assess if the context retrieved…

Information Retrieval · Computer Science 2026-05-08 Florian Geissler , Francesco Carella , Laura Fieback , Jakob Spiegelberg

Rising concern for the societal implications of artificial intelligence systems has inspired a wave of academic and journalistic literature in which deployed systems are audited for harm by investigators from outside the organizations…

Although Large Language Models (LLMs) have become capable reasoners, the problem of faithfulness persists: their reasoning can contain errors and omissions that are difficult to detect and that may obscure biases in model outputs. To…

Computation and Language · Computer Science 2025-09-30 Jixuan Leng , Cassandra A. Cohen , Zhixian Zhang , Chenyan Xiong , William W. Cohen

Multimodal Large Language Models (MLLMs) increasingly function as generative search systems that retrieve and synthesize answers from multimedia content, including YouTube videos. Although these systems project authority by citing specific…

Computers and Society · Computer Science 2026-05-27 Erfan Samieyan Sahneh , Luca Maria Aiello