English
Related papers

Related papers: A Benchmark Construction and Evaluation Framework …

200 papers

Parametric Retrieval-Augmented Generation (PRAG) is a RAG approach that integrates external knowledge directly into model parameters using a LoRA adapter, aiming at reducing the inference cost compared to traditional RAG. However, current…

Information Retrieval · Computer Science 2026-01-27 Zhan Su , Fengran Mo , Jinghan Zhang , Yuchen Hui , Jiaao Sun , Jian-yun Nie

Deep Research Agents (DRAs) generate citation-rich reports via multi-step search and synthesis, yet existing benchmarks mainly target text-only settings or short-form multimodal QA, missing end-to-end multimodal evidence use. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Peizhou Huang , Zixuan Zhong , Zhongwei Wan , Donghao Zhou , Samiul Alam , Xin Wang , Zexin Li , Zhihao Dou , Li Zhu , Jing Xiong , Chaofan Tao , Yan Xu , Dimitrios Dimitriadis , Tuo Zhang , Mi Zhang

Answering Questions over Knowledge Graphs (KGQA) is key to well-functioning autonomous language agents in various real-life applications. To improve the neural-symbolic reasoning capabilities of language agents powered by Large Language…

Computation and Language · Computer Science 2024-06-12 Haishuo Fang , Xiaodan Zhu , Iryna Gurevych

Large Language Models (LLMs) have recently exhibited remarkable reasoning capabilities, largely enabled by supervised fine-tuning (SFT)- and reinforcement learning (RL)-based post-training on high-quality reasoning data. However,…

Computation and Language · Computer Science 2026-03-03 Xinyu Zhu , Yihao Feng , Yanchao Sun , Xianzhi Du , Pingzhi Li , Olli Saarikivi , Yun Zhu , Yu Meng

Low-Rank Adaptation (LoRA) has become a widely adopted parameter-efficient fine-tuning method for large language models, with its effectiveness largely influenced by the allocation of ranks and scaling factors, as well as initialization.…

Computation and Language · Computer Science 2026-04-21 Weicheng Lin , Yi Zhang , Jiawei Dang , Liang-Jie Zhang

Reliably determining the performance of Retrieval-Augmented Generation (RAG) systems depends on comprehensive test questions. While a proliferation of evaluation frameworks for LLM-powered applications exists, current practices lack a…

Machine Learning · Computer Science 2025-10-02 Noah Broestl , Adel Nasser Abdalla , Rajprakash Bale , Hersh Gupta , Max Struever

Large Language Models (LLMs) demonstrate remarkable capabilities but remain limited by their reliance on static training data. Retrieval-Augmented Generation (RAG) addresses this constraint by retrieving external knowledge during inference,…

Computation and Language · Computer Science 2026-02-19 Xingda Lyu , Gongfu Lyu , Zitai Yan , Yuxin Jiang

Timely and accurate situation awareness is vital for decision-making in humanitarian response, conflict monitoring, and early warning and early action. However, the manual analysis of vast and heterogeneous data sources often results in…

Context-grounded generation underpins many LLM applications, including long-document question answering (QA), conversational personalization, and retrieval-augmented generation (RAG). However, classic token-based context concatenation is…

Information Retrieval · Computer Science 2026-01-27 Minghao Tang , Shiyu Ni , Jingtong Wu , Zengxin Han , Keping Bi

Evaluating Retrieval-Augmented Generation (RAG) in large language models (LLMs) is challenging because benchmarks can quickly become stale. Questions initially requiring retrieval may become answerable from pretraining knowledge as newer…

Computation and Language · Computer Science 2025-05-12 Max Glockner , Xiang Jiang , Leonardo F. R. Ribeiro , Iryna Gurevych , Markus Dreyer

Deep Research Agents are a prominent category of LLM-based agents. By autonomously orchestrating multistep web exploration, targeted retrieval, and higher-order synthesis, they transform vast amounts of online information into…

Computation and Language · Computer Science 2025-06-16 Mingxuan Du , Benfeng Xu , Chiwei Zhu , Xiaorui Wang , Zhendong Mao

Large Language Models (LLMs) such as Gemma-2B have shown strong performance in various natural language processing tasks. However, general-purpose models often lack the domain expertise required for cybersecurity applications. This work…

Cryptography and Security · Computer Science 2026-01-13 Vasanth Iyer , Leonardo Bobadilla , S. S. Iyengar

Low-Rank Adaptation (LoRA) has become one of the most widely used fine-tuning mechanisms for adapting large language models to new domains, tasks, and users. Yet adaptation performance alone can obscure an important failure mode: LoRA…

Computation and Language · Computer Science 2026-05-29 Runze Xu , Arpit Garg , Hemanth Saratchandran , Simon Lucey

Large language models (LLMs) are very costly and inefficient to update with new information. To address this limitation, retrieval-augmented generation (RAG) has been proposed as a solution that dynamically incorporates external knowledge…

Computation and Language · Computer Science 2025-07-10 Sezen Perçin , Xin Su , Qutub Sha Syed , Phillip Howard , Aleksei Kuvshinov , Leo Schwinn , Kay-Ulrich Scholl

Retrieval-Augmented Generation (RAG) has advanced significantly in recent years. The complexity of RAG systems, which involve multiple components-such as indexing, retrieval, and generation-along with numerous other parameters, poses…

Information Retrieval · Computer Science 2025-08-08 Lorenz Brehme , Thomas Ströhle , Ruth Breu

General-purpose large language models (LLMs) are increasingly deployed in verticals such as telecommunications, where adaptation is hindered by scarce, low-information-density corpora and tight mobile/edge constraints. We propose Data…

Machine Learning · Computer Science 2025-11-11 Zhicheng Zhou , Jing Li , Suming Qiu , Junjie Huang , Linyuan Qiu , Zhijie Sun

Fact-checking techniques can mitigate hallucinations in Large Language Models (LLMs), a prominent issue in specialized domains. As parameter-efficient techniques such as Low-Rank Adaptation (LoRA) can overcome substantial computational…

Computation and Language · Computer Science 2024-10-17 Hyeryun Park , Jeongwon Kwak , Dongsuk Jang , Sumin Park , Jinwook Choi

Large Language Models (LLMs) encounter challenges with the unique syntax of specific domains, such as biomolecules. Existing fine-tuning or modality alignment techniques struggle to bridge the domain knowledge gap and understand complex…

Biomolecules · Quantitative Biology 2024-06-28 Jinzhe Liu , Xiangsheng Huang , Zhuo Chen , Yin Fang

Low-Rank Adaptation~(LoRA), which updates the dense neural network layers with pluggable low-rank matrices, is one of the best performed parameter efficient fine-tuning paradigms. Furthermore, it has significant advantages in cross-task…

Machine Learning · Computer Science 2024-10-25 Yuren Mao , Yuhang Ge , Yijiang Fan , Wenyi Xu , Yu Mi , Zhonghao Hu , Yunjun Gao

Large language models (LLMs) have achieved remarkable success across a wide range of applications especially when augmented by external knowledge through retrieval-augmented generation (RAG). Despite their widespread adoption, recent…

Computation and Language · Computer Science 2026-04-14 Tianzhe Zhao , Jiaoyan Chen , Shuxiu Zhang , Haiping Zhu , Qika Lin , Jun Liu