English
Related papers

Related papers: Explicating Tacit Regulatory Knowledge from LLMs t…

200 papers

This paper examines how to make large language models reliable for high-stakes legal work by reducing hallucinations. It distinguishes three AI paradigms: (1) standalone generative models ("creative oracle"), (2) basic retrieval-augmented…

Artificial Intelligence · Computer Science 2026-01-23 Alex Dantart

Retrieval Augmented Generation (RAG) is a technique used to augment Large Language Models (LLMs) with contextually relevant, time-critical, or domain-specific information without altering the underlying model parameters. However,…

Information Retrieval · Computer Science 2024-08-20 Laurent Mombaerts , Terry Ding , Adi Banerjee , Florian Felice , Jonathan Taws , Tarik Borogovac

Retrieval Augmented Generation (RAG) is a common method for integrating external knowledge into pretrained Large Language Models (LLMs) to enhance accuracy and relevancy in question answering (QA) tasks. However, prompt engineering and…

Computation and Language · Computer Science 2024-10-18 Isaac Chung , Phat Vo , Arman C. Kizilkale , Aaron Reite

Reasoning is a cognitive process of using evidence to reach a sound conclusion. The reasoning capability is essential for large language models (LLMs) to serve as the brain of the artificial general intelligence agent. Recent studies reveal…

Computation and Language · Computer Science 2023-09-06 Peiyi Wang , Lei Li , Liang Chen , Feifan Song , Binghuai Lin , Yunbo Cao , Tianyu Liu , Zhifang Sui

Chain-of-thought (CoT) reasoning boosts large language models' (LLMs) performance on complex tasks but faces two key limitations: a lack of reliability when solely relying on LLM-generated reasoning chains and lower reasoning performance…

Computation and Language · Computer Science 2025-09-11 Feiyang Li , Peng Fang , Zhan Shi , Arijit Khan , Fang Wang , Weihao Wang , Xin Zhang , Yongjian Cui

Retrieval-Augmented Generation (RAG) enhances the performance of Large Language Models (LLMs) by incorporating external knowledge. However, LLMs still encounter challenges in effectively utilizing the knowledge from retrieved documents,…

Computation and Language · Computer Science 2025-02-26 Mingyan Wu , Zhenghao Liu , Yukun Yan , Xinze Li , Shi Yu , Zheni Zeng , Yu Gu , Ge Yu

The integration of external knowledge through Retrieval-Augmented Generation (RAG) has become foundational in enhancing large language models (LLMs) for knowledge-intensive tasks. However, existing RAG paradigms often overlook the cognitive…

Artificial Intelligence · Computer Science 2025-09-24 Yu Wang , Shiwan Zhao , Zhihu Wang , Ming Fan , Xicheng Zhang , Yubo Zhang , Zhengfan Wang , Heyuan Huang , Ting Liu

Safety critical software assessment requires robust assessment against complex regulatory frameworks, a process traditionally limited by manual evaluation. This paper presents Document Retrieval-Augmented Fine-Tuning (DRAFT), a novel…

Risk and Quality (R&Q) assurance in highly regulated industries requires constant navigation of complex regulatory frameworks, with employees handling numerous daily queries demanding accurate policy interpretation. Traditional methods…

Autoformalization, the process of translating informal statements into formal logic, has gained renewed interest with the emergence of powerful Large Language Models (LLMs). While LLMs show promise in generating structured outputs from…

Computation and Language · Computer Science 2025-11-18 Mihir Gupte , Ramesh S

Large language models (LLMs), such as GPT3.5, GPT4 and LLAMA2 perform surprisingly well and outperform human experts on many tasks. However, in many domain-specific evaluations, these LLMs often suffer from hallucination problems due to…

Computation and Language · Computer Science 2024-04-19 Yuqi Wang , Boran Jiang , Yi Luo , Dawei He , Peng Cheng , Liangcai Gao

Retrieval-augmented generation (RAG) enhances the question-answering (QA) abilities of large language models (LLMs) by integrating external knowledge. However, adapting general-purpose RAG systems to specialized fields such as science and…

Computation and Language · Computer Science 2025-01-28 Ran Xu , Hui Liu , Sreyashi Nag , Zhenwei Dai , Yaochen Xie , Xianfeng Tang , Chen Luo , Yang Li , Joyce C. Ho , Carl Yang , Qi He

Recent advances in large language models (LLMs) offer promising potential for automating formal methods. However, applying them to formal verification remains challenging due to the complexity of specification languages, the risk of…

Software Engineering · Computer Science 2025-09-30 Xinyue Zuo , Yifan Zhang , Hongshu Wang , Yufan Cai , Zhe Hou , Jing Sun , Jin Song Dong

Most prior deepfake detection methods lack explainable outputs. With the growing interest in multimodal large language models (MLLMs), researchers have started exploring their use in interpretable deepfake detection. However, a major…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Ning Jiang , Dingheng Zeng , Yanhong Liu , Haiyang Yi , Shijie Yu , Minghe Weng , Haifeng Shen , Ying Li

Large language models (LLMs) augmented with retrieval systems have significantly advanced natural language processing tasks by integrating external knowledge sources, enabling more accurate and contextually rich responses. To improve the…

Computation and Language · Computer Science 2025-05-28 Xin Sun , Jianan Xie , Zhongqi Chen , Qiang Liu , Shu Wu , Yuehe Chen , Bowen Song , Weiqiang Wang , Zilei Wang , Liang Wang

Large language models (LLMs) have shown promise in medical question answering but often struggle with hallucinations and shallow reasoning, particularly in tasks requiring nuanced clinical understanding. Retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2025-08-25 Ziyu Wang , Elahe Khatibi , Amir M. Rahmani

Large Language Models (LLMs) enhanced with external contexts, such as through retrieval-augmented generation (RAG), often face challenges in handling imperfect evidence. They tend to over-rely on external knowledge, making them vulnerable…

Computation and Language · Computer Science 2025-02-25 Shenglai Zeng , Pengfei He , Kai Guo , Tianqi Zheng , Hanqing Lu , Yue Xing , Hui Liu

The Retrieval-Augmented Language Model (RALM) has shown remarkable performance on knowledge-intensive tasks by incorporating external knowledge during inference, which mitigates the factual hallucinations inherited in large language models…

Computation and Language · Computer Science 2024-12-20 Yuan Xia , Jingbo Zhou , Zhenhui Shi , Jun Chen , Haifeng Huang

The integration of large language models (LLMs) into autonomous agents has enabled complex tool use, yet in high-stakes domains, these systems must strictly adhere to regulatory standards beyond simple functional correctness. However,…

Computation and Language · Computer Science 2026-01-14 Da Song , Yuheng Huang , Boqi Chen , Tianshuo Cong , Randy Goebel , Lei Ma , Foutse Khomh

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

Machine Learning · Computer Science 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen