English
Related papers

Related papers: Explaining Fine Tuned LLMs via Counterfactuals A K…

200 papers

Large language models have shown remarkable language processing and reasoning ability but are prone to hallucinate when asked about private data. Retrieval-augmented generation (RAG) retrieves relevant data that fit into an LLM's context…

Machine Learning · Computer Science 2025-11-13 Alfred Clemedtson , Borun Shi

Language models (LMs) pretrained on large corpora of text from the web have been observed to contain large amounts of various types of knowledge about the world. This observation has led to a new and exciting paradigm in knowledge graph…

Computation and Language · Computer Science 2023-01-27 Mehran Kazemi , Sid Mittal , Deepak Ramachandran

Previous studies have relied on existing question-answering benchmarks to evaluate the knowledge stored in large language models (LLMs). However, this approach has limitations regarding factual knowledge coverage, as it mostly focuses on…

Computation and Language · Computer Science 2023-10-31 Linhao Luo , Thuy-Trang Vu , Dinh Phung , Gholamreza Haffari

The performance of Large Language Models (LLMs) on many tasks is greatly limited by the knowledge learned during pre-training and stored in the model's parameters. Low-rank adaptation (LoRA) is a popular and efficient training technique for…

Computation and Language · Computer Science 2025-03-25 Sergey Pletenev , Maria Marina , Daniil Moskovskiy , Vasily Konovalov , Pavel Braslavski , Alexander Panchenko , Mikhail Salnikov

This study examines whether Low-Rank Adaptation (LoRA) fine-tuned Large Language Models (LLMs) can approximate the performance of fully fine-tuned models in generating human-interpretable decisions and explanations for malware…

Cryptography and Security · Computer Science 2025-11-26 Stephen C. Gravereaux , Sheikh Rabiul Islam

With the productive evolution of large language models (LLMs) in the field of natural language processing (NLP), tons of effort has been made to effectively fine-tune common pre-trained LLMs to fulfill a variety of tasks in one or multiple…

Computation and Language · Computer Science 2024-02-06 Chao Song , Zhihao Ye , Qiqiang Lin , Qiuying Peng , Jun Wang

Despite recent advancements in domain adaptation techniques for large language models, these methods remain computationally intensive, and the resulting models can still exhibit hallucination issues. Most existing adaptation methods do not…

Computation and Language · Computer Science 2025-05-28 Bogdan Bogachov , Yaoyao Fiona Zhao

Understanding complex biomolecular mechanisms requires multi-step reasoning across molecular interactions, signaling cascades, and metabolic pathways. While large language models(LLMs) show promise in such tasks, their application to…

Artificial Intelligence · Computer Science 2025-11-12 Tianwen Lyu , Xiang Zhuang , Keyan Ding , Xinzhe Cao , Lei Liang , Wei Zhao , Qiang Zhang , Huajun Chen

Large Language Models (LLMs) have demonstrated impressive capabilities across natural language processing tasks. However, their application to specialized domains such as medicine and biology requires further optimization to ensure factual…

Computation and Language · Computer Science 2025-02-06 Seonok Kim

Large language models (LLMs) have made significant progress in general-purpose natural language processing tasks. However, LLMs are still facing challenges when applied to domain-specific areas like telecommunications, which demands…

Computation and Language · Computer Science 2025-05-22 Dun Yuan , Hao Zhou , Di Wu , Xue Liu , Hao Chen , Yan Xin , Jianzhong , Zhang

Understanding the uncertainty in large language model (LLM) explanations is important for evaluating their faithfulness and reasoning consistency, and thus provides insights into the reliability of LLM's output regarding a question. In this…

Computation and Language · Computer Science 2025-09-16 Longchao Da , Xiaoou Liu , Jiaxin Dai , Lu Cheng , Yaqing Wang , Hua Wei

Large language models (LLMs) can be adapted either through numerical updates that alter model parameters or symbolic manipulations that work on discrete prompts or logical constraints. While numerical fine-tuning excels at injecting new…

Artificial Intelligence · Computer Science 2026-01-21 Kevin Wang , Neel P. Bhatt , Cong Liu , Junbo Li , Runjin Chen , Yihan Xi , Timothy Barclay , Alvaro Velasquez , Ufuk Topcu , Zhangyang Wang

Structured data, such as tables, graphs, and databases, play a critical role in plentiful NLP tasks such as question answering and dialogue system. Recently, inspired by Vision-Language Models, Graph Neutral Networks (GNNs) have been…

Computation and Language · Computer Science 2025-02-11 Yao Xu , Shizhu He , Jiabei Chen , Zeng Xiangrong , Bingning Wang , Guang Liu , Jun Zhao , Kang Liu

This paper addresses the problems of missing reasoning chains and insufficient entity-level semantic understanding in large language models when dealing with tasks that require structured knowledge. It proposes a fine-tuning algorithm…

Computation and Language · Computer Science 2025-08-21 Wuyang Zhang , Yexin Tian , Xiandong Meng , Mengjie Wang , Junliang Du

Drug repurposing is often framed as a candidate identification task, but existing approaches provide limited guidance for distinguishing biologically plausible candidates from historically well-connected ones. Here we introduce DrugKLM, a…

Large Language Models (LLMs) are being adopted at an unprecedented rate, yet still face challenges in knowledge-intensive domains like biomedicine. Solutions such as pre-training and domain-specific fine-tuning add substantial computational…

Finetuned large language models (LLMs) have shown remarkable performance in financial tasks, such as sentiment analysis and information retrieval. Due to privacy concerns, finetuning and deploying Financial LLMs (FinLLMs) locally are…

Machine Learning · Computer Science 2025-01-22 Dannong Wang , Daniel Kim , Bo Jin , Xingjian Zhao , Tianfan Fu , Steve Yang , Xiao-Yang Liu

Pathology reports serve as the definitive record for breast cancer staging, yet their unstructured format impedes large-scale data curation. While Large Language Models (LLMs) offer semantic reasoning, their deployment is often limited by…

Machine Learning · Computer Science 2026-04-16 Jiahao Shao , Anam Nawaz Khan , Christopher Brett , Tom Berg , Xueping Li , Bing Yao

Large language model (LLM) has achieved outstanding performance on various downstream tasks with its powerful natural language understanding and zero-shot capability, but LLM still suffers from knowledge limitation. Especially in scenarios…

Computation and Language · Computer Science 2024-08-07 Tiezheng Guo , Qingwen Yang , Chen Wang , Yanyi Liu , Pan Li , Jiawei Tang , Dapeng Li , Yingyou Wen

Graph problems are fundamentally challenging for large language models (LLMs). While LLMs excel at processing unstructured text, graph tasks require reasoning over explicit structure, permutation invariance, and computationally complex…

Machine Learning · Computer Science 2026-04-23 Angelo Zangari , Peyman Baghershahi , Sourav Medya