English
Related papers

Related papers: Data Doping or True Intelligence? Evaluating the T…

200 papers

Large Language Models (LLMs) have emerged as highly capable systems and are increasingly being integrated into various uses. However, the rapid pace of their deployment has outpaced a comprehensive understanding of their internal mechanisms…

Computation and Language · Computer Science 2025-10-27 Gabriele Prato , Jerry Huang , Prasanna Parthasarathi , Shagun Sodhani , Sarath Chandar

Although large language models (LLMs) excel in knowledge recall and reasoning, their static nature leads to outdated information as the real world evolves or when adapting to domain-specific knowledge, highlighting the need for effective…

Computation and Language · Computer Science 2025-04-02 Ruoxi Xu , Yunjie Ji , Boxi Cao , Yaojie Lu , Hongyu Lin , Xianpei Han , Ben He , Yingfei Sun , Xiangang Li , Le Sun

Recently, Language Models (LMs) instruction-tuned on multiple tasks, also known as multitask-prompted fine-tuning (MT), have shown the capability to generalize to unseen tasks. Previous work has shown that scaling the number of training…

Computation and Language · Computer Science 2023-02-10 Joel Jang , Seungone Kim , Seonghyeon Ye , Doyoung Kim , Lajanugen Logeswaran , Moontae Lee , Kyungjae Lee , Minjoon Seo

This work presents a framework for assessing whether large language models (LLMs) encode more factual knowledge in their parameters than what they express in their outputs. While a few studies hint at this possibility, none has clearly…

Computation and Language · Computer Science 2025-08-07 Zorik Gekhman , Eyal Ben David , Hadas Orgad , Eran Ofek , Yonatan Belinkov , Idan Szpektor , Jonathan Herzig , Roi Reichart

Multimodal large language models (MLLMs) have shown remarkable capabilities in multimodal perception and understanding tasks. However, their effectiveness in specialized domains, such as remote sensing and medical imaging, remains limited.…

Computation and Language · Computer Science 2026-02-05 Qinglong Cao , Yuntian Chen , Chao Ma , Xiaokang Yang

We demonstrate that LLMs may learn indicators of document usefulness and modulate their updates accordingly. We introduce random strings ("tags") as indicators of usefulness in a synthetic fine-tuning dataset. Fine-tuning on this dataset…

Machine Learning · Computer Science 2024-07-16 Dmitrii Krasheninnikov , Egor Krasheninnikov , Bruno Mlodozeniec , Tegan Maharaj , David Krueger

Adapting large language models (LLMs) to new and diverse knowledge is essential for their lasting effectiveness in real-world applications. This survey provides an overview of state-of-the-art methods for expanding the knowledge of LLMs,…

Computation and Language · Computer Science 2025-02-19 Mingyang Wang , Alisa Stoll , Lukas Lange , Heike Adel , Hinrich Schütze , Jannik Strötgen

Large language models (LLMs) have demonstrated outstanding performance, making them valuable digital assets with significant commercial potential. Unfortunately, the LLM and its API are susceptible to intellectual property theft.…

Cryptography and Security · Computer Science 2024-07-25 Shuai Li , Kejiang Chen , Kunsheng Tang , Jie Zhang , Weiming Zhang , Nenghai Yu , Kai Zeng

Despite their impressive performance on diverse tasks, large language models (LMs) still struggle with tasks requiring rich world knowledge, implying the limitations of relying solely on their parameters to encode a wealth of world…

Computation and Language · Computer Science 2023-07-04 Alex Mallen , Akari Asai , Victor Zhong , Rajarshi Das , Daniel Khashabi , Hannaneh Hajishirzi

Large Language Models (LLMs) have shown promising results on machine translation for high resource language pairs and domains. However, in specialised domains (e.g. medical) LLMs have shown lower performance compared to standard neural…

Computation and Language · Computer Science 2025-07-31 Miguel Rios

Recent work exploring the capabilities of pre-trained large language models (LLMs) has demonstrated their ability to act as general pattern machines by completing complex token sequences representing a wide array of tasks, including…

Computers and Society · Computer Science 2024-03-25 Seyed Parsa Neshaei , Richard Lee Davis , Adam Hazimeh , Bojan Lazarevski , Pierre Dillenbourg , Tanja Käser

Large language models (LLMs) encode extensive world knowledge through pre-training on massive datasets, which can then be fine-tuned for the question-answering (QA) task. However, effective strategies for fine-tuning LLMs for the QA task…

Computation and Language · Computer Science 2025-01-22 Junjie Ye , Yuming Yang , Qi Zhang , Tao Gui , Xuanjing Huang , Peng Wang , Zhongchao Shi , Jianping Fan

Compressing Large Language Models (LLMs) often leads to reduced performance, especially for knowledge-intensive tasks. In this work, we dive into how compression damages LLMs' inherent knowledge and the possible remedies. We start by…

Computation and Language · Computer Science 2024-02-19 Duc N. M Hoang , Minsik Cho , Thomas Merth , Mohammad Rastegari , Zhangyang Wang

Large Language Models are expressive tools that enable complex tasks of text understanding within Computational Social Science. Their versatility, while beneficial, poses a barrier for establishing standardized best practices within the…

Computers and Society · Computer Science 2024-08-05 Anders Giovanni Møller , Luca Maria Aiello

Fine-tuning Large Language Models (LLMs) incurs considerable training costs, driving the need for data-efficient training with optimised data ordering. Human-inspired strategies offer a solution by organising data based on human learning…

Computation and Language · Computer Science 2024-11-06 Yushi Yang , Andrew M. Bean , Robert McCraith , Adam Mahdi

Large language models (LLMs) have shown great capabilities in various tasks but also exhibited memorization of training data, raising tremendous privacy and copyright concerns. While prior works have studied memorization during…

Artificial Intelligence · Computer Science 2024-02-26 Shenglai Zeng , Yaxin Li , Jie Ren , Yiding Liu , Han Xu , Pengfei He , Yue Xing , Shuaiqiang Wang , Jiliang Tang , Dawei Yin

Large language models (LLMs) have shown remarkable performance on a variety of NLP tasks, and are being rapidly adopted in a wide range of use cases. It is therefore of vital importance to holistically evaluate the factuality of their…

Computation and Language · Computer Science 2024-04-26 Jiaqing Yuan , Lin Pan , Chung-Wei Hang , Jiang Guo , Jiarong Jiang , Bonan Min , Patrick Ng , Zhiguo Wang

Large language models (LLMs) show an innate skill for solving language based tasks. But insights have suggested an inability to adjust for information or task-solving skills becoming outdated, as their knowledge, stored directly within…

Computation and Language · Computer Science 2024-04-16 Jerry Huang , Prasanna Parthasarathi , Mehdi Rezagholizadeh , Sarath Chandar

Existing Large Language Models (LLMs) usually remain static after deployment, which might make it hard to inject new knowledge into the model. We aim to build models containing a considerable portion of self-updatable parameters, enabling…

Computation and Language · Computer Science 2024-05-28 Yu Wang , Yifan Gao , Xiusi Chen , Haoming Jiang , Shiyang Li , Jingfeng Yang , Qingyu Yin , Zheng Li , Xian Li , Bing Yin , Jingbo Shang , Julian McAuley

Large language models (LLMs) show early signs of artificial general intelligence but struggle with hallucinations. One promising solution to mitigate these hallucinations is to store external knowledge as embeddings, aiding LLMs in…

Computation and Language · Computer Science 2024-04-26 Zhihao Zhu , Ninglu Shao , Defu Lian , Chenwang Wu , Zheng Liu , Yi Yang , Enhong Chen