English
Related papers

Related papers: MLaKE: Multilingual Knowledge Editing Benchmark fo…

200 papers

Adapting large language models (LLMs) to new and diverse knowledge is essential for their lasting effectiveness in real-world applications. This survey provides an overview of state-of-the-art methods for expanding the knowledge of LLMs,…

Computation and Language · Computer Science 2025-02-19 Mingyang Wang , Alisa Stoll , Lukas Lange , Heike Adel , Hinrich Schütze , Jannik Strötgen

Multi-modal large language models(MLLMs) have achieved remarkable progress and demonstrated powerful knowledge comprehension and reasoning abilities. However, the mastery of domain-specific knowledge, which is essential for evaluating the…

Computation and Language · Computer Science 2024-05-09 Zheqi He , Xinya Wu , Pengfei Zhou , Richeng Xuan , Guang Liu , Xi Yang , Qiannan Zhu , Hua Huang

Multilingual large language models (LLMs) are advancing rapidly, with new models frequently claiming support for an increasing number of languages. However, existing evaluation datasets are limited and lack cross-lingual alignment, leaving…

Computation and Language · Computer Science 2025-06-25 Wenhan Han , Yifan Zhang , Zhixun Chen , Binbin Liu , Haobin Lin , Bingni Zhang , Taifeng Wang , Mykola Pechenizkiy , Meng Fang , Yin Zheng

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

Computation and Language · Computer Science 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

Open-source large language models (LLMs) have gained significant strength across diverse fields. Nevertheless, the majority of studies primarily concentrate on English, with only limited exploration into the realm of multilingual abilities.…

Computation and Language · Computer Science 2024-02-20 Haoyu Wang , Shuo Wang , Yukun Yan , Xujia Wang , Zhiyu Yang , Yuzhuang Xu , Zhenghao Liu , Liner Yang , Ning Ding , Xu Han , Zhiyuan Liu , Maosong Sun

Knowledge editing technology is crucial for maintaining the accuracy and timeliness of large language models (LLMs) . However, the setting of this task overlooks a significant portion of commonsense knowledge based on free-text in the real…

Computation and Language · Computer Science 2024-11-01 Xiusheng Huang , Yequan Wang , Jun Zhao , Kang Liu

Large language models (LLMs) often produce incorrect or outdated information, necessitating efficient and precise knowledge updates. Current model editing methods, however, struggle with long-form knowledge in diverse formats, such as…

Computation and Language · Computer Science 2025-10-13 Houcheng Jiang , Junfeng Fang , Ningyu Zhang , Guojun Ma , Mingyang Wan , Xiang Wang , Xiangnan He , Tat-seng Chua

Large Language Models (LLMs) have shown remarkable progress in medical question answering (QA), yet their effectiveness remains predominantly limited to English due to imbalanced multilingual training data and scarce medical resources for…

As Large Langue Models have been shown to memorize real-world facts, the need to update this knowledge in a controlled and efficient manner arises. Designed with these constraints in mind, Knowledge Editing (KE) approaches propose to alter…

Artificial Intelligence · Computer Science 2025-07-30 Marco Scialanga , Thibault Laugel , Vincent Grari , Marcin Detyniecki

Multiple-Choice Questions (MCQs) are often used to assess knowledge, reasoning abilities, and even values encoded in large language models (LLMs). While the effect of multilingualism has been studied on LLM factual recall, this paper seeks…

Computation and Language · Computer Science 2026-02-06 Léo Labat , Etienne Ollion , François Yvon

Knowledge editing (KE) provides a scalable approach for updating factual knowledge in large language models without full retraining. While previous studies have demonstrated effectiveness in general domains and medical QA tasks, little…

Artificial Intelligence · Computer Science 2025-08-12 Shengtao Wen , Haodong Chen , Yadong Wang , Zhongying Pan , Xiang Chen , Yu Tian , Bo Qian , Dong Liang , Sheng-Jun Huang

Although Large Language Models (LLMs) demonstrate strong capabilities across various tasks, they exhibit significant performance discrepancies across languages. While prompting LLMs in English typically yields the highest general…

Computation and Language · Computer Science 2026-05-26 Andrew Ivan Soegeng , Patrick Sutanto , Tan Sang Nguyen

The widespread adoption of Large Language Models (LLMs) has become commonplace, particularly with the emergence of open-source models. More importantly, smaller models are well-suited for integration into consumer devices and are frequently…

Computation and Language · Computer Science 2024-08-16 Aisha Khatun , Daniel G. Brown

Based on the foundation of Large Language Models (LLMs), Multilingual LLMs (MLLMs) have been developed to address the challenges faced in multilingual natural language processing, hoping to achieve knowledge transfer from high-resource…

Computation and Language · Computer Science 2024-12-10 Yuemei Xu , Ling Hu , Jiayi Zhao , Zihan Qiu , Kexin XU , Yuqi Ye , Hanwen Gu

Large language models (LLMs) have demonstrated impressive impact in the field of natural language processing, but they still struggle with several issues regarding, such as completeness, timeliness, faithfulness and adaptability. While…

Computation and Language · Computer Science 2023-08-24 Xintao Wang , Qianwen Yang , Yongting Qiu , Jiaqing Liang , Qianyu He , Zhouhong Gu , Yanghua Xiao , Wei Wang

In our era of widespread false information, human fact-checkers often face the challenge of duplicating efforts when verifying claims that may have already been addressed in other countries or languages. As false information transcends…

Computation and Language · Computer Science 2025-09-25 Ivan Vykopal , Matúš Pikuliak , Simon Ostermann , Tatiana Anikina , Michal Gregor , Marián Šimko

Knowledge editing methods for large language models are commonly evaluated using predefined benchmarks that assess edited facts together with a limited set of related or neighboring knowledge. While effective, such evaluations remain…

Computation and Language · Computer Science 2026-05-12 Shuainan Liu , Xuanang Chen , Ben He , Le Sun

Large Language Models (LLMs) have shown significant progress in Open-domain question answering (ODQA), yet most evaluations focus on English and assume locale-invariant answers across languages. This assumption neglects the cultural and…

Computation and Language · Computer Science 2025-08-25 Keon-Woo Roh , Yeong-Joon Ju , Seong-Whan Lee

Despite the existence of various benchmarks for evaluating natural language processing models, we argue that human exams are a more suitable means of evaluating general intelligence for large language models (LLMs), as they inherently…

Computation and Language · Computer Science 2023-11-13 Wenxuan Zhang , Sharifah Mahani Aljunied , Chang Gao , Yew Ken Chia , Lidong Bing

Despite their exceptional capabilities, large language models (LLMs) are prone to generating unintended text due to false or outdated knowledge. Given the resource-intensive nature of retraining LLMs, there has been a notable increase in…

Computation and Language · Computer Science 2024-05-28 Jun-Yu Ma , Zhen-Hua Ling , Ningyu Zhang , Jia-Chen Gu