English
Related papers

Related papers: DocMEdit: Towards Document-Level Model Editing

200 papers

Large Language Models (LLMs) have shown extraordinary capabilities in understanding and generating text that closely mirrors human communication. However, a primary limitation lies in the significant computational demands during training,…

Assessing factuality of text generated by large language models (LLMs) is an emerging yet crucial research area, aimed at alerting users to potential errors and guiding the development of more reliable LLMs. Nonetheless, the evaluators…

Computation and Language · Computer Science 2023-11-29 Shiqi Chen , Yiran Zhao , Jinghan Zhang , I-Chun Chern , Siyang Gao , Pengfei Liu , Junxian He

Existing large language models (LLMs) for machine translation are typically fine-tuned on sentence-level translation instructions and achieve satisfactory performance at the sentence level. However, when applied to document-level…

Computation and Language · Computer Science 2024-01-17 Yachao Li , Junhui Li , Jing Jiang , Min Zhang

With the rapid development of deep learning technologies, the field of machine translation has witnessed significant progress, especially with the advent of large language models (LLMs) that have greatly propelled the advancement of…

Computation and Language · Computer Science 2025-04-22 Jiaxin GUO , Xiaoyu Chen , Zhiqiang Rao , Jinlong Yang , Zongyao Li , Hengchao Shang , Daimeng Wei , Hao Yang

Model editing has become an increasingly popular alternative for efficiently updating knowledge within language models. Current methods mainly focus on reliability, generalization, and locality, with many methods excelling across these…

Artificial Intelligence · Computer Science 2024-10-25 Qi Li , Xiang Liu , Zhenheng Tang , Peijie Dong , Zeyu Li , Xinglin Pan , Xiaowen Chu

Previous multilingual benchmarks focus primarily on simple understanding tasks, but for large language models(LLMs), we emphasize proficiency in instruction following, reasoning, long context understanding, code generation, and so on.…

Computation and Language · Computer Science 2025-04-22 Xu Huang , Wenhao Zhu , Hanxu Hu , Conghui He , Lei Li , Shujian Huang , Fei Yuan

Large language models (LLMs) have significantly advanced various natural language processing (NLP) tasks. Recent research indicates that moderately-sized LLMs often outperform larger ones after task-specific fine-tuning. This study focuses…

Computation and Language · Computer Science 2024-10-14 Minghao Wu , Thuy-Trang Vu , Lizhen Qu , George Foster , Gholamreza Haffari

We present a benchmark for large language models designed to tackle one of the most knowledge-intensive tasks in data science: writing feature engineering code, which requires domain knowledge in addition to a deep understanding of the…

Computation and Language · Computer Science 2024-11-01 Michał Pietruszka , Łukasz Borchmann , Aleksander Jędrosz , Paweł Morawiecki

Model editing aims to correct inaccurate knowledge, update outdated information, and incorporate new data into Large Language Models (LLMs) without the need for retraining. This task poses challenges in lifelong scenarios where edits must…

Computation and Language · Computer Science 2025-03-17 Qizhou Chen , Chengyu Wang , Dakan Wang , Taolin Zhang , Wangyue Li , Xiaofeng He

The advancement of large language models (LLMs) has led to a greater challenge of having a rigorous and systematic evaluation of complex tasks performed, especially in enterprise applications. Therefore, LLMs need to be able to benchmark…

Computation and Language · Computer Science 2024-10-18 Bing Zhang , Mikio Takeuchi , Ryo Kawahara , Shubhi Asthana , Md. Maruf Hossain , Guang-Jie Ren , Kate Soule , Yada Zhu

The adoption of large language models (LLMs) to assist clinicians has attracted remarkable attention. Existing works mainly adopt the close-ended question-answering (QA) task with answer options for evaluation. However, many clinical…

Despite the known limitations, most machine translation systems today still operate on the sentence-level. One reason for this is, that most parallel training data is only sentence-level aligned, without document-level meta information…

Computation and Language · Computer Science 2023-10-20 Frithjof Petrick , Christian Herold , Pavel Petrushkov , Shahram Khadivi , Hermann Ney

Large Language Models (LLMs) usually suffer from knowledge cutoff or fallacy issues, which means they are unaware of unseen events or generate text with incorrect facts owing to outdated/noisy data. To this end, many knowledge editing…

Large Language Models (LLM) have revolutionized Natural Language Processing (NLP), improving state-of-the-art and exhibiting emergent capabilities across various tasks. However, their application in extracting information from visually rich…

Computation and Language · Computer Science 2024-06-25 Vincent Perot , Kai Kang , Florian Luisier , Guolong Su , Xiaoyu Sun , Ramya Sree Boppana , Zilong Wang , Zifeng Wang , Jiaqi Mu , Hao Zhang , Chen-Yu Lee , Nan Hua

Recently, knowledge editing on large language models (LLMs) has received considerable attention. Compared to this, editing Large Vision-Language Models (LVLMs) faces extra challenges from diverse data modalities and complicated model…

Computation and Language · Computer Science 2024-10-30 Han Huang , Haitian Zhong , Tao Yu , Qiang Liu , Shu Wu , Liang Wang , Tieniu Tan

Fine-tuning of Large Language Models (LLMs) for downstream tasks, performed on domain-specific data has shown significant promise. However, commercial use of such LLMs is limited by the high computational cost required for their deployment…

Computation and Language · Computer Science 2025-03-06 Boris Nazarov , Darya Frolova , Yackov Lubarsky , Alexei Gaissinski , Pavel Kisilev

Model editing has been gaining increasing attention over the past few years. For Knowledge Editing in particular, more challenging evaluation datasets have recently been released. These datasets use different methodologies to score the…

Computation and Language · Computer Science 2025-07-09 Sebastian Pohl , Max Ploner , Alan Akbik

Large Language Models (LLMs) have shown useful applications in a variety of tasks, including data wrangling. In this paper, we investigate the use of an off-the-shelf LLM for schema matching. Our objective is to identify semantic…

Databases · Computer Science 2024-07-17 Marcel Parciak , Brecht Vandevoort , Frank Neven , Liesbet M. Peeters , Stijn Vansummeren

Large Language Models (LLMs) have been widely applied in various professional fields. By fine-tuning the models using domain specific question and answer datasets, the professional domain knowledge and Q\&A abilities of these models have…

Computation and Language · Computer Science 2024-07-17 Qimin Yang , Rongsheng Wang , Jiexin Chen , Runqi Su , Tao Tan

In current benchmarks for evaluating large language models (LLMs), there are issues such as evaluation content restriction, untimely updates, and lack of optimization guidance. In this paper, we propose a new paradigm for the measurement of…

Computation and Language · Computer Science 2024-07-11 Jin Liu , Qingquan Li , Wenlong Du