English
Related papers

Related papers: Beyond Memorization: A Rigorous Evaluation Framewo…

200 papers

Text rendering has recently emerged as one of the most challenging frontiers in visual generation, drawing significant attention from large-scale diffusion and multimodal models. However, text editing within images remains largely…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Rui Gui , Yang Wan , Haochen Han , Dongxing Mao , Fangming Liu , Min Li , Alex Jinpeng Wang

Large Language Models (LLMs) require efficient knowledge editing (KE) to update factual information, yet existing methods exhibit significant performance decay in multi-hop factual recall. This failure is particularly acute when edits…

Computation and Language · Computer Science 2026-03-10 Jiayu Yang , Yuxuan Fan , Songning Lai , Shengen Wu , Jiaqi Tang , Chun Kang , Zhijiang Guo , Yutao Yue

There is vivid research on adapting Large Language Models (LLMs) to perform a variety of tasks in high-stakes domains such as healthcare. Despite their popularity, there is a lack of understanding of the extent and contributing factors that…

Computation and Language · Computer Science 2024-06-07 Anand Subramanian , Viktor Schlegel , Abhinav Ramesh Kashyap , Thanh-Tung Nguyen , Vijay Prakash Dwivedi , Stefan Winkler

Large language models (LLMs) risk retaining sensitive, copyrighted, or harmful information from their training data. Entity-level unlearning addresses this issue by removing all knowledge of a specific entity while preserving the model's…

Computation and Language · Computer Science 2026-01-15 Xiaoqi Han , Víctor Gutiérrez-Basulto , Ru Li , Xiaoli Li , Jiye Liang , Jeff Z. Pan

Unstructured Knowledge Editing (UKE) is crucial for updating the relevant knowledge of large language models (LLMs). It focuses on unstructured inputs, such as long or free-form texts, which are common forms of real-world knowledge.…

Computation and Language · Computer Science 2025-06-12 Hao Xiong , Chuanyuan Tan , Wenliang Chen

In recent years, large language models (LLMs), such as GPTs, have attained great impact worldwide. However, how to adapt these LLMs to better suit the vertical domain-specific tasks by utilizing external knowledge remains not completely…

Computation and Language · Computer Science 2023-11-03 Peng Fu , Yiming Zhang , Haobo Wang , Weikang Qiu , Junbo Zhao

Large Multi-modality Models (LMMs) have made significant progress in visual understanding and generation, but they still face challenges in General Visual Editing, particularly in following complex instructions, preserving appearance…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xiangyu Zhao , Peiyuan Zhang , Kexian Tang , Xiaorong Zhu , Hao Li , Wenhao Chai , Zicheng Zhang , Renqiu Xia , Guangtao Zhai , Junchi Yan , Hua Yang , Xue Yang , Haodong Duan

Drug repurposing plays a critical role in accelerating treatment discovery, especially for complex and rare diseases. Biomedical knowledge graphs (KGs), which encode rich clinical associations, have been widely adopted to support this task.…

Computation and Language · Computer Science 2025-10-15 Chengrui Xiang , Tengfei Ma , Xiangzheng Fu , Yiping Liu , Bosheng Song , Xiangxiang Zeng

Understanding and continuously refining multimodal molecular knowledge is crucial for advancing biomedicine, chemistry, and materials science. Molecule language models (MoLMs) have become powerful tools in these domains, integrating…

Machine Learning · Computer Science 2025-12-01 Zhenyu Lei , Patrick Soga , Yaochen Zhu , Yinhan He , Yushun Dong , Jundong Li

By design, large language models (LLMs) are static general-purpose models, expensive to retrain or update frequently. As they are increasingly adopted for knowledge-intensive tasks, it becomes evident that these design choices lead to…

Computation and Language · Computer Science 2024-03-25 Shangbin Feng , Weijia Shi , Yuyang Bai , Vidhisha Balachandran , Tianxing He , Yulia Tsvetkov

Large language models (LLMs) have demonstrated remarkable performance on various medical benchmarks, but their capabilities across different cognitive levels remain underexplored. Inspired by Bloom's Taxonomy, we propose a…

Computation and Language · Computer Science 2025-06-11 Yuxuan Zhou , Xien Liu , Chenwei Yan , Chen Ning , Xiao Zhang , Boxun Li , Xiangling Fu , Shijin Wang , Guoping Hu , Yu Wang , Ji Wu

Electronic medical records (EMRs), particularly in neurology, are inherently heterogeneous, sparse, and noisy, which poses significant challenges for large language models (LLMs) in clinical diagnosis. In such settings, single-agent systems…

Artificial Intelligence · Computer Science 2026-04-30 Shaowei Shen , Xiaohong Yang , Jie Yang , Lianfen Huang , Yongcai Zhang , Yang Zou , Seyyedali Hosseinalipour

Recently, large language model (LLM) based artificial intelligence (AI) systems have demonstrated remarkable capabilities in natural language understanding and generation. However, these models face a significant challenge when it comes to…

During pre-training, the Text-to-Image (T2I) diffusion models encode factual knowledge into their parameters. These parameterized facts enable realistic image generation, but they may become obsolete over time, thereby misrepresenting the…

Computation and Language · Computer Science 2024-10-29 Hengrui Gu , Kaixiong Zhou , Yili Wang , Ruobing Wang , Xin Wang

Passage re-ranking is to obtain a permutation over the candidate passage set from retrieval stage. Re-rankers have been boomed by Pre-trained Language Models (PLMs) due to their overwhelming advantages in natural language understanding.…

Information Retrieval · Computer Science 2022-04-26 Qian Dong , Yiding Liu , Suqi Cheng , Shuaiqiang Wang , Zhicong Cheng , Shuzi Niu , Dawei Yin

Cognitive Diagnosis Models (CDMs) are designed to assess students' cognitive states by analyzing their performance across a series of exercises. However, existing CDMs often struggle with diagnosing infrequent students and exercises due to…

Artificial Intelligence · Computer Science 2025-02-11 Zhiang Dong , Jingyuan Chen , Fei Wu

Evaluations of model editing currently only use the `next few token' completions after a prompt. As a result, the impact of these methods on longer natural language generation is largely unknown. We introduce long-form evaluation of model…

Computation and Language · Computer Science 2024-04-02 Domenic Rosati , Robie Gonzales , Jinkun Chen , Xuemin Yu , Melis Erkan , Yahya Kayani , Satya Deepika Chavatapalli , Frank Rudzicz , Hassan Sajjad

Enriching existing medical terminology knowledge bases (KBs) is an important and never-ending work for clinical research because new terminology alias may be continually added and standard terminologies may be newly renamed. In this paper,…

Computation and Language · Computer Science 2019-09-04 Jiaying Zhang , Zhixing Zhang , Huanhuan Zhang , Zhiyuan Ma , Yangming Zhou , Ping He

The widespread adoption of large-scale pre-training techniques has significantly advanced the development of medical foundation models, enabling them to serve as versatile tools across a broad range of medical tasks. However, despite their…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Haolin Li , Yuhang Zhou , Ziheng Zhao , Siyuan Du , Jiangchao Yao , Weidi Xie , Ya Zhang , Yanfeng Wang

Accurate prediction of clinical outcomes using Electronic Health Records (EHRs) is critical for early intervention, efficient resource allocation, and improved patient care. EHRs contain multimodal data, including both structured data and…

Machine Learning · Computer Science 2025-08-29 Rituparna Datta , Jiaming Cui , Zihan Guan , Vishal G. Reddy , Joshua C. Eby , Gregory Madden , Rupesh Silwal , Anil Vullikanti