中文
相关论文

相关论文: MechELK: A Mechanistic Interpretability Framework …

200 篇论文

Pre-trained Language Models (PLMs) are trained on large amounts of unlabeled data, yet they exhibit remarkable reasoning skills. However, the trustworthiness challenges posed by these black-box models have become increasingly evident in…

计算与语言 · 计算机科学 2025-08-26 Yunxiao Zhao , Hao Xu , Zhiqiang Wang , Xiaoli Li , Jiye Liang , Ru Li

Large language models (LLMs) exhibit systematic miscalibration with rhetorical intensity not proportionate to epistemic grounding. This study tests this hypothesis and proposes a framework for quantifying this decoupling by designing a…

计算与语言 · 计算机科学 2026-04-23 Asim D. Bakhshi

Large language models (LLMs) are increasingly used across diverse linguistic and cultural contexts, yet their cultural knowledge remains uneven across regions and languages. We present the DFKI-MLT system for SemEval-2026 Task 7 on cultural…

Despite Large Language Models' remarkable capabilities, understanding their internal representations remains challenging. Mechanistic interpretability tools such as sparse autoencoders (SAEs) were developed to extract interpretable features…

机器学习 · 计算机科学 2026-01-06 Xiangchen Song , Jiaqi Sun , Zijian Li , Yujia Zheng , Kun Zhang

Humankind's understanding of the world is fundamentally linked to our perception and cognition, with \emph{human languages} serving as one of the major carriers of \emph{world knowledge}. In this vein, \emph{Large Language Models} (LLMs)…

人工智能 · 计算机科学 2024-06-27 Huajun Chen

The growth of Massive Open Online Courses (MOOCs) presents significant challenges for personalized learning, where concept recommendation is crucial. Existing approaches typically rely on heterogeneous information networks or knowledge…

信息检索 · 计算机科学 2025-11-27 Xiangrui Xiong , Yichuan Lu , Zifei Pan , Chang Sun

In recent years, large-scale language models (LLMs) have gained attention for their impressive text generation capabilities. However, these models often face the challenge of "hallucination," which undermines their reliability. In this…

计算与语言 · 计算机科学 2023-10-10 Yuchen Yang , Houqiang Li , Yanfeng Wang , Yu Wang

Large Language Models (LLM) can struggle with reasoning ability and planning tasks. Many prompting techniques have been developed to assist with LLM reasoning, notably Chain-of-Thought (CoT); however, these techniques, too, have come under…

人工智能 · 计算机科学 2026-02-05 Erik Goh , John Kos , Ashok Goel

Calculating semantic textual similarity is a foundational task in natural language processing. Current large language models (LLMs) based methods typically rely on extracting last-layer hidden states with fixed dimensions to compute…

计算与语言 · 计算机科学 2026-05-29 Kaijie Zheng , Weiqin Wang , Yile Wang , Hui Huang

While large language models (LLMs) have demonstrated impressive capabilities across various natural language processing tasks by acquiring rich factual knowledge from their broad training data, their ability to synthesize and logically…

计算与语言 · 计算机科学 2024-07-31 Tianshi Zheng , Jiaxin Bai , Yicheng Wang , Tianqing Fang , Yue Guo , Yauwai Yim , Yangqiu Song

Despite the rapid expansion of Large Language Models (LLMs) in healthcare, robust and explainable evaluation of their ability to assess clinical trial reporting according to CONSORT standards remains an open challenge. In particular,…

人工智能 · 计算机科学 2026-02-26 Sohyeon Jeon , Hyung-Chul Lee

With the emerging branch of incorporating factual knowledge into pre-trained language models such as BERT, most existing models consider shallow, static, and separately pre-trained entity embeddings, which limits the performance gains of…

计算与语言 · 计算机科学 2020-10-02 Tianxiang Sun , Yunfan Shao , Xipeng Qiu , Qipeng Guo , Yaru Hu , Xuanjing Huang , Zheng Zhang

Large language models (LLMs) tend to inadequately integrate input context during text generation, relying excessively on encoded prior knowledge in model parameters, potentially resulting in generated text with factual inconsistencies or…

计算与语言 · 计算机科学 2024-05-07 Zheng Zhao , Emilio Monti , Jens Lehmann , Haytham Assem

Multimodal large language models (MLLMs) are prone to non-factual or outdated knowledge issues, which can manifest as misreading and misrecognition errors due to the complexity of multimodal knowledge. Previous benchmarks have not…

计算机视觉与模式识别 · 计算机科学 2024-10-31 Junzhe Zhang , Huixuan Zhang , Xunjian Yin , Baizhou Huang , Xu Zhang , Xinyu Hu , Xiaojun Wan

Large Language Models (LLMs) have shown impressive capabilities, yet updating their knowledge remains a significant challenge, often leading to outdated or inaccurate responses. A proposed solution is the integration of external knowledge…

计算与语言 · 计算机科学 2025-07-16 Dehao Tao , Congqi Wang , Feng Huang , Junhao Chen , Yongfeng Huang , Minghu Jiang

Click-through rate (CTR) prediction plays an important role in online advertising systems. On the one hand, traditional CTR prediction models capture the collaborative signals in tabular data via feature interaction modeling, but they lose…

信息检索 · 计算机科学 2025-09-10 Rui Dong , Wentao Ouyang , Xiangzheng Liu

Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when solely relying on their internal knowledge, especially when answering questions that require less commonly known…

计算与语言 · 计算机科学 2023-11-01 Wenting Zhao , Ye Liu , Tong Niu , Yao Wan , Philip S. Yu , Shafiq Joty , Yingbo Zhou , Semih Yavuz

Mechanistic Interpretability (MI) seeks to explain how neural networks implement their capabilities, but the scale of Large Language Models (LLMs) has limited prior MI work in Machine Translation (MT) to word-level analyses. We study…

计算与语言 · 计算机科学 2026-02-05 Théo Lasnier , Armel Zebaze , Djamé Seddah , Rachel Bawden , Benoît Sagot

Recently, knowledge editing on large language models (LLMs) has received considerable attention. Compared to this, editing Large Vision-Language Models (LVLMs) faces extra challenges from diverse data modalities and complicated model…

计算与语言 · 计算机科学 2024-10-30 Han Huang , Haitian Zhong , Tao Yu , Qiang Liu , Shu Wu , Liang Wang , Tieniu Tan

Large language models are increasingly integrated into decision-making in areas such as healthcare, law, finance, engineering, and government. Yet they share a critical limitation: they produce fluent outputs even when their internal…

人工智能 · 计算机科学 2026-04-17 Rikard Rosenbacke , Carl Rosenbacke , Victor Rosenbacke , Martin McKee