中文
相关论文

相关论文: Evaluating Chinese Ambiguity Understanding in Larg…

200 篇论文

Accurate uncertainty quantification (UQ) in Large Language Models (LLMs) is critical for trustworthy deployment. While real-world language is inherently ambiguous, reflecting aleatoric uncertainty, existing UQ methods are typically…

机器学习 · 计算机科学 2026-01-30 Tim Tomov , Dominik Fuchsgruber , Tom Wollschläger , Stephan Günnemann

Recent advances in large language models (LLMs) have shown that they can answer questions requiring complex reasoning. However, their ability to identify and respond to text containing logical fallacies or deliberately misleading premises…

计算与语言 · 计算机科学 2025-02-19 Zenan Zhai , Hao Li , Xudong Han , Zhenxuan Zhang , Yixuan Zhang , Timothy Baldwin , Haonan Li

Large language models (LLMs) have showcased remarkable capabilities in understanding and generating language. However, their ability in comprehending ancient languages, particularly ancient Chinese, remains largely unexplored. To bridge…

计算与语言 · 计算机科学 2023-10-17 Yixuan Zhang , Haonan Li

Short-video platforms have become major channels for misinformation, where deceptive claims frequently leverage visual experiments and social cues. While Multimodal Large Language Models (MLLMs) have demonstrated impressive reasoning…

计算与语言 · 计算机科学 2026-05-19 Jen-tse Huang , Chang Chen , Shiyang Lai , Wenxuan Wang , Michelle R. Kaufman , Mark Dredze

We present ZhoBLiMP, the largest linguistic minimal pair benchmark for Chinese, with over 100 paradigms, ranging from topicalization to the \textit{Ba} construction. We then train from scratch a suite of Chinese language models (LMs) with…

计算与语言 · 计算机科学 2025-12-09 Yikang Liu , Yeting Shen , Hongao Zhu , Lilong Xu , Zhiheng Qian , Siyuan Song , Kejia Zhang , Jialong Tang , Pei Zhang , Baosong Yang , Rui Wang , Hai Hu

Large language models (LLMs) demonstrate exceptional performance on tasks requiring complex linguistic abilities, such as reference disambiguation and metaphor recognition/generation. Although LLMs possess impressive capabilities, their…

计算与语言 · 计算机科学 2025-09-16 Yi Jing , Zijun Yao , Hongzhu Guo , Lingxu Ran , Xiaozhi Wang , Lei Hou , Juanzi Li

Large language models (LLMs) exhibit strong generative capabilities but remain vulnerable to confabulations, fluent yet unreliable outputs that vary arbitrarily even under identical prompts. Leveraging a quantum tensor network based…

计算与语言 · 计算机科学 2026-02-03 Pragatheeswaran Vipulanandan , Kamal Premaratne , Dilip Sarkar

Language confusion -- where large language models (LLMs) generate unintended languages against the user's need -- remains a critical challenge, especially for English-centric models. We present the first mechanistic interpretability (MI)…

计算与语言 · 计算机科学 2025-09-19 Ercong Nie , Helmut Schmid , Hinrich Schütze

Large Language Models (LLMs) are increasingly integrated into search services, providing direct answers that can reduce users' reliance on traditional result pages. Yet their factual reliability in non-English web ecosystems remains poorly…

信息检索 · 计算机科学 2026-02-27 Geng Liu , Junjie Mu , Li Feng , Mengxiao Zhu , Francesco Pierri

Ambiguity is an intrinsic feature of natural language. Managing ambiguity is a key part of human language understanding, allowing us to anticipate misunderstanding as communicators and revise our interpretations as listeners. As language…

The effectiveness of large language models (LLMs) to fact-check misinformation remains uncertain, despite their growing use. To this end, we present CANDY, a benchmark designed to systematically evaluate the capabilities and limitations of…

计算与语言 · 计算机科学 2025-09-05 Ruiling Guo , Xinwei Yang , Chen Huang , Tong Zhang , Yong Hu

The release of top-performing open-weight LLMs has cemented China's role as a leading force in AI development. Do these models support languages spoken in China? Or do they support the same languages as models developed in the United States…

计算与语言 · 计算机科学 2026-05-18 Andrea W Wen-Yi , Unso Eun Seo Jo , David Mimno

As ChatGPT and GPT-4 spearhead the development of Large Language Models (LLMs), more researchers are investigating their performance across various tasks. But more research needs to be done on the interpretability capabilities of LLMs, that…

计算与语言 · 计算机科学 2023-10-27 Dongfang Li , Jindi Yu , Baotian Hu , Zhenran Xu , Min Zhang

The advancement of large language models (LLMs) has enhanced the ability to generalize across a wide range of unseen natural language processing (NLP) tasks through instruction-following. Yet, their effectiveness often diminishes in…

Large language models (LLMs) demonstrate remarkable breadth of knowledge, yet their ability to reason about computational processes remains poorly understood. Closing this gap matters for practitioners who rely on LLMs to guide algorithm…

计算与语言 · 计算机科学 2026-04-07 Sohan Venkatesh , Ashish Mahendran Kurapath , Tejas Melkote

In this study, we introduce CT-LLM, a 2B large language model (LLM) that illustrates a pivotal shift towards prioritizing the Chinese language in developing LLMs. Uniquely initiated from scratch, CT-LLM diverges from the conventional…

While pre-trained language models (LMs) have brought great improvements in many NLP tasks, there is increasing attention to explore capabilities of LMs and interpret their predictions. However, existing works usually focus only on a certain…

计算与语言 · 计算机科学 2022-07-29 Yaozong Shen , Lijie Wang , Ying Chen , Xinyan Xiao , Jing Liu , Hua Wu

The rapid growth of large language models (LLMs) has heightened the demand for accurate detection of AI-generated text, particularly in languages like Chinese, where subtle linguistic nuances pose significant challenges to current methods.…

计算与语言 · 计算机科学 2025-09-03 Houji Jin , Negin Ashrafi , Armin Abdollahi , Wei Liu , Jian Wang , Ganyu Gui , Maryam Pishgar , Huanghao Feng

Large Language Models (LLMs) have demonstrated promising capabilities for code generation. While existing benchmarks evaluate the correctness and efficiency of LLM-generated code, the potential linguistic bias - where code quality varies…

软件工程 · 计算机科学 2025-05-02 Weipeng Jiang , Xuanqi Gao , Juan Zhai , Shiqing Ma , Xiaoyu Zhang , Ziyan Lei , Chao Shen

The success of ChatGPT validates the potential of large language models (LLMs) in artificial general intelligence (AGI). Subsequently, the release of LLMs has sparked the open-source community's interest in instruction-tuning, which is…

计算与语言 · 计算机科学 2023-10-23 Qingyi Si , Tong Wang , Zheng Lin , Xu Zhang , Yanan Cao , Weiping Wang