中文
相关论文

相关论文: Rethinking Cross-lingual Gaps from a Statistical V…

200 篇论文

Large Language Models (LLMs) have shown remarkable performances on a wide range of natural language understanding and generation tasks. We observe that the LLMs provide effective priors in exploiting $\textit{linguistic shortcuts}$ for…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Dohwan Ko , Ji Soo Lee , Wooyoung Kang , Byungseok Roh , Hyunwoo J. Kim

Large language models (LLMs) have shown impressive prowess in solving a wide range of tasks with world knowledge. However, it remains unclear how well LLMs are able to perceive their factual knowledge boundaries, particularly under…

计算与语言 · 计算机科学 2024-11-20 Ruiyang Ren , Yuhao Wang , Yingqi Qu , Wayne Xin Zhao , Jing Liu , Hao Tian , Hua Wu , Ji-Rong Wen , Haifeng Wang

Current large language models (LLMs) generally show a significant performance gap in alignment between English and other languages. To bridge this gap, existing research typically leverages the model's responses in English as a reference to…

计算与语言 · 计算机科学 2025-09-16 Xue Zhang , Yunlong Liang , Fandong Meng , Songming Zhang , Yufeng Chen , Jinan Xu , Jie Zhou

Large Language Models (LLMs) exhibit a puzzling disparity in their formal linguistic competence: while they learn some linguistic phenomena with near-perfect mastery, they often perform below chance on others, even after training on…

计算与语言 · 计算机科学 2026-04-21 H S V N S Kowndinya Renduchintala , Sumit Bhatia

Large language models (LLMs) are transforming the ways the general public accesses and consumes information. Their influence is particularly pronounced in pivotal sectors like healthcare, where lay individuals are increasingly appropriating…

计算与语言 · 计算机科学 2023-10-24 Yiqiao Jin , Mohit Chandra , Gaurav Verma , Yibo Hu , Munmun De Choudhury , Srijan Kumar

Lexical gaps are words that do not exist in certain languages. They pose challenges for building multilingual lexical resources, for machine translation, and for cross-lingual transfer. Existing lexical gap detection relies on human…

计算与语言 · 计算机科学 2026-05-26 Yoonwon Jung , Aaron S. Cohen , Benjamin K. Bergen

System 2 reasoning is one of the defining characteristics of intelligence, which requires slow and logical thinking. Human conducts System 2 reasoning via the language of thoughts that organizes the reasoning process as a causal sequence of…

计算与语言 · 计算机科学 2025-05-20 Chenxi Liu , Yongqiang Chen , Tongliang Liu , James Cheng , Bo Han , Kun Zhang

Large language models (LLMs) are increasingly used across diverse cultural contexts, making accurate cultural understanding essential. Prior evaluations have mostly focused on output-level performance, obscuring the factors that drive…

计算与语言 · 计算机科学 2025-11-12 Seungho Cho , Changgeon Ko , Eui Jun Hwang , Junmyeong Lee , Huije Lee , Jong C. Park

Large Language Models (LLMs) have demonstrated promising capabilities for code generation. While existing benchmarks evaluate the correctness and efficiency of LLM-generated code, the potential linguistic bias - where code quality varies…

软件工程 · 计算机科学 2025-05-02 Weipeng Jiang , Xuanqi Gao , Juan Zhai , Shiqing Ma , Xiaoyu Zhang , Ziyan Lei , Chao Shen

Large language models (LLMs) frequently generate confident yet inaccurate responses, introducing significant risks for deployment in safety-critical domains. We present a novel, test-time approach to detecting model hallucination through…

机器学习 · 计算机科学 2025-10-07 Hazel Kim , Tom A. Lamb , Adel Bibi , Philip Torr , Yarin Gal

Large Language Models (LLMs) are claimed to be capable of Natural Language Inference (NLI), necessary for applied tasks like question answering and summarization. We present a series of behavioral studies on several LLM families (LLaMA,…

计算与语言 · 计算机科学 2023-10-24 Nick McKenna , Tianyi Li , Liang Cheng , Mohammad Javad Hosseini , Mark Johnson , Mark Steedman

Language Models (LMs) have emerged as powerful sources of evidence for linguists seeking to develop theories of syntax. In this paper, we argue that causal interpretability methods, applied to LMs, can greatly enhance the value of such…

计算与语言 · 计算机科学 2025-10-01 Sasha Boguraev , Christopher Potts , Kyle Mahowald

Large language models are increasingly used as judges (LLM-as-a-judge) to evaluate model outputs at scale, but their assessments often diverge systematically from human judgments. We present Bridge, a unified statistical framework that…

机器学习 · 计算机科学 2025-12-03 Felipe Maia Polo , Xinhe Wang , Mikhail Yurochkin , Gongjun Xu , Moulinath Banerjee , Yuekai Sun

Large language models (LLMs) often encounter knowledge conflicts, scenarios where discrepancy arises between the internal parametric knowledge of LLMs and non-parametric information provided in the prompt context. In this work we ask what…

计算与语言 · 计算机科学 2024-10-16 Yike Wang , Shangbin Feng , Heng Wang , Weijia Shi , Vidhisha Balachandran , Tianxing He , Yulia Tsvetkov

Large language models (LLMs) have demonstrated significant capabilities in solving mathematical problems expressed in natural language. However, multilingual and culturally-grounded mathematical reasoning in low-resource languages lags…

计算与语言 · 计算机科学 2026-04-21 Israel Abebe Azime , Tadesse Destaw Belay , Dietrich Klakow , Philipp Slusallek , Anshuman Chhabra

Chain-of-thought (CoT) has emerged as a critical mechanism for enhancing reasoning capabilities in large language models (LLMs), with self-consistency demonstrating notable promise in boosting performance. However, inherent linguistic…

计算与语言 · 计算机科学 2025-04-03 Zhiwei Yu , Tuo Li , Changhong Wang , Hui Chen , Lang Zhou

Large language models (LLMs) have been found to produce hallucinations when the question exceeds their internal knowledge boundaries. A reliable model should have a clear perception of its knowledge boundaries, providing correct answers…

计算与语言 · 计算机科学 2024-08-20 Shiyu Ni , Keping Bi , Lulu Yu , Jiafeng Guo

In recent years, pre-trained Multilingual Language Models (MLLMs) have shown a strong ability to transfer knowledge across different languages. However, given that the aspiration for such an ability has not been explicitly incorporated in…

计算与语言 · 计算机科学 2023-05-29 Fred Philippy , Siwen Guo , Shohreh Haddadan

In our era of widespread false information, human fact-checkers often face the challenge of duplicating efforts when verifying claims that may have already been addressed in other countries or languages. As false information transcends…

计算与语言 · 计算机科学 2025-09-25 Ivan Vykopal , Matúš Pikuliak , Simon Ostermann , Tatiana Anikina , Michal Gregor , Marián Šimko

The rapid development of large language models (LLMs) has not only provided numerous opportunities but also presented significant challenges. This becomes particularly evident when LLMs inadvertently generate harmful or toxic content,…