中文
相关论文

相关论文: The Roles of English in Evaluating Multilingual La…

200 篇论文

Large language models (LLMs) have demonstrated multilingual capabilities, yet they are mostly English-centric due to the imbalanced training corpora. While prior works have leveraged this bias to enhance multilingual performance through…

计算与语言 · 计算机科学 2025-04-22 Chaoqun Liu , Wenxuan Zhang , Yiran Zhao , Anh Tuan Luu , Lidong Bing

Large language models (LLMs) are increasingly being adopted in educational settings. These applications expand beyond English, though current LLMs remain primarily English-centric. In this work, we ascertain if their use in education…

计算与语言 · 计算机科学 2025-08-06 Vansh Gupta , Sankalan Pal Chowdhury , Vilém Zouhar , Donya Rooein , Mrinmaya Sachan

Previous work indicates that large language models exhibit a significant "English bias", i.e. they often perform better when tasks are presented in English. Interestingly, we have observed that using certain other languages in reasoning…

计算与语言 · 计算机科学 2025-04-17 Changjiang Gao , Xu Huang , Wenhao Zhu , Shujian Huang , Lei Li , Fei Yuan

Natural language processing (NLP) tasks (e.g. question-answering in English) benefit from knowledge of other tasks (e.g. named entity recognition in English) and knowledge of other languages (e.g. question-answering in Spanish). Such shared…

计算与语言 · 计算机科学 2021-03-23 Ishan Tarunesh , Sushil Khyalia , Vishwajeet Kumar , Ganesh Ramakrishnan , Preethi Jyothi

In Natural Language Processing (NLP), one traditionally considers a single task (e.g. part-of-speech tagging) for a single language (e.g. English) at a time. However, recent work has shown that it can be beneficial to take advantage of…

计算与语言 · 计算机科学 2018-09-10 Johannes Bjerva

The breakthrough of generative large language models (LLMs) that can solve different tasks through chat interaction has led to a significant increase in the use of general benchmarks to assess the quality or performance of these models…

计算与语言 · 计算机科学 2025-04-03 Fabio Barth , Georg Rehm

Large language models (LLMs) have demonstrated impressive capabilities across diverse languages. This study explores how LLMs handle multilingualism. Based on observed language ratio shifts among layers and the relationships between network…

计算与语言 · 计算机科学 2024-11-12 Yiran Zhao , Wenxuan Zhang , Guizhen Chen , Kenji Kawaguchi , Lidong Bing

Large language models (LLMs) can answer prompts in many languages, despite being trained predominantly on English; yet, the mechanisms driving this generalization remain poorly understood. This work asks: How does an LLM's ability to align…

计算与语言 · 计算机科学 2026-02-02 Kartik Ravisankar , Hyojung Han , Sarah Wiegreffe , Marine Carpuat

Despite the widespread multilingual deployment of large language models, post-training pipelines remain predominantly English-centric, contributing to performance disparities across languages. We present a systematic, controlled study of…

计算与语言 · 计算机科学 2026-04-16 Mehak Dhaliwal , Shashwat Chaurasia , Yao Qin , Dezhi Hong , Thomas Butler

Large language models (LLMs) provide detailed and impressive responses to queries in English. However, are they really consistent at responding to the same query in other languages? The popular way of evaluating for multilingual performance…

计算与语言 · 计算机科学 2025-05-29 Ashim Gupta , Maitrey Mehta , Zhichao Xu , Vivek Srikumar

Current Large Language Models (LLMs) are predominantly designed with English as the primary language, and even the few that are multilingual tend to exhibit strong English-centric biases. Much like speakers who might produce awkward…

计算与语言 · 计算机科学 2025-07-29 Yanzhu Guo , Simone Conia , Zelin Zhou , Min Li , Saloni Potdar , Henry Xiao

Large language models (LLMs) offer promise in generating educational content, providing instructor feedback, and reducing teacher workload on assessments. While prior studies have focused on studying LLM-powered learning analytics, limited…

计算与语言 · 计算机科学 2024-11-08 Anand Syamkumar , Nora Tseng , Kaycie Barron , Shanglin Yang , Shamya Karumbaiah , Rheeya Uppal , Junjie Hu

Despite advances in the multilingual capabilities of Large Language Models (LLMs) across diverse tasks, English remains the dominant language for LLM research and development. So, when working with a different language, this has led to the…

计算与语言 · 计算机科学 2025-02-14 Itai Mondshine , Tzuf Paz-Argaman , Reut Tsarfaty

English has long been assumed the $\textit{lingua franca}$ of scientific research, and this notion is reflected in the natural language processing (NLP) research involving scientific document representation. In this position piece, we…

计算与语言 · 计算机科学 2024-03-28 Abteen Ebrahimi , Kenneth Church

The rise of Large Language Models (LLMs) has revolutionized natural language processing across numerous languages and tasks. However, evaluating LLM performance in a consistent and meaningful way across multiple European languages remains…

Large language models (LLMs) have multilingual capabilities and can solve tasks across various languages. However, we show that current LLMs make key decisions in a representation space closest to English, regardless of their input and…

计算与语言 · 计算机科学 2025-02-24 Lisa Schut , Yarin Gal , Sebastian Farquhar

Large language models (LLMs) are gaining increasing popularity in both academia and industry, owing to their unprecedented performance in various applications. As LLMs continue to play a vital role in both research and daily use, their…

As Large Language Models (LLMs) are now capable of producing fluent and coherent content in languages other than English, it is not imperative to precisely evaluate these non-English outputs. However, when assessing the outputs from…

While recent efforts have begun integrating large language models (LLMs) into English education, they often rely on traditional approaches to learning tasks without fully embracing educational methodologies, thus lacking adaptability to…

计算与语言 · 计算机科学 2025-09-09 Jingheng Ye , Shen Wang , Deqing Zou , Yibo Yan , Kun Wang , Hai-Tao Zheng , Ruitong Liu , Zenglin Xu , Irwin King , Philip S. Yu , Qingsong Wen

The vast majority of today's large language models (LLMs) are English-centric, having been pretrained predominantly on English text. Yet, in order to meet user expectations, models need to be able to respond appropriately in multiple…

计算与语言 · 计算机科学 2024-10-04 Tannon Kew , Florian Schottmann , Rico Sennrich
‹ 上一页 1 2 3 10 下一页 ›