中文
相关论文

相关论文: Multilingual Large Language Models and Curse of Mu…

200 篇论文

Recently, decoder-only pre-trained large language models (LLMs), with several tens of billion parameters, have significantly impacted a wide range of natural language processing (NLP) tasks. While encoder-only or encoder-decoder pre-trained…

计算与语言 · 计算机科学 2024-03-11 Aru Maekawa , Tsutomu Hirao , Hidetaka Kamigaito , Manabu Okumura

Multilingual pre-trained Large Language Models (LLMs) are incredibly effective at Question Answering (QA), a core task in Natural Language Understanding, achieving high accuracies on several multilingual benchmarks. However, little is known…

计算与语言 · 计算机科学 2024-04-16 Yahan Yang , Soham Dan , Dan Roth , Insup Lee

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

计算与语言 · 计算机科学 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

This paper investigates the utilization of Large Language Models (LLMs) for solving complex linguistic puzzles, a domain requiring advanced reasoning and adept translation capabilities akin to human cognitive processes. We explore specific…

计算与语言 · 计算机科学 2025-02-04 Zheng-Lin Lin , Yu-Fei Shih , Shu-Kai Hsieh

Large language models (LLMs) offer promise in generating educational content, providing instructor feedback, and reducing teacher workload on assessments. While prior studies have focused on studying LLM-powered learning analytics, limited…

计算与语言 · 计算机科学 2024-11-08 Anand Syamkumar , Nora Tseng , Kaycie Barron , Shanglin Yang , Shamya Karumbaiah , Rheeya Uppal , Junjie Hu

Large language models (LLMs) demonstrate unprecedented capabilities and define the state of the art for almost all natural language processing (NLP) tasks and also for essentially all Language Technology (LT) applications. LLMs can only be…

计算与语言 · 计算机科学 2025-02-19 Georg Rehm , Annika Grützner-Zahn , Fabio Barth

Multilingualism in Large Language Models (LLMs) is an yet under-explored area. In this paper, we conduct an in-depth analysis of the multilingual capabilities of a family of a Large Language Model, examining its architecture, activation…

计算与语言 · 计算机科学 2024-04-23 Sunit Bhattacharya , Ondřej Bojar

Language is essentially a complex, intricate system of human expressions governed by grammatical rules. It poses a significant challenge to develop capable AI algorithms for comprehending and grasping a language. As a major approach,…

Large Language Models (LLMs) have emerged as powerful tools in the field of Natural Language Processing (NLP) and have recently gained significant attention in the domain of Recommendation Systems (RS). These models, trained on massive…

信息检索 · 计算机科学 2024-06-19 Likang Wu , Zhi Zheng , Zhaopeng Qiu , Hao Wang , Hongchao Gu , Tingjia Shen , Chuan Qin , Chen Zhu , Hengshu Zhu , Qi Liu , Hui Xiong , Enhong Chen

Large Language Models (LLMs) have gained significant attention due to their high performance on a wide range of natural language tasks since the release of ChatGPT. The LLMs learn to understand and generate language by training billions of…

计算与语言 · 计算机科学 2024-08-29 Wazir Ali , Sampo Pyysalo

Human bilinguals often use similar brain regions to process multiple languages, depending on when they learned their second language and their proficiency. In large language models (LLMs), how are multiple languages learned and encoded? In…

计算与语言 · 计算机科学 2025-05-26 Jannik Brinkmann , Chris Wendler , Christian Bartelt , Aaron Mueller

Large Language Models (LLMs) have recently demonstrated remarkable capabilities in natural language processing tasks and beyond. This success of LLMs has led to a large influx of research contributions in this direction. These works…

计算与语言 · 计算机科学 2024-10-18 Humza Naveed , Asad Ullah Khan , Shi Qiu , Muhammad Saqib , Saeed Anwar , Muhammad Usman , Naveed Akhtar , Nick Barnes , Ajmal Mian

Although recent Massively Multilingual Language Models (MMLMs) like mBERT and XLMR support around 100 languages, most existing multilingual NLP benchmarks provide evaluation data in only a handful of these languages with little linguistic…

计算与语言 · 计算机科学 2022-11-15 Kabir Ahuja , Sandipan Dandapat , Sunayana Sitaram , Monojit Choudhury

Large language models (LLMs) have demonstrated impressive translation capabilities even without being explicitly trained on parallel data. This remarkable property has led some to believe that parallel data is no longer necessary for…

计算与语言 · 计算机科学 2025-06-17 Muhammad Reza Qorib , Junyi Li , Hwee Tou Ng

Neural language modeling (LM) has led to significant improvements in several applications, including Automatic Speech Recognition. However, they typically require large amounts of training data, which is not available for many domains and…

计算与语言 · 计算机科学 2019-06-05 Navid Rekabsaz , Nikolaos Pappas , James Henderson , Banriskhem K. Khonglah , Srikanth Madikeri

This paper presents a comprehensive evaluation of the capabilities of Large Language Models (LLMs) in metaphor interpretation across multiple datasets, tasks, and prompt configurations. Although metaphor processing has gained significant…

计算与语言 · 计算机科学 2025-07-22 Elisa Sanchez-Bayona , Rodrigo Agerri

With the advent of Large Language Models (LLMs), generating rule-based data for real-world applications has become more accessible. Due to the inherent ambiguity of natural language and the complexity of rule sets, especially in long…

计算与语言 · 计算机科学 2025-04-21 Teng Wang , Zhenqi He , Wing-Yin Yu , Xiaojin Fu , Xiongwei Han

Large language models (LLMs) are increasingly being adopted in educational settings. These applications expand beyond English, though current LLMs remain primarily English-centric. In this work, we ascertain if their use in education…

计算与语言 · 计算机科学 2025-08-06 Vansh Gupta , Sankalan Pal Chowdhury , Vilém Zouhar , Donya Rooein , Mrinmaya Sachan

Over the past three years, the rapid advancement of Large Language Models (LLMs) has had a profound impact on multiple areas of Artificial Intelligence (AI), particularly in Natural Language Processing (NLP) across diverse languages,…

计算与语言 · 计算机科学 2025-05-14 Haneh Rhel , Dmitri Roussinov

Deep learning-based approaches, particularly those leveraging pre-trained language models (PLMs), have shown promise in automated software vulnerability detection. However, existing methods are predominantly limited to specific programming…

软件工程 · 计算机科学 2025-05-13 Junji Yu , Honglin Shu , Michael Fu , Dong Wang , Chakkrit Tantithamthavorn , Yasutaka Kamei , Junjie Chen