中文
相关论文

相关论文: GlossLM: A Massively Multilingual Corpus and Pretr…

200 篇论文

Work done to uncover the knowledge encoded within pre-trained language models rely on annotated corpora or human-in-the-loop methods. However, these approaches are limited in terms of scalability and the scope of interpretation. We propose…

计算与语言 · 计算机科学 2023-10-23 Basel Mousi , Nadir Durrani , Fahim Dalvi

Recent advancements in Large Language Models (LLMs) have led to high-quality Machine-Generated Text (MGT), giving rise to countless new use cases and applications. However, easy access to LLMs is posing new challenges due to misuse. To…

计算与语言 · 计算机科学 2024-04-15 Areg Mikael Sarvazyan , José Ángel González , Marc Franco-Salvador

In this paper, we introduce DOCmT5, a multilingual sequence-to-sequence language model pretrained with large scale parallel documents. While previous approaches have focused on leveraging sentence-level parallel data, we try to build a…

计算与语言 · 计算机科学 2022-05-06 Chia-Hsuan Lee , Aditya Siddhant , Viresh Ratnakar , Melvin Johnson

Tabular data is among the oldest and most ubiquitous forms of data. However, the generation of synthetic samples with the original data's characteristics remains a significant challenge for tabular data. While many generative models from…

机器学习 · 计算机科学 2023-04-25 Vadim Borisov , Kathrin Seßler , Tobias Leemann , Martin Pawelczyk , Gjergji Kasneci

This paper introduces LogitLens4LLMs, a toolkit that extends the Logit Lens technique to modern large language models. While Logit Lens has been a crucial method for understanding internal representations of language models, it was…

计算与语言 · 计算机科学 2025-03-18 Zhenyu Wang

This paper introduces the Multi-Genre Natural Language Inference (MultiNLI) corpus, a dataset designed for use in the development and evaluation of machine learning models for sentence understanding. In addition to being one of the largest…

计算与语言 · 计算机科学 2018-02-21 Adina Williams , Nikita Nangia , Samuel R. Bowman

Large language models (LLMs) are a special class of pretrained language models obtained by scaling model size, pretraining corpus and computation. LLMs, because of their large size and pretraining on large volumes of text data, exhibit…

计算与语言 · 计算机科学 2023-10-20 Katikapalli Subramanyam Kalyan

The proliferation of complex structured data in hybrid sources, such as PDF documents and web pages, presents unique challenges for current Large Language Models (LLMs) and Multi-modal Large Language Models (MLLMs) in providing accurate…

信息检索 · 计算机科学 2025-08-22 Shivani Upadhyay , Messiah Ataey , Syed Shariyar Murtaza , Yifan Nie , Jimmy Lin

Generative Large Language Models (gLLMs), such as ChatGPT, are increasingly being used in communication research for content analysis. Studies show that gLLMs can outperform both crowd workers and trained coders, such as research…

人工智能 · 计算机科学 2025-10-29 Daria Kravets-Meinke , Hannah Schmid-Petri , Sonja Niemann , Ute Schmid

The paper presents a pilot exploration of the construction, management and analysis of a multimodal corpus. Through a three-layer annotation that provides orthographic, prosodic, and gestural transcriptions, the Gest-IT resource allows to…

Open-source, multilingual medical large language models (LLMs) have the potential to serve linguistically diverse populations across different regions. Adapting generic LLMs for healthcare often requires continual pretraining, but this…

计算与语言 · 计算机科学 2024-09-10 Meng Zhou , Surajsinh Parmar , Anubhav Bhatti

Multilingual Language Models (\MLLMs) such as mBERT, XLM, XLM-R, \textit{etc.} have emerged as a viable option for bringing the power of pretraining to a large number of languages. Given their success in zero-shot transfer learning, there…

计算与语言 · 计算机科学 2021-12-24 Sumanth Doddapaneni , Gowtham Ramesh , Mitesh M. Khapra , Anoop Kunchukuttan , Pratyush Kumar

Multimodal Large Language Models (MLLMs) have achieved notable success in enhancing translation performance by integrating multimodal information. However, existing research primarily focuses on image-guided methods, whose applicability is…

计算与语言 · 计算机科学 2026-03-04 Yexing Du , Youcheng Pan , Zekun Wang , Zheng Chu , Yichong Huang , Kaiyuan Liu , Bo Yang , Yang Xiang , Ming Liu , Bing Qin

Large Language Models (LLMs) are increasingly being integrated into various medical fields, including mental health support systems. However, there is a gap in research regarding the effectiveness of LLMs in non-English mental health…

计算与语言 · 计算机科学 2026-02-10 Konstantinos Skianis , John Pavlopoulos , A. Seza Doğruöz

Large Language Models (LLMs) have demonstrated superior abilities in tasks such as chatting, reasoning, and question-answering. However, standard LLMs may ignore crucial paralinguistic information, such as sentiment, emotion, and speaking…

Cross-lingual transfer of language models trained on high-resource languages like English has been widely studied for many NLP tasks, but focus on conversational tasks has been rather limited. This is partly due to the high cost of…

计算与语言 · 计算机科学 2024-01-30 Lifu Tu , Jin Qu , Semih Yavuz , Shafiq Joty , Wenhao Liu , Caiming Xiong , Yingbo Zhou

Large language models (LLMs) have demonstrated impressive performance across a wide range of Natural Language Processing (NLP) tasks. However, ensuring their effectiveness across multiple languages presents unique challenges. Multilingual…

计算与语言 · 计算机科学 2025-05-20 Shubham Vatsal , Harsh Dubey , Aditi Singh

Large Language Models (LLMs) have revo lutionized natural language processing Natural Language Processing (NLP), with Chat Generative Pre-trained Transformer (ChatGPT) standing out as a notable exampledue to its advanced capabilities and…

计算与语言 · 计算机科学 2025-03-25 Azim Akhtarshenas , Afshin Dini , Navid Ayoobi

Multilingual Large Language Models (LLMs) have gained large popularity among Natural Language Processing (NLP) researchers and practitioners. These models, trained on huge datasets, show proficiency across various languages and demonstrate…

计算与语言 · 计算机科学 2025-04-28 Daniil Gurgurov , Tanja Bäumel , Tatiana Anikina

Sign language translation (SLT) is a challenging task that involves translating sign language images into spoken language. For SLT models to perform this task successfully, they must bridge the modality gap and identify subtle variations in…

计算机视觉与模式识别 · 计算机科学 2025-08-26 Jungeun Kim , Hyeongwoo Jeon , Jongseong Bae , Ha Young Kim