English
Related papers

Related papers: Dialect Normalization using Large Language Models …

200 papers

Dialects exhibit a substantial degree of variation due to the lack of a standard orthography. At the same time, the ability of Large Language Models (LLMs) to process dialects remains largely understudied. To address this gap, we use…

Computation and Language · Computer Science 2025-09-23 Robert Litschko , Verena Blaschke , Diana Burkhardt , Barbara Plank , Diego Frassinelli

Although large language models (LLMs) have been touted for their ability to generate natural-sounding text, there are growing concerns around possible negative effects of LLMs such as data memorization, bias, and inappropriate language.…

Machine Learning · Computer Science 2023-05-10 Michael Kuchnik , Virginia Smith , George Amvrosiadis

Current benchmark tasks for natural language processing contain text that is qualitatively different from the text used in informal day to day digital communication. This discrepancy has led to severe performance degradation of…

Computation and Language · Computer Science 2021-10-13 Ana-Maria Bucur , Adrian Cosma , Liviu P. Dinu

What mechanisms underlie linguistic generalization in large language models (LLMs)? This question has attracted considerable attention, with most studies analyzing the extent to which the language skills of LLMs resemble rules. As of yet,…

Computation and Language · Computer Science 2024-11-13 Valentin Hofmann , Leonie Weissweiler , David Mortensen , Hinrich Schütze , Janet Pierrehumbert

Due to the scarcity of labeled dialectal speech, audio dialect classification is a challenging task for most languages, including Swiss German. In this work, we explore the ability of large language models (LLMs) as agents in understanding…

Computation and Language · Computer Science 2026-04-01 Tobias Bystrich , Lukas Hamm , Maria Hassan , Lea Fischbach , Lucie Flek , Akbar Karimi

Most of the world's languages and dialects are low-resource, and lack support in mainstream machine translation (MT) models. However, many of them have a closely-related high-resource language (HRL) neighbor, and differ in linguistically…

Computation and Language · Computer Science 2025-10-22 Niyati Bafna , Emily Chang , Nathaniel R. Robinson , David R. Mortensen , Kenton Murray , David Yarowsky , Hale Sirin

We present the second ever evaluated Arabic dialect-to-dialect machine translation effort, and the first to leverage external resources beyond a small parallel corpus. The subject has not previously received serious attention due to lack of…

Computation and Language · Computer Science 2017-12-19 Alexander Erdmann , Nizar Habash , Dima Taji , Houda Bouamor

Large language models (LLMs) exhibit superior performance on various natural language tasks, but they are susceptible to issues stemming from outdated data and domain-specific limitations. In order to address these challenges, researchers…

Computation and Language · Computer Science 2024-10-24 Zhangyin Feng , Weitao Ma , Weijiang Yu , Lei Huang , Haotian Wang , Qianglong Chen , Weihua Peng , Xiaocheng Feng , Bing Qin , Ting liu

Natural language processing (NLP) has largely focused on modelling standardized languages. More recently, attention has increasingly shifted to local, non-standardized languages and dialects. However, the relevant speaker populations' needs…

Computation and Language · Computer Science 2024-06-10 Verena Blaschke , Christoph Purschke , Hinrich Schütze , Barbara Plank

Large Language Models (LLMs) have shown remarkable performance in various natural language processing tasks but face challenges in mathematical reasoning, where complex problem-solving requires both linguistic understanding and mathematical…

Computation and Language · Computer Science 2025-03-20 Shuguang Chen , Guang Lin

Recent work investigates whether LMs learn human-like linguistic generalizations and representations from developmentally plausible amounts of data. Yet, the basic linguistic units processed in these LMs are determined by subword-based…

Computation and Language · Computer Science 2025-01-07 Bastian Bunzeck , Daniel Duran , Leonie Schade , Sina Zarrieß

Large language models have shown unprecedented abilities in generating linguistically coherent and syntactically correct natural language output. However, they often return incorrect and inconsistent answers to input questions. Due to the…

Databases · Computer Science 2023-12-27 Jasmin Mousavi , Arash Termehchy

Large language models (LLMs) have achieved state-of-the-art performance on a series of natural language understanding tasks. However, these LLMs might rely on dataset bias and artifacts as shortcuts for prediction. This has significantly…

Computation and Language · Computer Science 2023-05-09 Mengnan Du , Fengxiang He , Na Zou , Dacheng Tao , Xia Hu

In recent years, large language models (LLMs) have achieved state-of-the-art results in various biological sequence analysis tasks, such as sequence classification, structure prediction, and function prediction. Similar to advancements in…

Genomics · Quantitative Biology 2025-02-19 Wang Liang

Large language models have evolved to process multiple modalities beyond text, such as images and audio, which motivates us to explore how to effectively leverage them for graph reasoning tasks. The key question, therefore, is how to…

Fine-tuning large language models (LLMs) with limited data poses a practical challenge in low-resource languages, specialized domains, and constrained deployment settings. While pre-trained LLMs provide strong foundations, effective…

Computation and Language · Computer Science 2025-10-29 Marton Szep , Daniel Rueckert , Rüdiger von Eisenhart-Rothe , Florian Hinterwimmer

Large Language Models (LLMs) have recently been shown to produce estimates of psycholinguistic norms, such as valence, arousal, or concreteness, for words and multiword expressions, that correlate with human judgments. These estimates are…

Computation and Language · Computer Science 2026-03-13 Thomas Hikaru Clark , Carlos Arriaga , Javier Conde , Gonzalo Martínez , Pedro Reviriego

Text-to-speech models trained on large-scale datasets have demonstrated impressive in-context learning capabilities and naturalness. However, control of speaker identity and style in these models typically requires conditioning on reference…

Sound · Computer Science 2024-02-08 Dan Lyth , Simon King

Large language models (LLMs) are ubiquitous in modern day natural language processing. However, previous work has shown degraded LLM performance for under-represented English dialects. We analyze the effects of typifying "standard" American…

Computation and Language · Computer Science 2025-10-02 Eileen Pan , Anna Seo Gyeong Choi , Maartje ter Hoeve , Skyler Seto , Allison Koenecke

For a natural language problem that requires some non-trivial reasoning to solve, there are at least two ways to do it using a large language model (LLM). One is to ask it to solve it directly. The other is to use it to extract the facts…

Artificial Intelligence · Computer Science 2023-04-05 Fangzhen Lin , Ziyi Shou , Chengcai Chen