English
Related papers

Related papers: Evaluating Large Language Models on Urdu Idiom Tra…

200 papers

Contemporary translation engines based on the encoder-decoder framework have made significant strides in development. However, the emergence of Large Language Models (LLMs) has disrupted their position by presenting the potential for…

Computation and Language · Computer Science 2024-05-28 Jiali Zeng , Fandong Meng , Yongjing Yin , Jie Zhou

Language Identification (LI) is crucial for various natural language processing tasks, serving as a foundational step in applications such as sentiment analysis, machine translation, and information retrieval. In multilingual societies like…

Computation and Language · Computer Science 2025-03-13 Aniket Deroy , Subhankar Maity

Recent advancements in deep learning have created many opportunities to solve real-world problems that remained unsolved for more than a decade. Automatic caption generation is a major research field, and the research community has done a…

Computation and Language · Computer Science 2021-06-22 Inaam Ilahi , Hafiz Muhammad Abdullah Zia , Muhammad Ahtazaz Ahsan , Rauf Tabassam , Armaghan Ahmed

The rapid expansion of social media platforms has significantly increased the dissemination of forged content and misinformation, making the detection of fake news a critical area of research. Although fact-checking efforts predominantly…

Computation and Language · Computer Science 2025-06-03 Muhammad Islam , Javed Ali Khan , Mohammed Abaker , Ali Daud , Azeem Irshad

State-of-the-art speech recognition systems rely heavily on three basic components: an acoustic model, a pronunciation lexicon and a language model. To build these components, a researcher needs linguistic as well as technical expertise,…

Computation and Language · Computer Science 2018-03-06 Haris Bin Zia , Agha Ali Raza , Awais Athar

Language models have steadily increased in size over the past few years. They achieve a high level of performance on various natural language processing (NLP) tasks such as question answering and summarization. Large language models (LLMs)…

Computation and Language · Computer Science 2023-01-31 Jessica Huynh , Cathy Jiao , Prakhar Gupta , Shikib Mehri , Payal Bajaj , Vishrav Chaudhary , Maxine Eskenazi

Neural metrics for machine translation evaluation, such as COMET, exhibit significant improvements in their correlation with human judgments, as compared to traditional metrics based on lexical overlap, such as BLEU. Yet, neural metrics…

Computation and Language · Computer Science 2023-05-22 Ricardo Rei , Nuno M. Guerreiro , Marcos Treviso , Luisa Coheur , Alon Lavie , André F. T. Martins

Large Language Models (LLMs) are nowadays extensively used for various types of software engineering tasks, primarily code generation. Previous research has shown how suitable prompt engineering could help developers in improving their code…

Spoken Language Translation (SLT) is becoming more widely used and becoming a communication tool that helps in crossing language barriers. One of the challenges of SLT is the translation from a language without gender agreement to a…

Computation and Language · Computer Science 2018-02-27 Mostafa Elaraby , Ahmed Y. Tawfik , Mahmoud Khaled , Hany Hassan , Aly Osama

Machine-translated benchmarks are widely used to assess the multilingual capabilities of large language models (LLMs), yet translation errors in these benchmarks remain underexplored, raising concerns about the reliability and comparability…

Computation and Language · Computer Science 2026-05-26 Klaudia-Doris Thellmann , Bernhard Stadler , Michael Färber , Jens Lehmann

Neural Machine Translation (NMT) models are typically trained on datasets with limited exposure to Scientific, Technical and Educational domains. Translation models thus, in general, struggle with tasks that involve scientific understanding…

Computation and Language · Computer Science 2024-12-13 Advait Joglekar , Srinivasan Umesh

Analysing translation quality in regards to specific linguistic phenomena has historically been difficult and time-consuming. Neural machine translation has the attractive property that it can produce scores for arbitrary translations, and…

Computation and Language · Computer Science 2017-02-14 Rico Sennrich

This study explores linguistic distinctions among American, Indian, and Irish English dialects and assesses various Language Models (LLMs) in their ability to generate British English translations from these dialects. Using cosine…

Computation and Language · Computer Science 2023-11-15 Shruti Dutta , Shashwat Mookherjee

Despite remarkable progress in large language models, Urdu-a language spoken by over 230 million people-remains critically underrepresented in modern NLP systems. Existing multilingual models demonstrate poor performance on Urdu-specific…

Computation and Language · Computer Science 2026-01-14 Muhammad Taimoor Hassan , Jawad Ahmed , Muhammad Awais

This paper presents a comparative analysis of Large Language Models (LLMs) and traditional Optical Character Recognition (OCR) systems on Urdu newspapers, addressing challenges posed by complex multi-column layouts, low-resolution scans,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Samee Arif , Sualeha Farid

The training of large language models (LLMs) necessitates substantial data and computational resources, and updating outdated LLMs entails significant efforts and resources. While numerous model editing techniques (METs) have emerged to…

Computation and Language · Computer Science 2024-02-06 Himanshu Beniwal , Kowsik Nandagopan D , Mayank Singh

Machine Translation (MT) remains one of the last NLP tasks where large language models (LLMs) have not yet replaced dedicated supervised systems. This work exploits the complementary strengths of LLMs and supervised MT by guiding LLMs to…

Computation and Language · Computer Science 2025-09-03 Dayeon Ki , Marine Carpuat

This paper presents an in-depth investigation on integrating neural language models in translation systems. Scaling neural language models is a difficult task, but crucial for real-world applications. This paper evaluates the impact on…

Computation and Language · Computer Science 2015-03-23 Paul Baltescu , Phil Blunsom

Despite the recent ubiquity of large language models and their high zero-shot prompted performance across a wide range of tasks, it is still not known how well they perform on tasks which require processing of potentially idiomatic…

Computation and Language · Computer Science 2024-05-16 Dylan Phelps , Thomas Pickard , Maggie Mi , Edward Gow-Smith , Aline Villavicencio

This paper describes the acquisition, preprocessing, segmentation, and alignment of an Amharic-English parallel corpus. It will be helpful for machine translation of a low-resource language, Amharic. We freely released the corpus for…

Computation and Language · Computer Science 2022-05-04 Andargachew Mekonnen Gezmu , Andreas Nürnberger , Tesfaye Bayu Bati