English
Related papers

Related papers: Evaluating Large Language Models on Urdu Idiom Tra…

200 papers

This paper investigates whether large language models (LLMs) are state-of-the-art quality estimators for machine translation of user-generated content (UGC) that contains emotional expressions, without the use of reference translations. To…

Computation and Language · Computer Science 2024-10-10 Shenbin Qian , Constantin Orăsan , Diptesh Kanojia , Félix do Carmo

Machine Translation (MT) is one of the most prominent tasks in Natural Language Processing (NLP) which involves the automatic conversion of texts from one natural language to another while preserving its meaning and fluency. Although the…

Computation and Language · Computer Science 2023-09-26 Kavit Gangar , Hardik Ruparel , Shreyas Lele

Urdu, spoken by over 250 million people, remains critically under-served in multimodal and vision-language research. The absence of large-scale, high-quality datasets has limited the development of Urdu-capable systems and reinforced biases…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Umair Hassan

In order to provide benchmark performance for Urdu text document classification, the contribution of this paper is manifold. First, it pro-vides a publicly available benchmark dataset manually tagged against 6 classes. Second, it…

Computation and Language · Computer Science 2020-03-04 Muhammad Nabeel Asim , Muhammad Usman Ghani , Muhammad Ali Ibrahim , Sheraz Ahmad , Waqar Mahmood , Andreas Dengel

Studies show that large language models (LLMs) produce buggy code translations. One promising avenue to improve translation accuracy is through intermediate representations, which provide structured guidance for the translation process. We…

Software Engineering · Computer Science 2025-09-18 Chi-en Amy Tai , Pengyu Nie , Lukasz Golab , Alexander Wong

Mental health disorders pose a growing public health concern in the Arab world, emphasizing the need for accessible diagnostic and intervention tools. Large language models (LLMs) offer a promising approach, but their application in Arabic…

Computation and Language · Computer Science 2025-01-14 Noureldin Zahran , Aya E. Fouda , Radwa J. Hanafy , Mohammed E. Fouda

The use of subword embedding has proved to be a major innovation in Neural Machine Translation (NMT). It helps NMT to learn better context vectors for Low Resource Languages (LRLs) so as to predict the target words by better modelling the…

Computation and Language · Computer Science 2023-05-23 Amit Kumar , Shantipriya Parida , Ajay Pratap , Anil Kumar Singh

Neural machine translation (NMT) is a recent and effective technique which led to remarkable improvements in comparison of conventional machine translation techniques. Proposed neural machine translation model developed for the Gujarati…

Computation and Language · Computer Science 2020-02-10 Parth Shah , Vishvajit Bakrola

Multifarious intent detection predictors are developed for different languages, including English, Chinese and French, however, the field remains underdeveloped for Urdu, the 10th most spoken language. In the realm of well-known languages,…

Computation and Language · Computer Science 2025-05-14 Faiza Hassan , Summra Saleem , Kashif Javed , Muhammad Nabeel Asim , Abdur Rehman , Andreas Dengel

OCR algorithms have received a significant improvement in performance recently, mainly due to the increase in the capabilities of artificial intelligence algorithms. However, this advancement is not evenly distributed over all languages.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-15 Atique Ur Rehman , Sibt Ul Hussain

Evaluating Text Style Transfer (TST) is a complex task due to its multifaceted nature. The quality of the generated text is measured based on challenging factors, such as style transfer accuracy, content preservation, and overall fluency.…

Computation and Language · Computer Science 2023-09-26 Phil Ostheimer , Mayank Nagda , Marius Kloft , Sophie Fellenz

Urdu, spoken by 230 million people worldwide, lacks dedicated transformer-based language models and curated corpora. While multilingual models provide limited Urdu support, they suffer from poor performance, high computational costs, and…

Computation and Language · Computer Science 2026-01-27 Syed Muhammad Ali , Hammad Sajid , Zainab Haider , Ali Muhammad Asad , Haya Fatima , Abdul Samad

The remarkable understanding and generation capabilities of large language models (LLMs) have greatly improved translation performance. However, incorrect understanding of the sentence to be translated can degrade translation quality. To…

Computation and Language · Computer Science 2024-12-31 Andong Chen , Kehai Chen , Yang Xiang , Xuefeng Bai , Muyun Yang , Yang Feng , Tiejun Zhao , Min zhang

We introduce a dataset comprising commercial machine translations, gathered weekly over six years across 12 translation directions. Since human A/B testing is commonly used, we assume commercial systems improve over time, which enables us…

Computation and Language · Computer Science 2024-10-04 Guojun Wu , Shay B. Cohen , Rico Sennrich

With the rapid development of deep learning technologies, the field of machine translation has witnessed significant progress, especially with the advent of large language models (LLMs) that have greatly propelled the advancement of…

Computation and Language · Computer Science 2025-04-22 Jiaxin GUO , Xiaoyu Chen , Zhiqiang Rao , Jinlong Yang , Zongyao Li , Hengchao Shang , Daimeng Wei , Hao Yang

A Large Language Model (LLM) tends to generate inconsistent and sometimes contradictory outputs when presented with a prompt that has equivalent semantics but is expressed differently from the original prompt. To achieve semantic…

Computation and Language · Computer Science 2025-01-22 Jingyuan Yang , Dapeng Chen , Yajing Sun , Rongjun Li , Zhiyong Feng , Wei Peng

Recent studies have suggested that large language models (LLMs) underperform on mathematical and computer science tasks when these problems are translated from Romanian into English, compared to their original Romanian format. Accurate…

Pretrained language models are now of widespread use in Natural Language Processing. Despite their success, applying them to Low Resource languages is still a huge challenge. Although Multilingual models hold great promise, applying them to…

Computation and Language · Computer Science 2021-02-23 Usama Khalid , Mirza Omer Beg , Muhammad Umair Arshad

Idioms are common in everyday language, but often pose a challenge to translators because their meanings do not follow from the meanings of their parts. Despite significant advances, machine translation systems still struggle to translate…

Computation and Language · Computer Science 2023-10-24 Emmy Liu , Aditi Chaudhary , Graham Neubig

Soft prompt tuning is a parameter-efficient method for adapting LLMs to specific tasks, but suffers from a lack of interpretability. Building on recent work on interpreting soft prompts (Ramati et al., 2024), we explore how training a…

Computation and Language · Computer Science 2026-05-28 Pitipat Kongsomjit , Suryansh Goyal , Jacob Whitehill