English
Related papers

Related papers: BETA-Labeling for Multilingual Dataset Constructio…

200 papers

Advancements in Large Language Models (LLMs) have significantly enhanced instruction-following capabilities. However, most Instruction Fine-Tuning (IFT) datasets are predominantly in English, limiting model performance in other languages.…

Computation and Language · Computer Science 2024-07-03 Sathish Reddy Indurthi , Wenxuan Zhou , Shamil Chollampatt , Ravi Agrawal , Kaiqiang Song , Lingxiao Zhao , Chenguang Zhu

Programming is a core skill in computer science and software engineering (SE), yet identifying and resolving code errors remains challenging for both novice and experienced developers. While Large Language Models (LLMs) have shown…

Software Engineering · Computer Science 2026-03-27 Md Faizul Ibne Amin , Yutaka Watanobe , Md. Mostafizer Rahman , Daniel M. Muepu , Md. Shahajada Mia

Despite rapid advances in large language models (LLMs), their linguistic abilities in low-resource and morphologically rich languages are still not well understood due to limited annotated resources and the absence of standardized…

Computation and Language · Computer Science 2026-04-01 Hailay Kidu Teklehaymanot , Gebrearegawi Gebremariam , Wolfgang Nejdl

Although large language models (LLMs) have advanced the state-of-the-art in NLP significantly, deploying them for downstream applications is still challenging due to cost, responsiveness, control, or concerns around privacy and security. As…

Computation and Language · Computer Science 2023-11-01 Dong-Ho Lee , Jay Pujara , Mohit Sewak , Ryen W. White , Sujay Kumar Jauhar

Realignment is a promising strategy to improve cross-lingual transfer in multilingual language models. However, empirical results are mixed and often unreliable, particularly for typologically distant or low-resource languages (LRLs)…

Computation and Language · Computer Science 2025-11-11 Quang Phuoc Nguyen , David Anugraha , Felix Gaschi , Jun Bin Cheng , En-Shiun Annie Lee

What can pre-trained multilingual sequence-to-sequence models like mBART contribute to translating low-resource languages? We conduct a thorough empirical experiment in 10 languages to ascertain this, considering five factors: (1) the…

Reliability in cell type annotation is challenging in single-cell RNA-sequencing data analysis because both expert-driven and automated methods can be biased or constrained by their training data, especially for novel or rare cell types.…

Quantitative Methods · Quantitative Biology 2024-09-25 Wenjin Ye , Yuanchen Ma , Junkai Xiang , Hongjie Liang , Tao Wang , Qiuling Xiang , Andy Peng Xiang , Wu Song , Weiqiang Li , Weijun Huang

Recent research in multilingual language models (LM) has demonstrated their ability to effectively handle multiple languages in a single model. This holds promise for low web-resource languages (LRL) as multilingual models can enable…

Computation and Language · Computer Science 2021-06-10 Yash Khemchandani , Sarvesh Mehtani , Vaidehi Patil , Abhijeet Awasthi , Partha Talukdar , Sunita Sarawagi

Developing Named Entity Recognition (NER) systems for Indian languages has been a long-standing challenge, mainly owing to the requirement of a large amount of annotated clean training instances. This paper proposes an end-to-end framework…

Computation and Language · Computer Science 2021-11-24 Akshara Prabhakar , Gouri Sankar Majumder , Ashish Anand

Whether Large Language Models (LLMs) can outperform crowdsourcing on the data annotation task is attracting interest recently. Some works verified this issue with the average performance of individual crowd workers and LLM workers on some…

Computation and Language · Computer Science 2024-01-19 Jiyi Li

Instruction tuning enhances large language models (LLMs) by aligning them with human preferences across diverse tasks. Traditional approaches to create instruction tuning datasets face serious challenges for low-resource languages due to…

Computation and Language · Computer Science 2024-09-20 Abdullatif Köksal , Marion Thaler , Ayyoob Imani , Ahmet Üstün , Anna Korhonen , Hinrich Schütze

Large Language Models (LLMs) annotated datasets are widely used nowadays, however, large-scale annotations often show biases in low-quality datasets. For example, Multiple-Choice Questions (MCQs) datasets with one single correct option is…

Computation and Language · Computer Science 2026-01-08 Zipeng Ling , Shuliang Liu , Yuehao Tang , Chen Huang , Gaoyang Jiang , Shenghong Fu , Junqi Yang , Yao Wan , Jiawan Zhang , Kejia Huang , Xuming Hu

Sentiment analysis is an essential part of text analysis, which is a larger field that includes determining and evaluating the author's emotional state. This method is essential since it makes it easier to comprehend consumers' feelings,…

Computation and Language · Computer Science 2025-10-03 Sumaiya Tabassum

Evaluating instruction-tuned Large Language Models (LLMs) in Hindi is challenging due to a lack of high-quality benchmarks, as direct translation of English datasets fails to capture crucial linguistic and cultural nuances. To address this,…

Computation and Language · Computer Science 2025-10-16 Anusha Kamath , Kanishk Singla , Rakesh Paul , Raviraj Joshi , Utkarsh Vaidya , Sanjay Singh Chauhan , Niranjan Wartikar

This paper explores the potential of leveraging Large Language Models (LLMs) for data augmentation in multilingual commonsense reasoning datasets where the available training data is extremely limited. To achieve this, we utilise several…

Computation and Language · Computer Science 2023-10-24 Chenxi Whitehouse , Monojit Choudhury , Alham Fikri Aji

Meta learning has been widely used to exploit rich-resource source tasks to improve the performance of low-resource target tasks. Unfortunately, most existing meta learning approaches treat different source tasks equally, ignoring the…

Computation and Language · Computer Science 2025-04-14 Yu Fu , Jie He , Yifan Yang , Qun Liu , Deyi Xiong

This work presents BanglaNLG, a comprehensive benchmark for evaluating natural language generation (NLG) models in Bangla, a widely spoken yet low-resource language. We aggregate six challenging conditional text generation tasks under the…

Computation and Language · Computer Science 2023-02-14 Abhik Bhattacharjee , Tahmid Hasan , Wasi Uddin Ahmad , Rifat Shahriyar

In the field of Natural Language Processing (NLP), Named Entity Recognition (NER) is recognized as a critical technology, employed across a wide array of applications. Traditional methodologies for annotating datasets for NER models are…

Computation and Language · Computer Science 2025-01-03 Yuji Naraki , Ryosuke Yamaki , Yoshikazu Ikeda , Takafumi Horie , Kotaro Yoshida , Ryotaro Shimizu , Hiroki Naganuma

High annotation costs from hiring or crowdsourcing complicate the creation of large, high-quality datasets needed for training reliable text classifiers. Recent research suggests using Large Language Models (LLMs) to automate the annotation…

Computation and Language · Computer Science 2025-01-27 Tomas Horych , Christoph Mandl , Terry Ruas , Andre Greiner-Petter , Bela Gipp , Akiko Aizawa , Timo Spinde

Large Language Models (LLMs), such as GPT-4 and Llama 2, show remarkable proficiency in a wide range of natural language processing (NLP) tasks. Despite their effectiveness, the high costs associated with their use pose a challenge. We…

Computation and Language · Computer Science 2024-03-26 Bálint Csanády , Lajos Muzsai , Péter Vedres , Zoltán Nádasdy , András Lukács