English
Related papers

Related papers: Aya Dataset: An Open-Access Collection for Multili…

200 papers

While the NLP community is generally aware of resource disparities among languages, we lack research that quantifies the extent and types of such disparity. Prior surveys estimating the availability of resources based on the number of…

Computation and Language · Computer Science 2022-11-29 Xinyan Velocity Yu , Akari Asai , Trina Chatterjee , Junjie Hu , Eunsol Choi

Intonation is one of the important factors affecting the teaching language arts, so it is an urgent problem to be addressed by evaluating the teachers' intonation through artificial intelligence technology. However, the lack of an…

Sound · Computer Science 2023-12-15 Shuhua Liu , Chunyu Zhang , Binshuai Li , Niantong Qin , Huanting Cheng , Huayu Zhang

Multilingual language models often perform unevenly across different languages due to limited generalization capabilities for some languages. This issue is significant because of the growing interest in making universal language models that…

Computation and Language · Computer Science 2024-10-11 Gürkan Soykan , Gözde Gül Şahin

High-resource languages such as English, enables the pretraining of high-quality large language models (LLMs). The same can not be said for most other languages as LLMs still underperform for non-English languages, likely due to a gap in…

Computation and Language · Computer Science 2025-02-20 Jiayi Wang , Yao Lu , Maurice Weber , Max Ryabinin , David Adelani , Yihong Chen , Raphael Tang , Pontus Stenetorp

Large pre-trained language models (LMs) such as GPT-3 have acquired a surprising ability to perform zero-shot learning. For example, to classify sentiment without any training examples, we can "prompt" the LM with the review and the label…

Computation and Language · Computer Science 2021-09-09 Ruiqi Zhong , Kristy Lee , Zheng Zhang , Dan Klein

Modern machine learning relies on datasets to develop and validate research ideas. Given the growth of publicly available data, finding the right dataset to use is increasingly difficult. Any research question imposes explicit and implicit…

Information Retrieval · Computer Science 2023-06-08 Vijay Viswanathan , Luyu Gao , Tongshuang Wu , Pengfei Liu , Graham Neubig

The rapid development of large Vision-Language Models (VLMs) has led to impressive results on academic benchmarks, primarily in widely spoken languages. However, significant gaps remain in the ability of current VLMs to handle low-resource…

Multimodal large language models are typically trained in two stages: first pre-training on image-text pairs, and then fine-tuning using supervised vision-language instruction data. Recent studies have shown that large language models can…

Machine Learning · Computer Science 2026-04-14 Lai Wei , Xiaozhe Li , Zihao Jiang , Weiran Huang , Lichao Sun

Foundational large language models (LLMs) can be instruction-tuned to perform open-domain question answering, facilitating applications like chat assistants. While such efforts are often carried out in a single language, we empirically…

Computation and Language · Computer Science 2024-02-01 Pinzhen Chen , Shaoxiong Ji , Nikolay Bogoychev , Andrey Kutuzov , Barry Haddow , Kenneth Heafield

Instruction tuning enables pretrained language models to perform new tasks from inference-time natural language descriptions. These approaches rely on vast amounts of human supervision in the form of crowdsourced datasets or user…

Computation and Language · Computer Science 2022-12-20 Or Honovich , Thomas Scialom , Omer Levy , Timo Schick

How can language learning systems be developed for languages that lack sufficient training resources? This challenge is increasingly faced by developers across the African continent who aim to build AI systems capable of understanding and…

Large language models (LLMs) have demonstrated strong capabilities across various language tasks, notably through instruction-tuning methods. However, LLMs face challenges in visualizing complex, real-world data through charts and plots.…

Machine Learning · Computer Science 2025-02-18 Fatemeh Pesaran Zadeh , Juyeon Kim , Jin-Hwa Kim , Gunhee Kim

Multi-modal large language models have demonstrated impressive performances on most vision-language tasks. However, the model generally lacks the understanding capabilities for specific domain data, particularly when it comes to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Yucheng Han , Chi Zhang , Xin Chen , Xu Yang , Zhibin Wang , Gang Yu , Bin Fu , Hanwang Zhang

The remarkable multimodal capabilities demonstrated by OpenAI's GPT-4 have sparked significant interest in the development of multimodal Large Language Models (LLMs). A primary research objective of such models is to align visual and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Yanda Li , Chi Zhang , Gang Yu , Zhibin Wang , Bin Fu , Guosheng Lin , Chunhua Shen , Ling Chen , Yunchao Wei

Scaling laws research has focused overwhelmingly on English -- yet the most prominent AI models explicitly serve billions of international users. In this work, we undertake the largest multilingual scaling laws study to date, totaling 774…

Computation and Language · Computer Science 2026-02-26 Shayne Longpre , Sneha Kudugunta , Niklas Muennighoff , I-Hung Hsu , Isaac Caswell , Alex Pentland , Sercan Arik , Chen-Yu Lee , Sayna Ebrahimi

Story video-text alignment, a core task in computational story understanding, aims to align video clips with corresponding sentences in their descriptions. However, progress on the task has been held back by the scarcity of manually…

Computation and Language · Computer Science 2024-10-04 Yidan Sun , Jianfei Yu , Boyang Li

Tabular data is ubiquitous in real-world applications and abundant on the web, yet its annotation has traditionally required human labor, posing a significant scalability bottleneck for tabular machine learning. Our methodology can…

Machine Learning · Computer Science 2024-06-25 Yaojie Hu , Ilias Fountalis , Jin Tian , Nikolaos Vasiloglou

Advancements in emotion aware language processing increasingly shape vital NLP applications ranging from conversational AI and affective computing to computational psychology and creative content generation. Existing emotion datasets either…

Computation and Language · Computer Science 2025-04-14 Vishal Gandhi , Sagar Gandhi

While natural language processing tools have been developed extensively for some of the world's languages, a significant portion of the world's over 7000 languages are still neglected. One reason for this is that evaluation datasets do not…

Computation and Language · Computer Science 2024-06-05 Chunlan Ma , Ayyoob ImaniGooghari , Haotian Ye , Renhao Pei , Ehsaneddin Asgari , Hinrich Schütze

In recent times, we have seen a rapid development of large Vision-Language Models (VLMs). They have shown impressive results on academic benchmarks, primarily in widely spoken languages but lack performance on low-resource languages and…