English
Related papers

Related papers: GLUE: A Multi-Task Benchmark and Analysis Platform…

200 papers

Recent studies leverage large language models with multi-tasking capabilities, using natural language prompts to guide the model's behavior and surpassing performance of task-specific models. Motivated by this, we ask: can we build a single…

Computation and Language · Computer Science 2024-04-04 Siddhant Arora , Hayato Futami , Jee-weon Jung , Yifan Peng , Roshan Sharma , Yosuke Kashiwagi , Emiru Tsunoo , Karen Livescu , Shinji Watanabe

Code understanding is an increasingly important application of Artificial Intelligence. A fundamental aspect of understanding code is understanding text about code, e.g., documentation and forum discussions. Pre-trained language models…

Computation and Language · Computer Science 2021-09-16 Ibrahim Abdelaziz , Julian Dolby , Jamie McCusker , Kavitha Srinivas

The few-shot natural language understanding (NLU) task has attracted much recent attention. However, prior methods have been evaluated under a disparate set of protocols, which hinders fair comparison and measuring progress of the field. To…

Computation and Language · Computer Science 2022-03-16 Yanan Zheng , Jing Zhou , Yujie Qian , Ming Ding , Chonghua Liao , Jian Li , Ruslan Salakhutdinov , Jie Tang , Sebastian Ruder , Zhilin Yang

The Nepali language has distinct linguistic features, especially its complex script (Devanagari script), morphology, and various dialects,which pose a unique challenge for Natural Language Understanding (NLU) tasks. While the Nepali…

Computation and Language · Computer Science 2025-11-17 Jinu Nyachhyon , Mridul Sharma , Prajwal Thapa , Bal Krishna Bal

With the recent explosion in popularity of voice assistant devices, there is a growing interest in making them available to user populations in additional countries and languages. However, to provide the highest accuracy and best…

Computation and Language · Computer Science 2020-12-08 Lizhen Tan , Olga Golovneva

Detecting biases in natural language understanding (NLU) for African American Vernacular English (AAVE) is crucial to developing inclusive natural language processing (NLP) systems. To address dialect-induced performance discrepancies, we…

Computation and Language · Computer Science 2025-10-17 Abhay Gupta , Philip Meng , Ece Yurtseven , Sean O'Brien , Kevin Zhu

Large Language Models (LLMs) have demonstrated remarkable proficiency in various natural language generation (NLG) tasks. Previous studies suggest that LLMs' generation process involves uncertainty. However, existing approaches to…

Computation and Language · Computer Science 2024-09-06 Yu-Hsiang Wang , Andrew Bai , Che-Ping Tsai , Cho-Jui Hsieh

The success of Natural Language Understanding (NLU) benchmarks in various languages, such as GLUE for English, CLUE for Chinese, KLUE for Korean, and IndoNLU for Indonesian, has facilitated the evaluation of new NLU models across a wide…

Computation and Language · Computer Science 2024-03-26 Phong Nguyen-Thuan Do , Son Quoc Tran , Phu Gia Hoang , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

Recent advances in vision-language pre-training (VLP) have demonstrated impressive performance in a range of vision-language (VL) tasks. However, there exist several challenges for measuring the community's progress in building general…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Wangchunshu Zhou , Yan Zeng , Shizhe Diao , Xinsong Zhang

Natural language understanding (NLU) and natural language generation (NLG) are two fundamental and related tasks in building task-oriented dialogue systems with opposite objectives: NLU tackles the transformation from natural language to…

Computation and Language · Computer Science 2020-06-16 Bo-Hsiang Tseng , Jianpeng Cheng , Yimai Fang , David Vandyke

With the renaissance of deep learning, neural networks have achieved promising results on many natural language understanding (NLU) tasks. Even though the source codes of many neural network models are publicly available, there is still a…

Computation and Language · Computer Science 2020-11-30 Nham Le , Tuan Lai , Trung Bui , Doo Soon Kim

Practical needs of developing task-oriented dialogue assistants require the ability to understand many languages. Novel benchmarks for multilingual natural language understanding (NLU) include monolingual sentences in several languages,…

Computation and Language · Computer Science 2021-11-23 Alexey Birshert , Ekaterina Artemova

The impressive progress in NLP techniques has been driven by the development of multi-task benchmarks such as GLUE and SuperGLUE. While these benchmarks focus on tasks for one or two input sentences, there has been exciting work in…

Computation and Language · Computer Science 2025-10-20 G Thomas Hudson , Noura Al Moubayed

Spoken language understanding (SLU) is a core task in task-oriented dialogue systems, which aims at understanding the user's current goal through constructing semantic frames. SLU usually consists of two subtasks, including intent detection…

Computation and Language · Computer Science 2024-06-03 Xuxin Cheng , Wanshi Xu , Zhihong Zhu , Hongxiang Li , Yuexian Zou

Natural Language Understanding (NLU) is an established component within a conversational AI or digital assistant system, and it is responsible for producing semantic understanding of a user request. We propose a scalable and automatic…

Computation and Language · Computer Science 2021-09-13 Sunghyun Park , Han Li , Ameen Patel , Sidharth Mudgal , Sungjin Lee , Young-Bum Kim , Spyros Matsoukas , Ruhi Sarikaya

Transferability estimation has been attached to great attention in the computer vision fields. Researchers try to estimate with low computational cost the performance of a model when transferred from a source task to a given target task.…

Computation and Language · Computer Science 2023-12-11 Jun Bai , Xiaofeng Zhang , Chen Li , Hanhua Hong , Xi Xu , Chenghua Lin , Wenge Rong

Much recent progress in applications of machine learning models to NLP has been driven by benchmarks that evaluate models across a wide variety of tasks. However, these broad-coverage benchmarks have been mostly limited to English, and…

Computation and Language · Computer Science 2020-09-07 Junjie Hu , Sebastian Ruder , Aditya Siddhant , Graham Neubig , Orhan Firat , Melvin Johnson

The Catalan Language Understanding Benchmark (CLUB) encompasses various datasets representative of different NLU tasks that enable accurate evaluations of language models, following the General Language Understanding Evaluation (GLUE)…

Prevailing deep models are single-purpose and overspecialize at individual tasks. However, when being extended to new tasks, they typically forget previously learned skills and learn from scratch. We address this issue by introducing…

Computation and Language · Computer Science 2022-05-10 Fan Zhang , Duyu Tang , Yong Dai , Cong Zhou , Shuangzhi Wu , Shuming Shi

Recent hype surrounding the increasing sophistication of language processing models has renewed optimism regarding machines achieving a human-like command of natural language. Research in the area of natural language understanding (NLU) in…

Computation and Language · Computer Science 2022-11-18 Lize Alberts