English
Related papers

Related papers: Benchmarking Natural Language Understanding Servic…

200 papers

Large-scale pre-trained language models have shown impressive results on language understanding benchmarks like GLUE and SuperGLUE, improving considerably over other pre-training methods like distributed representations (GloVe) and purely…

Computation and Language · Computer Science 2020-05-12 Tanja Bunk , Daksh Varshneya , Vladimir Vlasov , Alan Nichol

With the recent explosion in popularity of voice assistant devices, there is a growing interest in making them available to user populations in additional countries and languages. However, to provide the highest accuracy and best…

Computation and Language · Computer Science 2020-12-08 Lizhen Tan , Olga Golovneva

In this paper, we perform an exhaustive evaluation of different representations to address the intent classification problem in a Spoken Language Understanding (SLU) setup. We benchmark three types of systems to perform the SLU intent…

Dialogue agents, which perform specific tasks, are part of the long-term goal of NLP researchers to build intelligent agents that communicate with humans in natural language. Such systems should adapt easily from one domain to another to…

Computation and Language · Computer Science 2024-04-24 Jesse Atuhurra , Hidetaka Kamigaito , Taro Watanabe , Eric Nichols

For natural language understanding (NLU) technology to be maximally useful, both practically and as a scientific object of study, it must be general: it must be able to process language in a way that is not exclusively tailored to any one…

Computation and Language · Computer Science 2019-02-26 Alex Wang , Amanpreet Singh , Julian Michael , Felix Hill , Omer Levy , Samuel R. Bowman

The recent state-of-the-art natural language understanding (NLU) systems often behave unpredictably, failing on simpler reasoning examples. Despite this, there has been limited focus on quantifying progress towards systems with more…

Artificial Intelligence · Computer Science 2021-07-16 Ishan Tarunesh , Somak Aditya , Monojit Choudhury

Current researches on spoken language understanding (SLU) heavily are limited to a simple setting: the plain text-based SLU that takes the user utterance as input and generates its corresponding semantic frames (e.g., intent and slots).…

Computation and Language · Computer Science 2022-01-13 Xiao Xu , Libo Qin , Kaiji Chen , Guoxing Wu , Linlin Li , Wanxiang Che

Laws and their interpretations, legal arguments and agreements\ are typically expressed in writing, leading to the production of vast corpora of legal text. Their analysis, which is at the center of legal practice, becomes increasingly…

Computation and Language · Computer Science 2022-11-09 Ilias Chalkidis , Abhik Jana , Dirk Hartung , Michael Bommarito , Ion Androutsopoulos , Daniel Martin Katz , Nikolaos Aletras

Seamless interaction between AI agents and humans using natural language remains a key goal in AI research. This paper addresses the challenges of developing interactive agents capable of understanding and executing grounded natural…

Artificial Intelligence · Computer Science 2024-07-15 Shrestha Mohanty , Negar Arabzadeh , Andrea Tupini , Yuxuan Sun , Alexey Skrynnik , Artem Zholus , Marc-Alexandre Côté , Julia Kiseleva

Intelligent systems designed for play-based interactions should be contextually aware of the users and their surroundings. Spoken Dialogue Systems (SDS) are critical for these interactive agents to carry out effective goal-oriented…

Computation and Language · Computer Science 2022-05-30 Eda Okur , Saurav Sahay , Lama Nachman

Existing conversational systems are mostly agent-centric, which assumes the user utterances would closely follow the system ontology (for NLU or dialogue state tracking). However, in real-world scenarios, it is highly desirable that the…

Computation and Language · Computer Science 2021-09-10 Zhiyu Chen , Honglei Liu , Hu Xu , Seungwhan Moon , Hao Zhou , Bing Liu

Customer service chatbots are conversational systems aimed at addressing customer queries, often by directing them to automated workflows. A crucial aspect of this process is the classification of the customer's intent. Presently, most…

Machine Learning · Computer Science 2025-06-03 Subhadip Nandi , Neeraj Agrawal , Anshika Singh , Priyanka Bhatt

Building the Natural Language Understanding (NLU) modules of task-oriented Spoken Dialogue Systems (SDS) involves a definition of intents and entities, collection of task-relevant data, annotating the data with intents and entities, and…

Computation and Language · Computer Science 2021-05-13 Saurav Sahay , Eda Okur , Nagib Hakim , Lama Nachman

Background: The adoption of chatbots into software development tasks has become increasingly popular among practitioners, driven by the advantages of cost reduction and acceleration of the software development process. Chatbots understand…

Software Engineering · Computer Science 2024-07-17 Ahmad Abdellatif , Khaled Badran , Diego Elias Costa , Emad Shihab

The advent of natural language understanding (NLU) benchmarks for English, such as GLUE and SuperGLUE allows new NLU models to be evaluated across a diverse set of tasks. These comprehensive benchmarks have facilitated a broad range of…

Natural language understanding and dialogue policy learning are both essential in conversational systems that predict the next system actions in response to a current user utterance. Conventional approaches aggregate separate models of…

Computation and Language · Computer Science 2017-10-03 Xuesong Yang , Yun-Nung Chen , Dilek Hakkani-Tur , Paul Crook , Xiujun Li , Jianfeng Gao , Li Deng

Natural Language Understanding (NLU) is an established component within a conversational AI or digital assistant system, and it is responsible for producing semantic understanding of a user request. We propose a scalable and automatic…

Computation and Language · Computer Science 2021-09-13 Sunghyun Park , Han Li , Ameen Patel , Sidharth Mudgal , Sungjin Lee , Young-Bum Kim , Spyros Matsoukas , Ruhi Sarikaya

Integrating machine learning (ML) into customer service chatbots enhances their ability to understand and respond to user queries, ultimately improving service performance. However, they may appear artificial to some users and affecting…

Artificial Intelligence · Computer Science 2024-09-30 Nurul Ain Nabilah Mohd Isa , Siti Nuraishah Agos Jawaddi , Azlan Ismail

Natural Language Understanding (NLU) is a branch of Natural Language Processing (NLP) that uses intelligent computer software to understand texts that encode human knowledge. Recent years have witnessed notable progress across various NLU…

Computation and Language · Computer Science 2022-03-01 Xinliang Frederick Zhang

Personal assistant systems, such as Apple Siri, Google Assistant, Amazon Alexa, and Microsoft Cortana, are becoming ever more widely used. Understanding user intent such as clarification questions, potential answers and user feedback in…

Information Retrieval · Computer Science 2020-02-06 Liu Yang , Minghui Qiu , Chen Qu , Cen Chen , Jiafeng Guo , Yongfeng Zhang , W. Bruce Croft , Haiqing Chen