English
Related papers

Related papers: Bootstrapping NLU Models with Multi-task Learning

200 papers

With the recent explosion in popularity of voice assistant devices, there is a growing interest in making them available to user populations in additional countries and languages. However, to provide the highest accuracy and best…

Computation and Language · Computer Science 2020-12-08 Lizhen Tan , Olga Golovneva

Spoken language understanding (SLU) treats automatic speech recognition (ASR) and natural language understanding (NLU) as a unified task and usually suffers from data scarcity. We exploit an ASR and NLU joint training method based on meta…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Yingying Gao , Junlan Feng , Chao Deng , Shilei Zhang

This paper investigates the use of Machine Translation (MT) to bootstrap a Natural Language Understanding (NLU) system for a new language for the use case of a large-scale voice-controlled device. The goal is to decrease the cost and time…

Computation and Language · Computer Science 2018-05-24 Judith Gaspers , Penny Karanasou , Rajen Chatterjee

It is expensive and difficult to obtain the large number of sentence-level intent and token-level slot label annotations required to train neural network (NN)-based Natural Language Understanding (NLU) components of task-oriented dialog…

Computation and Language · Computer Science 2022-12-16 Rashmi Gangadharaiah , Balakrishnan Narayanaswamy

Joint intent detection and slot filling, which is also termed as joint NLU (Natural Language Understanding) is invaluable for smart voice assistants. Recent advancements in this area have been heavily focusing on improving accuracy using…

Machine Learning · Computer Science 2023-09-27 Kalpa Gunaratna , Vijay Srinivasan , Hongxia Jin

Conversational agents such as Cortana, Alexa and Siri are continuously working on increasing their capabilities by adding new domains. The support of a new domain includes the design and development of a number of NLU components for domain…

Computation and Language · Computer Science 2020-01-27 Muhammad Raza Khan , Morteza Ziyadi , Mohamed AbdelHady

Natural Language Understanding (NLU) models are typically trained in a supervised learning framework. In the case of intent classification, the predicted labels are predefined and based on the designed annotation schema while the labelling…

Spoken Language Understanding (SLU) is composed of two subtasks: intent detection (ID) and slot filling (SF). There are two lines of research on SLU. One jointly tackles these two subtasks to improve their prediction accuracy, and the other…

Computation and Language · Computer Science 2021-07-27 Linhao Zhang , Yu Shi , Linjun Shou , Ming Gong , Houfeng Wang , Michael Zeng

When a human communicates with a machine using natural language on the web and online, how can it understand the human's intention and semantic context of their talk? This is an important AI task as it enables the machine to construct a…

Computation and Language · Computer Science 2022-12-22 Soyeon Caren Han , Siqu Long , Henry Weld , Josiah Poon

Spoken language understanding (SLU) systems, such as goal-oriented chatbots or personal assistants, rely on an initial natural language understanding (NLU) module to determine the intent and to extract the relevant information from the user…

Computation and Language · Computer Science 2018-07-10 Mladen Dimovski , Claudiu Musat , Vladimir Ilievski , Andreea Hossmann , Michael Baeriswyl

We present NLU++, a novel dataset for natural language understanding (NLU) in task-oriented dialogue (ToD) systems, with the aim to provide a much more challenging evaluation environment for dialogue NLU models, up to date with the current…

Computation and Language · Computer Science 2022-05-06 Iñigo Casanueva , Ivan Vulić , Georgios P. Spithourakis , Paweł Budzianowski

Named Entity Recognition (NER), a classic sequence labelling task, is an essential component of natural language understanding (NLU) systems in task-oriented dialog systems for slot filling. For well over a decade, different methods from…

Computation and Language · Computer Science 2018-12-07 Pratik Jayarao , Chirag Jain , Aman Srivastava

Natural language understanding (NLU) is the task of semantic decoding of human languages by machines. NLU models rely heavily on large training data to ensure good performance. However, substantial languages and domains have very few data…

Computation and Language · Computer Science 2022-08-22 Zihan Liu

Although Large Language Models (LLMs) can generate coherent text, they often struggle to recognise user intent behind queries. In contrast, Natural Language Understanding (NLU) models interpret the purpose and key information of user input…

Computation and Language · Computer Science 2025-06-02 Yan Li , So-Eon Kim , Seong-Bae Park , Soyeon Caren Han

State-of-the-art slot filling models for goal-oriented human/machine conversational language understanding systems rely on deep learning methods. While multi-task training of such models alleviates the need for large in-domain annotated…

Artificial Intelligence · Computer Science 2017-07-11 Ankur Bapna , Gokhan Tur , Dilek Hakkani-Tur , Larry Heck

In this paper, we explore the task of mapping spoken language utterances to one of thousands of natural language understanding domains in intelligent personal digital assistants (IPDAs). This scenario is observed for many mainstream IPDAs…

Computation and Language · Computer Science 2018-04-24 Young-Bum Kim , Dongchan Kim , Anjishnu Kumar , Ruhi Sarikaya

Multi-intent Spoken Language Understanding has great potential for widespread implementation. Jointly modeling Intent Detection and Slot Filling in it provides a channel to exploit the correlation between intents and slots. However, current…

Computation and Language · Computer Science 2022-10-10 Feifan Song , Lianzhe Huang , Houfeng Wang

We present a new neural architecture for wide-coverage Natural Language Understanding in Spoken Dialogue Systems. We develop a hierarchical multi-task architecture, which delivers a multi-layer representation of sentence meaning (i.e.,…

Computation and Language · Computer Science 2019-10-03 Andrea Vanzo , Emanuele Bastianelli , Oliver Lemon

Deep learning (DL) based language models achieve high performance on various benchmarks for Natural Language Inference (NLI). And at this time, symbolic approaches to NLI are receiving less attention. Both approaches (symbolic and DL) have…

Computation and Language · Computer Science 2021-06-11 Zeming Chen , Qiyue Gao , Lawrence S. Moss

Natural Language Understanding (NLU) is a branch of Natural Language Processing (NLP) that uses intelligent computer software to understand texts that encode human knowledge. Recent years have witnessed notable progress across various NLU…

Computation and Language · Computer Science 2022-03-01 Xinliang Frederick Zhang
‹ Prev 1 2 3 10 Next ›