English
Related papers

Related papers: Knowledge as a Teacher: Knowledge-Guided Structura…

200 papers

Training recurrent neural networks on long texts, in particular scholarly documents, causes problems for learning. While hierarchical attention networks (HANs) are effective in solving these problems, they still lose important information…

Spoken language understanding (SLU) system usually consists of various pipeline components, where each component heavily relies on the results of its upstream ones. For example, Intent detection (ID), and slot filling (SF) require its…

Computation and Language · Computer Science 2021-04-14 Di Wu , Yiren Chen , Liang Ding , Dacheng Tao

Speaker intent detection and semantic slot filling are two critical tasks in spoken language understanding (SLU) for dialogue systems. In this paper, we describe a recurrent neural network (RNN) model that jointly performs intent detection,…

Computation and Language · Computer Science 2016-09-07 Bing Liu , Ian Lane

When a human communicates with a machine using natural language on the web and online, how can it understand the human's intention and semantic context of their talk? This is an important AI task as it enables the machine to construct a…

Computation and Language · Computer Science 2022-12-22 Soyeon Caren Han , Siqu Long , Henry Weld , Josiah Poon

The tracking-by-detection framework requires a set of positive and negative training samples to learn robust tracking models for precise localization of target objects. However, existing tracking models mostly treat different samples…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Xiao Wang , Chenglong Li , Rui Yang , Tianzhu Zhang , Jin Tang , Bin Luo

In the realm of spoken language understanding (SLU), numerous natural language understanding (NLU) methodologies have been adapted by supplying large language models (LLMs) with transcribed speech instead of conventional written text. In…

Natural language understanding (NLU) converts sentences into structured semantic forms. The paucity of annotated training samples is still a fundamental challenge of NLU. To solve this data sparsity problem, previous work based on…

Computation and Language · Computer Science 2021-04-02 Su Zhu , Ruisheng Cao , Kai Yu

Self attention networks (SANs) have been widely utilized in recent NLP studies. Unlike CNNs or RNNs, standard SANs are usually position-independent, and thus are incapable of capturing the structural priors between sequences of words.…

Computation and Language · Computer Science 2021-01-01 Le Qi , Yu Zhang , Qingyu Yin , Ting Liu

Natural language understanding (NLU) of text is a fundamental challenge in AI, and it has received significant attention throughout the history of NLP research. This primary goal has been studied under different tasks, such as Question…

Computation and Language · Computer Science 2019-08-15 Daniel Khashabi

Common-sense and background knowledge is required to understand natural language, but in most neural natural language understanding (NLU) systems, this knowledge must be acquired from training corpora during learning, and then it is static…

Computation and Language · Computer Science 2018-08-22 Dirk Weissenborn , Tomáš Kočiský , Chris Dyer

This work investigates spoken language understanding (SLU) systems in the scenario when the semantic information is extracted directly from the speech signal by means of a single end-to-end neural network model. Two SLU tasks are…

Computation and Language · Computer Science 2019-10-29 Natalia Tomashenko , Antoine Caubriere , Yannick Esteve , Antoine Laurent , Emmanuel Morin

Discourse structure is integral to understanding a text and is helpful in many NLP tasks. Learning latent representations of discourse is an attractive alternative to acquiring expensive labeled discourse data. Liu and Lapata (2018) propose…

Computation and Language · Computer Science 2019-06-11 Elisa Ferracane , Greg Durrett , Junyi Jessy Li , Katrin Erk

Recurrent neural networks (RNNs) have reached striking performance in many natural language processing tasks. This has renewed interest in whether these generic sequence processing devices are inducing genuine linguistic knowledge. Nearly…

Computation and Language · Computer Science 2019-06-19 Michael Hahn , Marco Baroni

In a modern spoken language understanding (SLU) system, the natural language understanding (NLU) module takes interpretations of a speech from the automatic speech recognition (ASR) module as the input. The NLU module usually uses the first…

Computation and Language · Computer Science 2020-01-16 Mingda Li , Weitong Ruan , Xinyue Liu , Luca Soldaini , Wael Hamza , Chengwei Su

Understanding the meaning of a text is a fundamental challenge of natural language understanding (NLU) research. An ideal NLU system should process a language in a way that is not exclusive to a single task or a dataset. Keeping this in…

Computation and Language · Computer Science 2021-01-29 Kinjal Basu , Sarat Varanasi , Farhad Shakerin , Joaquin Arias , Gopal Gupta

Recurrent neural network grammars (RNNG) are a recently proposed probabilistic generative modeling family for natural language. They show state-of-the-art language modeling and parsing performance. We investigate what information they…

Computation and Language · Computer Science 2017-01-12 Adhiguna Kuncoro , Miguel Ballesteros , Lingpeng Kong , Chris Dyer , Graham Neubig , Noah A. Smith

Bootstrapping natural language understanding (NLU) systems with minimal training data is a fundamental challenge of extending digital assistants like Alexa and Siri to a new language. A common approach that is adapted in digital assistants…

Computation and Language · Computer Science 2019-11-18 Shubham Kapoor , Caglar Tirkaz

Although self-attention networks (SANs) have advanced the state-of-the-art on various NLP tasks, one criticism of SANs is their ability of encoding positions of input words (Shaw et al., 2018). In this work, we propose to augment SANs with…

Computation and Language · Computer Science 2019-09-04 Xing Wang , Zhaopeng Tu , Longyue Wang , Shuming Shi

Natural Language Understanding (NLU) is a core component of dialog systems. It typically involves two tasks - intent classification (IC) and slot labeling (SL), which are then followed by a dialogue management (DM) component. Such NLU…

Computation and Language · Computer Science 2019-09-20 Arshit Gupta , Peng Zhang , Garima Lalwani , Mona Diab

In modular dialogue systems, natural language understanding (NLU) and natural language generation (NLG) are two critical components, where NLU extracts the semantics from the given texts and NLG is to construct corresponding natural…

Computation and Language · Computer Science 2020-05-01 Shang-Yu Su , Chao-Wei Huang , Yun-Nung Chen