English
Related papers

Related papers: Capsule Networks for Low Resource Spoken Language …

200 papers

Deep neural networks have been able to outperform humans in some cases like image recognition and image classification. However, with the emergence of various novel categories, the ability to continuously widen the learning capability of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Nihar Bendre , Hugo Terashima Marín , Peyman Najafirad

The language acquisition literature shows that children do not build their lexicon by segmenting the spoken input into phonemes and then building up words from them, but rather adopt a top-down approach and start by segmenting word-like…

Computation and Language · Computer Science 2020-10-21 William N. Havard , Jean-Pierre Chevrot , Laurent Besacier

Machine translation systems achieve near human-level performance on some languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences, which hinders their applicability to the majority of…

Computation and Language · Computer Science 2018-08-15 Guillaume Lample , Myle Ott , Alexis Conneau , Ludovic Denoyer , Marc'Aurelio Ranzato

Capsule networks (CapsNets) are capable of modeling visual hierarchical relationships, which is achieved by the "routing-by-agreement" mechanism. This paper proposes a pairwise agreement mechanism to build capsules, inspired by the feature…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Lei Zhao , Xiaohui Wang , Lei Huang

Training machines to understand natural language and interact with humans is one of the major goals of artificial intelligence. Recent years have witnessed an evolution from matching networks to pre-trained language models (PrLMs). In…

Computation and Language · Computer Science 2023-01-12 Zhuosheng Zhang , Hai Zhao , Longxiang Liu

Spoken language understanding (SLU) system usually consists of various pipeline components, where each component heavily relies on the results of its upstream ones. For example, Intent detection (ID), and slot filling (SF) require its…

Computation and Language · Computer Science 2021-04-14 Di Wu , Yiren Chen , Liang Ding , Dacheng Tao

The predominant approach to open-domain dialog generation relies on end-to-end training of neural models on chat datasets. However, this approach provides little insight as to what these models learn (or do not learn) about engaging in…

Computation and Language · Computer Science 2020-08-04 Abdelrhman Saleh , Tovly Deutsch , Stephen Casper , Yonatan Belinkov , Stuart Shieber

In Weak Supervised Learning (WSL), a model is trained over noisy labels obtained from semantic rules and task-specific pre-trained models. Rules offer limited generalization over tasks and require significant manual efforts while…

Computation and Language · Computer Science 2022-06-22 Ayush Kumar , Rishabh Kumar Tripathi , Jithendra Vepa

Design of dialogue systems has witnessed many advances lately, yet acquiring huge set of data remains an hindrance to their fast development for a new task or language. Besides, training interactive systems with batch data is not…

Computation and Language · Computer Science 2021-10-27 Matthieu Riou , Bassam Jabaian , Stéphane Huet , Fabrice Lefèvre

State of the art algorithms for many pattern recognition problems rely on deep network models. Training these models requires a large labeled dataset and considerable computational resources. Also, it is difficult to understand the working…

Artificial Intelligence · Computer Science 2019-09-25 Heather Riley , Mohan Sridharan

Dialogue Act (DA) classification is a challenging problem in dialogue interpretation, which aims to attach semantic labels to utterances and characterize the speaker's intention. Currently, many existing approaches formulate the DA…

Computation and Language · Computer Science 2018-11-14 Yao Wan , Wenqiang Yan , Jianwei Gao , Zhou Zhao , Jian Wu , Philip S. Yu

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

Machine Learning · Computer Science 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

Recent advances on prompt-tuning cast few-shot classification tasks as a masked language modeling problem. By wrapping input into a template and using a verbalizer which constructs a mapping between label space and label word space,…

Computation and Language · Computer Science 2022-01-17 Yinyi Wei , Tong Mo , Yongtao Jiang , Weiping Li , Wen Zhao

Learning-based Text To Speech systems have the potential to generalize from one speaker to the next and thus require a relatively short sample of any new voice. However, this promise is currently largely unrealized. We present a method that…

Machine Learning · Computer Science 2018-02-21 Eliya Nachmani , Adam Polyak , Yaniv Taigman , Lior Wolf

Classic pipeline models for task-oriented dialogue system require explicit modeling the dialogue states and hand-crafted action spaces to query a domain-specific knowledge base. Conversely, sequence-to-sequence models learn to map dialogue…

Computation and Language · Computer Science 2018-06-13 Haoyang Wen , Yijia Liu , Wanxiang Che , Libo Qin , Ting Liu

Language-conditioned policies allow robots to interpret and execute human instructions. Learning such policies requires a substantial investment with regards to time and compute resources. Still, the resulting controllers are highly…

Robotics · Computer Science 2022-12-12 Yifan Zhou , Shubham Sonawani , Mariano Phielipp , Simon Stepputtis , Heni Ben Amor

Standard deep learning systems require thousands or millions of examples to learn a concept, and cannot integrate new concepts easily. By contrast, humans have an incredible ability to do one-shot or few-shot learning. For instance, from…

Computation and Language · Computer Science 2018-01-03 Andrew K. Lampinen , James L. McClelland

Despite the remarkable progress recently made in distant speech recognition, state-of-the-art technology still suffers from a lack of robustness, especially when adverse acoustic conditions characterized by non-stationary noises and…

Computation and Language · Computer Science 2017-03-24 Mirco Ravanelli , Philemon Brakel , Maurizio Omologo , Yoshua Bengio

In this paper we take the first steps in studying a new approach to synthesis of efficient communication schemes in multi-agent systems, trained via reinforcement learning. We combine symbolic methods with machine learning, in what is…

Artificial Intelligence · Computer Science 2022-12-29 Erik Jergéus , Leo Karlsson Oinonen , Emil Carlsson , Moa Johansson

We present the first complete spoken dialogue system driven by a multi-dimensional statistical dialogue manager. This framework has been shown to substantially reduce data needs by leveraging domain-independent dimensions, such as social…

Computation and Language · Computer Science 2019-09-09 Simon Keizer , Ondřej Dušek , Xingkun Liu , Verena Rieser