English
Related papers

Related papers: Transfer Learning for Neural Semantic Parsing

200 papers

Recent papers have shown that neural networks obtain state-of-the-art performance on several different sequence tagging tasks. One appealing property of such systems is their generality, as excellent performance can be achieved with a…

Computation and Language · Computer Science 2017-03-21 Zhilin Yang , Ruslan Salakhutdinov , William W. Cohen

In this paper, we demonstrate the efficacy of transfer learning and continuous learning for various automatic speech recognition (ASR) tasks. We start with a pre-trained English ASR model and show that transfer learning can be effectively…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-12 Jocelyn Huang , Oleksii Kuchaiev , Patrick O'Neill , Vitaly Lavrukhin , Jason Li , Adriana Flores , Georg Kucsko , Boris Ginsburg

Neural machine translation requires large amounts of parallel training text to learn a reasonable-quality translation model. This is particularly inconvenient for language pairs for which enough parallel text is not available. In this…

Computation and Language · Computer Science 2018-05-14 Poorya Zaremoodi , Gholamreza Haffari

In the literature, the research on abstract meaning representation (AMR) parsing is much restricted by the size of human-curated dataset which is critical to build an AMR parser with good performance. To alleviate such data size…

Computation and Language · Computer Science 2020-10-06 Dongqin Xu , Junhui Li , Muhua Zhu , Min Zhang , Guodong Zhou

We evaluate the character-level translation method for neural semantic parsing on a large corpus of sentences annotated with Abstract Meaning Representations (AMRs). Using a sequence-to-sequence model, and some trivial preprocessing and…

Computation and Language · Computer Science 2017-10-10 Rik van Noord , Johan Bos

In this thesis, we address the data scarcity and limitations of linguistic theory by proposing language-agnostic multi-task training methods. First, we introduce a meta-learning-based approach, meta-transfer learning, in which information…

Computation and Language · Computer Science 2021-04-14 Genta Indra Winata

We compare sequential fine-tuning with a model for multi-task learning in the context where we are interested in boosting performance on two tasks, one of which depends on the other. We test these models on the FigLang2022 shared task which…

Computation and Language · Computer Science 2022-11-01 Irina Bigoulaeva , Rachneet Sachdeva , Harish Tayyar Madabushi , Aline Villavicencio , Iryna Gurevych

Novel contexts may often arise in complex querying scenarios such as in evidence-based medicine (EBM) involving biomedical literature, that may not explicitly refer to entities or canonical concept forms occurring in any fact- or rule-based…

Computation and Language · Computer Science 2019-11-12 Manirupa Das , Juanxi Li , Eric Fosler-Lussier , Simon Lin , Soheil Moosavinasab , Steve Rust , Yungui Huang , Rajiv Ramnath

Semantic parsing aims at translating natural language (NL) utterances onto machine-interpretable programs, which can be executed against a real-world environment. The expensive annotation of utterance-program pairs has long been…

Computation and Language · Computer Science 2021-04-14 Bailin Wang , Mirella Lapata , Ivan Titov

Localizing a semantic parser to support new languages requires effective cross-lingual generalization. Recent work has found success with machine-translation or zero-shot methods although these approaches can struggle to model how native…

Computation and Language · Computer Science 2022-09-28 Tom Sherborne , Mirella Lapata

Open-text (or open-domain) semantic parsers are designed to interpret any statement in natural language by inferring a corresponding meaning representation (MR). Unfortunately, large scale systems cannot be easily machine-learned due to…

Artificial Intelligence · Computer Science 2011-07-20 Antoine Bordes , Xavier Glorot , Jason Weston , Yoshua Bengio

Sign Language Translation has attained considerable success recently, raising hopes for improved communication with the Deaf. A pre-processing step called tokenization improves the success of translations. Tokens can be learned from sign…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Alptekin Orbay , Lale Akarun

Different languages have distinct phonetic systems and vary in their prosodic features making it challenging to develop a Text-to-Speech (TTS) model that can effectively synthesise speech in multilingual settings. Furthermore, TTS…

Computation and Language · Computer Science 2024-06-26 Yingting Li , Ambuj Mehrish , Bryan Chew , Bo Cheng , Soujanya Poria

Recent progress in semantic parsing scarcely considers languages other than English but professional translation can be prohibitively expensive. We adapt a semantic parser trained on a single language, such as English, to new languages and…

Computation and Language · Computer Science 2020-09-24 Tom Sherborne , Yumo Xu , Mirella Lapata

Virtual assistants such as Amazon Alexa, Apple Siri, and Google Assistant often rely on a semantic parsing component to understand which action(s) to execute for an utterance spoken by its users. Traditionally, rule-based or statistical…

Computation and Language · Computer Science 2020-01-31 Subendhu Rongali , Luca Soldaini , Emilio Monti , Wael Hamza

Incorporating syntactic information in Neural Machine Translation models is a method to compensate their requirement for a large amount of parallel training text, especially for low-resource language pairs. Previous works on using syntactic…

Computation and Language · Computer Science 2017-11-27 Poorya Zaremoodi , Gholamreza Haffari

Learning distributed sentence representations is one of the key challenges in natural language processing. Previous work demonstrated that a recurrent neural network (RNNs) based sentence encoder trained on a large collection of annotated…

Computation and Language · Computer Science 2018-08-20 Wasi Uddin Ahmad , Xueying Bai , Zhechao Huang , Chao Jiang , Nanyun Peng , Kai-Wei Chang

Linguistic sequence labeling is a general modeling approach that encompasses a variety of problems, such as part-of-speech tagging and named entity recognition. Recent advances in neural networks (NNs) make it possible to build reliable…

Computation and Language · Computer Science 2017-11-27 Liyuan Liu , Jingbo Shang , Frank F. Xu , Xiang Ren , Huan Gui , Jian Peng , Jiawei Han

This thesis explores challenges in semantic parsing, specifically focusing on scenarios with limited data and computational resources. It offers solutions using techniques like automatic data curation, knowledge transfer, active learning,…

Computation and Language · Computer Science 2023-09-15 Zhuang Li

Transfer learning is a vital technique that generalizes models trained for one setting or task to other settings or tasks. For example in speech recognition, an acoustic model trained for one language can be used to recognize speech in…

Computation and Language · Computer Science 2015-11-20 Dong Wang , Thomas Fang Zheng