English
Related papers

Related papers: SemTra: A Semantic Skill Translator for Cross-Doma…

200 papers

We propose an approach for semantic imitation, which uses demonstrations from a source domain, e.g. human videos, to accelerate reinforcement learning (RL) in a different target domain, e.g. a robotic manipulator in a simulated kitchen.…

Machine Learning · Computer Science 2022-12-15 Karl Pertsch , Ruta Desai , Vikash Kumar , Franziska Meier , Joseph J. Lim , Dhruv Batra , Akshara Rai

Recent works have proven that many relevant visual tasks are closely related one to another. Yet, this connection is seldom deployed in practice due to the lack of practical methodologies to transfer learned concepts across different…

Computer Vision and Pattern Recognition · Computer Science 2019-10-04 Pierluigi Zama Ramirez , Alessio Tonioni , Samuele Salti , Luigi Di Stefano

Zero-shot neural machine translation is an attractive goal because of the high cost of obtaining data and building translation systems for new translation directions. However, previous papers have reported mixed success in zero-shot…

Computation and Language · Computer Science 2020-11-04 Annette Rios , Mathias Müller , Rico Sennrich

In this paper we present Scylla, a methodology for domain adaptation of Neural Machine Translation (NMT) systems that make use of a multilingual FrameNet enriched with qualia relations as an external knowledge base. Domain adaptation…

Computation and Language · Computer Science 2022-02-22 Alexandre Diniz Costa , Mateus Coutinho Marim , Ely Edison da Silva Matos , Tiago Timponi Torrent

In zero-shot cross-lingual transfer, a supervised NLP task trained on a corpus in one language is directly applicable to another language without any additional training. A source of cross-lingual transfer can be as straightforward as…

Computation and Language · Computer Science 2021-01-27 Hyunjin Choi , Judong Kim , Seongho Joe , Seungjai Min , Youngjune Gwon

Semantic parsing plays a key role in digital voice assistants such as Alexa, Siri, and Google Assistant by mapping natural language to structured meaning representations. When we want to improve the capabilities of a voice assistant by…

Computation and Language · Computer Science 2023-02-01 Subendhu Rongali , Mukund Sridhar , Haidar Khan , Konstantine Arkoudas , Wael Hamza , Andrew McCallum

Transfer learning between different language pairs has shown its effectiveness for Neural Machine Translation (NMT) in low-resource scenario. However, existing transfer methods involving a common target language are far from success in the…

Computation and Language · Computer Science 2019-12-04 Baijun Ji , Zhirui Zhang , Xiangyu Duan , Min Zhang , Boxing Chen , Weihua Luo

We consider a zero-shot semantic parsing task: parsing instructions into compositional logical forms, in domains that were not seen during training. We present a new dataset with 1,390 examples from 7 application domains (e.g. a calendar or…

Computation and Language · Computer Science 2019-11-21 Ofer Givoli , Roi Reichart

We cast a suite of information extraction tasks into a text-to-triple translation framework. Instead of solving each task relying on task-specific datasets and models, we formalize the task as a translation between task-specific input text…

Computation and Language · Computer Science 2021-09-24 Chenguang Wang , Xiao Liu , Zui Chen , Haoyun Hong , Jie Tang , Dawn Song

We introduce a novel method for multilingual transfer that utilizes deep contextual embeddings, pretrained in an unsupervised fashion. While contextual embeddings have been shown to yield richer representations of meaning compared to their…

Computation and Language · Computer Science 2019-04-05 Tal Schuster , Ori Ram , Regina Barzilay , Amir Globerson

In this work, we define and address a novel domain adaptation (DA) problem in semantic scene segmentation, where the target domain not only exhibits a data distribution shift w.r.t. the source domain, but also includes novel classes that do…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Maxime Bucher , Tuan-Hung Vu , Matthieu Cord , Patrick Pérez

We present META-MT, a meta-learning approach to adapt Neural Machine Translation (NMT) systems in a few-shot setting. META-MT provides a new approach to make NMT models easily adaptable to many target domains with the minimal amount of…

Computation and Language · Computer Science 2020-04-07 Amr Sharaf , Hany Hassan , Hal Daumé

Multilingual pre-trained language models (MPLMs) not only can handle tasks in different languages but also exhibit surprising zero-shot cross-lingual transferability. However, MPLMs usually are not able to achieve comparable supervised…

Computation and Language · Computer Science 2022-03-01 Ziqing Yang , Yiming Cui , Zhigang Chen , Shijin Wang

While different neural models often exhibit latent spaces that are alike when exposed to semantically related data, this intrinsic similarity is not always immediately discernible. Towards a better understanding of this phenomenon, our work…

Machine Learning · Computer Science 2024-02-13 Valentino Maiorca , Luca Moschella , Antonio Norelli , Marco Fumero , Francesco Locatello , Emanuele Rodolà

In this paper, we provide a new neural-network based perspective on multi-task learning (MTL) and multi-domain learning (MDL). By introducing the concept of a semantic descriptor, this framework unifies MDL and MTL as well as encompassing…

Machine Learning · Statistics 2015-03-27 Yongxin Yang , Timothy M. Hospedales

Zero-shot skeleton action recognition is a non-trivial task that requires robust unseen generalization with prior knowledge from only seen classes and shared semantics. Existing methods typically build the skeleton-semantics interactions by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Yang Chen , Jingcai Guo , Song Guo , Dacheng Tao

Building a semantic parser quickly in a new domain is a fundamental challenge for conversational interfaces, as current semantic parsers require expensive supervision and lack the ability to generalize to new domains. In this paper, we…

Computation and Language · Computer Science 2018-09-25 Jonathan Herzig , Jonathan Berant

Pre-trained multilingual language encoders, such as multilingual BERT and XLM-R, show great potential for zero-shot cross-lingual transfer. However, these multilingual encoders do not precisely align words and phrases across languages.…

Computation and Language · Computer Science 2021-09-13 Kuan-Hao Huang , Wasi Uddin Ahmad , Nanyun Peng , Kai-Wei Chang

This paper considers the unsupervised domain adaptation problem for neural machine translation (NMT), where we assume the access to only monolingual text in either the source or target language in the new domain. We propose a cross-lingual…

Computation and Language · Computer Science 2021-09-10 Thuy-Trang Vu , Xuanli He , Dinh Phung , Gholamreza Haffari

Domain adaptation for semantic segmentation aims to improve the model performance in the presence of a distribution shift between source and target domain. Leveraging the supervision from auxiliary tasks~(such as depth estimation) has the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Qin Wang , Dengxin Dai , Lukas Hoyer , Luc Van Gool , Olga Fink