English
Related papers

Related papers: Encoding Explanatory Knowledge for Zero-shot Scien…

200 papers

Large-scale pre-trained models (PTMs) show great zero-shot capabilities. In this paper, we study how to leverage them for zero-shot visual question answering (VQA). Our approach is motivated by a few observations. First, VQA questions often…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Rui Cao , Jing Jiang

Leveraging user-provided translation to constrain NMT has practical significance. Existing methods can be classified into two main categories, namely the use of placeholder tags for lexicon words and the use of hard constraints during…

Computation and Language · Computer Science 2019-05-17 Kai Song , Yue Zhang , Heng Yu , Weihua Luo , Kun Wang , Min Zhang

While several benefits were realized for multilingual vision-language pretrained models, recent benchmarks across various tasks and languages showed poor cross-lingual generalisation when multilingually pre-trained vision-language models…

Computation and Language · Computer Science 2022-12-01 Farhad Nooralahzadeh , Rico Sennrich

Recently, the NLP community has witnessed a rapid advancement in multilingual and cross-lingual transfer research where the supervision is transferred from high-resource languages (HRLs) to low-resource languages (LRLs). However, the…

Computation and Language · Computer Science 2022-03-22 Kaushal Kumar Maurya , Maunendra Sankar Desarkar

Transfer learning or multilingual model is essential for low-resource neural machine translation (NMT), but the applicability is limited to cognate languages by sharing their vocabularies. This paper shows effective techniques to transfer a…

Computation and Language · Computer Science 2019-06-06 Yunsu Kim , Yingbo Gao , Hermann Ney

Recent studies on transformer-based language models show that they can answer questions by reasoning over knowledge provided as part of the context (i.e., in-context reasoning). However, since the available knowledge is often not filtered…

Computation and Language · Computer Science 2023-11-07 Zeming Chen , Gail Weiss , Eric Mitchell , Asli Celikyilmaz , Antoine Bosselut

While deep neural networks have achieved impressive performance on a range of NLP tasks, these data-hungry models heavily rely on labeled data, which restricts their applications in scenarios where data annotation is expensive. Natural…

Computation and Language · Computer Science 2020-02-17 Ziqi Wang , Yujia Qin , Wenxuan Zhou , Jun Yan , Qinyuan Ye , Leonardo Neves , Zhiyuan Liu , Xiang Ren

With the rapid growth of knowledge bases (KBs) on the web, how to take full advantage of them becomes increasingly important. Knowledge base-based question answering (KB-QA) is one of the most promising approaches to access the substantial…

Information Retrieval · Computer Science 2016-06-06 Yuanzhe Zhang , Kang Liu , Shizhu He , Guoliang Ji , Zhanyi Liu , Hua Wu , Jun Zhao

The many-to-many multilingual neural machine translation can translate between language pairs unseen during training, i.e., zero-shot translation. Improving zero-shot translation requires the model to learn universal representations and…

Computation and Language · Computer Science 2022-10-31 Shuhao Gu , Yang Feng

Voice style transfer, also called voice conversion, seeks to modify one speaker's voice to generate speech as if it came from another (target) speaker. Previous works have made progress on voice conversion with parallel training data and…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-18 Siyang Yuan , Pengyu Cheng , Ruiyi Zhang , Weituo Hao , Zhe Gan , Lawrence Carin

In zero-shot cross-lingual transfer, a supervised NLP task trained on a corpus in one language is directly applicable to another language without any additional training. A source of cross-lingual transfer can be as straightforward as…

Computation and Language · Computer Science 2021-01-27 Hyunjin Choi , Judong Kim , Seongho Joe , Seungjai Min , Youngjune Gwon

We introduce NExT-QA, a rigorously designed video question answering (VideoQA) benchmark to advance video understanding from describing to explaining the temporal actions. Based on the dataset, we set up multi-choice and open-ended QA tasks…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Junbin Xiao , Xindi Shang , Angela Yao , Tat-Seng Chua

We propose a simple solution to use a single Neural Machine Translation (NMT) model to translate between multiple languages. Our solution requires no change in the model architecture from our base system but instead introduces an artificial…

k-nearest-neighbor machine translation (NN-MT), proposed by Khandelwal et al. (2021), has achieved many state-of-the-art results in machine translation tasks. Although effective, NN-MT requires conducting NN searches through the large…

Computation and Language · Computer Science 2022-05-03 Zhixian Yang , Renliang Sun , Xiaojun Wan

While state-of-the-art models that rely upon massively multilingual pretrained encoders achieve sample efficiency in downstream applications, they still require abundant amounts of unlabelled text. Nevertheless, most of the world's…

Computation and Language · Computer Science 2024-02-16 Yaoyiran Li , Edoardo M. Ponti , Ivan Vulić , Anna Korhonen

Knowledge Graph (KG) and its variant of ontology have been widely used for knowledge representation, and have shown to be quite effective in augmenting Zero-shot Learning (ZSL). However, existing ZSL methods that utilize KGs all neglect the…

Artificial Intelligence · Computer Science 2022-06-09 Yuxia Geng , Jiaoyan Chen , Wen Zhang , Yajing Xu , Zhuo Chen , Jeff Z. Pan , Yufeng Huang , Feiyu Xiong , Huajun Chen

Efficient utilisation of both intra- and extra-textual context remains one of the critical gaps between machine and human translation. Existing research has primarily focused on providing individual, well-defined types of context in…

Computation and Language · Computer Science 2023-05-26 Sebastian Vincent , Robert Flynn , Carolina Scarton

Question-answering (QA) data often encodes essential information in many facets. This paper studies a natural question: Can we get supervision from QA data for other tasks (typically, non-QA ones)? For example, {\em can we use QAMR (Michael…

Computation and Language · Computer Science 2020-12-07 Hangfeng He , Qiang Ning , Dan Roth

Large multilingual language models such as mBERT or XLM-R enable zero-shot cross-lingual transfer in various IR and NLP tasks. Cao et al. (2020) proposed a data- and compute-efficient method for cross-lingual adjustment of mBERT that uses a…

Computation and Language · Computer Science 2023-11-01 Pavel Efimov , Leonid Boytsov , Elena Arslanova , Pavel Braslavski

In this paper, we focus on a novel knowledge reuse scenario where the knowledge in the source schema needs to be translated to a semantically heterogeneous target schema. We refer to this task as "knowledge translation" (KT). Unlike data…

Artificial Intelligence · Computer Science 2015-07-14 Shangpu Jiang , Daniel Lowd , Dejing Dou