English
Related papers

Related papers: Zero-Shot Adaptive Transfer for Conversational Lan…

200 papers

Training deep networks for semantic segmentation requires annotation of large amounts of data, which can be time-consuming and expensive. Unfortunately, these trained networks still generalize poorly when tested in domains not consistent…

Computer Vision and Pattern Recognition · Computer Science 2018-11-09 Kashyap Chitta , Jianwei Feng , Martial Hebert

Transfer learning techniques are particularly useful in NLP tasks where a sizable amount of high-quality annotated data is difficult to obtain. Current approaches directly adapt a pre-trained language model (LM) on in-domain text before…

This paper presents Adaptive Meta-Domain Transfer Learning (AMDTL), a novel methodology that combines principles of meta-learning with domain-specific adaptations to enhance the transferability of artificial intelligence models across…

Machine Learning · Computer Science 2024-09-12 Michele Laurelli

Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiquan Ngiam , Daiyi Peng , Vijay Vasudevan , Simon Kornblith , Quoc V. Le , Ruoming Pang

Zero-Shot Learning (ZSL) learns models for recognizing new classes. One of the main challenges in ZSL is the domain discrepancy caused by the category inconsistency between training and testing data. Domain adaptation is the most intuitive…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Fengmao Lv , Jianyang Zhang , Guowu Yang , Lei Feng , Yufeng Yu , Lixin Duan

Pretrained language models (PLMs) have made remarkable progress in table-to-text generation tasks. However, the lack of domain-specific knowledge makes it challenging to bridge the topological gap between tabular data and text, especially…

Computation and Language · Computer Science 2024-03-28 Zhixin Guo , Minyxuan Yan , Jiexing Qi , Jianping Zhou , Ziwei He , Guanjie Zheng , Xinbing Wang

Previous zero-shot dialogue state tracking (DST) methods only apply transfer learning, ignoring unlabelled data in the target domain. We transform zero-shot DST into few-shot DST by utilising such unlabelled data via joint and self-training…

Computation and Language · Computer Science 2024-04-04 Chuang Li , Yan Zhang , Min-Yen Kan , Haizhou Li

Domain Adaptation has been widely used to deal with the distribution shift in vision, language, multimedia etc. Most domain adaptation methods learn domain-invariant features with data from both domains available. However, such a strategy…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Ning Ma , Jiajun Bu , Lixian Lu , Jun Wen , Zhen Zhang , Sheng Zhou , Xifeng Yan

We do not pursue a novel method in this paper, but aim to study if a modern text-to-image diffusion model can tailor any task-adaptive image classifier across domains and categories. Existing domain adaptive image classification works…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Weijie Chen , Haoyu Wang , Shicai Yang , Lei Zhang , Wei Wei , Yanning Zhang , Luojun Lin , Di Xie , Yueting Zhuang

Recent work building open-domain chatbots has demonstrated that increasing model size improves performance. On the other hand, latency and connectivity considerations dictate the move of digital assistants on the device. Giving a digital…

Computation and Language · Computer Science 2022-04-11 Greyson Gerhard-Young , Raviteja Anantha , Srinivas Chappidi , Björn Hoffmeister

Zero-shot learning (ZSL) aims to recognize a set of unseen classes without any training images. The standard approach to ZSL requires a set of training images annotated with seen class labels and a semantic descriptor for seen/unseen…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Nanyi Fei , Jiechao Guan , Zhiwu Lu , Tao Xiang , Ji-Rong Wen

Training deep generative models usually requires a large amount of data. To alleviate the data collection cost, the task of zero-shot GAN adaptation aims to reuse well-trained generators to synthesize images of an unseen target domain…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Seogkyu Jeon , Bei Liu , Pilhyeon Lee , Kibeom Hong , Jianlong Fu , Hyeran Byun

Source-free domain adaptation aims to adapt a source-trained model to an unlabeled target domain without access to the source data. It has attracted growing attention in recent years, where existing approaches focus on self-training that…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Idit Diamant , Amir Rosenfeld , Idan Achituve , Jacob Goldberger , Arnon Netzer

Learning what to share between tasks has been a topic of great importance recently, as strategic sharing of knowledge has been shown to improve downstream task performance. This is particularly important for multilingual applications, as…

Computation and Language · Computer Science 2020-10-06 Farhad Nooralahzadeh , Giannis Bekoulis , Johannes Bjerva , Isabelle Augenstein

The success of Zero-shot Action Recognition (ZSAR) methods is intrinsically related to the nature of semantic side information used to transfer knowledge, although this aspect has not been primarily investigated in the literature. This work…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Valter Estevam , Rayson Laroca , Helio Pedrini , David Menotti

Large pre-trained language models (LMs) such as GPT-3 have acquired a surprising ability to perform zero-shot learning. For example, to classify sentiment without any training examples, we can "prompt" the LM with the review and the label…

Computation and Language · Computer Science 2021-09-09 Ruiqi Zhong , Kristy Lee , Zheng Zhang , Dan Klein

Domain adaptation aims to transfer knowledge of labeled instances obtained from a source domain to a target domain to fill the gap between the domains. Most domain adaptation methods assume that the source and target domains have the same…

Machine Learning · Computer Science 2022-09-13 Toshimitsu Aritake , Hideitsu Hino

While billions of non-English speaking users rely on search engines every day, the problem of ad-hoc information retrieval is rarely studied for non-English languages. This is primarily due to a lack of data set that are suitable to train…

Information Retrieval · Computer Science 2020-05-01 Sean MacAvaney , Luca Soldaini , Nazli Goharian

Currently, most methods for text steganalysis are based on deep neural networks (DNNs). However, in real-life scenarios, obtaining a sufficient amount of labeled stego-text for correctly training networks using a large number of parameters…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yufei Luo , Zhen Yang , Ru Zhang , Jianyi Liu

Test-time domain adaptation aims to adapt a source pre-trained model to a target domain without using any source data. Existing works mainly consider the case where the target domain is static. However, real-world machine perception systems…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Qin Wang , Olga Fink , Luc Van Gool , Dengxin Dai