English
Related papers

Related papers: Unsupervised Domain Adaptation of Contextual Embed…

200 papers

With the rapid development of artificial intelligence, conversational bots have became prevalent in mainstream E-commerce platforms, which can provide convenient customer service timely. To satisfy the user, the conversational bots need to…

Computation and Language · Computer Science 2021-09-23 Zhenyu Zhang , Tao Guo , Meng Chen

Recent breakthroughs in scale have enabled the emergence of powerful generative language models, and the ability to fine-tune these models on various tasks by casting them into prompts or instructions. In this landscape, the problem of…

Computation and Language · Computer Science 2025-03-04 Rheeya Uppaal , Yixuan Li , Junjie Hu

In this paper, we consider the problem of unsupervised domain adaptation in the semantic segmentation. There are two primary issues in this field, i.e., what and how to transfer domain knowledge across two domains. Existing methods mainly…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Jinyu Yang , Weizhi An , Chaochao Yan , Peilin Zhao , Junzhou Huang

A classifier trained on a dataset seldom works on other datasets obtained under different conditions due to domain shift. This problem is commonly addressed by domain adaptation methods. In this work we introduce a novel deep learning…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Subhankar Roy , Aliaksandr Siarohin , Enver Sangineto , Samuel Rota Bulo , Nicu Sebe , Elisa Ricci

Answering simple questions over knowledge graphs is a well-studied problem in question answering. Previous approaches for this task built on recurrent and convolutional neural network based architectures that use pretrained word embeddings.…

Computation and Language · Computer Science 2020-02-03 D. Lukovnikov , A. Fischer , J. Lehmann

With the development of Natural Language Processing, Automatic question-answering system such as Waston, Siri, Alexa, has become one of the most important NLP applications. Nowadays, enterprises try to build automatic custom service…

Computation and Language · Computer Science 2019-07-09 Hsiang-En Cherng , Chia-Hui Chang

We propose two methods to make unsupervised domain adaptation (UDA) more parameter efficient using adapters, small bottleneck layers interspersed with every layer of the large-scale pre-trained language model (PLM). The first method…

Computation and Language · Computer Science 2023-02-17 Bhavitvya Malik , Abhinav Ramesh Kashyap , Min-Yen Kan , Soujanya Poria

The content on the web is in a constant state of flux. New entities, issues, and ideas continuously emerge, while the semantics of the existing conversation topics gradually shift. In recent years, pre-trained language models like BERT…

Computation and Language · Computer Science 2021-06-14 Spurthi Amba Hombaiah , Tao Chen , Mingyang Zhang , Michael Bendersky , Marc Najork

We introduce a simple yet effective method of integrating contextual embeddings with commonsense graph embeddings, dubbed BERT Infused Graphs: Matching Over Other embeDdings. First, we introduce a preprocessing method to improve the speed…

Computation and Language · Computer Science 2019-10-18 Jeff Da

Speech recognition systems are often highly domain dependent, a fact widely reported in the literature. However the concept of domain is complex and not bound to clear criteria. Hence it is often not evident if data should be considered to…

Computation and Language · Computer Science 2015-09-23 Mortaza Doulaty , Oscar Saz , Thomas Hain

Unsupervised domain adaptation aims at learning a shared model for two related, but not identical, domains by leveraging supervision from a source domain to an unsupervised target domain. A number of effective domain adaptation approaches…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Jinming Cao , Oren Katzir , Peng Jiang , Dani Lischinski , Danny Cohen-Or , Changhe Tu , Yangyan Li

Increasing model size when pretraining natural language representations often results in improved performance on downstream tasks. However, at some point further model increases become harder due to GPU/TPU memory limitations and longer…

Computation and Language · Computer Science 2020-02-11 Zhenzhong Lan , Mingda Chen , Sebastian Goodman , Kevin Gimpel , Piyush Sharma , Radu Soricut

Commonsense question answering requires reasoning about everyday situations and causes and effects implicit in context. Typically, existing approaches first retrieve external evidence and then perform commonsense reasoning using these…

Computation and Language · Computer Science 2022-10-05 Xunlin Zhan , Yuan Li , Xiao Dong , Xiaodan Liang , Zhiting Hu , Lawrence Carin

Machine reading comprehension is an essential natural language processing task, which takes into a pair of context and query and predicts the corresponding answer to query. In this project, we developed an end-to-end question answering…

Computation and Language · Computer Science 2024-04-05 Jiawei Li , Yue Zhang

Unsupervised domain adaptation (UDA) aims to learn the unlabeled target domain by transferring the knowledge of the labeled source domain. To date, most of the existing works focus on the scenario of one source domain and one target domain…

Machine Learning · Computer Science 2018-09-18 Huanhuan Yu , Menglei Hu , Songcan Chen

As one promising way to inquire about any particular information through a dialog with the bot, question answering dialog systems have gained increasing research interests recently. Designing interactive QA systems has always been a…

Computation and Language · Computer Science 2021-04-26 Munazza Zaib , Dai Hoang Tran , Subhash Sagar , Adnan Mahmood , Wei E. Zhang , Quan Z. Sheng

Review score prediction requires review text understanding, a critical real-world application of natural language processing. Due to dissimilar text domains in product reviews, a common practice is fine-tuning BERT models upon reviews of…

Computation and Language · Computer Science 2023-06-29 Albert Lu , Meng Jiang

Event-based cameras provide accurate and high temporal resolution measurements for performing computer vision tasks in challenging scenarios, such as high-dynamic range environments and fast-motion maneuvers. Despite their advantages,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Mohammad Rostami , Dayuan Jian , Ruitong Sun

Task-oriented semantic parsing is a critical component of virtual assistants, which is responsible for understanding the user's intents (set reminder, play music, etc.). Recent advances in deep learning have enabled several approaches to…

Computation and Language · Computer Science 2020-10-08 Xilun Chen , Asish Ghoshal , Yashar Mehdad , Luke Zettlemoyer , Sonal Gupta

Unsupervised domain adaptation (UDA) is the task of modifying a statistical model trained on labeled data from a source domain to achieve better performance on data from a target domain, with access to only unlabeled data in the target…

Computation and Language · Computer Science 2023-04-06 Timothy A Miller