English
Related papers

Related papers: A Pilot Study of Domain Adaptation Effect for Neur…

200 papers

Neural abstractive summarization has been increasingly studied, where the prior work mainly focused on summarizing single-speaker documents (news, scientific publications, etc). In dialogues, there are different interactions between…

Computation and Language · Computer Science 2018-10-02 Chih-Wen Goo , Yun-Nung Chen

Spoken language understanding has been addressed as a supervised learning problem, where a set of training data is available for each domain. However, annotating data for each domain is both financially costly and non-scalable so we should…

Computation and Language · Computer Science 2021-11-30 Libo Qin , Minheng Ni , Yue Zhang , Wanxiang Che , Yangming Li , Ting Liu

We study the problem of unsupervised domain adaption in the universal scenario, in which only some of the classes are shared between the source and target domains. We present a scoring scheme that is effective in identifying the samples of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Omri Lifshitz , Lior Wolf

All famous machine learning algorithms that comprise both supervised and semi-supervised learning work well only under a common assumption: the training and test data follow the same distribution. When the distribution changes, most…

Machine Learning · Computer Science 2022-07-15 Ievgen Redko , Emilie Morvant , Amaury Habrard , Marc Sebban , Younès Bennani

The phenomenon of data distribution evolving over time has been observed in a range of applications, calling the needs of adaptive learning algorithms. We thus study the problem of supervised gradual domain adaptation, where labeled data…

Machine Learning · Computer Science 2022-11-15 Jing Dong , Shiji Zhou , Baoxiang Wang , Han Zhao

Unsupervised domain adaptation aims to generalize the hypothesis trained in a source domain to an unlabeled target domain. One popular approach to this problem is to learn domain-invariant embeddings for both domains. In this work, we…

Machine Learning · Computer Science 2019-10-15 Ching-Yao Chuang , Antonio Torralba , Stefanie Jegelka

Deep neural networks are data hungry models and thus face difficulties when attempting to train on small text datasets. Transfer learning is a potential solution but their effectiveness in the text domain is not as explored as in areas such…

Machine Learning · Computer Science 2019-01-28 Yaser Keneshloo , Naren Ramakrishnan , Chandan K. Reddy

In machine learning, if the training data is an unbiased sample of an underlying distribution, then the learned classification function will make accurate predictions for new samples. However, if the training data is not an unbiased sample,…

Machine Learning · Computer Science 2019-01-15 Wouter M. Kouw , Marco Loog

The lack of out-of-domain generalization is a critical weakness of deep networks for semantic segmentation. Previous studies relied on the assumption of a static model, i. e., once the training process is complete, model parameters remain…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Sherwin Bahmani , Oliver Hahn , Eduard Zamfir , Nikita Araslanov , Daniel Cremers , Stefan Roth

Existing models for extractive summarization are usually trained from scratch with a cross-entropy loss, which does not explicitly capture the global context at the document level. In this paper, we aim to improve this task by introducing…

Computation and Language · Computer Science 2019-06-12 Hong Wang , Xin Wang , Wenhan Xiong , Mo Yu , Xiaoxiao Guo , Shiyu Chang , William Yang Wang

LiDAR semantic segmentation provides 3D semantic information about the environment, an essential cue for intelligent systems during their decision making processes. Deep neural networks are achieving state-of-the-art results on large public…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Inigo Alonso , Luis Riazuelo , Luis Montesano , Ana C. Murillo

Abstracts derived from biomedical literature possess distinct domain-specific characteristics, including specialised writing styles and biomedical terminologies, which necessitate a deep understanding of the related literature. As a result,…

Computation and Language · Computer Science 2023-10-25 Chen Tang , Shun Wang , Tomas Goldsack , Chenghua Lin

The assumption that training and testing samples are generated from the same distribution does not always hold for real-world machine-learning applications. The procedure of tackling this discrepancy between the training (source) and…

Machine Learning · Computer Science 2018-12-05 Debasmit Das , C. S. George Lee

Domain Adaptation aiming to learn a transferable feature between different but related domains has been well investigated and has shown excellent empirical performances. Previous works mainly focused on matching the marginal feature…

Machine Learning · Computer Science 2020-05-26 Fan Zhou , Changjian Shui , Bincheng Huang , Boyu Wang , Brahim Chaib-draa

Domain-adaptive pre-training (or DA-training for short), also known as post-training, aims to train a pre-trained general-purpose language model (LM) using an unlabeled corpus of a particular domain to adapt the LM so that end-tasks in the…

Computation and Language · Computer Science 2023-01-24 Zixuan Ke , Yijia Shao , Haowei Lin , Hu Xu , Lei Shu , Bing Liu

Neural Machine Translation (NMT) is a new approach for automatic translation of text from one human language into another. The basic concept in NMT is to train a large Neural Network that maximizes the translation performance on a given…

Computation and Language · Computer Science 2016-12-22 Markus Freitag , Yaser Al-Onaizan

Convolutional neural networks trained on publicly available medical imaging datasets (source domain) rarely generalise to different scanners or acquisition protocols (target domain). This motivates the active field of domain adaptation.…

Image and Video Processing · Electrical Eng. & Systems 2020-10-06 Thomas Varsavsky , Mauricio Orbes-Arteaga , Carole H. Sudre , Mark S. Graham , Parashkev Nachev , M. Jorge Cardoso

We develop an algorithm to improve the performance of a pre-trained model under concept shift without retraining the model from scratch when only unannotated samples of initial concepts are accessible. We model this problem as a domain…

Machine Learning · Computer Science 2022-11-22 Mohammad Rostami , Aram Galstyan

Domain adaptation is crucial in many real-world applications where the distribution of the training data differs from the distribution of the test data. Previous Deep Learning-based approaches to domain adaptation need to be trained jointly…

Computation and Language · Computer Science 2017-02-08 Sebastian Ruder , Parsa Ghaffari , John G. Breslin

Domain adaptation is a sub-field of machine learning that involves transferring knowledge from a source domain to perform the same task in the target domain. It is a typical challenge in machine learning that arises, e.g., when data is…

Machine Learning · Computer Science 2025-01-09 Philipp Spitzer , Dominik Martin , Laurin Eichberger , Niklas Kühl