English
Related papers

Related papers: Domain Mixture Design via Log-Likelihood Differenc…

200 papers

Domain adaptation allows generative language models to address specific flaws caused by the domain shift of their application. However, the traditional adaptation by further training on in-domain data rapidly weakens the model's ability to…

Computation and Language · Computer Science 2023-05-29 Michal Štefánik , Marek Kadlčík , Petr Sojka

Over the past year, the emergence of transfer learning with large-scale language models (LM) has led to dramatic performance improvements across a broad range of natural language understanding tasks. However, the size and memory footprint…

Computation and Language · Computer Science 2020-02-04 Luke Melas-Kyriazi , George Han , Celine Liang

Pre-trained Large Language Models (LLMs) often struggle on out-of-domain datasets like healthcare focused text. We explore specialized pre-training to adapt smaller LLMs to different healthcare datasets. Three methods are assessed:…

Computation and Language · Computer Science 2024-04-01 Niall Taylor , Dan Schofield , Andrey Kormilitzin , Dan W Joyce , Alejo Nevado-Holgado

Deep neural networks, trained with large amount of labeled data, can fail to generalize well when tested with examples from a \emph{target domain} whose distribution differs from the training data distribution, referred as the \emph{source…

In the current work, we connect token-level uncertainty in causal language modeling to two types of training objectives: 1) masked maximum likelihood (MLE), 2) self-distillation. We show that masked MLE is effective in reducing epistemic…

Computation and Language · Computer Science 2025-03-24 Tingkai Liu , Ari S. Benjamin , Anthony M. Zador

In real-world applications, the sample distribution at the inference stage often differs from the one at the training stage, causing performance degradation of trained deep models. The research on domain generalization (DG) aims to develop…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Jiao Zhang , Jian Xu , Xu-Yao Zhang , Cheng-Lin Liu

Existing pretraining data mixing methods for large language models (LLMs) typically follow a domain-wise methodology, a top-down process that first determines domain weights and then performs uniform data sampling across each domain.…

Computation and Language · Computer Science 2025-03-04 Xiangyu Xi , Deyang Kong , Jian Yang , Jiawei Yang , Zhengyu Chen , Wei Wang , Jingang Wang , Xunliang Cai , Shikun Zhang , Wei Ye

We propose a framework for learning calibrated uncertainties under domain shifts, where the source (training) distribution differs from the target (test) distribution. We detect such domain shifts via a differentiable density ratio…

Machine Learning · Computer Science 2024-02-07 Haoxuan Wang , Zhiding Yu , Yisong Yue , Anima Anandkumar , Anqi Liu , Junchi Yan

Pre-trained language models achieve outstanding performance in NLP tasks. Various knowledge distillation methods have been proposed to reduce the heavy computation and storage requirements of pre-trained language models. However, from our…

Computation and Language · Computer Science 2021-06-08 Xin Guo , Jianlei Yang , Haoyi Zhou , Xucheng Ye , Jianxin Li

Many text classification tasks are domain-dependent, and various domain adaptation approaches have been proposed to predict unlabeled data in a new domain. Domain-adversarial neural networks (DANN) and their variants have been used widely…

Computation and Language · Computer Science 2020-03-27 Zhuohao Chen , Singla Karan , David C. Atkins , Zac E Imel , Shrikanth Narayanan

Adversarial learning has demonstrated good performance in the unsupervised domain adaptation setting, by learning domain-invariant representations. However, recent work has shown limitations of this approach when label distributions differ…

Machine Learning · Computer Science 2020-12-15 Remi Tachet , Han Zhao , Yu-Xiang Wang , Geoff Gordon

Domain adaptation for large neural language models (NLMs) is coupled with massive amounts of unstructured data in the pretraining phase. In this study, however, we show that pretrained NLMs learn in-domain information more effectively and…

Computation and Language · Computer Science 2022-08-30 Shahriar Golchin , Mihai Surdeanu , Nazgol Tavabi , Ata Kiapour

A well-calibrated neural model produces confidence (probability outputs) closely approximated by the expected accuracy. While prior studies have shown that mixup training as a data augmentation technique can improve model calibration on…

Computation and Language · Computer Science 2022-03-16 Seo Yeon Park , Cornelia Caragea

Topic modeling is a dominant method for exploring document collections on the web and in digital libraries. Recent approaches to topic modeling use pretrained contextualized language models and variational autoencoders. However, large…

Computation and Language · Computer Science 2024-06-21 Suman Adhya , Debarshi Kumar Sanyal

Knowledge distillation (KD) aims to transfer knowledge from a large teacher model to a smaller student model. Previous work applying KD in the field of large language models (LLMs) typically focused on the post-training phase, where the…

Computation and Language · Computer Science 2024-10-22 Hao Peng , Xin Lv , Yushi Bai , Zijun Yao , Jiajie Zhang , Lei Hou , Juanzi Li

As a recent noticeable topic, domain generalization aims to learn a generalizable model on multiple source domains, which is expected to perform well on unseen test domains. Great efforts have been made to learn domain-invariant features by…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Jianxin Lin , Yongqiang Tang , Junping Wang , Wensheng Zhang

The vision-language pre-training has enabled deep models to make a huge step forward in generalizing across unseen domains. The recent learning method based on the vision-language pre-training model is a great tool for domain generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Liyuan Wang , Yan Jin , Zhen Chen , Jinlin Wu , Mengke Li , Yang Lu , Hanzi Wang

Domain adaptive semantic segmentation methods commonly utilize stage-wise training, consisting of a warm-up and a self-training stage. However, this popular approach still faces several challenges in each stage: for warm-up, the widely…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Fengyi Shen , Akhil Gurram , Ziyuan Liu , He Wang , Alois Knoll

Speech recognition systems are often highly domain dependent, a fact widely reported in the literature. However the concept of domain is complex and not bound to clear criteria. Hence it is often not evident if data should be considered to…

Computation and Language · Computer Science 2015-09-23 Mortaza Doulaty , Oscar Saz , Thomas Hain

Domain Adaptation arises when we aim at learning from source domain a model that can per- form acceptably well on a different target domain. It is especially crucial for Natural Language Generation (NLG) in Spoken Dialogue Systems when…

Computation and Language · Computer Science 2018-08-09 Van-Khanh Tran , Le-Minh Nguyen