English
Related papers

Related papers: Generalizing through Forgetting -- Domain Generali…

200 papers

A central problem in unsupervised domain adaptation is determining what to transfer from labeled source domains to an unlabeled target domain. To handle high-dimensional observations (e.g., images), a line of approaches use deep learning to…

Machine Learning · Computer Science 2026-04-28 Ignavier Ng , Yan Li , Zijian Li , Yujia Zheng , Guangyi Chen , Kun Zhang

In-context learning enables transformer models to generalize to new tasks based solely on input prompts, without any need for weight updates. However, existing training paradigms typically rely on large, unstructured datasets that are…

Automatically summarizing patients' main problems from daily progress notes using natural language processing methods helps to battle against information and cognitive overload in hospital settings and potentially assists providers with…

Computation and Language · Computer Science 2022-09-16 Yanjun Gao , Dmitriy Dligach , Timothy Miller , Dongfang Xu , Matthew M. Churpek , Majid Afshar

Domain adaptive semantic segmentation methods commonly utilize stage-wise training, consisting of a warm-up and a self-training stage. However, this popular approach still faces several challenges in each stage: for warm-up, the widely…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Fengyi Shen , Akhil Gurram , Ziyuan Liu , He Wang , Alois Knoll

This paper focuses on the domain generalization task where domain knowledge is unavailable, and even worse, only samples from a single domain can be utilized during training. Our motivation originates from the recent progresses in deep…

Machine Learning · Computer Science 2022-03-08 Chris Xing Tian , Haoliang Li , Xiaofei Xie , Yang Liu , Shiqi Wang

Language models pretrained on text from a wide variety of sources form the foundation of today's NLP. In light of the success of these broad-coverage models, we investigate whether it is still helpful to tailor a pretrained model to the…

Computation and Language · Computer Science 2020-05-07 Suchin Gururangan , Ana Marasović , Swabha Swayamdipta , Kyle Lo , Iz Beltagy , Doug Downey , Noah A. Smith

Though convolutional neural networks (CNNs) have demonstrated remarkable ability in learning discriminative features, they often generalize poorly to unseen domains. Domain generalization aims to address this problem by learning from a set…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Kaiyang Zhou , Yongxin Yang , Yu Qiao , Tao Xiang

To build a French national electronic injury surveillance system based on emergency room visits, we aim to develop a coding system to classify their causes from clinical notes in free-text. Supervised learning techniques have shown good…

Computation and Language · Computer Science 2021-04-08 Binbin Xu , Cédric Gil-Jardiné , Frantz Thiessard , Eric Tellier , Marta Avalos , Emmanuel Lagarde

Domain shift is a significant problem in histopathology. There can be large differences in data characteristics of whole-slide images between medical centers and scanners, making generalization of deep learning to unseen data difficult. To…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Karin Stacke , Gabriel Eilertsen , Jonas Unger , Claes Lundström

Although deep networks have significantly increased the performance of visual recognition methods, it is still challenging to achieve the robustness across visual domains that is necessary for real-world applications. To tackle this issue,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Antonio D'Innocente , Silvia Bucci , Barbara Caputo , Tatiana Tommasi

The purpose of this study is to analyze the efficacy of transfer learning techniques and transformer-based models as applied to medical natural language processing (NLP) tasks, specifically radiological text classification. We used 1,977…

Computation and Language · Computer Science 2020-02-19 Daniel Ranti , Katie Hanss , Shan Zhao , Varun Arvind , Joseph Titano , Anthony Costa , Eric Oermann

Menstrual health is a critical yet often overlooked aspect of women's healthcare. Despite its clinical relevance, detailed data on menstrual characteristics is rarely available in structured medical records. To address this gap, we propose…

Computation and Language · Computer Science 2025-04-01 Anna Shopova , Cristoph Lippert , Leslee J. Shaw , Eugenia Alleva

Relation Extraction (RE) is one of the fundamental tasks in Information Extraction and Natural Language Processing. Dependency trees have been shown to be a very useful source of information for this task. The current deep learning models…

Computation and Language · Computer Science 2019-07-09 Amir Pouran Ben Veyseh , Thien Huu Nguyen , Dejing Dou

The vast amount of health data has been continuously collected for each patient, providing opportunities to support diverse healthcare predictive tasks such as seizure detection and hospitalization prediction. Existing models are mostly…

Machine Learning · Computer Science 2023-02-16 Chaoqi Yang , M. Brandon Westover , Jimeng Sun

Humans have the ability to accumulate knowledge of new tasks in varying conditions, but deep neural networks often suffer from catastrophic forgetting of previously learned knowledge after learning a new task. Many recent methods focus on…

Domain generalization (DG) focuses on transferring domain-invariant knowledge from multiple source domains (available at train time) to an, a priori, unseen target domain(s). This requires a class to be expressed in multiple domains for the…

Machine Learning · Computer Science 2023-06-02 Kimathi Kaai , Saad Hossain , Sirisha Rambhatla

The insertion of deep learning in medical image analysis had lead to the development of state-of-the art strategies in several applications such a disease classification, as well as abnormality detection and segmentation. However, even the…

Image and Video Processing · Electrical Eng. & Systems 2022-02-24 Mauricio Orbes-Arteaga , Thomas Varsavsky , Lauge Sorensen , Mads Nielsen , Akshay Pai , Sebastien Ourselin , Marc Modat , M Jorge Cardoso

AI-text detectors achieve high accuracy on in-domain benchmarks, but often struggle to generalize across different generation conditions such as unseen prompts, model families, or domains. While prior work has reported these generalization…

Computation and Language · Computer Science 2026-01-27 Yuxi Xia , Kinga Stańczak , Benjamin Roth

Sentiment analysis is a costly yet necessary task for enterprises to study the opinions of their customers to improve their products and to determine optimal marketing strategies. Due to the existence of a wide range of domains across…

Computation and Language · Computer Science 2021-07-06 Mohammad Rostami , Aram Galstyan

In domain adaptation for neural machine translation, translation performance can benefit from separating features into domain-specific features and common features. In this paper, we propose a method to explicitly model the two kinds of…

Computation and Language · Computer Science 2019-09-24 Shuhao Gu , Yang Feng , Qun Liu