English
Related papers

Related papers: Neural Adaptation Layers for Cross-domain Named En…

200 papers

Magnetic Resonance Imaging (MRI) is widely used in routine clinical diagnosis and treatment. However, variations in MRI acquisition protocols result in different appearances of normal and diseased tissue in the images. Convolutional neural…

Large pre-trained models are usually fine-tuned on downstream task data, and tested on unseen data. When the train and test data come from different domains, the model is likely to struggle, as it is not adapted to the test domain. We…

Computation and Language · Computer Science 2022-06-02 Omer Antverg , Eyal Ben-David , Yonatan Belinkov

Selecting or designing an appropriate domain adaptation algorithm for a given problem remains challenging. This paper presents a Transformer model that can provably approximate and opt for domain adaptation methods for a given dataset in…

Machine Learning · Computer Science 2024-05-28 Ryuichiro Hataya , Kota Matsui , Masaaki Imaizumi

The cost of large scale data collection and annotation often makes the application of machine learning algorithms to new tasks or datasets prohibitively expensive. One approach circumventing this cost is training models on synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2016-08-23 Konstantinos Bousmalis , George Trigeorgis , Nathan Silberman , Dilip Krishnan , Dumitru Erhan

Expanding the domain that deep neural network has already learned without accessing old domain data is a challenging task because deep neural networks forget previously learned information when learning new data from a new domain. In this…

Machine Learning · Computer Science 2017-11-17 Heechul Jung , Jeongwoo Ju , Minju Jung , Junmo Kim

Convolutional neural networks (CNNs) have led to significant improvements in the semantic segmentation of images. When source and target datasets come from different modalities, CNN performance suffers due to domain shift. In such cases…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Serban Stan , Mohammad Rostami

Named Entity Recognition (NER) is an important subtask of information extraction that seeks to locate and recognise named entities. Despite recent achievements, we still face limitations with correctly detecting and classifying entities,…

Information Retrieval · Computer Science 2017-10-31 Diego Esteves , Rafael Peres , Jens Lehmann , Giulio Napolitano

We propose a general framework for unsupervised domain adaptation, which allows deep neural networks trained on a source domain to be tested on a different target domain without requiring any training annotations in the target domain. This…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Zak Murez , Soheil Kolouri , David Kriegman , Ravi Ramamoorthi , Kyungnam Kim

Entity matching (EM) identifies data records that refer to the same real-world entity. Despite the effort in the past years to improve the performance in EM, the existing methods still require a huge amount of labeled data in each domain…

Machine Learning · Computer Science 2022-04-21 Mohamed Trabelsi , Jeff Heflin , Jin Cao

3D object detectors are fundamental components of perception systems in autonomous vehicles. While these detectors achieve remarkable performance on standard autonomous driving benchmarks, they often struggle to generalize across different…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Bartłomiej Olber , Jakub Winter , Paweł Wawrzyński , Andrii Gamalii , Daniel Górniak , Marcin Łojek , Robert Nowak , Krystian Radlak

Large-scale labeled training datasets have enabled deep neural networks to excel on a wide range of benchmark vision tasks. However, in many applications it is prohibitively expensive or time-consuming to obtain large quantities of labeled…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Sicheng Zhao , Bichen Wu , Joseph Gonzalez , Sanjit A. Seshia , Kurt Keutzer

Deep neural networks are widely used in image classification problems. However, little work addresses how features from different deep neural networks affect the domain adaptation problem. Existing methods often extract deep features from…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Youshan Zhang , Brian D. Davison

Unsupervised domain adaptation (UDA) methods have been broadly utilized to improve the models' adaptation ability in general computer vision. However, different from the natural images, there exist huge semantic gaps for the nuclei from…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Canran Li , Dongnan Liu , Haoran Li , Zheng Zhang , Guangming Lu , Xiaojun Chang , Weidong Cai

Despite their widespread success, the application of deep neural networks to functional data remains scarce today. The infinite dimensionality of functional data means standard learning algorithms can be applied only after appropriate…

Machine Learning · Statistics 2021-06-22 Junwen Yao , Jonas Mueller , Jane-Ling Wang

We propose an approach to domain adaptation for semantic segmentation that is both practical and highly accurate. In contrast to previous work, we abandon the use of computationally involved adversarial objectives, network ensembles and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Nikita Araslanov , Stefan Roth

Fine-tuning pre-trained Neural Machine Translation (NMT) models is the dominant approach for adapting to new languages and domains. However, fine-tuning requires adapting and maintaining a separate model for each target task. We propose a…

Computation and Language · Computer Science 2019-09-19 Ankur Bapna , Naveen Arivazhagan , Orhan Firat

Training CNNs from scratch on new domains typically demands large numbers of labeled images and computations, which is not suitable for low-power hardware. One way to reduce these requirements is to modularize the CNN architecture and…

Machine Learning · Computer Science 2021-10-22 Himanshu Pradeep Aswani , Abhiraj Sunil Kanse , Shubhang Bhatnagar , Amit Sethi

It is today acknowledged that neural network language models outperform backoff language models in applications like speech recognition or statistical machine translation. However, training these models on large amounts of data can take…

Neural and Evolutionary Computing · Computer Science 2015-07-08 Aram Ter-Sarkisov , Holger Schwenk , Loic Barrault , Fethi Bougares

Fine-tuning neural networks is widely used to transfer valuable knowledge from high-resource to low-resource domains. In a standard fine-tuning scheme, source and target problems are trained using the same architecture. Although capable of…

Computation and Language · Computer Science 2019-04-09 Sara Meftah , Youssef Tamaazousti , Nasredine Semmar , Hassane Essafi , Fatiha Sadat

The insertion of deep learning in medical image analysis had lead to the development of state-of-the art strategies in several applications such a disease classification, as well as abnormality detection and segmentation. However, even the…

Image and Video Processing · Electrical Eng. & Systems 2022-02-24 Mauricio Orbes-Arteaga , Thomas Varsavsky , Lauge Sorensen , Mads Nielsen , Akshay Pai , Sebastien Ourselin , Marc Modat , M Jorge Cardoso