English
Related papers

Related papers: Efficient Domain Adaptation for Text Line Recognit…

200 papers

Motivated by the success of pre-trained language models such as BERT in a broad range of natural language processing (NLP) tasks, recent research efforts have been made for adapting these models for different application domains. Along this…

Computation and Language · Computer Science 2021-12-07 Denghui Zhang , Zixuan Yuan , Yanchi Liu , Hao Liu , Fuzhen Zhuang , Hui Xiong , Haifeng Chen

It is a well-known fact that the performance of deep learning models deteriorates when they encounter a distribution shift at test time. Test-time adaptation (TTA) algorithms have been proposed to adapt the model online while inferring test…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Jayeon Yoo , Dongkwan Lee , Inseop Chung , Donghyun Kim , Nojun Kwak

Topic modeling plays a vital role in uncovering hidden semantic structures within text corpora, but existing models struggle in low-resource settings where limited target-domain data leads to unstable and incoherent topic inference. We…

Computation and Language · Computer Science 2025-06-10 Pritom Saha Akash , Kevin Chen-Chuan Chang

Foundation object detectors such as GLIP and Grounding DINO excel on general-domain data but often degrade in specialized and data-scarce settings like underwater imagery or industrial defects. Typical cross-domain few-shot approaches rely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Xu Zhang , Zhe Chen , Jing Zhang , Dacheng Tao

Many Transformer-based pre-trained models for code have been developed and applied to code-related tasks. In this paper, we review the existing literature, examine the suitability of model architectures for different tasks, and look at the…

Software Engineering · Computer Science 2023-10-03 Yan Xiao , Xinyue Zuo , Lei Xue , Kailong Wang , Jin Song Dong , Ivan Beschastnikh

Semantic segmentation models have reached remarkable performance across various tasks. However, this performance is achieved with extremely large models, using powerful computational resources and without considering training and inference…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Antonio Tavera , Carlo Masone , Barbara Caputo

Enhancing the domain generalization performance of Face Anti-Spoofing (FAS) techniques has emerged as a research focus. Existing methods are dedicated to extracting domain-invariant features from various training domains. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Lianrui Mu , Jianhong Bai , Xiaoxuan He , Jiangnan Ye , Xiaoyu Liang , Yuchen Yang , Jiedong Zhuang , Haoji Hu

Recently, Transformers have gained significant popularity in image restoration tasks such as image super-resolution and denoising, owing to their superior performance. However, balancing performance and computational burden remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Leheng Zhang , Wei Long , Yawei Li , Xingyu Zhou , Xiaorui Zhao , Shuhang Gu

We introduce a novel approach to unsupervised and semi-supervised domain adaptation for semantic segmentation. Unlike many earlier methods that rely on adversarial learning for feature alignment, we leverage contrastive learning to bridge…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Weizhe Liu , David Ferstl , Samuel Schulter , Lukas Zebedin , Pascal Fua , Christian Leistner

The ubiquity of offensive content on social media is a growing cause for concern among companies and government organizations. Recently, transformer-based models such as BERT, XLNET, and XLM-R have achieved state-of-the-art performance in…

Computation and Language · Computer Science 2023-12-07 Tharindu Ranasinghe , Marcos Zampieri

Prompt learning has recently become a very efficient transfer learning paradigm for Contrastive Language Image Pretraining (CLIP) models. Compared with fine-tuning the entire encoder, prompt learning can obtain highly competitive results by…

Machine Learning · Computer Science 2024-08-30 Guoyizhe Wei , Feng Wang , Anshul Shah , Rama Chellappa

We do not pursue a novel method in this paper, but aim to study if a modern text-to-image diffusion model can tailor any task-adaptive image classifier across domains and categories. Existing domain adaptive image classification works…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Weijie Chen , Haoyu Wang , Shicai Yang , Lei Zhang , Wei Wei , Yanning Zhang , Luojun Lin , Di Xie , Yueting Zhuang

Keyword spotting accuracy degrades when neural networks are exposed to noisy environments. On-site adaptation to previously unseen noise is crucial to recovering accuracy loss, and on-device learning is required to ensure that the…

Sound · Computer Science 2024-03-19 Cristian Cioflan , Lukas Cavigelli , Manuele Rusci , Miguel de Prado , Luca Benini

Unsupervised Domain Adaptation (UDA) addresses the problem of performance degradation due to domain shift between training and testing sets, which is common in computer vision applications. Most existing UDA approaches are based on…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Songsong Wu , Yan Yan , Hao Tang , Jianjun Qian , Jian Zhang , Xiao-Yuan Jing

Dense retrieval overcome the lexical gap and has shown great success in ad-hoc information retrieval (IR). Despite their success, dense retrievers are expensive to serve across practical use cases. For use cases requiring to search from…

Information Retrieval · Computer Science 2023-07-21 Nandan Thakur , Nils Reimers , Jimmy Lin

Deep learning models heavily rely on large scale annotated datasets for training. Unfortunately, datasets cannot capture the infinite variability of the real world, thus neural networks are inherently limited by the restricted visual and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Massimiliano Mancini

Pretrained Large Language Models (LLM) such as ChatGPT, Claude, etc. have demonstrated strong capabilities in various fields of natural language generation. However, there are still many problems when using LLM in specialized…

Computation and Language · Computer Science 2024-05-17 Dawei Feng , Yihai Zhang , Zhixuan Xu

Large Language Models (LLMs) have shown impressive versatility as general purpose models. However, their broad applicability comes at a high-cost computational overhead, particularly in auto-regressive decoding where each step requires a…

Computation and Language · Computer Science 2025-08-04 Itay Nakash , Nitay Calderon , Eyal Ben David , Elad Hoffer , Roi Reichart

Convolutional neural network-based approaches for semantic segmentation rely on supervision with pixel-level ground truth, but may not generalize well to unseen image domains. As the labeling process is tedious and labor intensive,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Yi-Hsuan Tsai , Wei-Chih Hung , Samuel Schulter , Kihyuk Sohn , Ming-Hsuan Yang , Manmohan Chandraker

Existing deep learning-based change detection methods try to elaborately design complicated neural networks with powerful feature representations, but ignore the universal domain shift induced by time-varying land cover changes, including…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Jia Liu , Wenjie Xuan , Yuhang Gan , Juhua Liu , Bo Du