English
Related papers

Related papers: TMT: Cross-domain Semantic Segmentation with Regio…

200 papers

Unsupervised domain adaptation enables to alleviate the need for pixel-wise annotation in the semantic segmentation. One of the most common strategies is to translate images from the source domain to the target domain and then align their…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jinyu Yang , Weizhi An , Sheng Wang , Xinliang Zhu , Chaochao Yan , Junzhou Huang

Despite domain-adaptive object detectors based on CNN and transformers have made significant progress in cross-domain detection tasks, it is regrettable that domain adaptation for real-time transformer-based detectors has not yet been…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Feng Lv , Guoqing Li , Jin Li , Chunlong Xia

Transformers with powerful global relation modeling abilities have been introduced to fundamental computer vision tasks recently. As a typical example, the Vision Transformer (ViT) directly applies a pure transformer architecture on image…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Xiaoyu Yue , Shuyang Sun , Zhanghui Kuang , Meng Wei , Philip Torr , Wayne Zhang , Dahua Lin

Transformers, known for their attention mechanisms, have proven highly effective in focusing on critical elements within complex data. This feature can effectively be used to address the time-varying channels in wireless communication…

Machine Learning · Computer Science 2024-12-03 Matin Mortaheb , Mohammad A. Amir Khojastepour , Sennur Ulukus

Diffusion Transformers (DiTs) achieve state-of-the-art performance in text-to-image synthesis but remain computationally expensive due to the iterative nature of denoising and the quadratic cost of global attention. In this work, we observe…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Bowen Lin , Fanjiang Ye , Yihua Liu , Zhenghui Guo , Boyuan Zhang , Weijian Zheng , Yufan Xu , Tiancheng Xing , Yuke Wang , Chengming Zhang

Vision Transformers (ViTs) have emerged with superior performance on computer vision tasks compared to convolutional neural network (CNN)-based models. However, ViTs are mainly designed for image classification that generate single-scale…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Jiaqi Gu , Hyoukjun Kwon , Dilin Wang , Wei Ye , Meng Li , Yu-Hsin Chen , Liangzhen Lai , Vikas Chandra , David Z. Pan

Though image transformers have shown competitive results with convolutional neural networks in computer vision tasks, lacking inductive biases such as locality still poses problems in terms of model efficiency especially for embedded…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Ling Li , Ali Shafiee Ardestani , Joseph Hassoun

The development of deep learning techniques has allowed Neural Machine Translation (NMT) models to become extremely powerful, given sufficient training data and training time. However, systems struggle when translating text from a new…

Computation and Language · Computer Science 2022-03-23 Danielle Saunders

Recent Vision Transformer (ViT)-based methods for Image Super-Resolution have demonstrated impressive performance. However, they suffer from significant complexity, resulting in high inference times and memory usage. Additionally, ViT…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Jeongsoo Kim , Jongho Nang , Junsuk Choe

To successfully apply trained neural network models to new domains, powerful transfer learning solutions are essential. We propose to introduce a novel cross-domain latent modulation mechanism to a variational autoencoder framework so as to…

Machine Learning · Computer Science 2024-02-01 Jinyong Hou , Jeremiah D. Deng , Stephen Cranefield , Xuejie Din

In the evolving landscape of 6G networks, semantic communications are poised to revolutionize data transmission by prioritizing the transmission of semantic meaning over raw data accuracy. This paper presents a Vision Transformer…

Image and Video Processing · Electrical Eng. & Systems 2025-03-24 Muhammad Ahmed Mohsin , Muhammad Jazib , Zeeshan Alam , Muhmmad Farhan Khan , Muhammad Saad , Muhammad Ali Jamshed

Many works proposed methods to improve the performance of Neural Machine Translation (NMT) models in a domain/multi-domain adaptation scenario. However, an understanding of how NMT baselines represent text domain information internally is…

Computation and Language · Computer Science 2021-09-17 Maksym Del , Elizaveta Korotkova , Mark Fishel

In this paper, we propose two novel methods for domain adaptation for the attention-only neural machine translation (NMT) model, i.e., the Transformer. Our methods focus on training a single translation model for multiple domains by either…

Computation and Language · Computer Science 2019-06-21 Chenhui Chu , Raj Dabre

The Vision Transformer (ViT) architecture has become widely recognized in computer vision, leveraging its self-attention mechanism to achieve remarkable success across various tasks. Despite its strengths, ViT's optimization remains…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Haoyu Yun , Hamid Krim

As deep learning models increasingly find applications in critical domains such as medical imaging, the need for transparent and trustworthy decision-making becomes paramount. Many explainability methods provide insights into how these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Piotr Komorowski , Hubert Baniecki , Przemysław Biecek

Learning representations in the joint domain of vision and touch can improve manipulation dexterity, robustness, and sample-complexity by exploiting mutual information and complementary cues. Here, we present Visuo-Tactile Transformers…

Robotics · Computer Science 2022-10-04 Yizhou Chen , Andrea Sipos , Mark Van der Merwe , Nima Fazeli

While transformers have greatly boosted performance in semantic segmentation, domain adaptive transformers are not yet well explored. We identify that the domain gap can cause discrepancies in self-attention. Due to this gap, the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Kaihong Wang , Donghyun Kim , Rogerio Feris , Kate Saenko , Margrit Betke

The goal of the challenge is to develop a test-time adaptation (TTA) method, which could adapt the model to gradually changing domains in video sequences for semantic segmentation task. It is based on a synthetic driving video dataset -…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Damian Sójka , Yuyang Liu , Dipam Goswami , Sebastian Cygert , Bartłomiej Twardowski , Joost van de Weijer

This paper considers the unsupervised domain adaptation problem for neural machine translation (NMT), where we assume the access to only monolingual text in either the source or target language in the new domain. We propose a cross-lingual…

Computation and Language · Computer Science 2021-09-10 Thuy-Trang Vu , Xuanli He , Dinh Phung , Gholamreza Haffari

Test-time adaptation (TTA) has emerged as a promising paradigm to handle the domain shifts at test time for medical images from different institutions without using extra training data. However, existing TTA solutions for segmentation tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Chuyan Zhang , Hao Zheng , Xin You , Yefeng Zheng , Yun Gu