中文
相关论文

相关论文: Robustifying Vision Transformer without Retraining…

200 篇论文

Convolutional Neural Networks (ConvNets) are trained offline using the few available data and may therefore suffer from substantial accuracy loss when ported on the field, where unseen input patterns received under unpredictable external…

计算机视觉与模式识别 · 计算机科学 2021-05-14 Luca Mocerino , Roberto G. Rizzo , Valentino Peluso , Andrea Calimera , Enrico Macii

Vision Transformers (ViTs) have shown promising performance compared with Convolutional Neural Networks (CNNs), but the training of ViTs is much harder than CNNs. In this paper, we define several metrics, including Dynamic Data Proportion…

计算机视觉与模式识别 · 计算机科学 2022-09-30 Benjia Zhou , Pichao Wang , Jun Wan , Yanyan Liang , Fan Wang

We present in this paper a new architecture, named Convolutional vision Transformer (CvT), that improves Vision Transformer (ViT) in performance and efficiency by introducing convolutions into ViT to yield the best of both designs. This is…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Haiping Wu , Bin Xiao , Noel Codella , Mengchen Liu , Xiyang Dai , Lu Yuan , Lei Zhang

Vision Transformer (ViT) has shown its advantages over the convolutional neural network (CNN) with its ability to capture global long-range dependencies for visual representation learning. Besides ViT, contrastive learning is another…

计算机视觉与模式识别 · 计算机科学 2022-07-12 Hua-Bao Ling , Bowen Zhu , Dong Huang , Ding-Hua Chen , Chang-Dong Wang , Jian-Huang Lai

Vision Transformers (ViTs) have demonstrated remarkable capabilities in learning representations, but their performance is compromised when applied to unseen domains. Previous methods either engage in prompt learning during the training…

计算机视觉与模式识别 · 计算机科学 2024-09-11 Yunbei Zhang , Akshay Mehra , Jihun Hamm

Facial expression recognition (FER) in videos requires model personalization to capture the considerable variations across subjects. Vision-language models (VLMs) offer strong transfer to downstream tasks through image-text alignment, but…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Masoumeh Sharafi , Muhammad Osama Zeeshan , Soufiane Belharbi , Alessandro Lameiras Koerich , Marco Pedersoli , Eric Granger

Large-scale pretrained vision-language models like CLIP have demonstrated remarkable zero-shot image classification capabilities across diverse domains. To enhance CLIP's performance while preserving the zero-shot paradigm, various…

计算机视觉与模式识别 · 计算机科学 2024-06-19 Xuefeng Hu , Ke Zhang , Min Sun , Albert Chen , Cheng-Hao Kuo , Ram Nevatia

Test-time adaptation (TTA) addresses distribution shifts for streaming test data in unsupervised settings. Currently, most TTA methods can only deal with minor shifts and rely heavily on heuristic and empirical studies. To advance TTA under…

机器学习 · 计算机科学 2024-04-09 Shurui Gui , Xiner Li , Shuiwang Ji

Recently, Vision Transformers (ViTs) have achieved unprecedented effectiveness in the general domain of image classification. Nonetheless, these models remain underexplored in the field of deepfake detection, given their lower performance…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Dat Nguyen , Marcella Astrid , Enjie Ghorbel , Djamila Aouada

While recent face anti-spoofing methods perform well under the intra-domain setups, an effective approach needs to account for much larger appearance variations of images acquired in complex scenes with different sensors for robust…

计算机视觉与模式识别 · 计算机科学 2023-08-01 Hsin-Ping Huang , Deqing Sun , Yaojie Liu , Wen-Sheng Chu , Taihong Xiao , Jinwei Yuan , Hartwig Adam , Ming-Hsuan Yang

We propose a novel method for privacy-preserving deep neural networks (DNNs) with the Vision Transformer (ViT). The method allows us not only to train models and test with visually protected images but to also avoid the performance…

计算机视觉与模式识别 · 计算机科学 2024-02-12 Teru Nagamori , Sayaka Shiota , Hitoshi Kiya

The goal of the challenge is to develop a test-time adaptation (TTA) method, which could adapt the model to gradually changing domains in video sequences for semantic segmentation task. It is based on a synthetic driving video dataset -…

计算机视觉与模式识别 · 计算机科学 2023-10-23 Damian Sójka , Yuyang Liu , Dipam Goswami , Sebastian Cygert , Bartłomiej Twardowski , Joost van de Weijer

Feature shifts have been shown to be useful for action recognition with CNN-based models since Temporal Shift Module (TSM) was proposed. It is based on frame-wise feature extraction with late fusion, and layer features are shifted along the…

计算机视觉与模式识别 · 计算机科学 2022-11-15 Ryota Hashiguchi , Toru Tamaki

Unsupervised domain adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain. The most recent UDA methods always resort to adversarial training to yield state-of-the-art results and a dominant…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Yahan Li , Yuan Wu

Vision Transformer (ViT) has recently gained significant attention in solving computer vision (CV) problems due to its capability of extracting informative features and modeling long-range dependencies through the attention mechanism.…

计算机视觉与模式识别 · 计算机科学 2024-07-12 Yao Qiang , Chengyin Li , Prashant Khanduri , Dongxiao Zhu

Deep neural networks have achieved remarkable success in a variety of computer vision applications. However, there is a problem of degrading accuracy when the data distribution shifts between training and testing. As a solution of this…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Shohei Enomoto , Naoya Hasegawa , Kazuki Adachi , Taku Sasaki , Shin'ya Yamaguchi , Satoshi Suzuki , Takeharu Eda

The goal of this paper is to enhance face recognition performance by augmenting head poses during the testing phase. Existing methods often rely on training on frontalised images or learning pose-invariant representations, yet both…

计算机视觉与模式识别 · 计算机科学 2025-05-15 Jaemin Jung , Youngjoon Jang , Joon Son Chung

Adapting models to dynamic, real-world environments characterized by shifting data distributions and unseen test scenarios is a critical challenge in deep learning. In this paper, we consider a realistic and challenging Test-Time Adaptation…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Manogna Sreenivas , Soma Biswas

In this study, we introduce an intelligent Test Time Augmentation (TTA) algorithm designed to enhance the robustness and accuracy of image classification models against viewpoint variations. Unlike traditional TTA methods that…

图像与视频处理 · 电气工程与系统科学 2024-06-14 Efe Ozturk , Mohit Prabhushankar , Ghassan AlRegib

Given the inevitability of domain shifts during inference in real-world applications, test-time adaptation (TTA) is essential for model adaptation after deployment. However, the real-world scenario of continuously changing target…

机器学习 · 计算机科学 2023-11-28 Junyoung Park , Jin Kim , Hyeongjun Kwon , Ilhoon Yoon , Kwanghoon Sohn