English
Related papers

Related papers: Learning an Ensemble Token from Task-driven Priors…

200 papers

Unsupervised domain adaptation (UDA) aims to transfer the knowledge learnt from a labeled source domain to an unlabeled target domain. Previous work is mainly built upon convolutional neural networks (CNNs) to learn domain-invariant…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Jinyu Yang , Jingjing Liu , Ning Xu , Junzhou Huang

Knowledge Transfer (KT) techniques tackle the problem of transferring the knowledge from a large and complex neural network into a smaller and faster one. However, existing KT methods are tailored towards classification tasks and they…

Machine Learning · Computer Science 2019-03-21 Nikolaos Passalis , Anastasios Tefas

Visual place recognition (VPR) is typically regarded as a specific image retrieval task, whose core lies in representing images as global descriptors. Over the past decade, dominant VPR methods (e.g., NetVLAD) have followed a paradigm that…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Feng Lu , Tong Jin , Canming Ye , Yunpeng Liu , Xiangyuan Lan , Chun Yuan

Discriminative feature representation of person image is important for person re-identification (Re-ID) task. Recently, attributes have been demonstrated beneficially in guiding for learning more discriminative feature representations for…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Bo Jiang , Xixi Wang , Jin Tang

Learning based feature matching methods have been commonly studied in recent years. The core issue for learning feature matching is to how to learn (1) discriminative representations for feature points (or regions) within each intra-image…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Bo Jiang , Shuxian Luo , Xiao Wang , Chuanfu Li , Jin Tang

Transformers have demonstrated remarkable success across vision, language, and video. Yet, increasing task complexity has led to larger models and more tokens, raising the quadratic cost of self-attention and the overhead of GPU memory…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Joonmyung Choi , Sanghyeok Lee , Byungoh Ko , Eunseo Kim , Jihyung Kil , Hyunwoo J. Kim

We introduce Knowledge Fusion Transformers for video action classification. We present a self-attention based feature enhancer to fuse action knowledge in 3D inception based spatio-temporal context of the video clip intended to be…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Ganesh Samarth , Sheetal Ojha , Nikhil Pareek

Fine-tuning a pre-trained deep neural network has become a successful paradigm in various machine learning tasks. However, such a paradigm becomes particularly challenging with tabular data when there are discrepancies between the feature…

Machine Learning · Computer Science 2023-10-24 Qi-Le Zhou , Han-Jia Ye , Le-Ye Wang , De-Chuan Zhan

Vision Transformers (ViTs) have recently dominated a range of computer vision tasks, yet it suffers from low training data efficiency and inferior local semantic representation capability without appropriate inductive bias. Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Cong Wang , Hongmin Xu , Xiong Zhang , Li Wang , Zhitong Zheng , Haifeng Liu

Recently, deep convolution neural networks (CNNs) steered face super-resolution methods have achieved great progress in restoring degraded facial details by jointly training with facial priors. However, these methods have some obvious…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Guangwei Gao , Zixiang Xu , Juncheng Li , Jian Yang , Tieyong Zeng , Guo-Jun Qi

Face recognition performance based on deep learning heavily relies on large-scale training data, which is often difficult to acquire in practical applications. To address this challenge, this paper proposes a GAN-based data augmentation…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Zhongwen Li , Zongwei Li , Xiaoqi Li

The immense success of deep learning based methods in computer vision heavily relies on large scale training datasets. These richly annotated datasets help the network learn discriminative visual features. Collecting and annotating such…

Computer Vision and Pattern Recognition · Computer Science 2018-07-09 Yash Patel , Lluis Gomez , Raul Gomez , Marçal Rusiñol , Dimosthenis Karatzas , C. V. Jawahar

The extension of convolutional neural networks (CNNs) to non-Euclidean geometries has led to multiple frameworks for studying manifolds. Many of those methods have shown design limitations resulting in poor modelling of long-range…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Simon Dahan , Abdulah Fawaz , Logan Z. J. Williams , Chunhui Yang , Timothy S. Coalson , Matthew F. Glasser , A. David Edwards , Daniel Rueckert , Emma C. Robinson

We propose Vision Token Turing Machines (ViTTM), an efficient, low-latency, memory-augmented Vision Transformer (ViT). Our approach builds on Neural Turing Machines and Token Turing Machines, which were applied to NLP and sequential visual…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Purvish Jajal , Nick John Eliopoulos , Benjamin Shiue-Hal Chou , George K. Thiruvathukal , James C. Davis , Yung-Hsiang Lu

The attention mechanism is the primary component of the transformer architecture; it has led to significant advancements in deep learning spanning many domains and covering multiple tasks. In computer vision, the attention mechanism was…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Abdullah Nazhat Abdullah , Tarkan Aydin

Recent studies show that Vision Transformers(ViTs) exhibit strong robustness against various corruptions. Although this property is partly attributed to the self-attention mechanism, there is still a lack of systematic understanding. In…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Daquan Zhou , Zhiding Yu , Enze Xie , Chaowei Xiao , Anima Anandkumar , Jiashi Feng , Jose M. Alvarez

Recognizing facial expressions from static images or video sequences is a widely studied but still challenging problem. The recent progresses obtained by deep neural architectures, or by ensembles of heterogeneous models, have shown that…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Lisa Graziani , Stefano Melacci , Marco Gori

Ethnicity is a key demographic attribute of human beings and it plays a vital role in automatic facial recognition and have extensive real world applications such as Human Computer Interaction (HCI); demographic based classification;…

Computer Vision and Pattern Recognition · Computer Science 2017-11-01 Inzamam Anwar , Naeem Ul Islam

Vision Transformers (ViTs) have shown impressive performance in computer vision, but their high computational cost, quadratic in the number of tokens, limits their adoption in computation-constrained applications. However, this large number…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Yifei Liu , Mathias Gehrig , Nico Messikommer , Marco Cannici , Davide Scaramuzza

Recent Vision-Language Models (VLMs) have demonstrated remarkable multimodal understanding capabilities, yet the redundant visual tokens incur prohibitive computational overhead and degrade inference efficiency. Prior studies typically…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Qiankun Ma , Ziyao Zhang , Haofei Wang , Jie Chen , Zhen Song , Hairong Zheng