English
Related papers

Related papers: DGME-T: Directional Grid Motion Encoding for Trans…

200 papers

Gait recognition is emerging as a promising technology and an innovative field within computer vision, with a wide range of applications in remote human identification. However, existing methods typically rely on complex architectures to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Zhengxian Wu , Chuanrui Zhang , Shenao Jiang , Hangrui Xu , Zirui Liao , Luyuan Zhang , Huaqiu Li , Peng Jiao , Haoqian Wang

Transformers, renowned for their powerful feature extraction capabilities, have played an increasingly prominent role in various vision tasks. Especially, recent advancements present transformer with hierarchical structures such as Dilated…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Jinghuai Jie , Yan Guo , Guixing Wu , Junmin Wu , Baojian Hua

We present a simple, yet effective and flexible method for action recognition supporting multiple sensor modalities. Multivariate signal sequences are encoded in an image and are then classified using a recently proposed EfficientNet CNN…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Raphael Memmesheimer , Nick Theisen , Dietrich Paulus

Accurate identification of cat breeds from images is a challenging task due to subtle differences in fur patterns, facial structure, and color. In this paper, we present a deep learning-based approach for classifying cat breeds using a…

Exploring the trustworthiness of deep learning models is crucial, especially in critical domains such as medical imaging decision support systems. Conformal prediction has emerged as a rigorous means of providing deep learning models with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Mehran Zoravar , Shadi Alijani , Homayoun Najjaran

Tracking multiple tiny objects is highly challenging due to their weak appearance and limited features. Existing multi-object tracking algorithms generally focus on single-modality scenes, and overlook the complementary characteristics of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Qingyu Xu , Longguang Wang , Weidong Sheng , Yingqian Wang , Chao Xiao , Chao Ma , Wei An

Autoregressive Transformer models have demonstrated impressive performance in video generation, but their sequential token-by-token decoding process poses a major bottleneck, particularly for long videos represented by tens of thousands of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yang Ye , Junliang Guo , Haoyu Wu , Tianyu He , Tim Pearce , Tabish Rashid , Katja Hofmann , Jiang Bian

Transformers, the de-facto standard for language modeling, have been recently applied for vision tasks. This paper introduces sparse queries for vision transformers to exploit the intrinsic spatial redundancy of natural images and save…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Lin Song , Songyang Zhang , Songtao Liu , Zeming Li , Xuming He , Hongbin Sun , Jian Sun , Nanning Zheng

We introduce the Normalized Matching Transformer (NMT), a deep learning approach for efficient and accurate sparse semantic keypoint matching between image pairs. NMT consists of a strong visual backbone, geometric feature refinement via…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Abtin Pourhadi , Paul Swoboda

Recently, the performance of neural image compression (NIC) has steadily improved thanks to the last line of study, reaching or outperforming state-of-the-art conventional codecs. Despite significant progress, current NIC methods still rely…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Ahmed Ghorbel , Wassim Hamidouche , Luce Morin

Over the past two decades, machine analysis of medical imaging has advanced rapidly, opening up significant potential for several important medical applications. As complicated diseases increase and the number of cases rises, the role of…

Image and Video Processing · Electrical Eng. & Systems 2024-05-08 Fares Bougourzi , Fadi Dornaika , Cosimo Distante , Abdelmalik Taleb-Ahmed

Training on large-scale datasets can boost the performance of video instance segmentation while the annotated datasets for VIS are hard to scale up due to the high labor cost. What we possess are numerous isolated filed-specific datasets,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Rongkun Zheng , Lu Qi , Xi Chen , Yi Wang , Kun Wang , Yu Qiao , Hengshuang Zhao

The input tokens to Vision Transformers carry little semantic meaning as they are defined as regular equal-sized patches of the input image, regardless of its content. However, processing uniform background areas of an image should not…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Jakob Drachmann Havtorn , Amelie Royer , Tijmen Blankevoort , Babak Ehteshami Bejnordi

Previous deep image registration methods that employ single homography, multi-grid homography, or thin-plate spline often struggle with real scenes containing depth disparities due to their inherent limitations. To address this, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Haokai Zhu , Bo Qu , Si-Yuan Cao , Runmin Zhang , Shujie Chen , Bailin Yang , Hui-Liang Shen

Deep learning-based medical image segmentation is increasingly used to support clinical diagnosis and develop new treatment strategies. However, model performance remains limited by the scarcity of high-quality annotated data and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Nathan Molinier , Hendrik Möller , Thomas Dagonneau , Anna Curto-Vilalta , Robert Graf , Matan Atad , Daniel Rueckert , Jan S. Kirschke , Julien Cohen-Adad

Dynamic Scene Graph Generation (DSGG) aims to structurally model objects and their dynamic interactions in video sequences for high-level semantic understanding. However, existing methods struggle with fine-grained relationship modeling,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xuejiao Wang , Bohao Zhang , Changbo Wang , Gaoqi He

Class-incremental learning (CIL) enables models to continuously learn new categories from sequential tasks without forgetting previously acquired knowledge. While recent advances in vision-language models such as CLIP have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Haoran Chen , Houze Xu , Micah Goldblum , Daoguo Dong , Zuxuan Wu

In recent years, the deployment of large-scale pre-trained models in audio-visual downstream tasks has yielded remarkable outcomes. However, these models, primarily trained on single-modality unconstrained datasets, still encounter…

Machine Learning · Computer Science 2023-12-22 Haoyi Duan , Yan Xia , Mingze Zhou , Li Tang , Jieming Zhu , Zhou Zhao

Multimodal transformer exhibits high capacity and flexibility to align image and text for visual grounding. However, the existing encoder-only grounding framework (e.g., TransVG) suffers from heavy computation due to the self-attention…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Fengyuan Shi , Ruopeng Gao , Weilin Huang , Limin Wang

CNN-LSTM based architectures have played an important role in image captioning, but limited by the training efficiency and expression ability, researchers began to explore the CNN-Transformer based models and achieved great success.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yiyu Wang , Jungang Xu , Yingfei Sun