English
Related papers

Related papers: MM-ViT: Multi-Modal Video Transformer for Compress…

200 papers

Automatic modulation recognition (AMR) is critical for cognitive radio, spectrum monitoring, and secure wireless communication. However, existing solutions often rely on large labeled datasets or multi-stage training pipelines, which limit…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Hossein Ahmadi , Banafsheh Saffari , Sajjad Emdadi Mahdimahalleh , Mohammad Esmaeil Safari , Aria Ahmadi

Motion representation plays an important role in video understanding and has many applications including action recognition, robot and autonomous guidance or others. Lately, transformer networks, through their self-attention mechanism…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Nattapong Kurpukdee , Adrian G. Bors

Since their emergence, Convolutional Neural Networks (CNNs) have made significant strides in medical image analysis. However, the local nature of the convolution operator may pose a limitation for capturing global and long-range…

Image and Video Processing · Electrical Eng. & Systems 2024-04-01 Abdul Rehman Khan , Asifullah Khan

Video transformers have become the de facto standard for human action recognition, yet their exclusive reliance on the RGB modality still limits their adoption in certain domains. One such domain is Activities of Daily Living (ADL), where…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Dominick Reilly , Srijan Das

We show how transformers can be used to vastly simplify neural video compression. Previous methods have been relying on an increasing number of architectural biases and priors, including motion prediction and warping operations, resulting…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Fabian Mentzer , George Toderici , David Minnen , Sung-Jin Hwang , Sergi Caelles , Mario Lucic , Eirikur Agustsson

Video summarization is among challenging tasks in computer vision, which aims at identifying highlight frames or shots over a lengthy video input. In this paper, we propose an novel attention-based framework for video summarization with…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Yen-Ting Liu , Yu-Jhe Li , Yu-Chiang Frank Wang

We present an approach to efficiently and effectively adapt a masked image modeling (MIM) pre-trained vanilla Vision Transformer (ViT) for object detection, which is based on our two novel observations: (i) A MIM pre-trained vanilla ViT…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Yuxin Fang , Shusheng Yang , Shijie Wang , Yixiao Ge , Ying Shan , Xinggang Wang

Few-shot video segmentation is the task of delineating a specific novel class in a query video using few labelled support images. Typical approaches compare support and query features while limiting comparisons to a single feature layer and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Mennatullah Siam , Rezaul Karim , He Zhao , Richard Wildes

In order to deal with variant-length long videos, prior works extract multi-modal features and fuse them to predict students' engagement intensity. In this paper, we present a new end-to-end method Class Attention in Video Transformer…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Xusheng Ai , Victor S. Sheng , Chunhua Li , Zhiming Cui

Videos capture events that typically contain multiple sequential, and simultaneous, actions even in the span of only a few seconds. However, most large-scale datasets built to train models for action recognition in video only provide a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Mathew Monfort , Bowen Pan , Kandan Ramakrishnan , Alex Andonian , Barry A McNamara , Alex Lascelles , Quanfu Fan , Dan Gutfreund , Rogerio Feris , Aude Oliva

Owing to their ability to extract relevant spatio-temporal video embeddings, Vision Transformers (ViTs) are currently the best performing models in video action understanding. However, their generalization over domains or datasets is…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Hui Lu , Hu Jian , Ronald Poppe , Albert Ali Salah

Learning discriminative spatiotemporal representation is the key problem of video understanding. Recently, Vision Transformers (ViTs) have shown their power in learning long-term video dependency with self-attention. Unfortunately, they…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Kunchang Li , Yali Wang , Yinan He , Yizhuo Li , Yi Wang , Limin Wang , Yu Qiao

In this paper, we present MM-Gesture, the solution developed by our team HFUT-VUT, which ranked 1st in the micro-gesture classification track of the 3rd MiGA Challenge at IJCAI 2025, achieving superior performance compared to previous…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jihao Gu , Fei Wang , Kun Li , Yanyan Wei , Zhiliang Wu , Dan Guo

Ensuring safety in autonomous driving is a complex challenge requiring handling unknown objects and unforeseen driving scenarios. We develop multiscale video transformers capable of detecting unknown objects using only motion cues. Video…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Leila Cheshmi , Mennatullah Siam

Traditional video summarization methods generate fixed video representations regardless of user interest. Therefore such methods limit users' expectations in content search and exploration scenarios. Multi-modal video summarization is one…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Jia-Hong Huang , Luka Murn , Marta Mrak , Marcel Worring

Recent advances in vision transformers (ViTs) have achieved great performance in visual recognition tasks. Convolutional neural networks (CNNs) exploit spatial inductive bias to learn visual representations, but these networks are spatially…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Youpeng Zhao , Huadong Tang , Yingying Jiang , Yong A , Qiang Wu

Transformers have recently shown superior performances on various vision tasks. The large, sometimes even global, receptive field endows Transformer models with higher representation power over their CNN counterparts. Nevertheless, simply…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Zhuofan Xia , Xuran Pan , Shiji Song , Li Erran Li , Gao Huang

Recent Vision Transformer (ViT)-based methods for Image Super-Resolution have demonstrated impressive performance. However, they suffer from significant complexity, resulting in high inference times and memory usage. Additionally, ViT…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Jeongsoo Kim , Jongho Nang , Junsuk Choe

Fine-grained visual classification (FGVC) which aims at recognizing objects from subcategories is a very challenging task due to the inherently subtle inter-class differences. Most existing works mainly tackle this problem by reusing the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Ju He , Jie-Neng Chen , Shuai Liu , Adam Kortylewski , Cheng Yang , Yutong Bai , Changhu Wang

In human-centered environments such as restaurants, homes, and warehouses, robots often face challenges in accurately recognizing 3D objects. These challenges stem from the complexity and variability of these environments, including diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Songsong Xiong , Hamidreza Kasaei