English
Related papers

Related papers: Lightweight Vision Transformer with Window and Spa…

200 papers

To address the high resolution of image pixels, the Swin Transformer introduces window attention. This mechanism divides an image into non-overlapping windows and restricts attention computation to within each window, significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Zhendong Zhang

Automatically discovering composable abstractions from raw perceptual data is a long-standing challenge in machine learning. Recent slot-based neural networks that learn about objects in a self-supervised manner have made exciting progress…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Ondrej Biza , Sjoerd van Steenkiste , Mehdi S. M. Sajjadi , Gamaleldin F. Elsayed , Aravindh Mahendran , Thomas Kipf

Class Activation Mapping (CAM) is a powerful technique used to understand the decision making of Convolutional Neural Network (CNN) in computer vision. Recently, there have been attempts not only to generate better visual explanations, but…

Machine Learning · Computer Science 2021-05-04 Kwang Hee Lee , Chaewon Park , Junghyun Oh , Nojun Kwak

To ensure global food security and the overall profit of stakeholders, the importance of correctly detecting and classifying plant diseases is paramount. In this connection, the emergence of deep learning-based image classification has…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Sabbir Ahmed , Md. Bakhtiar Hasan , Tasnim Ahmed , Redwan Karim Sony , Md. Hasanul Kabir

3D point cloud segmentation has a wide range of applications in areas such as autonomous driving, augmented reality, virtual reality and digital twins. The point cloud data collected in real scenes often contain small objects and categories…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Chade Li , Pengju Zhang , Jiaming Zhang , Yihong Wu

In Few-Shot Learning (FSL), traditional metric-based approaches often rely on global metrics to compute similarity. However, in natural scenes, the spatial arrangement of key instances is often inconsistent across images. This spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Hao Tang , Junhao Lu , Guoheng Huang , Ming Li , Xuhang Chen , Guo Zhong , Zhengguang Tan , Zinuo Li

Medical imaging is essential for the diagnosis and treatment of diseases, with medical image segmentation as a subtask receiving high attention. However, automatic medical image segmentation models are typically task-specific and struggle…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Ruochen Gao , Donghang Lyu , Marius Staring

As intensities of MRI volumes are inconsistent across institutes, it is essential to extract universal features of multi-modal MRIs to precisely segment brain tumors. In this concept, we propose a volumetric vision transformer that follows…

Image and Video Processing · Electrical Eng. & Systems 2022-09-19 Himashi Peiris , Munawar Hayat , Zhaolin Chen , Gary Egan , Mehrtash Harandi

Humans exhibit remarkable proficiency in visual classification tasks, accurately recognizing and classifying new images with minimal examples. This ability is attributed to their capacity to focus on details and identify common features…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Weihao Jiang , Shuoxi Zhang , Kun He

Medical image processing tasks such as segmentation often require capturing non-local information. As organs, bones, and tissues share common characteristics such as intensity, shape, and texture, the contextual information plays a critical…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Samuel Joutard , Reuben Dorent , Amanda Isaac , Sebastien Ourselin , Tom Vercauteren , Marc Modat

Recently, the soft attention mechanism, which was originally proposed in language processing, has been applied in computer vision tasks like image captioning. This paper presents improvements to the soft attention model by combining a…

Computer Vision and Pattern Recognition · Computer Science 2017-05-22 Shiyang Yan , Jeremy S. Smith , Wenjin Lu , Bailing Zhang

Vision Transformers have achieved remarkable progresses, among which Swin Transformer has demonstrated the tremendous potential of Transformer for vision tasks. It surmounts the key challenge of high computational complexity by performing…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jiatong Zhang , Zengwei Yao , Fanglin Chen , Guangming Lu , Wenjie Pei

In the domain of large foundation models, the Segment Anything Model (SAM) has gained notable recognition for its exceptional performance in image segmentation. However, tackling the video camouflage object detection (VCOD) task presents a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Muhammad Nawfal Meeran , Gokul Adethya T , Bhanu Pratyush Mantha

Recently Transformer has shown good performance in several vision tasks due to its powerful modeling capabilities. To reduce the quadratic complexity caused by the attention, some outstanding work restricts attention to local regions or…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Fangjian Lin , Yizhe Ma , Sitong Wu , Long Yu , Shengwei Tian

Image super-resolution (SR) has significantly advanced through the adoption of Transformer architectures. However, conventional techniques aimed at enlarging the self-attention window to capture broader contexts come with inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Chengxing Xie , Xiaoming Zhang , Linze Li , Yuqian Fu , Biao Gong , Tianrui Li , Kai Zhang

While large visual models (LVM) demonstrated significant potential in image understanding, due to the application of large-scale pre-training, the Segment Anything Model (SAM) has also achieved great success in the field of image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Jiaqi Yang , Yaning Zhang , Jingxi Hu , Xiangjian He , Linlin Shen , Guoping Qiu

This paper proposes a novel deep architecture to address multi-label image recognition, a fundamental and practical task towards general visual understanding. Current solutions for this task usually rely on an extra step of extracting…

Computer Vision and Pattern Recognition · Computer Science 2017-11-09 Zhouxia Wang , Tianshui Chen , Guanbin Li , Ruijia Xu , Liang Lin

Global food insecurity is expected to worsen in the coming decades with the accelerated rate of climate change and the rapidly increasing population. In this vein, it is important to remove inefficiencies at every level of food production.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Oh Joon Kwon , Byungsoo Kim , Youngduck Choi

This study addresses the demand for real-time detection of tomatoes and tomato flowers by agricultural robots deployed on edge devices in greenhouse environments. Under practical imaging conditions, object detection systems often face…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Hung-Chih Tu , Bo-Syun Chen , Yun-Chien Cheng

Although numerous solutions have been proposed for image super-resolution, they are usually incompatible with low-power devices with many computational and memory constraints. In this paper, we address this problem by proposing a simple yet…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Long Sun , Jiangxin Dong , Jinhui Tang , Jinshan Pan