English
Related papers

Related papers: Efficient Multi-Purpose Cross-Attention Based Imag…

200 papers

This paper introduces a novel attention mechanism, called dual attention, which is both efficient and effective. The dual attention mechanism consists of two parallel components: local attention generated by Convolutional Neural Networks…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Zhengkai Jiang , Liang Liu , Jiangning Zhang , Yabiao Wang , Mingang Chen , Chengjie Wang

Recently, transformers have captured significant interest in the area of single-image super-resolution tasks, demonstrating substantial gains in performance. Current models heavily depend on the network's extensive ability to extract…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Alik Pramanick , Utsav Bheda , Arijit Sur

Self-supervised learning has recently emerged as the preeminent pretraining paradigm across and between modalities, with remarkable results. In the image domain specifically, group (or cluster) discrimination has been one of the most…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Ioannis Maniadis Metaxas , Georgios Tzimiropoulos , Ioannis Patras

In the world of deep learning, Transformer models have become very significant, leading to improvements in many areas from understanding language to recognizing images, covering a wide range of applications. Despite their success, the…

Machine Learning · Computer Science 2024-07-19 Ghadeer Jaradat , Mohammed Tolba , Ghada Alsuhli , Hani Saleh , Mahmoud Al-Qutayri , Thanos Stouraitis , Baker Mohammad

Convolutional neural networks have become a popular research in the field of finger vein recognition because of their powerful image feature representation. However, most researchers focus on improving the performance of the network by…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Zhongxia Zhang , Mingwen Wang

Cross-attention is commonly adopted in multimodal large language models (MLLMs) for integrating visual information into the language backbone. However, in applications with large visual inputs, such as video understanding, processing a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Tzu-Tao Chang , Shivaram Venkataraman

Vision Transformer models, such as ViT, Swin Transformer, and Transformer-in-Transformer, have recently gained significant traction in computer vision tasks due to their ability to capture the global relation between features which leads to…

Hardware Architecture · Computer Science 2023-09-13 Shashank Nag , Gourav Datta , Souvik Kundu , Nitin Chandrachoodan , Peter A. Beerel

Infrared and visible image fusion aims at generating a fused image containing the intensity and detail information of source images, and the key issue is effectively measuring and integrating the complementary information of multi-modality…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Guang Yang , Jie Li , Hanxiao Lei , Xinbo Gao

Deep learning-based methods have shown remarkable success for various image restoration tasks such as denoising and deblurring. The current state-of-the-art networks are relatively deep and utilize (variants of) self attention mechanisms.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Youssef Mansour , Reinhard Heckel

We propose a new residual block for convolutional neural networks and demonstrate its state-of-the-art performance in medical image segmentation. We combine attention mechanisms with group convolutions to create our group attention…

Image and Video Processing · Electrical Eng. & Systems 2021-04-09 Chaitanya Kaul , Nick Pears , Hang Dai , Roderick Murray-Smith , Suresh Manandhar

Efficiency of gradient propagation in intermediate layers of convolutional neural networks is of key importance for super-resolution task. To this end, we propose a deep architecture for single image super-resolution (SISR), which is built…

Image and Video Processing · Electrical Eng. & Systems 2022-01-31 Kuldeep Purohit , Srimanta Mandal , A. N. Rajagopalan

How to aggregate spatial information plays an essential role in learning-based image restoration. Most existing CNN-based networks adopt static convolutional kernels to encode spatial information, which cannot aggregate spatial information…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Yi Zhang , Dasong Li , Xiaoyu Shi , Dailan He , Kangning Song , Xiaogang Wang , Hongwei Qin , Hongsheng Li

It is challenging to align multi-exposed images due to large illumination variations, especially in presence of saturated regions. In this paper, a novel image alignment algorithm is proposed to cope with the multi-exposed images with…

Image and Video Processing · Electrical Eng. & Systems 2020-12-22 Jun Jiang , Zhengguo Li , Shoulie Xie , Shiqian Wu , Liangcai Zeng

Feature matching is a crucial task in the field of computer vision, which involves finding correspondences between images. Previous studies achieve remarkable performance using learning-based feature comparison. However, the pervasive…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yesheng Zhang , Xu Zhao

Multispectral imaging is very beneficial in diverse applications, like healthcare and agriculture, since it can capture absorption bands of molecules in different spectral areas. A promising approach for multispectral snapshot imaging are…

Image and Video Processing · Electrical Eng. & Systems 2024-11-08 Frank Sippel , Jürgen Seiler , André Kaup

Recently, deep convolutional neural networks (CNNs) have been widely explored in single image super-resolution (SISR) and contribute remarkable progress. However, most of the existing CNNs-based SISR methods do not adequately explore…

Image and Video Processing · Electrical Eng. & Systems 2021-04-22 Jiqing Zhang , Chengjiang Long , Yuxin Wang , Haiyin Piao , Haiyang Mei , Xin Yang , Baocai Yin

Deep learning-based image registration methods have shown state-of-the-art performance and rapid inference speeds. Despite these advances, many existing approaches fall short in capturing spatially varying information in non-local regions…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Xinxing Cheng , Tianyang Zhang , Wenqi Lu , Qingjie Meng , Alejandro F. Frangi , Jinming Duan

In recent years, the long-range attention mechanism of vision transformers has driven significant performance breakthroughs across various computer vision tasks. However, the traditional self-attention mechanism, which processes both…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Tianyi Zhang , Baoxin Li , Jae-sun Seo , Yu Cao

We introduce an efficient video segmentation system for resource-limited edge devices leveraging heterogeneous compute. Specifically, we design network models by searching across multiple dimensions of specifications for the neural…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Jamie Menjay Lin , Siargey Pisarchyk , Juhyun Lee , David Tian , Tingbo Hou , Karthik Raveendran , Raman Sarokin , George Sung , Trent Tolley , Matthias Grundmann

Multi-label image and video classification are fundamental yet challenging tasks in computer vision. The main challenges lie in capturing spatial or temporal dependencies between labels and discovering the locations of discriminative…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Renchun You , Zhiyao Guo , Lei Cui , Xiang Long , Yingze Bao , Shilei Wen