English
Related papers

Related papers: Revisiting the Integration of Convolution and Atte…

200 papers

A substantial body of research has focused on developing systems that assist medical professionals during labor-intensive early screening processes, many based on convolutional deep-learning architectures. Recently, multiple studies…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Tristan Piater , Niklas Penzel , Gideon Stein , Joachim Denzler

Unsupervised object-centric learning (OCL) decomposes visual scenes into distinct entities. Slot attention is a popular approach that represents individual objects as latent vectors, called slots. Current methods obtain these slot…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Sebastian Bock , Leonie Schüßler , Krishnakant Singh , Simone Schaub-Meyer , Stefan Roth

Self-Attention has become prevalent in computer vision models. Inspired by fully connected Conditional Random Fields (CRFs), we decompose self-attention into local and context terms. They correspond to the unary and binary terms in CRF and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Chenglin Yang , Siyuan Qiao , Adam Kortylewski , Alan Yuille

An important development direction in the Single-Image Super-Resolution (SISR) algorithms is to improve the efficiency of the algorithms. Recently, efficient Super-Resolution (SR) research focuses on reducing model complexity and improving…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Chengxu Wu , Qinrui Fan , Shu Hu , Xi Wu , Xin Wang , Jing Hu

Medical head CT-scan imaging has been successfully combined with deep learning for medical diagnostics of head diseases and lesions[1]. State of the art classification models and algorithms for this task usually are based on 3d convolution…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Luis Leal , Marvin Castillo , Fernando Juarez , Erick Ramirez , Mildred Aspuac , Diana Letona

Recent advancements in machine learning-based signal analysis, coupled with open data initiatives, have fuelled efforts in automatic sleep stage classification. Despite the proliferation of classification models, few have prioritised…

Machine Learning · Computer Science 2026-03-25 Stephan Goerttler , Yucheng Wang , Emadeldeen Eldele , Min Wu , Fei He

Lightweight and efficiency are critical drivers for the practical application of image super-resolution (SR) algorithms. We propose a simple and effective approach, ShuffleMixer, for lightweight image super-resolution that explores large…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Long Sun , Jinshan Pan , Jinhui Tang

Hyperspectral image (HSI) denoising is critical for the effective analysis and interpretation of hyperspectral data. However, simultaneously modeling global and local features is rarely explored to enhance HSI denoising. In this letter, we…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Shuai Hu , Feng Gao , Xiaowei Zhou , Junyu Dong , Qian Du

Transformers have attracted increasing interests in computer vision, but they still fall behind state-of-the-art convolutional networks. In this work, we show that while Transformers tend to have larger model capacity, their generalization…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Zihang Dai , Hanxiao Liu , Quoc V. Le , Mingxing Tan

The architecture of multimodal large language models (MLLMs) commonly connects a vision encoder, often based on CLIP-ViT, to a large language model. While CLIP-ViT works well for capturing global image features, it struggles to model local…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Haoran Lou , Chunxiao Fan , Ziyan Liu , Yuexin Wu , Xinliang Wang

Large-scale point cloud consists of a multitude of individual objects, thereby encompassing rich structural and underlying semantic contextual information, resulting in a challenging problem in efficiently segmenting a point cloud. Most…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Zhenchao Lin , Li He , Hongqiang Yang , Xiaoqun Sun , Cuojin Zhang , Weinan Chen , Yisheng Guan , Hong Zhang

Vision-Language Models (vLLMs) have emerged as powerful architectures for joint reasoning over visual and textual inputs, enabling breakthroughs in image captioning, cross modal retrieval, and multimodal dialogue. However, as these models…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Andrew Kiruluta , Preethi Raju , Priscilla Burity

Seeing clearly with high resolution is a foundation of Large Multimodal Models (LMMs), which has been proven to be vital for visual perception and reasoning. Existing works usually employ a straightforward resolution upscaling method, where…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Yi-Fan Zhang , Qingsong Wen , Chaoyou Fu , Xue Wang , Zhang Zhang , Liang Wang , Rong Jin

Methods based on convolutional neural network (CNN) have demonstrated tremendous improvements on single image super-resolution. However, the previous methods mainly restore images from one single area in the low resolution (LR) input, which…

Computer Vision and Pattern Recognition · Computer Science 2017-05-16 Xiaoyi Jia , Xiangmin Xu , Bolun Cai , Kailing Guo

It has long been considered a significant problem to improve the visual quality of lossy image and video compression. Recent advances in computing power together with the availability of large training data sets has increased interest in…

Multimedia · Computer Science 2017-03-30 Aaditya Prakash , Nick Moran , Solomon Garber , Antonella DiLillo , James Storer

Vision transformers have become popular as a possible substitute to convolutional neural networks (CNNs) for a variety of computer vision applications. These transformers, with their ability to focus on global relationships in images, offer…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Asifullah Khan , Zunaira Rauf , Anabia Sohail , Abdul Rehman , Hifsa Asif , Aqsa Asif , Umair Farooq

Even though convolutional neural networks (CNNs) are driving progress in medical image segmentation, standard models still have some drawbacks. First, the use of multi-scale approaches, i.e., encoder-decoder architectures, leads to a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Ashish Sinha , Jose Dolz

Mobile vision transformers (MobileViT) can achieve state-of-the-art performance across several mobile vision tasks, including classification and detection. Though these models have fewer parameters, they have high latency as compared to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Sachin Mehta , Mohammad Rastegari

Recently, multi-view learning (MVL) has garnered significant attention due to its ability to fuse discriminative information from multiple views. However, real-world multi-view datasets are often heterogeneous and imperfect, which usually…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jie Xu , Na Zhao , Gang Niu , Masashi Sugiyama , Xiaofeng Zhu

Reconstructing hyperspectral images (HSIs) from RGB inputs provides a cost-effective alternative to hyperspectral cameras, but reconstructing high-dimensional spectra from three channels is inherently ill-posed. Existing methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Zhanjiang Yang , Lijun Sun , Jiawei Dong , Xiaoxin An , Yang Liu , Meng Li