English
Related papers

Related papers: Unifying Dimensions: A Linear Adaptive Approach to…

200 papers

Deep models have achieved significant process on single image super-resolution (SISR) tasks, in particular large models with large kernel ($3\times3$ or more). However, the heavy computational footprint of such models prevents their…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Gang Wu , Junjun Jiang , Kui Jiang , Xianming Liu

3D convolutional neural networks have achieved promising results for video tasks in computer vision, including video saliency prediction that is explored in this paper. However, 3D convolution encodes visual representation merely on fixed…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Ziqiang Wang , Zhi Liu , Gongyang Li , Yang Wang , Tianhong Zhang , Lihua Xu , Jijun Wang

Recently Transformers have provided state-of-the-art performance in sparse matching, crucial to realize high-performance 3D vision applications. Yet, these Transformers lack efficiency due to the quadratic computational complexity of their…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Suwichaya Suwanwimolkul , Satoshi Komorita

Transformers have astounding representational power but typically consume considerable computation which is quadratic with image resolution. The prevailing Swin transformer reduces computational costs through a local window strategy.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Haolin Qin , Daquan Zhou , Tingfa Xu , Ziyang Bian , Jianan Li

For medical image semantic segmentation (MISS), Vision Transformers have emerged as strong alternatives to convolutional neural networks thanks to their inherent ability to capture long-range correlations. However, existing research uses…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Qianying Liu , Chaitanya Kaul , Jun Wang , Christos Anagnostopoulos , Roderick Murray-Smith , Fani Deligianni

While convolutional neural networks have shown a tremendous impact on various computer vision tasks, they generally demonstrate limitations in explicitly modeling long-range dependencies due to the intrinsic locality of the convolution…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Guanglei Yang , Hao Tang , Mingli Ding , Nicu Sebe , Elisa Ricci

To manage the complexity of transformers in video compression, local attention mechanisms are a practical necessity. The common approach of partitioning frames into patches, however, creates architectural flaws like irregular receptive…

Image and Video Processing · Electrical Eng. & Systems 2025-10-07 Alexander Kopte , André Kaup

Transformers have had tremendous impact for several sequence related tasks, largely due to their ability to retrieve from any part of the sequence via softmax based dot-product attention. This mechanism plays a crucial role in Transformer's…

Machine Learning · Computer Science 2025-07-15 Sai Surya Duvvuri , Inderjit S. Dhillon

Recently, deep learning has been successfully applied to the single-image super-resolution (SISR) with remarkable performance. However, most existing methods focus on building a more complex network with a large number of layers, which can…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Wenbin Zou , Tian Ye , Weixin Zheng , Yunchen Zhang , Liang Chen , Yi Wu

Single-image super-resolution (SISR) has achieved significant breakthroughs with the development of deep learning. However, these methods are difficult to be applied in real-world scenarios since they are inevitably accompanied by the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-29 Guangwei Gao , Zhengxue Wang , Juncheng Li , Wenjie Li , Yi Yu , Tieyong Zeng

In this paper, we study the local visual modeling with grid features for image captioning, which is critical for generating accurate and detailed captions. To achieve this target, we propose a Locality-Sensitive Transformer Network (LSTNet)…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Yiwei Ma , Jiayi Ji , Xiaoshuai Sun , Yiyi Zhou , Rongrong Ji

Though U-Net has achieved tremendous success in medical image segmentation tasks, it lacks the ability to explicitly model long-range dependencies. Therefore, Vision Transformers have emerged as alternative segmentation structures recently,…

Image and Video Processing · Electrical Eng. & Systems 2021-11-12 Hongyi Wang , Shiao Xie , Lanfen Lin , Yutaro Iwamoto , Xian-Hua Han , Yen-Wei Chen , Ruofeng Tong

The joint optimization of the reconstruction and classification error is a hard non convex problem, especially when a non linear mapping is utilized. In order to overcome this obstacle, a novel optimization strategy is proposed, in which a…

Machine Learning · Computer Science 2022-11-07 Ioannis A. Nellas , Sotiris K. Tasoulis , Vassilis P. Plagianakos , Spiros V. Georgakopoulos

Deep 3-dimensional (3D) Convolutional Network (ConvNet) has shown promising performance on video recognition tasks because of its powerful spatio-temporal information fusion ability. However, the extremely intensive requirements on memory…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Haonan Wang , Jun Lin , Zhongfeng Wang

Transformers excel at sequence modeling but face quadratic complexity, while linear attention offers improved efficiency but often compromises recall accuracy over long contexts. In this work, we introduce Native Hybrid Attention (NHA), a…

Computation and Language · Computer Science 2026-04-16 Jusen Du , Jiaxi Hu , Tao Zhang , Weigao Sun , Yu Cheng

Although deep convolutional neural networks (CNNs) have obtained outstanding performance in image superresolution (SR), their computational cost increases geometrically as CNN models get deeper and wider. Meanwhile, the features of…

Image and Video Processing · Electrical Eng. & Systems 2019-12-02 Seongmin Hwang , Gwanghuyn Yu , Cheolkon Jung , Jinyoung Kim

Identifying robust and accurate correspondences across images is a fundamental problem in computer vision that enables various downstream tasks. Recent semi-dense matching methods emphasize the effectiveness of fusing relevant cross-view…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Hongkai Chen , Zixin Luo , Yurun Tian , Xuyang Bai , Ziyu Wang , Lei Zhou , Mingmin Zhen , Tian Fang , David McKinnon , Yanghai Tsin , Long Quan

Foundation models like the Segment Anything Model (SAM) demonstrate impressive zero-shot generalization but frequently degrade under diverse real-world illumination, particularly for instance segmentation. In this work, we address this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Qisai Liu , Alloy Das , Zhanhong Jiang , Joshua R. Waite , Aditya Balu , Adarsh Krishnamurthy , Soumik Sarkar

High-dimensional, heterogeneous data with complex feature interactions pose significant challenges for traditional predictive modeling approaches. While Projection to Latent Structures (PLS) remains a popular technique, it struggles to…

Machine Learning · Computer Science 2025-10-21 Farwa Abbas , Hussain Ahmad , Claudia Szabo

Transformers, known for their attention mechanisms, have proven highly effective in focusing on critical elements within complex data. This feature can effectively be used to address the time-varying channels in wireless communication…

Machine Learning · Computer Science 2024-12-03 Matin Mortaheb , Mohammad A. Amir Khojastepour , Sennur Ulukus