English
Related papers

Related papers: Spatio-temporal Vision Transformer for Super-resol…

200 papers

We present a novel approach for super-resolution that utilizes implicit neural representation (INR) to effectively reconstruct and enhance low-resolution videos and images. By leveraging the capacity of neural networks to implicitly encode…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Mary Aiyetigbo , Wanqi Yuan , Feng Luo , Nianyi Li

Video Super-Resolution (VSR) aims to recover sequences of high-resolution (HR) frames from low-resolution (LR) frames. Previous methods mainly utilize temporally adjacent frames to assist the reconstruction of target frames. However, in the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Yongjie Chen , Tieru Wu

Self-supervised learning (SSL) with Vision Transformers (ViT) has shown immense potential in medical image analysis. However, the quadratic complexity ($\mathcal{O}(N^2)$) of standard self-attention poses a severe barrier for…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Hung Q. Vo , Pengyu Yuan , Zheng Yin , Kelvin K. Wong , Chika F. Ezeana , Son T. Ly , Hien V. Nguyen , Stephen T. C. Wong

High-resolution fMRI provides a window into the brain's mesoscale organization. Yet, higher spatial resolution increases scan times, to compensate for the low signal and contrast-to-noise ratio. This work introduces a deep learning-based 3D…

Image and Video Processing · Electrical Eng. & Systems 2024-03-20 Hongwei Bran Li , Matthew S. Rosen , Shahin Nasr , Juan Eugenio Iglesias

Fluorescence lifetime imaging microscopy (FLIM) is a powerful quantitative technique that provides metabolic and molecular contrast, offering strong translational potential for label-free, real-time diagnostics. However, its clinical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Paloma Casteleiro Costa , Parnian Ghapandar Kashani , Xuhui Liu , Alexander Chen , Ary Portes , Julien Bec , Laura Marcu , Aydogan Ozcan

The primary challenge in video super-resolution (VSR) is to handle large motions in the input frames, which makes it difficult to accurately aggregate information from multiple frames. Existing works either adopt deformable convolutions or…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Zhihe Lu , Zeyu Xiao , Jiawang Bai , Zhiwei Xiong , Xinchao Wang

Recently, Transformers have shown promising performance in various vision tasks. However, the high costs of global self-attention remain challenging for Transformers, especially for high-resolution vision tasks. Local self-attention runs…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Zhemin Zhang , Xun Gong

Biomedical image classification requires capturing of bio-informatics based on specific feature distribution. In most of such applications, there are mainly challenges due to limited availability of samples for diseased cases and imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Arun K. Sharma , Nishchal K. Verma

In this paper, we develop a novel super-resolution algorithm for near-field synthetic-aperture radar (SAR) under irregular scanning geometries. As fifth-generation (5G) millimeter-wave (mmWave) devices are becoming increasingly affordable…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Josiah Smith , Yusef Alimam , Geetika Vedula , Murat Torlak

Transformer-based models like ViViT and TimeSformer have advanced video understanding by effectively modeling spatiotemporal dependencies. Recent video generation models, such as Sora and Vidu, further highlight the power of transformers in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Shuo Cao , Yihao Liu , Xiaohui Li , Yuanting Gao , Yu Zhou , Chao Dong

Video Super-Resolution (VSR) aims to restore high-resolution (HR) videos from low-resolution (LR) videos. Existing VSR techniques usually recover HR frames by extracting pertinent textures from nearby frames with known degradation…

Image and Video Processing · Electrical Eng. & Systems 2023-01-02 Zhongwei Qiu , Huan Yang , Jianlong Fu , Daochang Liu , Chang Xu , Dongmei Fu

Purpose: This study presents a variable resolution (VR) sampling and deep learning reconstruction approach for multi-spectral MRI near metal implants, aiming to reduce scan times while maintaining image quality. Background: The rising use…

Image and Video Processing · Electrical Eng. & Systems 2024-11-01 Azadeh Sharafi , Nikolai J. Mickevicius , Mehran Baboli , Andrew S. Nencka , Kevin M. Koch

State of the art magnetic resonance (MR) image super-resolution methods (ISR) using convolutional neural networks (CNNs) leverage limited contextual information due to the limited spatial coverage of CNNs. Vision transformers (ViT) learn…

Image and Video Processing · Electrical Eng. & Systems 2022-07-26 Dwarikanath Mahapatra

Image restoration has witnessed significant advancements with the development of deep learning models. Transformer-based models, particularly those using window-based self-attention, have become a dominant force. However, their performance…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Gang Wu , Junjun Jiang , Kui Jiang , Xianming Liu , Liqiang Nie

Deep learning-based single-image super-resolution (SISR) technology focuses on enhancing low-resolution (LR) images into high-resolution (HR) ones. Although significant progress has been made, challenges remain in computational complexity…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Rongchang Lu , Changyu Li , Donghang Li , Guojing Zhang , Jianqiang Huang , Xilai Li

We introduce the Large Sparse Reconstruction Model to study how scaling transformer context windows impacts feed-forward 3D reconstruction. Although recent object-centric feed-forward methods deliver robust, high-quality reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Zhengqin Li , Cheng Zhang , Jakob Engel , Zhao Dong

In fine-grained image recognition (FGIR), the localization and amplification of region attention is an important factor, which has been explored a lot by convolutional neural networks (CNNs) based approaches. The recently developed vision…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Yunqing Hu , Xuan Jin , Yin Zhang , Haiwen Hong , Jingfeng Zhang , Yuan He , Hui Xue

3D Swin Transformer (3D-ST) known for its hierarchical attention and window-based processing, excels in capturing intricate spatial relationships within images. Spatial-spectral Transformer (SST), meanwhile, specializes in modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Muhammad Ahmad , Manuel Mazzara , Salvatore Distifano

Confocal laser scanning microscopy (CLSM) stands out as one of the most widely used microscopy techniques, thanks to its three-dimensional imaging capability and its sub-diffraction spatial resolution, achieved through the closure of a…

Vision Transformer (ViT) architectures represent images as collections of high-dimensional vectorized tokens, each corresponding to a rectangular non-overlapping patch. This representation trades spatial granularity for embedding…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Dong Lao , Yangchao Wu , Tian Yu Liu , Alex Wong , Stefano Soatto