English
Related papers

Related papers: N-Gram in Swin Transformers for Efficient Lightwei…

200 papers

In-line digital holography (DIH) is a widely used lensless imaging technique, valued for its simplicity and capability to image samples at high throughput. However, capturing only intensity of the interference pattern during the recording…

Image and Video Processing · Electrical Eng. & Systems 2026-03-06 Gökhan Koçmarlı , G. Bora Esmer

The vision community is witnessing a modeling shift from CNNs to Transformers, where pure Transformer architectures have attained top accuracy on the major video recognition benchmarks. These video models are all built on Transformer layers…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Ze Liu , Jia Ning , Yue Cao , Yixuan Wei , Zheng Zhang , Stephen Lin , Han Hu

Convolutional neural networks (CNNs) are good at extracting contexture features within certain receptive fields, while transformers can model the global long-range dependency features. By absorbing the advantage of transformer and the merit…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Zhengyi Liu , Yacheng Tan , Qian He , Yun Xiao

Semantic segmentation of brain tumors is a fundamental medical image analysis task involving multiple MRI imaging modalities that can assist clinicians in diagnosing the patient and successively studying the progression of the malignant…

Image and Video Processing · Electrical Eng. & Systems 2022-01-05 Ali Hatamizadeh , Vishwesh Nath , Yucheng Tang , Dong Yang , Holger Roth , Daguang Xu

Transformer architectures have exhibited remarkable performance in image super-resolution (SR). Since the quadratic computational complexity of the self-attention (SA) in Transformer, existing methods tend to adopt SA in a local region to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Zheng Chen , Yulun Zhang , Jinjin Gu , Linghe Kong , Xiaokang Yang

Although convolutional neural networks (CNNs) have achieved remarkable progress in weakly supervised semantic segmentation (WSSS), the effective receptive field of CNN is insufficient to capture global context information, leading to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Chunmeng Liu , Enze Xie , Wenjia Wang , Wenhai Wang , Guangyao Li , Ping Luo

Among the current mainstream change detection networks, transformer is deficient in the ability to capture accurate low-level details, while convolutional neural network (CNN) is wanting in the capacity to understand global information and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Dalong Zheng , Zebin Wu , Jia Liu , Zhihui Wei

In this paper, we present Uformer, an effective and efficient Transformer-based architecture for image restoration, in which we build a hierarchical encoder-decoder network using the Transformer block. In Uformer, there are two core…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Zhendong Wang , Xiaodong Cun , Jianmin Bao , Wengang Zhou , Jianzhuang Liu , Houqiang Li

In the field of medical images, although various works find Swin Transformer has promising effectiveness on pixelwise dense prediction, whether pre-training these models without using extra dataset can further boost the performance for the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Xinrong Hu , Dewen Zeng , Yawen Wu , Xueyang Li , Yiyu Shi

Scene segmentation in images is a fundamental yet challenging problem in visual content understanding, which is to learn a model to assign every image pixel to a categorical label. One of the challenges for this learning task is to consider…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Litao Yu , Zhibin Li , Jian Zhang , Qiang Wu

Transformers have become foundational architectures for both natural language and computer vision tasks. However, the high computational cost makes it quite challenging to deploy on resource-constraint devices. This paper investigates the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jialong Guo , Xinghao Chen , Yehui Tang , Yunhe Wang

High-resolution wide-angle fisheye images are becoming more and more important for robotics applications such as autonomous driving. However, using ordinary convolutional neural networks or vision transformers on this data is problematic…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Oscar Carlsson , Jan E. Gerken , Hampus Linander , Heiner Spieß , Fredrik Ohlsson , Christoffer Petersson , Daniel Persson

A deep learning-assisted inversion method is proposed to solve the inhomogeneous background imaging problem. Three non-iterative methods, namely the distorted-Born (DB) major current coefficients method, the DB modified Born approximation…

Applied Physics · Physics 2023-12-12 Naike Du , Tiantian Yin , Jing Wang , Rencheng Song , Kuiwen Xu , Bingyuan Liang , Sheng Sun , Xiuzhu Ye

Since context modeling is critical for estimating depth from a single image, researchers put tremendous effort into obtaining global context. Many global manipulations are designed for traditional CNN-based architectures to overcome the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Chang Shu , Ziming Chen , Lei Chen , Kuan Ma , Minghui Wang , Haibing Ren

Image super-resolution generation aims to generate a high-resolution image from its low-resolution image. However, more complex neural networks bring high computational costs and memory storage. It is still an active area for offering the…

Image and Video Processing · Electrical Eng. & Systems 2023-10-23 Neeraj Baghel , Shiv Ram Dubey , Satish Kumar Singh

CNNs with strong learning abilities are widely chosen to resolve super-resolution problem. However, CNNs depend on deeper network architectures to improve performance of image super-resolution, which may increase computational cost in…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Chunwei Tian , Yixuan Yuan , Shichao Zhang , Chia-Wen Lin , Wangmeng Zuo , David Zhang

Compared to CNN-based methods, Transformer-based methods achieve impressive image restoration outcomes due to their abilities to model remote dependencies. However, how to apply Transformer-based methods to the field of blind…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Qingguo Liu , Pan Gao , Kang Han , Ningzhong Liu , Wei Xiang

Unsupervised image-to-image translation is a central task in computer vision. Current translation frameworks will abandon the discriminator once the training process is completed. This paper contends a novel role of the discriminator by…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Runfa Chen , Wenbing Huang , Binghui Huang , Fuchun Sun , Bin Fang

Convolutional neural networks (CNNs) have achieved remarkable performance in hyperspectral image (HSI) classification over the last few years. Despite the progress that has been made, rich and informative spectral information of HSI has…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Huiling Wang

Recent advancements in Single-Image Super-Resolution (SISR) using deep learning have significantly improved image restoration quality. However, the high computational cost of processing high-resolution images due to the large number of…

Quantum Physics · Physics 2026-01-09 Siddhant Dutta , Nouhaila Innan , Khadijeh Najafi , Sadok Ben Yahia , Muhammad Shafique