English
Related papers

Related papers: Exploring Frequency-Inspired Optimization in Trans…

200 papers

Lightweight neural networks for single-image super-resolution (SISR) tasks have made substantial breakthroughs in recent years. Compared to low-frequency information, high-frequency detail is much more difficult to reconstruct. Most SISR…

Image and Video Processing · Electrical Eng. & Systems 2023-03-22 Xiaotian Weng , Yi Chen , Zhichao Zheng , Yanhui Gu , Junsheng Zhou , Yudong Zhang

Since context modeling is critical for estimating depth from a single image, researchers put tremendous effort into obtaining global context. Many global manipulations are designed for traditional CNN-based architectures to overcome the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Chang Shu , Ziming Chen , Lei Chen , Kuan Ma , Minghui Wang , Haibing Ren

Pansharpening aims to fuse high-resolution panchromatic (PAN) images with low-resolution multispectral (LRMS) images to generate high-resolution multispectral (HRMS) images. Although deep learning-based methods have achieved promising…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Zeyu Xia , Chenxi Sun , Tianyu Xin , Yubo Zeng , Haoyu Chen , Liang-Jian Deng

Recent advancements in Single-Image Super-Resolution (SISR) using deep learning have significantly improved image restoration quality. However, the high computational cost of processing high-resolution images due to the large number of…

Quantum Physics · Physics 2026-01-09 Siddhant Dutta , Nouhaila Innan , Khadijeh Najafi , Sadok Ben Yahia , Muhammad Shafique

Recently, Transformer-based methods have shown impressive performance in single image super-resolution (SISR) tasks due to the ability of global feature extraction. However, the capabilities of Transformers that need to incorporate…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Wenjie Li , Juncheng Li , Guangwei Gao , Jiantao Zhou , Jian Yang , Guo-Jun Qi

Transformers have demonstrated promising performance in computer vision tasks, including image super-resolution (SR). The quadratic computational complexity of window self-attention mechanisms in many transformer-based SR methods forces the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Fayaz Ali , Muhammad Zawish , Steven Davy , Radu Timofte

The pre-trained transformer demonstrates remarkable generalization ability in natural image processing. However, directly transferring it to magnetic resonance images faces two key challenges: the inability to adapt to the specificity of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jingkai Li , Xiaoze Tian , Yuhang Shen , Jia Wang , Dianjie Lu , Guijuan Zhang , Zhuoran Zheng

Recently, Mamba-based super-resolution (SR) methods have demonstrated the ability to capture global receptive fields with linear complexity, addressing the quadratic computational cost of Transformer-based SR approaches. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Sichen Guo , Wenjie Li , Yuanyang Liu , Guangwei Gao , Jian Yang , Chia-Wen Lin

Transformer architectures have exhibited remarkable performance in image super-resolution (SR). Since the quadratic computational complexity of the self-attention (SA) in Transformer, existing methods tend to adopt SA in a local region to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Zheng Chen , Yulun Zhang , Jinjin Gu , Linghe Kong , Xiaokang Yang

Seismic images obtained by stacking or migration are usually characterized as low signal-to-noise ratio (SNR), low dominant frequency and sparse sampling both in depth (or time) and offset dimensions. For improving the resolution of seismic…

Geophysics · Physics 2024-08-06 Shiqi Dong , Xintong Dong , Kaiyuan Zheng , Ming Cheng , Tie Zhong , Hongzhou Wang

Large language models (LLMs) have significantly advanced natural language processing, but their massive parameter counts create substantial computational and memory challenges during deployment. Post-training quantization (PTQ) has emerged…

Machine Learning · Computer Science 2025-11-25 Cuong Pham , Hoang Anh Dung , Cuong C. Nguyen , Trung Le , Gustavo Carneiro , Thanh-Toan Do

Recently, window-based attention methods have shown great potential for computer vision tasks, particularly in Single Image Super-Resolution (SISR). However, it may fall short in capturing long-range dependencies and relationships between…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Dinh Phu Tran , Dao Duy Hung , Daeyoung Kim

Recent transformer-based super-resolution (SR) methods have achieved promising results against conventional CNN-based methods. However, these approaches suffer from essential shortsightedness created by only utilizing the standard…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Jinsu Yoo , Taehoon Kim , Sihaeng Lee , Seung Hwan Kim , Honglak Lee , Tae Hyun Kim

Recently, Diffusion Transformers (DiTs) have emerged in Real-World Image Super-Resolution (Real-ISR) to generate high-quality textures, yet their heavy inference burden hinders real-world deployment. While Post-Training Quantization (PTQ)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Xun Zhang , Kaicheng Yang , Hongliang Lu , Haotong Qin , Yong Guo , Yulun Zhang

Model quantization reduces neural network parameter precision to achieve compression, but often compromises accuracy. Existing post-training quantization (PTQ) methods employ iterative parameter updates to preserve accuracy under high…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Zekang Zheng , Haokun Li , Yaofo Chen , Mingkui Tan , Qing Du

Low-bit quantization is widely used to compress super-resolution (SR) models and reduce storage and computation costs for deployment on resource-limited devices. However, when SR models are pushed to ultra-low precision (2-4 bits),…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Haotong Qin , Xudong Ma , Xianglong Liu , Jie Luo , Jinyang Guo , Michele Magno , Yulun Zhang

Network quantization significantly reduces model inference complexity and has been widely used in real-world deployments. However, most existing quantization methods have been developed mainly on Convolutional Neural Networks (CNNs), and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Yang Lin , Tianyu Zhang , Peiqin Sun , Zheng Li , Shuchang Zhou

As wireless communication systems advance toward Sixth Generation (6G) Radio Access Networks (RAN), Deep Learning (DL)-based neural receivers are emerging as transformative solutions for Physical Layer (PHY) processing, delivering superior…

Signal Processing · Electrical Eng. & Systems 2026-02-16 SaiKrishna Saketh Yellapragada , Esa Ollila , Mario Costa

This work aims to tackle the all-in-one image restoration task, which seeks to handle multiple types of degradation with a single model. The primary challenge is to extract degradation representations from the input degraded images and use…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Jie Chu , Tong Su , Pei Liu , Yunpeng Wu , Le Zhang , Zenglin Shi , Meng Wang

Graph-structured scene descriptions can be efficiently used in generative models to control the composition of the generated image. Previous approaches are based on the combination of graph convolutional networks and adversarial methods for…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Renato Sortino , Simone Palazzo , Concetto Spampinato