English
Related papers

Related papers: Edge-Efficient Image Restoration: Transformer Dist…

200 papers

Convolutional neural network (CNN) based image enhancement methods such as super-resolution and detail enhancement have achieved remarkable performances. However, amounts of operations including convolution and parameters within the…

Image and Video Processing · Electrical Eng. & Systems 2022-05-03 Sangwook Baek , Yongsup Park , Youngo Park , Jungmin Lee , Kwangpyo Choi

All-in-One image restoration aims to address multiple image degradation problems using a single model, offering a more practical and versatile solution compared to designing dedicated models for each degradation type. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Zhanwen Liu , Sai Zhou , Yuchao Dai , Yang Wang , Yisheng An , Xiangmo Zhao

Hyperspectral change detection plays an essential role of monitoring the dynamic urban development and detecting precise fine object evolution and alteration. In this paper, we have proposed an original Efficient Multi-temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Meiqi Hu , Chen Wu , Bo Du

Designing low-latency and high-efficiency hybrid networks for a variety of low-cost commodity edge devices is both costly and tedious, leading to the adoption of hardware-aware neural architecture search (NAS) for finding optimal…

Machine Learning · Computer Science 2024-08-29 Hung-Yueh Chiang , Diana Marculescu

Deep state-space models (SSMs), like recent Mamba architectures, are emerging as a promising alternative to CNN and Transformer networks. Existing Mamba-based restoration methods process visual data by leveraging a flatten-and-scan strategy…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Hanzhou Liu , Chengkai Liu , Jiacong Xu , Peng Jiang , Mi Lu

Long-sequence state-space models (SSMs) such as Hyena and Mamba replace the quadratic complexity of self-attention with more efficient FFT and scan operations. However, modern accelerators like GPUs are poorly suited to these non-GEMM…

Hardware Architecture · Computer Science 2025-08-12 Sho Ko , Kunle Olukotun

Recent efforts on image restoration have focused on developing "all-in-one" models that can handle different degradation types and levels within single model. However, most of mainstream Transformer-based ones confronted with dilemma…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Aiwen Jiang , Hourong Chen , Zhiwen Chen , Jihua Ye , Mingwen Wang

This paper proposes an end-to-end Efficient Re-parameterizationResidual Attention Network(ERRA-Net) to directly restore the nonhomogeneous hazy image. The contribution of this paper mainly has the following three aspects: 1) A novel…

Image and Video Processing · Electrical Eng. & Systems 2021-09-15 Tian Ye , ErKang Chen , XinRui Huang , Peng Chen

Optical and Synthetic Aperture Radar (SAR) image registration is crucial for multi-modal image fusion and applications. However, several challenges limit the performance of existing deep learning-based methods in cross-modal image…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Wei Wang , Dou Quan , Ning Huyan , Chonghua Lv , Shuang Wang , Yunan Li , Licheng Jiao

State-space models (SSMs) have recently shown promise in capturing long-range dependencies with subquadratic computational complexity, making them attractive for various applications. However, purely SSM-based models face critical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Abdelrahman Shaker , Syed Talal Wasim , Salman Khan , Juergen Gall , Fahad Shahbaz Khan

In recent years, Transformer-based language models have become the standard approach for natural language processing tasks. However, stringent throughput and latency requirements in industrial applications are limiting their adoption. To…

Machine Learning · Computer Science 2023-06-30 Haihao Shen , Hengyu Meng , Bo Dong , Zhe Wang , Ofir Zafrir , Yi Ding , Yu Luo , Hanwen Chang , Qun Gao , Ziheng Wang , Guy Boudoukh , Moshe Wasserblat

Hybrid models combining Transformers and State Space Models (SSMs) are promising for balancing performance and efficiency. However, optimizing these hybrid models, particularly by addressing the potential redundancy inherent within the…

Computation and Language · Computer Science 2025-05-29 Yuichiro Hoshino , Hideyuki Tachibana , Muneyoshi Inahara , Hiroto Takegawa

We introduce the first learning-based dense matching algorithm, termed Equirectangular Projection-Oriented Dense Kernelized Feature Matching (EDM), specifically designed for omnidirectional images. Equirectangular projection (ERP) images,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Dongki Jung , Jaehoon Choi , Yonghan Lee , Somi Jeong , Taejae Lee , Dinesh Manocha , Suyong Yeon

Effectively modeling global context information in hyperspectral image (HSI) denoising is crucial, but prevailing methods using convolution or transformers still face localized or computational efficiency limitations. Inspired by the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Yang Liu , Jiahua Xiao , Xiang Song , Yu Guo , Peilin Jiang , Haiwei Yang , Fei Wang

While deep neural networks (NN) significantly advance image compressed sensing (CS) by improving reconstruction quality, the necessity of training current CS NNs from scratch constrains their effectiveness and hampers rapid deployment.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Bin Chen , Zhenyu Zhang , Weiqi Li , Chen Zhao , Jiwen Yu , Shijie Zhao , Jie Chen , Jian Zhang

Unlike general image deblurring that prioritizes perceptual quality, QR code deblurring focuses on ensuring successful decoding. QR codes are characterized by highly structured patterns with sharp edges, a robust prior for restoration. Yet…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jianping Li , Dongyang Guo , Wenjie Li , Wei Zhao

Reconfigurable electromagnetic structures (REMSs), such as reconfigurable reflectarrays (RRAs) or reconfigurable intelligent surfaces (RISs), hold significant potential to improve the spectral efficiency of wireless communication systems…

Signal Processing · Electrical Eng. & Systems 2025-12-16 Alexander Stutz-Tirri , Georg Schwan , Christoph Studer

Transformer architectures deliver state-of-the-art accuracy via dense full-attention, but their quadratic time and memory complexity with respect to sequence length limits practical deployment. Linear attention mechanisms offer linear or…

Machine Learning · Computer Science 2026-01-21 Xiaojie Xia , Huigang Zhang , Chaoliang Zhong , Jun Sun , Yusuke Oishi

Image restoration aims to recover details and enhance contrast in degraded images. With the growing demand for high-quality imaging (\textit{e.g.}, 4K and 8K), achieving a balance between restoration quality and computational efficiency has…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Long Peng , Xin Di , Zhanfeng Feng , Wenbo Li , Renjing Pei , Yang Wang , Xueyang Fu , Yang Cao , Zheng-Jun Zha

Transformers have revolutionized image modeling tasks with adaptations like DeIT, Swin, SVT, Biformer, STVit, and FDVIT. However, these models often face challenges with inductive bias and high quadratic complexity, making them less…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Badri N. Patro , Suhas Ranganath , Vinay P. Namboodiri , Vijay S. Agneeswaran