English
Related papers

Related papers: Large Kernel Distillation Network for Efficient Si…

200 papers

Dataset distillation (DD) is a newly emerging research area aiming at alleviating the heavy computational load in training models on large datasets. It tries to distill a large dataset into a small and condensed one so that models trained…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Yuxuan Duan , Jianfu Zhang , Liqing Zhang

Deep convolutional neural networks have significantly improved the peak signal-to-noise ratio of SuperResolution (SR). However, image viewer applications commonly allow users to zoom the images to arbitrary magnification scales, thus far…

Image and Video Processing · Electrical Eng. & Systems 2020-10-07 Jialiang Shen , Yucheng Wang , Jian Zhang

We propose an effective lightweight dynamic local and global self-attention network (DLGSANet) to solve image super-resolution. Our method explores the properties of Transformers while having low computational costs. Motivated by the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Xiang Li , Jinshan Pan , Jinhui Tang , Jiangxin Dong

Deep Neural Networks (DNNs) have achieved notable performance in the fields of computer vision and natural language processing with various applications in both academia and industry. However, with recent advancements in DNNs and…

Diffusion models (DMs) have demonstrated remarkable success in real-world image super-resolution (SR), yet their reliance on time-consuming multi-step sampling largely hinders their practical applications. While recent efforts have…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Jiaqi Xu , Wenbo Li , Haoze Sun , Fan Li , Zhixin Wang , Long Peng , Jingjing Ren , Haoran Yang , Xiaowei Hu , Renjing Pei , Pheng-Ann Heng

Spiking Neural Networks (SNNs) are biologically realistic and practically promising in low-power computation because of their event-driven mechanism. Usually, the training of SNNs suffers accuracy loss on various tasks, yielding an inferior…

Neural and Evolutionary Computing · Computer Science 2023-04-19 Di Hong , Jiangrong Shen , Yu Qi , Yueming Wang

Single image super-resolution(SISR) has witnessed great progress as convolutional neural network(CNN) gets deeper and wider. However, enormous parameters hinder its application to real world problems. In this letter, We propose a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Wenming Yang , Wei Wang , Xuechen Zhang , Shuifa Sun , Qingmin Liao

Knowledge distillation (KD), which can efficiently transfer knowledge from a cumbersome network (teacher) to a compact network (student), has demonstrated its advantages in some computer vision applications. The representation of knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Han Zhu , Zhenzhong Chen , Shan Liu

Large-scale models (LSMs) can be an effective framework for semantic representation and understanding, thereby providing a suitable tool for designing semantic communication (SC) systems. However, their direct deployment is often hindered…

Machine Learning · Computer Science 2025-08-26 Kuiyuan Ding , Caili Guo , Yang Yang , Zhongtian Du , Walid Saad

Existing video-based human pose estimation methods extensively apply large networks onto every frame in the video to localize body joints, which suffer high computational cost and hardly meet the low-latency requirement in realistic…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Xuecheng Nie , Yuncheng Li , Linjie Luo , Ning Zhang , Jiashi Feng

While burst Low-Resolution (LR) images are useful for improving their Super Resolution (SR) image compared to a single LR image, prior burst SR methods are trained in a deterministic manner, which produces a blurry SR image. Since such…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Kento Kawai , Takeru Oba , Kyotaro Tokoro , Kazutoshi Akita , Norimichi Ukita

Single-image super-resolution (SISR) networks trained with perceptual and adversarial losses provide high-contrast outputs compared to those of networks trained with distortion-oriented losses, such as L1 or L2. However, it has been shown…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Seung Ho Park , Young Su Moon , Nam Ik Cho

Two-step approaches combining pre-trained large language model embeddings and anomaly detectors demonstrate strong performance in text anomaly detection by leveraging rich semantic representations. However, high-dimensional dense embeddings…

Computation and Language · Computer Science 2026-01-08 Yang Cao , Sikun Yang , Yujiu Yang , Lianyong Qi , Ming Liu

Transformer-based methods have demonstrated impressive performance in low-level visual tasks such as Image Super-Resolution (SR). However, its computational complexity grows quadratically with the spatial resolution. A series of works…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xin Liu , Jie Liu , Jie Tang , Gangshan Wu

Huge amount of data is the key of the success of deep learning, however, redundant information impairs the generalization ability of the model and increases the burden of calculation. Dataset Distillation (DD) compresses the original…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Hangyang Kong , Wenbo Zhou , Xuxiang He , Xiaotong Tu , Xinghao Ding

Diffusion models show promise for image restoration, but existing methods often struggle with inconsistent fidelity and undesirable artifacts. To address this, we introduce Kernel Density Steering (KDS), a novel inference-time framework…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yuyang Hu , Kangfu Mei , Mojtaba Sahraee-Ardakan , Ulugbek S. Kamilov , Peyman Milanfar , Mauricio Delbracio

We aim at accelerating super-resolution (SR) networks on large images (2K-8K). The large images are usually decomposed into small sub-images in practical usages. Based on this processing, we found that different image regions have different…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Xiangtao Kong , Hengyuan Zhao , Yu Qiao , Chao Dong

Deep unfolding networks (DUNs) have achieved remarkable success and become the mainstream paradigm for spectral compressive imaging (SCI) reconstruction. Existing DUNs are derived from full-HSI imaging models, where each stage operates…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 He Huang , Yujun Guo , Wei He

Knowledge distillation (KD) is a promising yet challenging model compression technique that transfers rich learning representations from a well-performing but cumbersome teacher model to a compact student model. Previous methods for image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Simiao Li , Yun Zhang , Wei Li , Hanting Chen , Wenjia Wang , Bingyi Jing , Shaohui Lin , Jie Hu

With the advent of smart devices that support 4K and 8K resolution, Single Image Super Resolution (SISR) has become an important computer vision problem. However, most super resolution deep networks are computationally very expensive. In…

Image and Video Processing · Electrical Eng. & Systems 2022-03-21 Kartikeya Bhardwaj , Milos Milosavljevic , Liam O'Neil , Dibakar Gope , Ramon Matas , Alex Chalfin , Naveen Suda , Lingchuan Meng , Danny Loh