English
Related papers

Related papers: Distillation-Supervised Convolutional Low-Rank Ada…

200 papers

The persistent challenge of medical image synthesis posed by the scarcity of annotated data and the need to synthesize `missing modalities' for multi-modal analysis, underscored the imperative development of effective synthesis methods.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Yuchen Mao , Hongwei Li , Wei Pang , Giorgos Papanastasiou , Guang Yang , Chengjia Wang

With the rapid development of deep learning (DL) in recent years, automatic modulation recognition (AMR) with DL has achieved high accuracy. However, insufficient training signal data in complicated channel environments and large-scale DL…

Machine Learning · Computer Science 2024-01-01 Dongbin Hou , Lixin Li , Wensheng Lin , Junli Liang , Zhu Han

Diffusion models have revolutionized text-to-image (T2I) synthesis, producing high-quality, photorealistic images. However, they still struggle to properly render the spatial relationships described in text prompts. To address the lack of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Andrea Rigo , Luca Stornaiuolo , Mauro Martino , Bruno Lepri , Nicu Sebe

Feature regression is a simple way to distill large neural network models to smaller ones. We show that with simple changes to the network architecture, regression can outperform more complex state-of-the-art approaches for knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 K L Navaneet , Soroush Abbasi Koohpayegani , Ajinkya Tejankar , Hamed Pirsiavash

Low-Rank Adaptation (LoRA) has gained popularity for fine-tuning large foundation models, leveraging low-rank matrices $\mathbf{A}$ and $\mathbf{B}$ to represent weight changes (i.e., $\Delta \mathbf{W} = \mathbf{B} \mathbf{A}$). This…

Machine Learning · Computer Science 2025-07-02 Aochuan Chen , Jiashun Cheng , Zijing Liu , Ziqi Gao , Fugee Tsung , Yu Li , Jia Li

Deep learning based methods have recently pushed the state-of-the-art on the problem of Single Image Super-Resolution (SISR). In this work, we revisit the more traditional interpolation-based methods, that were popular before, now with the…

Computer Vision and Pattern Recognition · Computer Science 2017-12-19 Xu Jia , Hong Chang , Tinne Tuytelaars

As a successful deep model applied in image super-resolution (SR), the Super-Resolution Convolutional Neural Network (SRCNN) has demonstrated superior performance to the previous hand-crafted models either in speed and restoration quality.…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Chao Dong , Chen Change Loy , Xiaoou Tang

Efficient fine-tuning of pre-trained convolutional neural network (CNN) models using local data is essential for providing high-quality services to users using ubiquitous and resource-limited Internet of Things (IoT) devices. Low-Rank…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 Chuntao Ding , Xu Cao , Jianhang Xie , Linlin Fan , Shangguang Wang , Zhichao Lu

We propose a deep learning method for single image super-resolution (SR). Our method directly learns an end-to-end mapping between the low/high-resolution images. The mapping is represented as a deep convolutional neural network (CNN) that…

Computer Vision and Pattern Recognition · Computer Science 2015-08-03 Chao Dong , Chen Change Loy , Kaiming He , Xiaoou Tang

Convolutional Neural Networks (CNNs) have achieved impressive results across many super-resolution (SR) and image restoration tasks. While many such networks can upscale low-resolution (LR) images using just the raw pixel-level information,…

Image and Video Processing · Electrical Eng. & Systems 2021-10-29 Matthew Aquilina , Christian Galea , John Abela , Kenneth P. Camilleri , Reuben A. Farrugia

Successful fine-grained image classification methods learn subtle details between visually similar (sub-)classes, but the problem becomes significantly more challenging if the details are missing due to low resolution. Encouraged by the…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 Dingding Cai , Ke Chen , Yanlin Qian , Joni-Kristian Kämäräinen

Deep convolutional neural networks achieve excellent image up-sampling performance. However, CNN-based methods tend to restore high-resolution results highly depending on traditional interpolations (e.g. bicubic). In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Bolun Cai , Xiangmin Xu , Kailing Guo , Kui Jia , Dacheng Tao

Single Image Super-Resolution (SISR) is one of the low-level computer vision problems that has received increased attention in the last few years. Current approaches are primarily based on harnessing the power of deep learning models and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Santiago López-Tapia , Nicolás Pérez de la Blanca

Deep convolutional neural networks (DCNNs) are a class of artificial neural networks, primarily for computer vision tasks such as segmentation and classification. Many nonlinear operations, such as activation functions and pooling…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Zuocheng Wen , Lingzhong Guo

Many convolutional neural networks (CNNs) rely on progressive downsampling of their feature maps to increase the network's receptive field and decrease computational cost. However, this comes at the price of losing granularity in the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Robin Hesse , Simone Schaub-Meyer , Stefan Roth

The deep complex convolution recurrent network (DCCRN) achieves excellent speech enhancement performance by utilizing the audio spectrum's complex features. However, it has a large number of model parameters. We propose a smaller model,…

Sound · Computer Science 2024-08-09 Runduo Han , Weiming Xu , Zihan Zhang , Mingshuai Liu , Lei Xie

Existing domain adaptation (DA) methods often involve pre-training on the source domain and fine-tuning on the target domain. For multi-target domain adaptation, having a dedicated/separate fine-tuned network for each target domain, that…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Sidra Aleem , Julia Dietlmeier , Eric Arazo , Suzanne Little

Low-Rank Adaptation (LoRA) lowers the computational and memory overhead of fine-tuning large models by updating a low-dimensional subspace of the pre-trained weight matrix. Albeit efficient, LoRA exhibits suboptimal convergence and…

Machine Learning · Computer Science 2026-02-25 Yilang Zhang , Bingcong Li , Georgios B. Giannakis

Deep learning has achieved significant success in single hyperspectral image super-resolution (SHSR); however, the high spectral dimensionality leads to a heavy computational burden, thus making it difficult to deploy in real-time…

Image and Video Processing · Electrical Eng. & Systems 2025-10-01 Haohan Shi , Fei Zhou , Xin Sun , Jungong Han

Image deblurring aims to recover the latent sharp image from its blurry counterpart and has a wide range of applications in computer vision. The Convolution Neural Networks (CNNs) have performed well in this domain for many years, and until…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Lingyan Ruan , Mojtaba Bemana , Hans-peter Seidel , Karol Myszkowski , Bin Chen