English
Related papers

Related papers: DDistill-SR: Reparameterized Dynamic Distillation …

200 papers

Indoor scene semantic parsing from RGB images is very challenging due to occlusions, object distortion, and viewpoint variations. Going beyond prior works that leverage geometry information, typically paired depth maps, we present a new…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Zhengzhe Liu , Xiaojuan Qi , Chi-Wing Fu

Distillation addresses the slow sampling problem in diffusion models by creating models with smaller size or fewer steps that approximate the behavior of high-step teachers. In this work, we propose a reinforcement learning based…

Machine Learning · Computer Science 2025-12-30 Amirhossein Tighkhorshid , Zahra Dehghanian , Gholamali Aminian , Chengchun Shi , Hamid R. Rabiee

Convolutional neural networks based single-image super-resolution (SISR) has made great progress in recent years. However, it is difficult to apply these methods to real-world scenarios due to the computational and memory cost. Meanwhile,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Guangwei Gao , Wenjie Li , Juncheng Li , Fei Wu , Huimin Lu , Yi Yu

The growing prevalence of high-resolution displays on edge devices has created a pressing need for efficient high dynamic range (HDR) imaging algorithms. However, most existing HDR methods either struggle to deliver satisfactory visual…

Image and Video Processing · Electrical Eng. & Systems 2026-02-11 Qirui Yang , Yihao Liu , Qihua Cheng , Huanjing Yue , Kun Li , Jingyu Yang

A low-resolution digital surface model (DSM) features distinctive attributes impacted by noise, sensor limitations and data acquisition conditions, which failed to be replicated using simple interpolation methods like bicubic. This causes…

Image and Video Processing · Electrical Eng. & Systems 2024-04-08 Daniel Panangian , Ksenia Bittner

Deep learning-based hyperspectral image super-resolution (SR) methods have achieved great success recently. However, most existing models can not effectively explore spatial information and spectral information between bands simultaneously,…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Qi Wang , Qiang Li , Xuelong Li

Knowledge distillation is an effective and hardware-friendly method, which plays a key role in lightweighting remote sensing object detection. However, existing distillation methods often encounter the issue of mixed features in remote…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Xiangyi Gao , Danpei Zhao , Bo Yuan , Wentao Li

Dataset distillation has become a popular method for compressing large datasets into smaller, more efficient representations while preserving critical information for model training. Data features are broadly categorized into two types:…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Minh-Tuan Tran , Trung Le , Xuan-May Le , Thanh-Toan Do , Dinh Phung

Despite the recent success of deep neural networks, there remains a need for effective methods to enhance domain generalization using vision transformers. In this paper, we propose a novel domain generalization technique called Robust…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Ankur Singh , Senthilnath Jayavelu

With the exponential increase in image data, training an image restoration model is laborious. Dataset distillation is a potential solution to this problem, yet current distillation techniques are a blank canvas in the field of image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Zhuoran Zheng , Xin Su , Chen Wu , Xiuyi Jia

We study generative super-resolution (SR) in real-world scenarios where content and degradations vary across domains, genres, and segments. For example, images and videos may alternate between text overlays, fast motion, smooth cartoons,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Jiaqi Guo , Mingzhen Li , Haohong Wang , Aggelos K. Katsaggelos

The challenge in fine-grained visual categorization lies in how to explore the subtle differences between different subclasses and achieve accurate discrimination. Previous research has relied on large-scale annotated data and pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Tianxu Wu , Shuo Ye , Shuhuang Chen , Qinmu Peng , Xinge You

Color-guided depth map super-resolution (CDSR) improve the spatial resolution of a low-quality depth map with the corresponding high-quality color map, benefiting various applications such as 3D reconstruction, virtual reality, and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Yuan Shi , Bin Xia , Rui Zhu , Qingmin Liao , Wenming Yang

Distribution Matching Distillation (DMD) facilitates efficient inference by distilling multi-step diffusion models into few-step variants. Concurrently, Reinforcement Learning (RL) has emerged as a vital tool for aligning generative models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Dengyang Jiang , Dongyang Liu , Zanyi Wang , Qilong Wu , Liuzhuozheng Li , Hengzhuang Li , Xin Jin , David Liu , Changsheng Lu , Zhen Li , Bo Zhang , Mengmeng Wang , Steven Hoi , Peng Gao , Harry Yang

Diffusion distillation is central to accelerating image and video generation, yet existing methods are fundamentally limited by the denoising process, where step reduction has largely saturated. Partial timestep low-resolution generation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Feiyang Chen , Hongpeng Pan , Haonan Xu , Xinyu Duan , Yang Yang , Zhefeng Wang

Deep convolutional neural networks (CNNs) have obtained remarkable performance in single image super-resolution (SISR). However, very deep networks can suffer from training difficulty and hardly achieve further performance gain. There are…

Image and Video Processing · Electrical Eng. & Systems 2022-11-18 Alexander Panaetov , Karim Elhadji Daou , Igor Samenko , Evgeny Tetin , Ilya Ivanov

The emerging task of fine-grained image classification in low-data regimes assumes the presence of low inter-class variance and large intra-class variation along with a highly limited amount of training samples per class. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Dmitry Demidov , Abduragim Shtanchaev , Mihail Mihaylov , Mohammad Almansoori

We investigate the design aspects of feature distillation methods achieving network compression and propose a novel feature distillation method in which the distillation loss is designed to make a synergy among various aspects: teacher…

Computer Vision and Pattern Recognition · Computer Science 2019-08-12 Byeongho Heo , Jeesoo Kim , Sangdoo Yun , Hyojin Park , Nojun Kwak , Jin Young Choi

Diffusion-based models have been widely used in various visual generation tasks, showing promising results in image super-resolution (SR), while typically being limited by dozens or even hundreds of sampling steps. Although existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Xue Wu , Jingwei Xin , Zhijun Tu , Jie Hu , Jie Li , Nannan Wang , Xinbo Gao

The generative priors of pre-trained latent diffusion models (DMs) have demonstrated great potential to enhance the visual quality of image super-resolution (SR) results. However, the noise sampling process in DMs introduces randomness in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-26 Lingchen Sun , Rongyuan Wu , Jie Liang , Zhengqiang Zhang , Hongwei Yong , Lei Zhang