English
Related papers

Related papers: Detail Consistent Stage-Wise Distillation for Effi…

200 papers

Deploying medical image segmentation models in routine clinical workflows is often constrained by on-premises infrastructure, where computational resources are fixed and cloud-based inference may be restricted by governance and security…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Qizhen Lan , Aaron Choi , Jun Ma , Bo Wang , Zhaogming Zhao , Xiaoqian Jiang , Yu-Chun Hsu

Although the vision-and-language pretraining (VLP) equipped cross-modal image-text retrieval (ITR) has achieved remarkable progress in the past two years, it suffers from a major drawback: the ever-increasing size of VLP models restricts…

Multimedia · Computer Science 2022-07-05 Jun Rao , Liang Ding , Shuhan Qi , Meng Fang , Yang Liu , Li Shen , Dacheng Tao

The balance between high accuracy and high speed has always been a challenging task in semantic image segmentation. Compact segmentation networks are more widely used in the case of limited resources, while their performances are…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Yingchao Feng , Xian Sun , Wenhui Diao , Jihao Li , Xin Gao

Accurate 3D medical image segmentation is vital for diagnosis and treatment planning, but state-of-the-art models are often too large for clinics with limited computing resources. Lightweight architectures typically suffer significant…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Qizhen Lan , Yu-Chun Hsu , Nida Saddaf Khan , Xiaoqian Jiang

Four-dimensional scanning transmission electron microscopy (4D-STEM) enables mapping of diffraction information with nanometer-scale spatial resolution, offering detailed insight into local structure, orientation, and strain. However, as…

Dataset distillation (DD) aims to generate a compact yet informative dataset that achieves performance comparable to the original dataset, thereby reducing demands on storage and computational resources. Although diffusion models have made…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Yawen Zou , Guang Li , Zi Wang , Chunzhi Gu , Chao Zhang

Dataset distillation provides an effective approach to reduce memory and computational costs by optimizing a compact dataset that achieves performance comparable to the full original. However, for large-scale datasets and complex deep…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Xinhao Zhong , Shuoyang Sun , Xulin Gu , Zhaoyang Xu , Yaowei Wang , Min Zhang , Bin Chen

Despite the success of Deep Learning (DL), the deployment of modern DL models requiring large computational power poses a significant problem for resource-constrained systems. This necessitates building compact networks that reduce…

Machine Learning · Computer Science 2020-06-24 Akshay Kulkarni , Navid Panchi , Sharath Chandra Raparthy , Shital Chiddarwar

Current 3D Gaussian Splatting stylization approaches are limited in their ability to represent diverse artistic styles, frequently defaulting to low-level texture replacement or yielding semantically inconsistent outputs. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Cailin Zhuang , Yaoqi Hu , Xuanyang Zhang , Wei Cheng , Jiacheng Bao , Shengqi Liu , Yiying Yang , Xianfang Zeng , Gang Yu , Ming Li

Recent approaches have shown promises distilling diffusion models into efficient one-step generators. Among them, Distribution Matching Distillation (DMD) produces one-step generators that match their teacher in distribution, without…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Tianwei Yin , Michaël Gharbi , Taesung Park , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman

Diffusion distillation is central to accelerating image and video generation, yet existing methods are fundamentally limited by the denoising process, where step reduction has largely saturated. Partial timestep low-resolution generation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Feiyang Chen , Hongpeng Pan , Haonan Xu , Xinyu Duan , Yang Yang , Zhefeng Wang

Coherent diffractive imaging (CDI) provides new opportunities for high resolution X-ray imaging with simultaneous amplitude and phase contrast. Extensions to CDI broaden the scope of the technique for use in a wide variety of experimental…

Optics · Physics 2016-01-20 Matthew H. Seaberg , Alexandre d'Aspremont , Joshua J. Turner

3D image segmentation is a recent and crucial step in many medical analysis and recognition schemes. In fact, it represents a relevant research subject and a fundamental challenge due to its importance and influence. This paper provides a…

Image and Video Processing · Electrical Eng. & Systems 2022-07-22 Omar Boudraa

Purpose: In curriculum learning, the idea is to train on easier samples first and gradually increase the difficulty, while in self-paced learning, a pacing function defines the speed to adapt the training progress. While both methods…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Mobarakol Islam , Lalithkumar Seenivasan , S. P. Sharan , V. K. Viekash , Bhavesh Gupta , Ben Glocker , Hongliang Ren

3D semantic scene understanding is essential for digital twins, autonomous driving, smart agriculture, and embodied perception, yet dense point-wise annotation for point clouds remains expensive and difficult to scale. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Yijing Wang , Ruonan Li , Qilin Wang , Rongqiang Zhao , Jie Liu

Text-to-3D generation aims to create 3D assets from text-to-image diffusion models. However, existing methods face an inherent bottleneck in generation quality because the widely-used objectives such as Score Distillation Sampling (SDS)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Zixuan Chen , Ruijie Su , Jiahao Zhu , Lingxiao Yang , Jian-Huang Lai , Xiaohua Xie

Image diffusion distillation achieves high-fidelity generation with very few sampling steps. However, applying these techniques directly to video diffusion often results in unsatisfactory frame quality due to the limited visual quality in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yuanhao Zhai , Kevin Lin , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Chung-Ching Lin , David Doermann , Junsong Yuan , Lijuan Wang

Distribution Matching Distillation (DMD) is a widely used paradigm for accelerating inference in few-step video diffusion models. However, DMD-style video distillation faces two coupled challenges: the fake score must track a continuously…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Zhuguanyu Wu , Ruihao Gong , Yang Yong , Yushi Huang , Xiangyu Fan , Lei Yang , Dahua Lin , Xianglong Liu

With the exponential increase in image data, training an image restoration model is laborious. Dataset distillation is a potential solution to this problem, yet current distillation techniques are a blank canvas in the field of image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Zhuoran Zheng , Xin Su , Chen Wu , Xiuyi Jia

The inference latency of diffusion models remains a critical barrier to their real-time application. While trajectory-based and distribution-based step distillation methods offer solutions, they present a fundamental trade-off.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Hanbo Cheng , Peng Wang , Kaixiang Lei , Qi Li , Zhen Zou , Pengfei Hu , Jun Du