English
Related papers

Related papers: Learning to Distill Global Representation for Spar…

200 papers

Convolutional Neural Networks (CNNs) are prone to overfit small training datasets. We present a novel two-phase pipeline that leverages self-supervised learning and knowledge distillation to improve the generalization ability of CNN models…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Bingchen Zhao , Xin Wen

As deep learning models grow in complexity and the volume of training data increases, reducing storage and computational costs becomes increasingly important. Dataset distillation addresses this challenge by synthesizing a compact set of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zhe Li , Sarah Cechnicka , Cheng Ouyang , Katharina Breininger , Peter Schüffler , Bernhard Kainz

Computed tomography (CT) is one of the most widely used non-invasive imaging modalities for medical diagnosis. In clinical practice, CT images are usually acquired with large slice thicknesses due to the high cost of memory storage and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Kwang-Hyun Uhm , Hyunjun Cho , Sung-Hoo Hong , Seung-Won Jung

Objective: There exist several X-ray computed tomography (CT) scanning strategies to reduce a radiation dose, such as (1) sparse-view CT, (2) low-dose CT, and (3) region-of-interest (ROI) CT (called interior tomography). To further reduce…

Image and Video Processing · Electrical Eng. & Systems 2025-01-10 Yoseob Han , Dufan Wu , Kyungsang Kim , Quanzheng Li

As a result of several successful applications in computer vision and image processing, sparse representation (SR) has attracted significant attention in multi-sensor image fusion. Unlike the traditional multiscale transforms (MSTs) that…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Qiang Zhang , Yi Liu , Rick S. Blum , Jungong Han , Dacheng Tao

For more clinical applications of deep learning models for medical image segmentation, high demands on labeled data and computational resources must be addressed. This study proposes a coarse-to-fine framework with two teacher models and a…

Image and Video Processing · Electrical Eng. & Systems 2022-11-14 Jae Won Choi

Recent advances in generative models have highlighted the need for robust detectors capable of distinguishing real images from AI-generated images. While existing methods perform well on known generators, their performance often declines…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Kuo Shi , Jie Lu , Shanshan Ye , Guangquan Zhang , Zhen Fang

Deep learning has become the state-of-the-art approach to medical tomographic imaging. A common approach is to feed the result of a simple inversion, for example the backprojection, to a multiscale convolutional neural network (CNN) which…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 AmirEhsan Khorashadizadeh , Valentin Debarnot , Tianlin Liu , Ivan Dokmanić

This work presents GS-DOT, a novel image reconstruction framework based on Gaussian Splatting (GS) for diffuse optical tomography (DOT). Inspired by GS for rendering applications, absorption coefficients are represented as a sparse sum of…

Image and Video Processing · Electrical Eng. & Systems 2026-04-28 Jingjing Jiang

Training deep neural networks has become increasingly demanding, requiring large datasets and significant computational resources, especially as model complexity advances. Data distillation methods, which aim to improve data efficiency,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Sunwoo Cho , Yejin Jung , Nam Ik Cho , Jae Woong Soh

Surface reconstruction from sparse views aims to reconstruct a 3D shape or scene from few RGB images. The latest methods are either generalization-based or overfitting-based. However, the generalization-based methods do not generalize well…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Liang Han , Xu Zhang , Haichuan Song , Kanle Shi , Yu-Shen Liu , Zhizhong Han

In the intention of minimizing excessive X-ray radiation administration to patients, low-dose computed tomography (LDCT) has become a distinct trend in radiology. However, while lowering the radiation dose reduces the risk to the patient,…

Medical Physics · Physics 2022-04-12 Long Zhou , Xiaozhuang Wang , Min Hou , Ping Li , Chunlong Fu , Yanjun Ren , Tingting Shao , Xi Hu , Jihong Sun , Hongwei Ye

Low-field to high-field MRI synthesis has emerged as a cost-effective strategy to enhance image quality under hardware and acquisition constraints, particularly in scenarios where access to high-field scanners is limited or impractical.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Zhenxuan Zhang , Peiyuan Jing , Ruicheng Yuan , Liwei Hu , Anbang Wang , Fanwen Wang , Yinzhe Wu , Kh Tohidul Islam , Zhaolin Chen , Zi Wang , Peter Lally , Guang Yang

Knowledge distillation enables fast and effective transfer of features learned from a bigger model to a smaller one. However, distillation objectives are susceptible to sub-population shifts, a common scenario in medical imaging analysis…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Konstantinos Vilouras , Xiao Liu , Pedro Sanchez , Alison Q. O'Neil , Sotirios A. Tsaftaris

Generative adversarial networks has emerged as a defacto standard for image translation problems. To successfully drive such models, one has to rely on additional networks e.g., discriminators and/or perceptual networks. Training these…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 M. Saquib Sarfraz , Constantin Seibold , Haroon Khalid , Rainer Stiefelhagen

We present Distill CLIP (DCLIP), a fine-tuned variant of the CLIP model that enhances multimodal image-text retrieval while preserving the original model's strong zero-shot classification capabilities. CLIP models are typically constrained…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Daniel Csizmadia , Andrei Codreanu , Victor Sim , Vighnesh Prabhu , Michael Lu , Kevin Zhu , Sean O'Brien , Vasu Sharma

In radiation therapy (RT), the reliance on pre-treatment computed tomography (CT) images encounter challenges due to anatomical changes, necessitating adaptive planning. Daily cone-beam CT (CBCT) imaging, pivotal for therapy adjustment,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Joonil Hwang , Sangjoon Park , NaHyeon Park , Seungryong Cho , Jin Sung Kim

Diffusion models have been demonstrated as powerful deep learning tools for image generation in CT reconstruction and restoration. Recently, diffusion posterior sampling, where a score-based diffusion prior is combined with a likelihood…

Medical Physics · Physics 2024-09-02 Shudong Li , Xiao Jiang , Matthew Tivnan , Grace J. Gang , Yuan Shen , J. Webster Stayman

Traditional one-shot medical image segmentation (MIS) methods use registration networks to propagate labels from a reference atlas or rely on comprehensive sampling strategies to generate synthetic labeled data for training. However, these…

Image and Video Processing · Electrical Eng. & Systems 2025-01-07 Feng Zhou , Yanjie Zhou , Longjie Wang , Yun Peng , David E. Carlson , Liyun Tu

Denoising low-dose computed tomography (CT) images is a critical task in medical image computing. Supervised deep learning-based approaches have made significant advancements in this area in recent years. However, these methods typically…

Image and Video Processing · Electrical Eng. & Systems 2023-07-17 Xuan Liu , Yaoqin Xie , Jun Cheng , Songhui Diao , Shan Tan , Xiaokun Liang