English
Related papers

Related papers: Agglomerating Large Vision Encoders via Distillati…

200 papers

Learned image compression sits at the intersection of machine learning and image processing. With advances in deep learning, neural network-based compression methods have emerged. In this process, an encoder maps the image to a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Fabien Allemand , Attilio Fiandrotti , Sumanta Chaudhuri , Alaa Eddine Mazouz

Most state-of-the-art techniques for medical image segmentation rely on deep-learning models. These models, however, are often trained on narrowly-defined tasks in a supervised fashion, which requires expensive labeled datasets. Recent…

Image and Video Processing · Electrical Eng. & Systems 2023-10-04 Heejong Kim , Victor Ion Butoi , Adrian V. Dalca , Daniel J. A. Margolis , Mert R. Sabuncu

With the exponential increase in image data, training an image restoration model is laborious. Dataset distillation is a potential solution to this problem, yet current distillation techniques are a blank canvas in the field of image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Zhuoran Zheng , Xin Su , Chen Wu , Xiuyi Jia

The powerful generalization of Vision-Language-Action (VLA) models is bottlenecked by their heavy reliance on massive, redundant, and unevenly valued datasets, hindering their widespread application. Existing model-centric optimization…

Robotics · Computer Science 2025-11-21 Kewei Chen , Yayu Long , Shuai Li , Mingsheng Shang

Medical image segmentation is a key task in the imaging workflow, influencing many image-based decisions. Traditional, fully-supervised segmentation models rely on large amounts of labeled training data, typically obtained through manual…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Tyler Ward , Abdullah-Al-Zubaer Imran

Traditional deep learning methods in medical imaging often focus solely on segmentation or classification, limiting their ability to leverage shared information. Multi-task learning (MTL) addresses this by combining both tasks through…

Image and Video Processing · Electrical Eng. & Systems 2024-12-03 Phuoc-Nguyen Bui , Duc-Tai Le , Junghyun Bum , Hyunseung Choo

Deep learning techniques have been demonstrated to surpass preceding cutting-edge machine learning techniques in recent years, with computer vision being one of the most prominent examples. However, deep learning models suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Gousia Habib , Tausifa jan Saleem , Sheikh Musa Kaleem , Tufail Rouf , Brejesh Lall

Large pretrained visual foundation models exhibit impressive general capabilities. However, the extensive prior knowledge inherent in these models can sometimes be a double-edged sword when adapting them to downstream tasks in specific…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Qinghe Ma , Jian Zhang , Zekun Li , Lei Qi , Qian Yu , Yinghuan Shi

We have witnessed remarkable progress in foundation models in vision tasks. Currently, several recent works have utilized the segmenting anything model (SAM) to boost the segmentation performance in medical images, where most of them focus…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Haoran Wang , Lian Huai , Wenbin Li , Lei Qi , Xingqun Jiang , Yinghuan Shi

In this work, we propose a method that leverages CLIP feature distillation, achieving efficient 3D segmentation through language guidance. Unlike previous methods that rely on multi-scale CLIP features and are limited by processing speed…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Xingyu Miao , Haoran Duan , Yang Bai , Tejal Shah , Jun Song , Yang Long , Rajiv Ranjan , Ling Shao

The Segment Anything Model (SAM) is a recently developed large model for general-purpose segmentation for computer vision tasks. SAM was trained using 11 million images with over 1 billion masks and can produce segmentation results for a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yizhe Zhang , Tao Zhou , Shuo Wang , Peixian Liang , Danny Z. Chen

Currently, one of the major challenges in deep learning-based video frame interpolation (VFI) is the large model sizes and high computational complexity associated with many high performance VFI approaches. In this paper, we present a…

Image and Video Processing · Electrical Eng. & Systems 2023-02-24 Crispian Morris , Duolikun Danier , Fan Zhang , Nantheera Anantrasirichai , David R. Bull

The success of large language models has inspired the computer vision community to explore image segmentation foundation model that is able to zero/few-shot generalize through prompt engineering. Segment-Anything(SAM), among others, is the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Haojie Zhang , Yongyi Su , Xun Xu , Kui Jia

Time Series foundation models (TSFMs) deliver strong forecasting performance through large-scale pretraining, but their large parameter sizes make deployment costly. While knowledge distillation offers a natural and effective approach for…

Machine Learning · Computer Science 2026-01-21 Yuqi Li , Kuiye Ding , Chuanguang Yang , Szu-Yu Chen , Yingli Tian

Modern wearable devices can conveniently record various biosignals in the many different environments of daily living, enabling a rich view of individual health. However, not all biosignals are the same: high-fidelity biosignals, such as…

Machine Learning · Computer Science 2025-02-03 Salar Abbaspourazad , Anshuman Mishra , Joseph Futoma , Andrew C. Miller , Ian Shapiro

Based on the Denoising Diffusion Probabilistic Model (DDPM), medical image segmentation can be described as a conditional image generation task, which allows to compute pixel-wise uncertainty maps of the segmentation and allows an implicit…

Image and Video Processing · Electrical Eng. & Systems 2022-11-01 Xutao Guo , Yanwu Yang , Chenfei Ye , Shang Lu , Yang Xiang , Ting Ma

Retinal blood vessel segmentation can extract clinically relevant information from fundus images. As manual tracing is cumbersome, algorithms based on Convolution Neural Networks have been developed. Such studies have used small publicly…

Image and Video Processing · Electrical Eng. & Systems 2024-06-24 Jeremiah Fadugba , Patrick Köhler , Lisa Koch , Petru Manescu , Philipp Berens

Few-shot semantic segmentation has attracted growing interest for its ability to generalize to novel object categories using only a few annotated samples. To address data scarcity, recent methods incorporate multiple foundation models to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Wei Zhuo , Zhiyue Tang , Wufeng Xue , Hao Ding , Junkai Ji , Linlin Shen

Although large-scale visual foundation models (VFMs) achieve remarkable performance in semantic understanding, they still underperform in instance-aware dense prediction tasks. They exhibit different biases in representation: for instance,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yachan Guo , JoseLuis Gomez Zurita , Danna Xue , Yi Xiao , AntonioManuel Lopez Pena

Medical image segmentation plays an important role in clinical decision making, treatment planning, and disease tracking. However, it still faces two major challenges. On the one hand, there is often a ``soft boundary'' between foreground…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Mengqi Lei , Haochen Wu , Xinhua Lv , Xin Wang