English
Related papers

Related papers: Privileged Prior Information Distillation for Imag…

200 papers

Text-to-image diffusion models have emerged as powerful priors for real-world image super-resolution (Real-ISR). However, existing methods may produce unintended results due to noisy text prompts and their lack of spatial information. In…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Li-Yuan Tsao , Hao-Wei Chen , Hao-Wei Chung , Deqing Sun , Chun-Yi Lee , Kelvin C. K. Chan , Ming-Hsuan Yang

Knowledge distillation leverages a teacher model to improve the training of a student model. A persistent challenge is that a better teacher does not always yield a better student, to which a common mitigation is to use additional…

Machine Learning · Computer Science 2024-10-10 Abhishek Panigrahi , Bingbin Liu , Sadhika Malladi , Andrej Risteski , Surbhi Goel

Intrinsic Image Decomposition (IID) is a challenging and interesting computer vision problem with various applications in several fields. We present novel semantic priors and an integrated approach for single image IID that involves…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Saurabh Saini , P. J. Narayanan

In the surveillance and defense domain, multi-target detection and classification (MTD) is considered essential yet challenging due to heterogeneous inputs from diverse data sources and the computational complexity of algorithms designed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ngoc Tuyen Do , Tri Nhu Do

High-performance Radar-Camera 3D object detection can be achieved by leveraging knowledge distillation without using LiDAR at inference time. However, existing distillation methods typically transfer modality-specific features directly to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Shashank Mishra , Karan Patil , Didier Stricker , Jason Rambach

Diffusion-based text-to-image generation models trained on extensive text-image pairs have demonstrated the ability to produce photorealistic images aligned with textual descriptions. However, a significant limitation of these models is…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Mingyuan Zhou , Zhendong Wang , Huangjie Zheng , Hai Huang

Local field potentials (LFPs) can be routinely recorded alongside spiking activity in intracortical neural experiments, measure a larger complementary spatiotemporal scale of brain activity for scientific inquiry, and can offer practical…

Machine Learning · Computer Science 2025-12-16 Eray Erturk , Saba Hashemi , Maryam M. Shanechi

Dataset distillation (DD) promises compact yet faithful synthetic data, but existing approaches often inherit the inductive bias of a single teacher model. As dataset size increases, this bias drives generation toward overly smooth,…

The amount of medical images for training deep classification models is typically very scarce, making these deep models prone to overfit the training data. Studies showed that knowledge distillation (KD), especially the mean-teacher…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Xiaohan Xing , Yuenan Hou , Hang Li , Yixuan Yuan , Hongsheng Li , Max Q. -H. Meng

Past works on multimodal machine translation (MMT) elevate bilingual setup by incorporating additional aligned vision information. However, an image-must requirement of the multimodal dataset largely hinders MMT's development -- namely that…

Computation and Language · Computer Science 2023-04-24 Ru Peng , Yawen Zeng , Junbo Zhao

Contrastive Language-Image Pre-training (CLIP) models excel in integrating semantic information between images and text through contrastive learning techniques. It has achieved remarkable performance in various multimodal tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Yifan Chen , Xiaozhen Qiao , Zhe Sun , Xuelong Li

Although instance segmentation methods have improved considerably, the dominant paradigm is to rely on fully-annotated training images, which are tedious to obtain. To alleviate this reliance, and boost results, semi-supervised approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Tariq Berrada , Camille Couprie , Karteek Alahari , Jakob Verbeek

When capturing images in low-light conditions, the images often suffer from low visibility, which not only degrades the visual aesthetics of images, but also significantly degenerates the performance of many computer vision algorithms. In…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Lijun Zhang , Xiao Liu , Erik Learned-Miller , Hui Guan

We introduce Transductive Infomation Maximization (TIM) for few-shot learning. Our method maximizes the mutual information between the query features and their label predictions for a given few-shot task, in conjunction with a supervision…

Machine Learning · Computer Science 2020-10-26 Malik Boudiaf , Ziko Imtiaz Masud , Jérôme Rony , José Dolz , Pablo Piantanida , Ismail Ben Ayed

Recently, large-scale pre-trained models have shown their advantages in many tasks. However, due to the huge computational complexity and storage requirements, it is challenging to apply the large-scale model to real scenes. A common…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Deng Li , Aming Wu , Yahong Han , Qi Tian

In knowledge distillation, previous feature distillation methods mainly focus on the design of loss functions and the selection of the distilled layers, while the effect of the feature projector between the student and the teacher remains…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Yudong Chen , Sen Wang , Jiajun Liu , Xuwei Xu , Frank de Hoog , Zi Huang

Deep image prior (DIP) proposed in recent research has revealed the inherent trait of convolutional neural networks (CNN) for capturing substantial low-level image statistics priors. This framework efficiently addresses the inverse problems…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Ziyu Shu , Zhixin Pan

In text-to-image personalization, a timely and crucial challenge is the tendency of generated images overfitting to the biases present in the reference images. We initiate our study with a comprehensive categorization of the biases into…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Jimyeong Kim , Jungwon Park , Wonjong Rhee

The increasing intensity and frequency of floods is one of the many consequences of our changing climate. In this work, we explore ML techniques that improve the flood detection module of an operational early flood warning system. Our…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Shubhika Garg , Ben Feinstein , Shahar Timnat , Vishal Batchu , Gideon Dror , Adi Gerzi Rosenthal , Varun Gulshan

Advanced reasoning typically requires Chain-of-Thought prompting, which is accurate but incurs prohibitive latency and substantial test-time inference costs. The standard alternative, fine-tuning smaller models, often sacrifices…

Computation and Language · Computer Science 2026-02-25 Sanket Badhe , Deep Shah