English
Related papers

Related papers: Distilling Knowledge from Object Classification to…

200 papers

AI algorithms have become valuable in aiding professionals in healthcare. The increasing confidence obtained by these models is helpful in critical decision demands. In clinical dermatology, classification models can detect malignant…

Learning visual representations with interpretable features, i.e., disentangled representations, remains a challenging problem. Existing methods demonstrate some success but are hard to apply to large-scale vision datasets like ImageNet. In…

Machine Learning · Computer Science 2023-06-01 Lilian Ngweta , Subha Maity , Alex Gittens , Yuekai Sun , Mikhail Yurochkin

Image aesthetic quality assessment has been a relatively hot topic during the last decade. Most recently, comments type assessment (aesthetic captions) has been proposed to describe the general aesthetic impression of an image using text.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Xin Jin , Le Wu , Geng Zhao , Xiaodong Li , Xiaokun Zhang , Shiming Ge , Dongqing Zou , Bin Zhou , Xinghui Zhou

We revisit the one- and two-stage detector distillation tasks and present a simple and efficient semantic-aware framework to fill the gap between them. We address the pixel-level imbalance problem by designing the category anchor to produce…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Yixin Chen , Zhuotao Tian , Pengguang Chen , Shu Liu , Jiaya Jia

The development of computer vision solutions for gigapixel images in digital pathology is hampered by significant computational limitations due to the large size of whole slide images. In particular, digitizing biopsies at high resolutions…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Rocío del Amor , Julio Silva-Rodríguez , Adrián Colomer , Valery Naranjo

Knowledge distillation allows transferring knowledge from a pre-trained model to another. However, it suffers from limitations, and constraints related to the two models need to be architecturally similar. Knowledge distillation addresses…

Image and Video Processing · Electrical Eng. & Systems 2020-09-03 Sajjad Abbasi , Mohsen Hajabdollahi , Pejman Khadivi , Nader Karimi , Roshanak Roshandel , Shahram Shirani , Shadrokh Samavi

Computational visual aesthetics has recently become an active research area. Existing state-of-art methods formulate this as a binary classification task where a given image is predicted to be beautiful or not. In many applications such as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-06 Parag S. Chandakkar , Vijetha Gattupalli , Baoxin Li

Research on image quality assessment (IQA) remains limited mainly due to our incomplete knowledge about human visual perception. Existing IQA algorithms have been designed or trained with insufficient subjective data with a small degree of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Lucie Lévêque , Ji Yang , Xiaohan Yang , Pengfei Guo , Kenneth Dasalla , Leida Li , Yingying Wu , Hantao Liu

Image quality assessment (IQA) is very important for both end-users and service providers since a high-quality image can significantly improve the user's quality of experience (QoE) and also benefit lots of computer vision algorithms. Most…

Multimedia · Computer Science 2023-04-28 Wei Sun , Xiongkuo Min , Danyang Tu , Guangtao Zhai , Siwei Ma

The interest in Artificial Intelligence (AI) and its applications has seen unprecedented growth in the last few years. The success can be partly attributed to the advancements of deep neural networks made in the sub-fields of AI such as…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Xuewen Yang

Knowledge distillation involves transferring the predictive capabilities of large, high-performing AI models (teachers) to smaller models (students) that can operate in environments with limited computing power. In this paper, we address…

Machine Learning · Computer Science 2026-01-12 Pattarawat Chormai , Ali Hashemi , Klaus-Robert Müller , Grégoire Montavon

Textual reasoning has recently been widely adopted in Blind Image Quality Assessment (BIQA). However, it remains unclear how textual information contributes to quality prediction and to what extent text can represent the score-related image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yuan Li , Shin'ya Nishida

Image classification models tend to make decisions based on peripheral attributes of data items that have strong correlation with a target variable (i.e., dataset bias). These biased models suffer from the poor generalization capability…

Machine Learning · Computer Science 2021-10-26 Jungsoo Lee , Eungyeup Kim , Juyoung Lee , Jihyeon Lee , Jaegul Choo

Image Aesthetics Assessment is one of the emerging domains in research. The domain deals with classification of images into categories depending on the basis of how pleasant they are for the users to watch. In this article, the focus is on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Nishi Doshi , Gitam Shikhenawis , Suman K Mitra

Aesthetic assessment is subjective, and the distribution of the aesthetic levels is imbalanced. In order to realize the auto-assessment of photo aesthetics, we focus on retraining the CNN-based aesthetic assessment model by dropping out the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-17 Ying Dai

When we experience a visual stimulus as beautiful, how much of that experience derives from perceptual computations we cannot describe versus conceptual knowledge we can readily translate into natural language? Disentangling perception from…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Colin Conwell , Christopher Hamblin , Chelsea Boccagno , David Mayo , Jesse Cummings , Leyla Isik , Andrei Barbu

A thorough comprehension of image content demands a complex grasp of the interactions that may occur in the natural world. One of the key issues is to describe the visual relationships between objects. When dealing with real world data,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 François Plesse , Alexandru Ginsca , Bertrand Delezoide , Françoise Prêteux

Knowledge distillation is a widely used paradigm for inheriting information from a complicated teacher network to a compact student network and maintaining the strong performance. Different from image classification, object detectors are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Jianyuan Guo , Kai Han , Yunhe Wang , Han Wu , Xinghao Chen , Chunjing Xu , Chang Xu

Knowledge distillation, the technique of transferring knowledge from large, complex models to smaller ones, marks a pivotal step towards efficient AI deployment. Distilling Step-by-Step~(DSS), a novel method utilizing chain-of-thought~(CoT)…

Computation and Language · Computer Science 2024-06-11 Xin Chen , Hanxian Huang , Yanjun Gao , Yi Wang , Jishen Zhao , Ke Ding

Scale-invariance is an open problem in many computer vision subfields. For example, object labels should remain constant across scales, yet model predictions diverge in many cases. This problem gets harder for tasks where the ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Oliver Wiedemann , Vlad Hosu , Shaolin Su , Dietmar Saupe