English
Related papers

Related papers: Relational Subsets Knowledge Distillation for Long…

200 papers

Artificial intelligence algorithms have demonstrated their image classification and segmentation ability in the past decade. However, artificial intelligence algorithms perform less for actual clinical data than those used for simulations.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Mostafa Hajighasemlou , Samad Sheikhaei , Hamid Soltanian-Zadeh

Preventable or undiagnosed visual impairment and blindness affect billion of people worldwide. Automated multi-disease detection models offer great potential to address this problem via clinical decision support in diagnosis. In this work,…

Image and Video Processing · Electrical Eng. & Systems 2021-03-30 Dominik Müller , Iñaki Soto-Rey , Frank Kramer

Knowledge distillation involves transferring knowledge from large, cumbersome teacher models to more compact student models. The standard approach minimizes the Kullback-Leibler (KL) divergence between the probabilistic outputs of a teacher…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Nikolaos Giakoumoglou , Tania Stathaki

The long-tailed recognition (LTR) is the task of learning high-performance classifiers given extremely imbalanced training samples between categories. Most of the existing works address the problem by either enhancing the features of tail…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Haixu Long , Xiaolin Zhang , Yanbin Liu , Zongtai Luo , Jianbo Liu

Real-world visual recognition requires handling the extreme sample imbalance in large-scale long-tailed data. We propose a "divide&conquer" strategy for the challenging LVIS task: divide the whole data into balanced parts and then apply…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Xinting Hu , Yi Jiang , Kaihua Tang , Jingyuan Chen , Chunyan Miao , Hanwang Zhang

Deploying deep learning models on resource-constrained edge devices remains a major challenge in smart agriculture due to the trade-off between computational efficiency and recognition accuracy. To address this challenge, this study…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Phi-Hung Hoang , Nam-Thuan Trinh , Van-Manh Tran , Thi-Thu-Hong Phan

Diabetic retinopathy (DR) is one of the leading causes of blindness. However, no specific symptoms of early DR lead to a delayed diagnosis, which results in disease progression in patients. To determine the disease severity levels,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 Li Tian , Liyan Ma , Zhijie Wen , Shaorong Xie , Yupeng Xu

Ensuring robust performance on long-tail examples is an important problem for many real-world applications of machine learning, such as autonomous driving. This work focuses on the problem of identifying rare examples within a corpus of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Mao Ye , Gregory P. Meyer , Zaiwei Zhang , Dennis Park , Siva Karthik Mustikovela , Yuning Chai , Eric M Wolff

Balancing training on long-tail data distributions remains a long-standing challenge in deep learning. While methods such as re-weighting and re-sampling help alleviate the imbalance issue, limited sample diversity continues to hinder…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Shizhen Zhao , Xin Wen , Jiahui Liu , Chuofan Ma , Chunfeng Yuan , Xiaojuan Qi

Mining relationships between treatment(s) and medical problem(s) is vital in the biomedical domain. This helps in various applications, such as decision support system, safety surveillance, and new treatment discovery. We propose a deep…

Machine Learning · Computer Science 2018-07-02 Veera Raghavendra Chikka , Kamalakar Karlapalem

This paper introduces a two-stage framework designed to enhance long-tail class incremental learning, enabling the model to progressively learn new classes, while mitigating catastrophic forgetting in the context of long-tailed data…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Jayateja Kalla , Soma Biswas

Diabetic retinopathy (DR) is one of the major blindness-causing diseases currently known. Automatic grading of DR using deep learning methods not only speeds up the diagnosis of the disease but also reduces the rate of misdiagnosis.…

Image and Video Processing · Electrical Eng. & Systems 2023-05-25 Lei Shi , Bin Wang , Junxing Zhang

Knowledge distillation is an effective method to improve the performance of a lightweight neural network (i.e., student model) by transferring the knowledge of a well-performed neural network (i.e., teacher model), which has been widely…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Jiaheng Liu , Haoyu Qin , Yichao Wu , Jinyang Guo , Ding Liang , Ke Xu

Retinal vessel segmentation from retinal images is an essential task for developing the computer-aided diagnosis system for retinal diseases. Efforts have been made on high-performance deep learning-based approaches to segment the retinal…

Image and Video Processing · Electrical Eng. & Systems 2021-03-08 Yuqian Zhou , Hanchao Yu , Humphrey Shi

Data is the foundation for the development of computer vision, and the establishment of datasets plays an important role in advancing the techniques of fine-grained visual categorization~(FGVC). In the existing FGVC datasets used in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Shuo Ye , Shiming Chen , Ruxin Wang , Tianxu Wu , Jiamiao Xu , Salman Khan , Fahad Shahbaz Khan , Ling Shao

Data privacy and class imbalance are the norm rather than the exception in many machine learning tasks. Recent attempts have been launched to, on one side, address the problem of learning from pervasive private data, and on the other side,…

Machine Learning · Computer Science 2022-07-01 Zihan Chen , Songshang Liu , Hualiang Wang , Howard H. Yang , Tony Q. S. Quek , Zuozhu Liu

The development of computer vision solutions for gigapixel images in digital pathology is hampered by significant computational limitations due to the large size of whole slide images. In particular, digitizing biopsies at high resolutions…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Rocío del Amor , Julio Silva-Rodríguez , Adrián Colomer , Valery Naranjo

Real-world data often follow a long-tailed distribution as the frequency of each class is typically different. For example, a dataset can have a large number of under-represented classes and a few classes with more than sufficient data.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Peng Chu , Xiao Bian , Shaopeng Liu , Haibin Ling

The datasets used for Deep Neural Network training (e.g., ImageNet, MSCOCO, etc.) are often manually balanced across categories (classes) to facilitate learning of all the categories. This curation process is often expensive and requires…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Harsh Rangwani

In recent years, deep neural networks have been successful in both industry and academia, especially for computer vision tasks. The great success of deep learning is mainly due to its scalability to encode large-scale data and to maneuver…

Machine Learning · Computer Science 2021-05-21 Jianping Gou , Baosheng Yu , Stephen John Maybank , Dacheng Tao