English
Related papers

Related papers: Identifying and Compensating for Feature Deviation…

200 papers

The infrequent occurrence of overfitting in deep neural networks is perplexing: contrary to theoretical expectations, increasing model size often enhances performance in practice. But what if overfitting does occur, though restricted to…

Machine Learning · Computer Science 2025-01-08 Uri Stern , Tomer Yaacoby , Daphna Weinshall

Machine learning (ML) models have difficulty generalizing when the number of training class instances are numerically imbalanced. The problem of generalization in the face of data imbalance has largely been attributed to the lack of…

Machine Learning · Computer Science 2024-07-16 Damien A. Dablain , Nitesh V. Chawla

Background and Aim: Over-fitting issue has been the reason behind deep learning technology not being successfully implemented in oral cancer images classification. The aims of this research were reducing overfitting for accurately producing…

Image and Video Processing · Electrical Eng. & Systems 2022-08-17 Prakrit Joshi , Omar Hisham Alsadoon , Abeer Alsadoon , Nada AlSallami , Tarik A. Rashid , P. W. C. Prasad , Sami Haddad

The current paradigm of training deep neural networks for classification tasks includes minimizing the empirical risk that pushes the training loss value towards zero, even after the training error has been vanished. In this terminal phase…

Machine Learning · Computer Science 2024-06-07 Hien Dang , Tho Tran , Tan Nguyen , Nhat Ho

Cross-Domain Few-shot Semantic Segmentation (CD-FSS) aims to train generalized models that can segment classes from different domains with a few labeled images. Previous works have proven the effectiveness of feature transformation in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Jiayi Chen , Rong Quan , Jie Qin

Few-shot classification requires adapting knowledge learned from a large annotated base dataset to recognize novel unseen classes, each represented by few labeled examples. In such a scenario, pretraining a network with high capacity on the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Yiren Jian , Lorenzo Torresani

Overfit is a fundamental problem in machine learning in general, and in deep learning in particular. In order to reduce overfit and improve generalization in the classification of images, some employ invariance to a group of…

Machine Learning · Computer Science 2021-02-12 Roee Cates , Daphna Weinshall

We address a core problem of computer vision: Detection and description of 2D feature points for image matching. For a long time, hand-crafted designs, like the seminal SIFT algorithm, were unsurpassed in accuracy and efficiency. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Aritra Bhowmik , Stefan Gumhold , Carsten Rother , Eric Brachmann

Universal lesion detection and tagging (ULDT) in CT studies is critical for tumor burden assessment and tracking the progression of lesion status (growth/shrinkage) over time. However, a lack of fully annotated data hinders the development…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Alexander Shieh , Tejas Sudharshan Mathai , Jianfei Liu , Angshuman Paul , Ronald M. Summers

Although deep neural networks are effective on supervised learning tasks, they have been shown to be brittle. They are prone to overfitting on their training distribution and are easily fooled by small adversarial perturbations. In this…

Machine Learning · Computer Science 2020-10-07 Laëtitia Shao , Yang Song , Stefano Ermon

Federated learning aims to learn a global model collaboratively while the training data belongs to different clients and is not allowed to be exchanged. However, the statistical heterogeneity challenge on non-IID data, such as class…

Machine Learning · Computer Science 2023-04-12 Yunheng Shen , Haoxiang Wang , Hairong Lv

Substantial efforts have been devoted to alleviating the impact of the long-tailed class distribution in federated learning. In this work, we observe an interesting phenomenon that certain weak classes consistently exist even for…

Machine Learning · Computer Science 2025-05-01 Xiaoyu Gan , Jingbo Jiang , Jingyang Zhu , Xiaomeng Wang , Xizi Chen , Chi-Ying Tsui

Few-shot learning is a challenging problem that has attracted more and more attention recently since abundant training samples are difficult to obtain in practical applications. Meta-learning has been proposed to address this issue, which…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Xian Zhong , Cheng Gu , Wenxin Huang , Lin Li , Shuqin Chen , Chia-Wen Lin

Common click-through rate (CTR) prediction recommender models tend to exhibit feature-level bias, which leads to unfair recommendations among item groups and inaccurate recommendations for users. While existing methods address this issue by…

Information Retrieval · Computer Science 2024-02-07 Jinqiu Jin , Sihao Ding , Wenjie Wang , Fuli Feng

The collected data from industrial machines are often imbalanced, which poses a negative effect on learning algorithms. However, this problem becomes more challenging for a mixed type of data or while there is overlapping between classes.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Masoumeh Zareapoor , Pourya Shamsolmoali , Jie Yang

In software engineering, deep learning models are increasingly deployed for critical tasks such as bug detection and code review. However, overfitting remains a challenge that affects the quality, reliability, and trustworthiness of…

Software Engineering · Computer Science 2024-05-21 Hao Li , Gopi Krishnan Rajbahadur , Dayi Lin , Cor-Paul Bezemer , Zhen Ming , Jiang

Radiologists routinely detect and size lesions in CT to stage cancer and assess tumor burden. To potentially aid their efforts, multiple lesion detection algorithms have been developed with a large public dataset called DeepLesion (32,735…

Image and Video Processing · Electrical Eng. & Systems 2025-04-09 Peter D. Erickson , Tejas Sudharshan Mathai , Ronald M. Summers

Test-time adaptation (TTA) in federated learning (FL) is crucial for handling unseen data distributions across clients, particularly when faced with domain shifts and skewed class distributions. Class Imbalance (CI) remains a fundamental…

Fine-grained few-shot recognition often suffers from the problem of training data scarcity for novel categories.The network tends to overfit and does not generalize well to unseen classes due to insufficient training data. Many methods have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Jingyi Xu , Hieu Le , Mingzhen Huang , ShahRukh Athar , Dimitris Samaras

Although binary classification is a well-studied problem in computer vision, training reliable classifiers under severe class imbalance remains a challenging problem. Recent work has proposed techniques that mitigate the effects of training…

Machine Learning · Computer Science 2024-06-06 Kelsey Lieberman , Shuai Yuan , Swarna Kamlam Ravindran , Carlo Tomasi