English
Related papers

Related papers: CALF: A Conditionally Adaptive Loss Function to Mi…

200 papers

Federated Learning (FL) marks a transformative approach to distributed model training by combining locally optimized models from various clients into a unified global model. While FL preserves data privacy by eliminating centralized…

Machine Learning · Computer Science 2026-01-08 Pranab Sahoo , Ashutosh Tripathi , Sriparna Saha , Samrat Mondal

Label noise and class imbalance commonly coexist in real-world data. Previous works for robust learning, however, usually address either one type of the data biases and underperform when facing them both. To mitigate this gap, this work…

Machine Learning · Computer Science 2023-09-06 Shenwang Jiang , Jianan Li , Jizhou Zhang , Ying Wang , Tingfa Xu

Loss functions are error metrics that quantify the difference between a prediction and its corresponding ground truth. Fundamentally, they define a functional landscape for traversal by gradient descent. Although numerous loss functions…

Image and Video Processing · Electrical Eng. & Systems 2021-04-09 Chaitanya Kaul , Nick Pears , Hang Dai , Roderick Murray-Smith , Suresh Manandhar

Classification of functional data where observations are curves or trajectories poses unique challenges, particularly under severe class imbalance. Traditional Random Forest algorithms, while robust for tabular data, often fail to capture…

Machine Learning · Statistics 2025-12-10 Fahad Mostafa , Hafiz Khan

Multi-label classification is a widely encountered problem in daily life, where an instance can be associated with multiple classes. In theory, this is a supervised learning method that requires a large amount of labeling. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 XIn Zhang , Yuqi Song , Fei Zuo , Xiaofeng Wang

Federated Learning (FL) offers a promising approach for training clinical AI models without centralizing sensitive patient data. However, its real-world adoption is hindered by challenges related to privacy, resource constraints, and…

We present a new loss function called Distribution-Balanced Loss for the multi-label recognition problems that exhibit long-tailed class distributions. Compared to conventional single-label classification problem, multi-label recognition…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Tong Wu , Qingqiu Huang , Ziwei Liu , Yu Wang , Dahua Lin

Class-Incremental Learning (CIL) trains a model to continually recognize new classes from non-stationary data while retaining learned knowledge. A major challenge of CIL arises when applying to real-world data characterized by non-uniform…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jiangpeng He , Fengqing Zhu

Federated learning offers a paradigm to the challenge of preserving privacy in distributed machine learning. However, datasets distributed across each client in the real world are inevitably heterogeneous, and if the datasets can be…

Machine Learning · Computer Science 2024-09-19 Xiuhua Lu , Peng Li , Xuefeng Jiang

Active learning (AL) reduces human annotation costs for machine learning systems by strategically selecting the most informative unlabeled data for annotation, but performing it individually may still be insufficient due to restricted data…

Machine Learning · Computer Science 2025-04-25 Jun Zhang , Jue Wang , Huan Li , Zhongle Xie , Ke Chen , Lidan Shou

Federated Learning (FL) on non-independently and identically distributed (non-IID) data remains a critical challenge, as existing approaches struggle with severe data heterogeneity. Current methods primarily address symptoms of non-IID by…

Machine Learning · Computer Science 2025-04-21 Hui Yeok Wong , Chee Kau Lim , Chee Seng Chan

Federated Learning (FL) enables collaborative model training across decentralized devices while preserving data privacy. However, real-world FL deployments face critical challenges such as data imbalances, including label noise and non-IID…

Machine Learning · Computer Science 2026-01-13 Siqi Zhu , Joshua D. Kaggie

Federated Learning (FL) aims to train a machine learning (ML) model in a distributed fashion to strengthen data privacy with limited data migration costs. It is a distributed learning framework naturally suitable for privacy-sensitive…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Erum Mushtaq , Yavuz Faruk Bakman , Jie Ding , Salman Avestimehr

Object frequency in the real world often follows a power law, leading to a mismatch between datasets with long-tailed class distributions seen by a machine learning model and our expectation of the model to perform well on all classes. We…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Muhammad Abdullah Jamal , Matthew Brown , Ming-Hsuan Yang , Liqiang Wang , Boqing Gong

Complementary-label learning (CLL) is widely used in weakly supervised classification, but it faces a significant challenge in real-world datasets when confronted with class-imbalanced training samples. In such scenarios, the number of…

Machine Learning · Computer Science 2024-03-21 Meng Wei , Yong Zhou , Zhongnian Li , Xinzheng Xu

Unwanted samples from private source categories in the learning objective of a partial domain adaptation setup can lead to negative transfer and reduce classification performance. Existing methods, such as re-weighting or aggregating target…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Sandipan Choudhuri , Arunabha Sen

With the ever increasing data deluge and the success of deep neural networks, the research of distributed deep learning has become pronounced. Two common approaches to achieve this distributed learning is synchronous and asynchronous weight…

Machine Learning · Computer Science 2022-04-29 Debasrita Chakraborty , Ashish Ghosh

Imbalanced classification datasets pose significant challenges in machine learning, often leading to biased models that perform poorly on underrepresented classes. With the rise of foundation models, recent research has focused on the full,…

Machine Learning · Computer Science 2025-09-22 Nakul Sharma

Annotating medical images demands significant time and expertise, often requiring pathologists to invest hundreds of hours in labeling mammary epithelial nuclei datasets. We address this critical challenge by achieving 95.5% Dice score…

Artificial Intelligence · Computer Science 2025-12-03 Varun Kumar Dasoju , Qingsu Cheng , Zeyun Yu

Federated Learning (FL) faces major challenges regarding communication overhead and model privacy when training large language models (LLMs), especially in healthcare applications. To address these, we introduce Selective Attention…

Computation and Language · Computer Science 2025-04-22 Yue Li , Lihong Zhang