中文
相关论文

相关论文: SSE-SAM: Balancing Head and Tail Classes Gradually…

200 篇论文

Imbalanced learning (IL), i.e., learning unbiased models from class-imbalanced data, is a challenging problem. Typical IL methods including resampling and reweighting were designed based on some heuristic assumptions. They often suffer from…

机器学习 · 计算机科学 2020-10-20 Zhining Liu , Pengfei Wei , Jing Jiang , Wei Cao , Jiang Bian , Yi Chang

Deep models trained on long-tailed datasets exhibit unsatisfactory performance on tail classes. Existing methods usually modify the classification loss to increase the learning focus on tail classes, which unexpectedly sacrifice the…

计算机视觉与模式识别 · 计算机科学 2021-04-22 Shaoyu Zhang , Chen Chen , Xiyuan Hu , Silong Peng

Robots rely on motion planning to navigate safely and efficiently while performing various tasks. In this paper, we investigate motion planning through Bayesian inference, where motion plans are inferred based on planning objectives and…

机器人学 · 计算机科学 2025-06-02 Ali Vaziri , Iman Askari , Huazhen Fang

Deep neural network models degrade significantly in the long-tailed data distribution, with the overall training data dominated by a small set of classes in the head, and the tail classes obtaining less training examples. Addressing the…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Brainard Philemon Jagati , Jitendra Tembhurne , Harsh Goud , Rudra Pratap Singh , Chandrashekhar Meshram

Various algorithms have been proposed to address the challenges posed by class-imbalanced learning from real-world data with long-tailed distributions. While these algorithms reduce prediction bias through rebalancing techniques, they often…

机器学习 · 计算机科学 2026-05-29 Hyuck Lee , Taemin Park , Heeyoung Kim

Long-tailed problems in healthcare emerge from data imbalance due to variability in the prevalence and representation of different medical conditions, warranting the requirement of precise and dependable classification methods. Traditional…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Pankhi Kashyap , Pavni Tandon , Sunny Gupta , Abhishek Tiwari , Ritwik Kulkarni , Kshitij Sharad Jadhav

Sharpness-Aware Minimization (SAM) has been proven to be an effective optimization technique for improving generalization in overparameterized models. While prior works have explored the implicit regularization of SAM in simple two-core…

机器学习 · 计算机科学 2025-08-15 Tianxiao Cao , Kyohei Atarashi , Hisashi Kashima

In this paper, we propose mean squared error (MSE) loss with outlying label for class imbalanced classification. Cross entropy (CE) loss, which is widely used for image recognition, is learned so that the probability value of true class is…

计算机视觉与模式识别 · 计算机科学 2021-07-07 Sota Kato , Kazuhiro Hotta

Conventional knowledge distillation, designed for model compression, fails on long-tailed distributions because the teacher model tends to be biased toward head classes and provides limited supervision for tail classes. We propose…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Seonghak Kim

Real-world data often exhibits long tail distributions with heavy class imbalance, where the majority classes can dominate the training process and alter the decision boundaries of the minority classes. Recently, researchers have…

计算机视觉与模式识别 · 计算机科学 2022-05-03 Tianhong Li , Peng Cao , Yuan Yuan , Lijie Fan , Yuzhe Yang , Rogerio Feris , Piotr Indyk , Dina Katabi

Autonomous vehicles (AVs) rely on accurate trajectory prediction for safe navigation in diverse traffic environments, yet existing models struggle with long-tail scenarios-rare but safety-critical events characterized by abrupt maneuvers,…

新兴技术 · 计算机科学 2026-04-07 Bin Rao , Haicheng Liao , Chengyue Wang , Keqiang Li , Zhenning Li , Hai Yang

Sharpness-aware minimization (SAM), which searches for flat minima by min-max optimization, has been shown to be useful in improving model generalization. However, since each SAM update requires computing two gradients, its computational…

机器学习 · 计算机科学 2023-05-01 Weisen Jiang , Hansi Yang , Yu Zhang , James Kwok

Learning from imbalanced data is a challenging task. Standard classification algorithms tend to perform poorly when trained on imbalanced data. Some special strategies need to be adopted, either by modifying the data distribution or by…

机器学习 · 计算机科学 2022-08-26 Asif Newaz , Shahriar Hassan , Farhan Shahriyar Haq

Class imbalance, which is also called long-tailed distribution, is a common problem in classification tasks based on machine learning. If it happens, the minority data will be overwhelmed by the majority, which presents quite a challenge…

机器学习 · 计算机科学 2023-03-29 Jia-Chen Zhao

We propose GradTail, an algorithm that uses gradients to improve model performance on the fly in the face of long-tailed training data distributions. Unlike conventional long-tail classifiers which operate on converged - and possibly…

机器学习 · 计算机科学 2022-01-20 Zhao Chen , Vincent Casser , Henrik Kretzschmar , Dragomir Anguelov

Long-tailed learning has garnered increasing attention due to its practical significance. Among the various approaches, the fine-tuning paradigm has gained considerable interest with the advent of foundation models. However, most existing…

机器学习 · 计算机科学 2025-08-11 Jiahao Chen , Bin Qin , Jiangmeng Li , Hao Chen , Bing Su

Long-tail class incremental learning (LT CIL) remains highly challenging because the scarcity of samples in tail classes not only hampers their learning but also exacerbates catastrophic forgetting under continuously evolving and imbalanced…

人工智能 · 计算机科学 2026-03-24 Xi Wang , Xu Yang , Donghao Sun , Cheng Deng

While tasks could come with varying the number of instances and classes in realistic settings, the existing meta-learning approaches for few-shot classification assume that the number of instances per task and class is fixed. Due to such…

机器学习 · 计算机科学 2022-02-15 Hae Beom Lee , Hayeon Lee , Donghyun Na , Saehoon Kim , Minseop Park , Eunho Yang , Sung Ju Hwang

Methods for improving deep neural network training times and model generalizability consist of various data augmentation, regularization, and optimization approaches, which tend to be sensitive to hyperparameter settings and make…

机器学习 · 计算机科学 2022-11-02 Masud An-Nur Islam Fahim , Jani Boutellier

There is a growing demand in the field of KIE (Key Information Extraction) to apply semi-supervised learning to save manpower and costs, as training document data using fully-supervised methods requires labor-intensive manual annotation.…

机器学习 · 计算机科学 2024-07-24 Qi Zhang , Yonghong Song , Pengcheng Guo , Yangyang Hui