中文
相关论文

相关论文: SSE-SAM: Balancing Head and Tail Classes Gradually…

200 篇论文

The real-world data distribution is essentially long-tailed, which poses great challenge to the deep model. In this work, we propose a new method, Gradual Balanced Loss and Adaptive Feature Generator (GLAG) to alleviate imbalance. GLAG…

计算机视觉与模式识别 · 计算机科学 2022-03-02 Zihan Zhang , Xiang Xiang

Data collected from the real world typically exhibit long-tailed distributions, where frequent classes contain abundant data while rare ones have only a limited number of samples. While existing supervised learning approaches have been…

计算机视觉与模式识别 · 计算机科学 2023-09-18 Ci-Siang Lin , Min-Hung Chen , Yu-Chiang Frank Wang

Most existing methods that cope with noisy labels usually assume that the class distributions are well balanced, which has insufficient capacity to deal with the practical scenarios where training samples have imbalanced distributions. To…

计算机视觉与模式识别 · 计算机科学 2022-09-27 Chaowei Fang , Lechao Cheng , Huiyan Qi , Dingwen Zhang

The training datasets used in long-tailed recognition are extremely unbalanced, resulting in significant variation in per-class accuracy across categories. Prior works mostly used average accuracy to evaluate their algorithms, which easily…

计算机视觉与模式识别 · 计算机科学 2024-01-31 Hao Yu , Yingxiao Du , Jianxin Wu

Long-tailed image recognition presents massive challenges to deep learning systems since the imbalance between majority (head) classes and minority (tail) classes severely skews the data-driven deep neural networks. Previous methods tackle…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Yue Xu , Yong-Lu Li , Jiefeng Li , Cewu Lu

Deep neural networks often suffer from poor generalization due to complex and non-convex loss landscapes. Sharpness-Aware Minimization (SAM) is a popular solution that smooths the loss landscape by minimizing the maximized change of…

人工智能 · 计算机科学 2023-07-03 Peng Mi , Li Shen , Tianhe Ren , Yiyi Zhou , Tianshuo Xu , Xiaoshuai Sun , Tongliang Liu , Rongrong Ji , Dacheng Tao

Long-tailed classification poses a challenge due to its heavy imbalance in class probabilities and tail-sensitivity risks with asymmetric misprediction costs. Recent attempts have used re-balancing loss and ensemble methods, but they are…

机器学习 · 计算机科学 2023-03-22 Bolian Li , Ruqi Zhang

Deep learning has achieved remarkable progress for visual recognition on large-scale balanced datasets but still performs poorly on real-world long-tailed data. Previous methods often adopt class re-balanced training strategies to…

计算机视觉与模式识别 · 计算机科学 2021-09-10 Tianhao Li , Limin Wang , Gangshan Wu

Long-tailed recognition with imbalanced class distribution naturally emerges in practical machine learning applications. Existing methods such as data reweighing, resampling, and supervised contrastive learning enforce the class balance…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Chengkai Hou , Jieyu Zhang , Haonan Wang , Tianyi Zhou

Sharpness-Aware Minimization (SAM) has been demonstrated to improve the generalization performance of overparameterized models by seeking flat minima on the loss landscape through optimizing model parameters that incur the largest loss…

机器学习 · 计算机科学 2025-06-10 Tian Li , Tianyi Zhou , Jeffrey A. Bilmes

Real-world data usually present long-tailed distributions. Training on imbalanced data tends to render neural networks perform well on head classes while much worse on tail classes. The severe sparseness of training instances for the tail…

机器学习 · 计算机科学 2021-11-10 Chaozheng Wang , Shuzheng Gao , Cuiyun Gao , Pengyun Wang , Wenjie Pei , Lujia Pan , Zenglin Xu

Dataset distillation (DD) aims to compress large-scale datasets into compact synthetic counterparts for efficient model training. However, existing DD methods exhibit substantial performance degradation on long-tailed datasets. We identify…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Ruixi Wu , Shaobo Wang , Jiahuan Chen , Zhiyuan Liu , Yicun Yang , Zhaorun Chen , Zekai Li , Kaixin Li , Xinming Wang , Hongzhu Yi , Kai Wang , Linfeng Zhang

When trained with severely imbalanced data, deep neural networks often struggle to accurately recognize classes with only a few samples. Previous studies in long-tailed recognition have attempted to rebalance biased learning using known…

计算机视觉与模式识别 · 计算机科学 2024-12-23 Minseok Son , Inyong Koo , Jinyoung Park , Changick Kim

Class imbalance is a common issue in real-world data distributions, negatively impacting the training of accurate classifiers. Traditional approaches to mitigate this problem fall into three main categories: class re-balancing, information…

机器学习 · 计算机科学 2024-06-26 Zhiwei Yao

Real-world imagery is often characterized by a significant imbalance of the number of images per class, leading to long-tailed distributions. An effective and simple approach to long-tailed visual recognition is to learn feature…

计算机视觉与模式识别 · 计算机科学 2022-01-14 Ahmet Iscen , André Araujo , Boqing Gong , Cordelia Schmid

Real-world datasets usually are class-imbalanced and corrupted by label noise. To solve the joint issue of long-tailed distribution and label noise, most previous works usually aim to design a noise detector to distinguish the noisy and…

机器学习 · 计算机科学 2024-04-11 Zhuo Li , He Zhao , Zhen Li , Tongliang Liu , Dandan Guo , Xiang Wan

Due to the notorious modality imbalance problem, multimodal learning (MML) leads to the phenomenon of optimization imbalance, thus struggling to achieve satisfactory performance. Recently, some representative methods have been proposed to…

机器学习 · 计算机科学 2024-07-08 Qing-Yuan Jiang , Zhouyang Chi , Yang Yang

We introduce the \textsc{Tailed-Uniform} proposal distribution for generating training simulations in simulation-based inference. Instead of sampling parameters uniformly within bounded regions, we extend the distribution beyond prior…

天体物理仪器与方法 · 物理学 2026-01-27 Chaipat Tirapongprasert , Matthew Ho

In today's heavily overparameterized models, the value of the training loss provides few guarantees on model generalization ability. Indeed, optimizing only the training loss value, as is commonly done, can easily lead to suboptimal model…

机器学习 · 计算机科学 2021-04-30 Pierre Foret , Ariel Kleiner , Hossein Mobahi , Behnam Neyshabur

Data imbalance exists ubiquitously in real-world visual regressions, e.g., age estimation and pose estimation, hurting the model's generalizability and fairness. Thus, imbalanced regression gains increasing research attention recently.…

计算机视觉与模式识别 · 计算机科学 2022-03-31 Jiawei Ren , Mingyuan Zhang , Cunjun Yu , Ziwei Liu