中文
相关论文

相关论文: Focal-SAM: Focal Sharpness-Aware Minimization for …

200 篇论文

In the context of long-tail classification on graphs, the vast majority of existing work primarily revolves around the development of model debiasing strategies, intending to mitigate class imbalances and enhance the overall performance.…

机器学习 · 计算机科学 2024-06-03 Haohui Wang , Baoyu Jing , Kaize Ding , Yada Zhu , Wei Cheng , Si Zhang , Yonghui Fan , Liqing Zhang , Dawei Zhou

Long-tailed (LT) classification is an unavoidable and challenging problem in the real world. Most existing long-tailed classification methods focus only on solving the class-wise imbalance while ignoring the attribute-wise imbalance. The…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Jinye Yang , Ji Xu , Di Wu , Jianhang Tang , Shaobo Li , Guoyin Wang

Backdoor defense, which aims to detect or mitigate the effect of malicious triggers introduced by attackers, is becoming increasingly critical for machine learning security and integrity. Fine-tuning based on benign data is a natural…

人工智能 · 计算机科学 2023-10-31 Mingli Zhu , Shaokui Wei , Li Shen , Yanbo Fan , Baoyuan Wu

When trained with severely imbalanced data, deep neural networks often struggle to accurately recognize classes with only a few samples. Previous studies in long-tailed recognition have attempted to rebalance biased learning using known…

计算机视觉与模式识别 · 计算机科学 2024-12-23 Minseok Son , Inyong Koo , Jinyoung Park , Changick Kim

Curvature regularization techniques like Sharpness Aware Minimization (SAM) have shown great promise in improving generalization on vision tasks. However, we find that SAM performs poorly in domains like natural language processing (NLP),…

机器学习 · 计算机科学 2025-02-05 Sidak Pal Singh , Hossein Mobahi , Atish Agarwala , Yann Dauphin

The variance in class-wise sample sizes within long-tailed scenarios often results in degraded performance in less frequent classes. Fortunately, foundation models, pre-trained on vast open-world datasets, demonstrate strong potential for…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Yufei Peng , Yonggang Zhang , Yiu-ming Cheung

Long-tailed object detection faces great challenges because of its extremely imbalanced class distribution. Recent methods mainly focus on the classification bias and its loss function design, while ignoring the subtle influence of the…

计算机视觉与模式识别 · 计算机科学 2024-02-01 Ke Zhu , Minghao Fu , Jie Shao , Tianyu Liu , Jianxin Wu

Sharpness-Aware Minimization (SAM) has been proven to be an effective optimization technique for improving generalization in overparameterized models. While prior works have explored the implicit regularization of SAM in simple two-core…

机器学习 · 计算机科学 2025-08-15 Tianxiao Cao , Kyohei Atarashi , Hisashi Kashima

Label distributions in camera-trap images are highly imbalanced and long-tailed, resulting in neural networks tending to be biased towards head-classes that appear frequently. Although long-tail learning has been extremely explored to…

计算机视觉与模式识别 · 计算机科学 2022-02-17 Byeongjun Park , Jeongsoo Kim , Seungju Cho , Heeseon Kim , Changick Kim

Balancing training on long-tail data distributions remains a long-standing challenge in deep learning. While methods such as re-weighting and re-sampling help alleviate the imbalance issue, limited sample diversity continues to hinder…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Shizhen Zhao , Xin Wen , Jiahui Liu , Chuofan Ma , Chunfeng Yuan , Xiaojuan Qi

Dataset condensation aims to synthesize datasets with a few representative samples that can effectively represent the original datasets. This enables efficient training and produces models with performance close to those trained on the…

机器学习 · 计算机科学 2025-02-05 Boyan Gao , Bo Zhao , Shreyank N Gowda , Xingrun Xing , Yibo Yang , Timothy Hospedales , David A. Clifton

Many data distributions in the real world are hardly uniform. Instead, skewed and long-tailed distributions of various kinds are commonly observed. This poses an interesting problem for machine learning, where most algorithms assume or work…

机器学习 · 计算机科学 2024-04-25 Charika de Alvis , Suranga Seneviratne

Significant progress has been made in learning image classification neural networks under long-tail data distribution using robust training algorithms such as data re-sampling, re-weighting, and margin adjustment. Those methods, however,…

计算机视觉与模式识别 · 计算机科学 2022-12-05 Lechao Cheng , Chaowei Fang , Dingwen Zhang , Guanbin Li , Gang Huang

To address the problem of long-tail distribution for the large vocabulary object detection task, existing methods usually divide the whole categories into several groups and treat each group with different strategies. These methods bring…

计算机视觉与模式识别 · 计算机科学 2021-04-05 Tong Wang , Yousong Zhu , Chaoyang Zhao , Wei Zeng , Jinqiao Wang , Ming Tang

Few-shot fine-grained visual categorization (FS-FGVC) focuses on identifying various subcategories within a common superclass given just one or few support examples. Most existing methods aim to boost classification accuracy by enriching…

计算机视觉与模式识别 · 计算机科学 2025-12-29 Zhiwen Yang , Jinglin Xu , Yuxin Pen

Most of the medical tasks naturally exhibit a long-tailed distribution due to the complex patient-level conditions and the existence of rare diseases. Existing long-tailed learning methods usually treat each class equally to re-balance the…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Lie Ju , Yicheng Wu , Lin Wang , Zhen Yu , Xin Zhao , Xin Wang , Paul Bonnington , Zongyuan Ge

Large-scale object detection and instance segmentation face a severe data imbalance. The finer-grained object classes become, the less frequent they appear in our datasets. However, at test-time, we expect a detector that performs well for…

计算机视觉与模式识别 · 计算机科学 2023-01-25 Jang Hyun Cho , Philipp Krähenbühl

In object detection, the instance count is typically used to define whether a dataset exhibits a long-tail distribution, implicitly assuming that models will underperform on categories with fewer instances. This assumption has led to…

计算机视觉与模式识别 · 计算机科学 2025-02-07 Yanbiao Ma , Wei Dai , Jiayi Chen

Sharpness-Aware Minimization (SAM) has attracted considerable attention for its effectiveness in improving generalization in deep neural network training by explicitly minimizing sharpness in the loss landscape. Its success, however, relies…

机器学习 · 计算机科学 2025-06-16 Sungbin Shin , Dongyeop Lee , Maksym Andriushchenko , Namhoon Lee

Few-shot classification (FSC) is one of the most concerned hot issues in recent years. The general setting consists of two phases: (1) Pre-train a feature extraction model (FEM) with base data (has large amounts of labeled samples). (2) Use…

计算机视觉与模式识别 · 计算机科学 2021-09-08 Shuai Shao , Lei Xing , Yixin Chen , Yan-Jiang Wang , Bao-Di Liu , Yicong Zhou