English
Related papers

Related papers: Learning Prototype Classifiers for Long-Tailed Rec…

200 papers

Distance metric learning (DML) is to learn the embeddings where examples from the same class are closer than examples from different classes. It can be cast as an optimization problem with triplet constraints. Due to the vast number of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-16 Qi Qian , Lei Shang , Baigui Sun , Juhua Hu , Hao Li , Rong Jin

Federated learning-assisted edge intelligence enables privacy protection in modern intelligent services. However, not independent and identically distributed (non-IID) distribution among edge clients can impair the local model performance.…

Machine Learning · Computer Science 2023-10-12 Yu Qiao , Md. Shirajum Munir , Apurba Adhikary , Huy Q. Le , Avi Deb Raha , Chaoning Zhang , Choong Seon Hong

The full potential of large pretrained models remains largely untapped in control domains like robotics. This is mainly because of the scarcity of data and the computational challenges associated with training or fine-tuning these large…

Machine Learning · Computer Science 2024-03-11 Zuxin Liu , Jesse Zhang , Kavosh Asadi , Yao Liu , Ding Zhao , Shoham Sabach , Rasool Fakoor

The natural world often follows a long-tailed data distribution where only a few classes account for most of the examples. This long-tail causes classifiers to overfit to the majority class. To mitigate this, prior solutions commonly adopt…

Machine Learning · Computer Science 2020-09-15 Rahul Duggal , Scott Freitas , Sunny Dhamnani , Duen Horng Chau , Jimeng Sun

This paper presents an investigation into long-tail video recognition. We demonstrate that, unlike naturally-collected video datasets and existing long-tail image benchmarks, current video benchmarks fall short on multiple long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Toby Perrett , Saptarshi Sinha , Tilo Burghardt , Majid Mirmehdi , Dima Damen

Relation classification (RC) task is one of fundamental tasks of information extraction, aiming to detect the relation information between entity pairs in unstructured natural language text and generate structured data in the form of…

Computation and Language · Computer Science 2021-01-12 Yan Xiao , Yaochu Jin , Kuangrong Hao

For a broad variety of critical applications, it is essential to know how confident a classification prediction is. In this paper, we discuss the drawbacks of softmax to calculate class probabilities and to handle uncertainty in Bayesian…

Machine Learning · Computer Science 2019-06-11 Christian Herta , Benjamin Voigt

Real-world data tends to follow a long-tailed distribution, where the class imbalance results in dominance of the head classes during training. In this paper, we propose a frustratingly simple but effective step-wise learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Na Dong , Yongqiang Zhang , Mingli Ding , Gim Hee Lee

Deep learning-based multi-view coarse-grained 3D shape classification has achieved remarkable success over the past decade, leveraging the powerful feature learning capabilities of CNN-based and ViT-based backbones. However, as a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Shuxian Ma , Zihao Dong , Runmin Cong , Sam Kwong , Xiuli Shao

Data is the foundation for the development of computer vision, and the establishment of datasets plays an important role in advancing the techniques of fine-grained visual categorization~(FGVC). In the existing FGVC datasets used in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Shuo Ye , Shiming Chen , Ruxin Wang , Tianxu Wu , Jiamiao Xu , Salman Khan , Fahad Shahbaz Khan , Ling Shao

Long-tail learning is the problem of learning under skewed label distributions, which pose a challenge for standard learners. Several recent approaches for the problem have proposed enforcing a suitable margin in logit space. Such…

Machine Learning · Computer Science 2022-04-29 Wittawat Jitkrittum , Aditya Krishna Menon , Ankit Singh Rawat , Sanjiv Kumar

Main challenges in long-tailed recognition come from the imbalanced data distribution and sample scarcity in its tail classes. While techniques have been proposed to achieve a more balanced training loss and to improve tail classes data…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Bo Liu , Haoxiang Li , Hao Kang , Nuno Vasconcelos , Gang Hua

Contemporary autonomous vehicle (AV) benchmarks have advanced techniques for training 3D detectors, particularly on large-scale lidar data. Surprisingly, although semantic class labels naturally follow a long-tailed distribution,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Neehar Peri , Achal Dave , Deva Ramanan , Shu Kong

The goal of continual learning is to improve the performance of recognition models in learning sequentially arrived data. Although most existing works are established on the premise of learning from scratch, growing efforts have been…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Gengwei Zhang , Liyuan Wang , Guoliang Kang , Ling Chen , Yunchao Wei

Federated learning offers a paradigm to the challenge of preserving privacy in distributed machine learning. However, datasets distributed across each client in the real world are inevitably heterogeneous, and if the datasets can be…

Machine Learning · Computer Science 2024-09-19 Xiuhua Lu , Peng Li , Xuefeng Jiang

Ensuring the reliability of automated decision-making based on neural networks will be crucial as Artificial Intelligence systems are deployed more widely in critical situations. This paper proposes a new approach for measuring confidence…

Machine Learning · Computer Science 2025-05-01 Daniel Sikar , Artur d'Avila Garcez , Tillman Weyde

In the real-world setting, data often follows a long-tailed distribution, where head classes contain significantly more training samples than tail classes. Consequently, models trained on such data tend to be biased toward head classes. The…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Fan Zhang , Wei Qin , Weijieying Ren , Lei Wang , Zetong Chen , Richang Hong

Large language models (LLMs) can learn vast amounts of knowledge from diverse domains during pre-training. However, long-tail knowledge from specialized domains is often scarce and underrepresented, rarely appearing in the models'…

Computation and Language · Computer Science 2025-02-11 Shuyang Yu , Runxue Bao , Parminder Bhatia , Taha Kass-Hout , Jiayu Zhou , Cao Xiao

Pre-training Large Language Models (LLMs) on web-scale datasets becomes fundamental for advancing general-purpose AI. In contrast, enhancing their predictive performance on downstream tasks typically involves adapting their knowledge…

We show that scale-adjusted versions of the centroid-based classifier enjoys optimal properties when used to discriminate between two very high-dimensional populations where the principal differences are in location. The scale adjustment…

Statistics Theory · Mathematics 2010-02-26 Peter Hall , Tung Pham