English
Related papers

Related papers: Imbalance Robust Softmax for Deep Embeeding Learni…

200 papers

This paper studies the unsupervised embedding learning problem, which requires an effective similarity measurement between samples in low-dimensional embedding space. Motivated by the positive concentrated and negative separated properties…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Mang Ye , Xu Zhang , Pong C. Yuen , Shih-Fu Chang

Federated learning, which allows multiple client devices in a network to jointly train a machine learning model without direct exposure of clients' data, is an emerging distributed learning technique due to its nature of privacy…

Machine Learning · Computer Science 2023-03-22 Jing Zhang , Chuanwen Li , Jianzgong Qi , Jiayuan He

Deep convolutional neural networks (CNNs) trained with logistic and softmax losses have made significant advancement in visual recognition tasks in computer vision. When training data exhibit class imbalances, the class-wise reweighted…

Machine Learning · Computer Science 2020-03-06 Xiangrui Li , Xin Li , Deng Pan , Dongxiao Zhu

Federated learning (FL) is a promising approach for training decentralized data located on local client devices while improving efficiency and privacy. However, the distribution and quantity of the training data on the clients' side may…

Machine Learning · Computer Science 2020-12-16 Lixu Wang , Shichao Xu , Xiao Wang , Qi Zhu

With the ever increasing data deluge and the success of deep neural networks, the research of distributed deep learning has become pronounced. Two common approaches to achieve this distributed learning is synchronous and asynchronous weight…

Machine Learning · Computer Science 2022-04-29 Debasrita Chakraborty , Ashish Ghosh

Many current successful Person Re-Identification(ReID) methods train a model with the softmax loss function to classify images of different persons and obtain the feature vectors at the same time. However, the underlying feature embedding…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Xing Fan , Wei Jiang , Hao Luo , Mengjuan Fei

Deep Learning methods have significantly advanced various data-driven tasks such as regression, classification, and forecasting. However, much of this progress has been predicated on the strong but often unrealistic assumption that training…

Machine Learning · Computer Science 2023-10-12 Josias Moukpe

Real-world large-scale datasets are heteroskedastic and imbalanced -- labels have varying levels of uncertainty and label distributions are long-tailed. Heteroskedasticity and imbalance challenge deep learning algorithms due to the…

Machine Learning · Computer Science 2021-03-19 Kaidi Cao , Yining Chen , Junwei Lu , Nikos Arechiga , Adrien Gaidon , Tengyu Ma

In this study, we consider classification problems based on neural networks in data-imbalanced environment. Learning from an imbalanced data set is one of the most important and practical problems in the field of machine learning. A…

Machine Learning · Statistics 2019-12-02 Muneki Yasuda , Seishirou Ueno

Class imbalance is a problem of significant importance in applied deep learning where trained models are exploited for decision support and automated decisions in critical areas such as health and medicine, transportation, and finance. The…

Machine Learning · Computer Science 2020-12-07 Colin Bellinger , Roberto Corizzo , Nathalie Japkowicz

Deep learning models have become increasingly useful in many different industries. On the domain of image classification, convolutional neural networks proved the ability to learn robust features for the closed set problem, as shown in many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Rafael S. Pereira , Alexis Joly , Patrick Valduriez , Fabio Porto

Softmax loss is arguably one of the most popular losses to train CNN models for image classification. However, recent works have exposed its limitation on feature discriminability. This paper casts a new viewpoint on the weakness of softmax…

Computer Vision and Pattern Recognition · Computer Science 2018-05-11 Xiaobo Wang , Shifeng Zhang , Zhen Lei , Si Liu , Xiaojie Guo , Stan Z. Li

We present a novel framework to exploit privileged information for recognition which is provided only during the training phase. Here, we focus on recognition task where images are provided as the main view and soft biometric traits…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Seyed Mehdi Iranmanesh , Ali Dabouei , Nasser M. Nasrabadi

One challenging property lurking in medical datasets is the imbalanced data distribution, where the frequency of the samples between the different classes is not balanced. Training a model on an imbalanced dataset can introduce unique…

Image and Video Processing · Electrical Eng. & Systems 2022-04-06 Ashkan Khakzar , Yawei Li , Yang Zhang , Mirac Sanisoglu , Seong Tae Kim , Mina Rezaei , Bernd Bischl , Nassir Navab

Federated learning (FL), training deep models from decentralized data without privacy leakage, has shown great potential in medical image computing recently. However, considering the ubiquitous class imbalance in medical data, FL can…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Nannan Wu , Li Yu , Xin Yang , Kwang-Ting Cheng , Zengqiang Yan

Training with more data has always been the most stable and effective way of improving performance in deep learning era. As the largest object detection dataset so far, Open Images brings great opportunities and challenges for object…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Junran Peng , Xingyuan Bu , Ming Sun , Zhaoxiang Zhang , Tieniu Tan , Junjie Yan

Deep Convolutional Neural Networks (DCNNs) and their variants have been widely used in large scale face recognition(FR) recently. Existing methods have achieved good performance on many FR benchmarks. However, most of them suffer from two…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Jing Xu , Tszhang Guo , Yong Xu , Zenglin Xu , Kun Bai

Imbalanced learning occurs in classification settings where the distribution of class-labels is highly skewed in the training data, such as when predicting rare diseases or in fraud detection. This class imbalance presents a significant…

Machine Learning · Computer Science 2024-11-11 Lucas Rosenblatt , Yuliia Lut , Eitan Turok , Marco Avella-Medina , Rachel Cummings

Learning from imbalanced data is one of the most significant challenges in real-world classification tasks. In such cases, neural networks performance is substantially impaired due to preference towards the majority class. Existing…

Machine Learning · Computer Science 2022-11-13 Bronislav Yasinnik , Moshe Salhov , Ofir Lindenbaum , Amir Averbuch

Supervised deep learning methods are enjoying enormous success in many practical applications of computer vision and have the potential to revolutionize robotics. However, the marked performance degradation to biases and imbalanced data…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Aadarsh Sahoo , Ankit Singh , Rameswar Panda , Rogerio Feris , Abir Das