English
Related papers

Related papers: Scope Loss for Imbalanced Classification and RL Ex…

200 papers

This paper addresses the problem of visual feature representation learning with an aim to improve the performance of end-to-end reinforcement learning (RL) models. Specifically, a novel architecture is proposed that uses a heterogeneous…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Darshita Jain , Anima Majumder , Samrat Dutta , Swagat Kumar

Automated driving object detection has always been a challenging task in computer vision due to environmental uncertainties. These uncertainties include significant differences in object sizes and encountering the class unseen. It may…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zezhou Wang , Guitao Cao , Xidong Xi , Jiangtao Wang

Neural networks can be trained to solve regression problems by using gradient-based methods to minimize the square loss. However, practitioners often prefer to reformulate regression as a classification problem, observing that training on…

Machine Learning · Computer Science 2023-03-02 Lawrence Stewart , Francis Bach , Quentin Berthet , Jean-Philippe Vert

In the last several years, the intimate connection between convex optimization and learning problems, in both statistical and sequential frameworks, has shifted the focus of algorithmic machine learning to examine this interplay. In…

Machine Learning · Computer Science 2014-07-23 Mehrdad Mahdavi

Class imbalance, where certain classes have insufficient data, poses a critical challenge for robust classification, often biasing models toward majority classes. Distribution calibration offers a promising avenue to address this by…

Machine Learning · Computer Science 2025-10-23 Priyobrata Mondal , Faizanuddin Ansari , Swagatam Das

Supervised learning is often computationally easy in practice. But to what extent does this mean that other modes of learning, such as reinforcement learning (RL), ought to be computationally easy by extension? In this work we show the…

Machine Learning · Computer Science 2024-04-08 Noah Golowich , Ankur Moitra , Dhruv Rohatgi

In this paper we explore methods to exploit symmetries for ensuring sample efficiency in reinforcement learning (RL), this problem deserves ever increasing attention with the recent advances in the use of deep networks for complex RL tasks…

Machine Learning · Statistics 2017-06-12 Anuj Mahajan , Theja Tulabandhula

Most state-of-the-art computer vision models heavily depend on data. However, many datasets exhibit extreme class imbalance which has been shown to negatively impact model performance. Among the training-time and data-generation solutions…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Indu Panigrahi , Richard Zhu

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

Graph representation learning has long been an important yet challenging task for various real-world applications. However, their downstream tasks are mainly performed in the settings of supervised or semi-supervised learning. Inspired by…

Machine Learning · Computer Science 2021-04-14 Shiyi Chen , Ziao Wang , Xinni Zhang , Xiaofeng Zhang , Dan Peng

A toy model of binary classification is studied with the aim of clarifying the class-wise resampling/reweighting effect on the feature learning performance under the presence of class imbalance. In the analysis, a high-dimensional limit of…

Machine Learning · Statistics 2025-04-23 Tomoyuki Obuchi , Toshiyuki Tanaka

In order to push the performance on realistic computer vision tasks, the number of classes in modern benchmark datasets has significantly increased in recent years. This increase in the number of classes comes along with increased ambiguity…

Machine Learning · Statistics 2016-04-14 Maksim Lapin , Matthias Hein , Bernt Schiele

Semi-Supervised Learning (SSL) has achieved great success in overcoming the difficulties of labeling and making full use of unlabeled data. However, SSL has a limited assumption that the numbers of samples in different classes are balanced,…

Machine Learning · Computer Science 2020-02-18 Minsung Hyun , Jisoo Jeong , Nojun Kwak

We address the problem of general supervised learning when data can only be accessed through an (indefinite) similarity function between data points. Existing work on learning with indefinite kernels has concentrated solely on…

Machine Learning · Computer Science 2012-10-23 Purushottam Kar , Prateek Jain

The accuracy of deep learning methods for two foundational tasks in medical image analysis -- detection and segmentation -- can suffer from class imbalance. We propose a `switching loss' function that adaptively shifts the emphasis between…

Image and Video Processing · Electrical Eng. & Systems 2020-08-11 Deepak Anand , Gaurav Patel , Yaman Dang , Amit Sethi

We consider the problem of reinforcement learning under safety requirements, in which an agent is trained to complete a given task, typically formalized as the maximization of a reward signal over time, while concurrently avoiding…

Machine Learning · Computer Science 2018-09-25 Tu-Hoa Pham , Giovanni De Magistris , Don Joven Agravante , Subhajit Chaudhury , Asim Munawar , Ryuki Tachibana

Class imbalance, which is also called long-tailed distribution, is a common problem in classification tasks based on machine learning. If it happens, the minority data will be overwhelmed by the majority, which presents quite a challenge…

Machine Learning · Computer Science 2023-03-29 Jia-Chen Zhao

Labeling a training set is often expensive and susceptible to errors, making the design of robust loss functions for label noise an important problem. The symmetry condition provides theoretical guarantees for robustness to such noise. In…

Machine Learning · Computer Science 2026-05-21 Alexandre Lemire Paquin , Brahim Chaib-Draa , Philippe Giguère

Synthetic oversampling of minority examples using SMOTE and its variants is a leading strategy for addressing imbalanced classification problems. Despite the success of this approach in practice, its theoretical foundations remain…

Machine Learning · Statistics 2025-10-24 Touqeer Ahmad , Mohammadreza M. Kalan , François Portier , Gilles Stupfler

The overarching goal of this paper is to derive excess risk bounds for learning from exp-concave loss functions in passive and sequential learning settings. Exp-concave loss functions encompass several fundamental problems in machine…

Machine Learning · Computer Science 2014-02-11 Mehrdad Mahdavi , Rong Jin