English
Related papers

Related papers: BCE3S: Binary Cross-Entropy Based Tripartite Syner…

200 papers

Contrastive representation learning has proven to be an effective self-supervised learning method. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as positives that should be…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault , Stéphane Canu

Brain-computer interfaces (BCIs) allow direct communication between the brain and external devices, frequently using electroencephalography (EEG) to record neural activity. Dimensionality reduction and structured regularization are…

Signal Processing · Electrical Eng. & Systems 2025-11-07 Arne Van Den Kerchove , Hakim Si-Mohammed , François Cabestaing , Marc M. Van Hulle

Solving long-tail large vocabulary object detection with deep learning based models is a challenging and demanding task, which is however under-explored.In this work, we provide the first systematic analysis on the underperformance of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-20 Yu Li , Tao Wang , Bingyi Kang , Sheng Tang , Chunfeng Wang , Jintao Li , Jiashi Feng

Semi-supervised learning (SSL), thanks to the significant reduction of data annotation costs, has been an active research topic for large-scale 3D scene understanding. However, the existing SSL-based methods suffer from severe training…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Mengtian Li , Shaohui Lin , Zihan Wang , Yunhang Shen , Baochang Zhang , Lizhuang Ma

Real-world data universally confronts a severe class-imbalance problem and exhibits a long-tailed distribution, i.e., most labels are associated with limited instances. The na\"ive models supervised by such datasets would prefer dominant…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Zhengzhuo Xu , Zenghao Chai , Chun Yuan

This paper proposes a way to combine the Mesh Adaptive Direct Search (MADS) algorithm with the Cross-Entropy (CE) method for non smooth constrained optimization. The CE method is used as a Search step by the MADS algorithm. The result of…

Optimization and Control · Mathematics 2023-08-15 Charles Audet , Romain Couderc , Jean Bigeon

Long-tailed datasets are very frequently encountered in real-world use cases where few classes or categories (known as majority or head classes) have higher number of data samples compared to the other classes (known as minority or tail…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Saptarshi Sinha , Hiroki Ohashi , Katsuyuki Nakamura

Binary Code Embedding (BCE) has important applications in various reverse engineering tasks such as binary code similarity detection, type recovery, control-flow recovery and data-flow analysis. Recent studies have shown that the…

Software Engineering · Computer Science 2023-08-25 Wenyu Zhu , Hao Wang , Yuchen Zhou , Jiaming Wang , Zihan Sha , Zeyu Gao , Chao Zhang

Loss functions play a central role in supervised classification. Cross-entropy (CE) is widely used, whereas the mean absolute error (MAE) loss can offer robustness but is difficult to optimize. Interpolating between the CE and MAE losses,…

Machine Learning · Statistics 2026-04-29 Kartheek Bondugula , Santiago Mazuelas , Aritz Pérez , Anqi Liu

Transfer learning (TL) has been widely used in motor imagery (MI) based brain-computer interfaces (BCIs) to reduce the calibration effort for a new subject, and demonstrated promising performance. While a closed-loop MI-based BCI system,…

Signal Processing · Electrical Eng. & Systems 2023-05-04 Dongrui Wu , Xue Jiang , Ruimin Peng , Wanzeng Kong , Jian Huang , Zhigang Zeng

Natural data are often long-tail distributed over semantic classes. Existing recognition methods tackle this imbalanced classification by placing more emphasis on the tail data, through class re-balancing/re-weighting or ensembling over…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Xudong Wang , Long Lian , Zhongqi Miao , Ziwei Liu , Stella X. Yu

Contrastive loss and triplet loss are widely used objectives in deep metric learning, yet their effects on representation quality remain insufficiently understood. We present a theoretical and empirical comparison of these losses, focusing…

Multimedia · Computer Science 2025-10-07 Donghuo Zeng

Class-incremental learning is dedicated to the development of deep learning models that are capable of acquiring new knowledge while retaining previously learned information. Most methods focus on balanced data distribution for each task,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Linjie Li , Zhenyu Wu , Jiaming Liu , Yang Ji

The imbalance (or long-tail) is the nature of many real-world data distributions, which often induces the undesirable bias of deep classification models toward frequent classes, resulting in poor performance for tail classes. In this paper,…

Machine Learning · Computer Science 2025-10-13 Fudong Lin , Xu Yuan

Skin image datasets often suffer from imbalanced data distribution, exacerbating the difficulty of computer-aided skin disease diagnosis. Some recent works exploit supervised contrastive learning (SCL) for this long-tailed challenge.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Yilan Zhang , Jianqi Chen , Ke Wang , Fengying Xie

Multi-Task Learning (MTL) aims to boost predictive performance by sharing information across related tasks, yet conventional methods often suffer from negative transfer when unrelated or noisy tasks are forced to share representations. We…

Machine Learning · Computer Science 2026-02-17 Seyedsaman Emami , Daniel Hernández-Lobato , Gonzalo Martínez-Muñoz

Long-tailed data is a special type of multi-class imbalanced data with a very large amount of minority/tail classes that have a very significant combined influence. Long-tailed learning aims to build high-performance models on datasets with…

Machine Learning · Computer Science 2024-08-02 Chongsheng Zhang , George Almpanidis , Gaojuan Fan , Binquan Deng , Yanbo Zhang , Ji Liu , Aouaidjia Kamel , Paolo Soda , João Gama

This paper describes one objective function for learning semantically coherent feature embeddings in multi-output classification problems, i.e., when the response variables have dimension higher than one. In particular, we consider the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Hugo Proença , Ehsan Yaghoubi , Pendar Alirezazadeh

Long-tailed distributions in class-imbalanced data present a fundamental challenge for deep learning models, which tend to be biased toward majority classes. While recent methods for long-tailed recognition have mitigated this issue, they…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Heegeon Yoon , Heeyoung Kim

The goal of Knowledge Tracing (KT) is to estimate how well students have mastered a concept based on their historical learning of related exercises. The benefit of knowledge tracing is that students' learning plans can be better organised…

Machine Learning · Computer Science 2022-01-25 Xiangyu Song , Jianxin Li , Qi Lei , Wei Zhao , Yunliang Chen , Ajmal Mian