English
Related papers

Related papers: Enhancing Cross Entropy with a Linearly Adaptive L…

200 papers

Conformal inference provides a rigorous statistical framework for uncertainty quantification in machine learning, enabling well-calibrated prediction sets with precise coverage guarantees for any classification model. However, its reliance…

Collecting labeled data is costly and thus a critical bottleneck in real-world classification tasks. To mitigate this problem, we propose a novel setting, namely learning from complementary labels for multi-class classification. A…

Machine Learning · Statistics 2017-11-15 Takashi Ishida , Gang Niu , Weihua Hu , Masashi Sugiyama

Standard cross-entropy is the default classification loss across virtually all of machine learning, yet it treats all misclassifications equally, ignoring the semantic distances that a class hierarchy encodes. We propose Hierarchy-Aware…

Machine Learning · Computer Science 2026-05-08 April Chan , Davide D'Ascenzo , Sebastiano Cultrera di Montesano

We propose "collision cross-entropy" as a robust alternative to Shannon's cross-entropy (CE) loss when class labels are represented by soft categorical distributions y. In general, soft labels can naturally represent ambiguous targets in…

Machine Learning · Computer Science 2023-11-30 Zhongwen Zhang , Yuri Boykov

Changepoint detection is commonly formulated by minimizing the sum of in-sample losses to quantify the model's overall fit. However, for flexible modeling procedures -- especially those involving high-dimensional parameter spaces or…

Methodology · Statistics 2026-05-05 Chengde Qian , Guanghui Wang , Zhaojun Wang , Changliang Zou

Automatic modulation classification enables intelligent communications and it is of crucial importance in today's and future wireless communication networks. Although many automatic modulation classification schemes have been proposed, they…

Signal Processing · Electrical Eng. & Systems 2021-06-01 Hao Zhang , Fuhui Zhou , Qihui Wu , Wei Wu , Rose Qingyang Hu

Imbalanced datasets pose a considerable challenge in training deep learning (DL) models for medical diagnostics, particularly for segmentation tasks. Imbalance may be associated with annotation quality limited annotated datasets, rare…

Image and Video Processing · Electrical Eng. & Systems 2025-04-08 Bashir Alam , Masa Cirkovic , Mete Harun Akcay , Md Kaf Shahrier , Sebastien Lafond , Hergys Rexha , Kurt Benke , Sepinoud Azimi , Janan Arslan

In a recent paper, the authors proposed a general methodology for probabilistic learning on manifolds. The method was used to generate numerical samples that are statistically consistent with an existing dataset construed as a realization…

Probability · Mathematics 2018-03-30 C. Soizea , R. Ghanem , C. Safta , X. Huan , Z. P. Vane , J. Oefelein , G. Lacaz , H. N. Najm , Q. Tang , X. Chen

Cross-modal retrieval aims to learn discriminative and modal-invariant features for data from different modalities. Unlike the existing methods which usually learn from the features extracted by offline networks, in this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Longlong Jing , Elahe Vahdani , Jiaxing Tan , Yingli Tian

Multi-task learning (MTL) is an active field in deep learning in which we train a model to jointly learn multiple tasks by exploiting relationships between the tasks. It has been shown that MTL helps the model share the learned features…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Akihiro Nakano , Shi Chen , Kazuyuki Demachi

We consider the use of machine learning for hypothesis testing with an emphasis on target detection. Classical model-based solutions rely on comparing likelihoods. These are sensitive to imperfect models and are often computationally…

Machine Learning · Computer Science 2022-06-14 Tzvi Diskin , Uri Okun , Ami Wiesel

In this paper, we study bidirectional LSTM network for the task of text classification using both supervised and semi-supervised approaches. Several prior works have suggested that either complex pretraining schemes using unsupervised…

Computation and Language · Computer Science 2020-09-10 Devendra Singh Sachan , Manzil Zaheer , Ruslan Salakhutdinov

This paper deals with the estimation of rare event probabilities using importance sampling (IS), where an optimal proposal distribution is computed with the cross-entropy (CE) method. Although, IS optimized with the CE method leads to an…

Computation · Statistics 2020-02-05 Patrick Héas

Measuring dataset similarity is fundamental in machine learning, particularly for transfer learning and domain adaptation. In the context of supervised learning, most existing approaches quantify similarity of two data sets based on their…

Machine Learning · Statistics 2026-04-22 Shudong Sun , Hao Helen Zhang , Joseph C Watkins

Translation-based embedding models have gained significant attention in link prediction tasks for knowledge graphs. TransE is the primary model among translation-based embeddings and is well-known for its low complexity and high efficiency.…

Computation and Language · Computer Science 2019-07-12 Mojtaba Nayyeri , Xiaotian Zhou , Sahar Vahdati , Hamed Shariat Yazdi , Jens Lehmann

There is a family of label modification approaches including self and non-self label correction (LC), and output regularisation. They are widely used for training robust deep neural networks (DNNs), but have not been mathematically and…

Machine Learning · Computer Science 2022-09-07 Xinshao Wang , Yang Hua , Elyor Kodirov , Sankha Subhra Mukherjee , David A. Clifton , Neil M. Robertson

This paper introduces the concept of uniform classification, which employs a unified threshold to classify all samples rather than adaptive threshold classifying each individual sample. We also propose the uniform classification accuracy as…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Qiufu Li , Xi Jia , Jiancan Zhou , Linlin Shen , Jinming Duan

Class-imbalanced node classification tasks are prevalent in real-world scenarios. Due to the uneven distribution of nodes across different classes, learning high-quality node representations remains a challenging endeavor. The engineering…

Machine Learning · Computer Science 2024-05-24 Xinyu Guo , Kai Wu , Xiaoyu Zhang , Jing Liu

Machine learning classifiers rely on loss functions for performance evaluation, often on a private (hidden) dataset. In a recent line of research, label inference was introduced as the problem of reconstructing the ground truth labels of…

Machine Learning · Computer Science 2021-11-02 Abhinav Aggarwal , Shiva Prasad Kasiviswanathan , Zekun Xu , Oluwaseyi Feyisetan , Nathanael Teissier

A weakly-supervised learning framework named as complementary-label learning has been proposed recently, where each sample is equipped with a single complementary label that denotes one of the classes the sample does not belong to. However,…

Machine Learning · Statistics 2020-07-24 Yuzhou Cao , Shuqi Liu , Yitian Xu