English
Related papers

Related papers: Delta divergence: A novel decision cognizant measu…

200 papers

Class imbalance poses a significant challenge in classification tasks, where traditional approaches often lead to biased models and unreliable predictions. Undersampling and oversampling techniques have been commonly employed to address…

Machine Learning · Computer Science 2025-10-22 Matt Clifford , Jonathan Erskine , Alexander Hepburn , Raúl Santos-Rodríguez , Dario Garcia-Garcia

We propose new nonparametric accordance R\'enyi-$\alpha$ and $\alpha$-Tsallis divergence estimators for continuous distributions. We discuss this approach with a view to the selection model (on al\'etoire and autoregressive AR (1)). We…

Methodology · Statistics 2014-01-22 Hamza Dhaker , Papa Ngom , Pierre Mendy

In novelty detection, the goal is to decide if a new data point should be categorized as an inlier or an outlier, given a training dataset that primarily captures the inlier distribution. Recent approaches typically use deep encoder and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Muhammad Asad , Ihsan Ullah , Ganesh Sistu , Michael G. Madden

Anomaly detection aims at detecting unexpected behaviours in the data. Because anomaly detection is usually an unsupervised task, traditional anomaly detectors learn a decision boundary by employing heuristics based on intuitions, which are…

Machine Learning · Computer Science 2023-10-19 Lorenzo Perini , Jesse Davis

Measuring inconsistency is viewed as an important issue related to handling inconsistencies. Good measures are supposed to satisfy a set of rational properties. However, defining sound properties is sometimes problematic. In this paper, we…

Artificial Intelligence · Computer Science 2014-06-03 Said Jabbour , Yue Ma , Badran Raddaoui , Lakhdar Sais , Yakoub Salhi

Divergences are quantities that measure discrepancy between two probability distributions and play an important role in various fields such as statistics and machine learning. Divergences are non-negative and are equal to zero if and only…

Statistics Theory · Mathematics 2019-10-22 Tomohiro Nishiyama

Novel class discovery (NCD) aims at learning a model that transfers the common knowledge from a class-disjoint labelled dataset to another unlabelled dataset and discovers new classes (clusters) within it. Many methods, as well as elaborate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Wenbin Li , Zhichen Fan , Jing Huo , Yang Gao

Classification with rejection emerges as a learning paradigm which allows models to abstain from making predictions. The predominant approach is to alter the supervised learning pipeline by augmenting typical loss functions, letting model…

Machine Learning · Statistics 2025-05-09 Alexander Soen , Hisham Husain , Philip Schulz , Vu Nguyen

Training of deep neural networks heavily depends on the data distribution. In particular, the networks easily suffer from class imbalance. The trained networks would recognize the frequent classes better than the infrequent classes. To…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Byungju Kim , Junmo Kim

The property of conformal predictors to guarantee the required accuracy rate makes this framework attractive in various practical applications. However, this property is achieved at a price of reduction in precision. In the case of…

Machine Learning · Computer Science 2021-08-13 Marharyta Aleksandrova , Oleg Chertov

The advent of modern data collection and processing techniques has seen the size, scale, and complexity of data grow exponentially. A seminal step in leveraging these rich datasets for downstream inference is understanding the…

Applications · Statistics 2024-07-30 Zeyi Wang , Eric Bridgeford , Shangsi Wang , Joshua T. Vogelstein , Brian Caffo

The random cluster model is used to define an upper bound on a distance measure as a function of the number of data points to be classified and the expected value of the number of classes to form in a hybrid K-means and regression…

Machine Learning · Computer Science 2016-02-12 Robert A. Murphy

Deep anomaly detection (AD) aims to provide robust and efficient classifiers for one-class and unbalanced settings. However current AD models still struggle on edge-case normal samples and are often unable to keep high performance over…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Loic Jezequel , Ngoc-Son Vu , Jean Beaudet , Aymeric Histace

As performance gains through scaling data and/or model size experience diminishing returns, it is becoming increasingly popular to turn to ensembling, where the predictions of multiple models are combined to improve accuracy. In this paper,…

Machine Learning · Statistics 2024-11-04 Hyunsuk Kim , Liam Hodgkinson , Ryan Theisen , Michael W. Mahoney

This thesis develops a new divergence that generalizes relative entropy and can be used to compare probability measures without a requirement of absolute continuity. We establish properties of the divergence, and in particular derive and…

Probability · Mathematics 2020-11-18 Yixiang Mao

Saliency methods are widely used to visualize which input features are deemed relevant to a model's prediction. However, their visual plausibility can obscure critical limitations. In this work, we propose a diagnostic test for class…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Dane Williamson , Yangfeng Ji , Matthew Dwyer

Proper quantification of predictive uncertainty is essential for the use of machine learning in safety-critical applications. Various uncertainty measures have been proposed for this purpose, typically claiming superiority over other…

Machine Learning · Computer Science 2025-12-16 Paul Hofman , Yusuf Sale , Eyke Hüllermeier

A new entanglement measure, which is called D-concurrence, is proposed. Then the upper and lower bounds for D-concurrence are obtained and the relationship between D-concurrence and the usual concurrence of Wootters was established. In…

Quantum Physics · Physics 2009-11-02 ZhiHao Ma , Xiao-Dong Zhang

Anomaly detection is a branch of data analysis and machine learning which aims at identifying observations that exhibit abnormal behaviour. Be it measurement errors, disease development, severe weather, production quality default(s) (items)…

Machine Learning · Statistics 2024-07-11 Pavlo Mozharovskyi , Romain Valla

As a data-driven method, the performance of deep convolutional neural networks (CNN) relies heavily on training data. The prediction results of traditional networks give a bias toward larger classes, which tend to be the background in the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 N. Anantrasirichai , David Bull