English
Related papers

Related papers: Improving Multi-class Classifier Using Likelihood …

200 papers

Under a multinormal distribution with an arbitrary unknown covariance matrix, the main purpose of this paper is to propose a framework to achieve the goal of reconciliation of Bayesian, frequentist, and Fisher's reporting $p$-values,…

Statistics Theory · Mathematics 2024-12-10 Ming-Tien Tsai

Labeling mistakes are frequently encountered in real-world applications. If not treated well, the labeling mistakes can deteriorate the classification performances of a model seriously. To address this issue, we propose an improved Naive…

Machine Learning · Computer Science 2023-04-14 Qianhan Zeng , Yingqiu Zhu , Xuening Zhu , Feifei Wang , Weichen Zhao , Shuning Sun , Meng Su , Hansheng Wang

Downsampling or under-sampling is a technique that is utilized in the context of large and highly imbalanced classification models. We study optimal downsampling for imbalanced classification using generalized linear models (GLMs). We…

Machine Learning · Statistics 2025-05-20 Yan Chen , Jose Blanchet , Krzysztof Dembczynski , Laura Fee Nern , Aaron Flores

The likelihood ratio (LR) is largely used to evaluate the relative weight of forensic data regarding two hypotheses and for its assessment Bayesian methods are widespread in the forensic field. However, the Bayesian `recipe' for the LR…

Applications · Statistics 2016-04-14 Giulia Cereda

Learning with noisy labels has gained increasing attention because the inevitable imperfect labels in real-world scenarios can substantially hurt the deep model performance. Recent studies tend to regard low-loss samples as clean ones and…

Machine Learning · Computer Science 2024-02-20 Huafeng Liu , Mengmeng Sheng , Zeren Sun , Yazhou Yao , Xian-Sheng Hua , Heng-Tao Shen

Class-imbalanced data, in which some classes contain far more samples than others, is ubiquitous in real-world applications. Standard techniques for handling class-imbalance usually work by training on a re-weighted loss or on re-balanced…

Artificial Intelligence · Computer Science 2021-06-18 Arpit Bansal , Micah Goldblum , Valeriia Cherepanova , Avi Schwarzschild , C. Bayan Bruss , Tom Goldstein

Recently, many improved naive Bayes methods have been developed with enhanced discrimination capabilities. Among them, regularized naive Bayes (RNB) produces excellent performance by balancing the discrimination power and generalization…

Machine Learning · Computer Science 2023-04-19 Shihe Wang , Jianfeng Ren , Ruibin Bai

Class imbalance in real-world data poses a common bottleneck for machine learning tasks, since achieving good generalization on under-represented examples is often challenging. Mitigation strategies, such as under or oversampling the data…

Disordered Systems and Neural Networks · Physics 2025-02-03 Emanuele Loffredo , Mauro Pastore , Simona Cocco , Rémi Monasson

Recent years have witnessed a great success of supervised deep learning, where predictive models were trained from a large amount of fully labeled data. However, in practice, labeling such big data can be very costly and may not even be…

Machine Learning · Computer Science 2022-10-18 Yuting Tang , Nan Lu , Tianyi Zhang , Masashi Sugiyama

Linear discrimination, from the point of view of numerical linear algebra, can be treated as solving an ill-posed system of linear equations. In order to generate a solution that is robust in the presence of noise, these problems require…

Genomics · Quantitative Biology 2007-05-23 Erik Andries , Thomas Hagstrom , Susan R. Atlas , Cheryl Willman

In a broad range of classification and decision making problems, one is given the advice or predictions of several classifiers, of unknown reliability, over multiple questions or queries. This scenario is different from the standard…

Machine Learning · Statistics 2014-02-07 Fabio Parisi , Francesco Strino , Boaz Nadler , Yuval Kluger

Fundamental machine learning theory shows that different samples contribute unequally both in learning and testing processes. Contemporary studies on DNN imply that such sample difference is rooted on the distribution of intrinsic pattern…

Machine Learning · Computer Science 2021-08-19 Chi Zhang , Xiaoning Ma , Yu Liu , Le Wang , Yuanqi Su , Yuehu Liu

Standard regularization methods that are used to compute solutions to ill-posed inverse problems require knowledge of the forward model. In many real-life applications, the forward model is not known, but training data is readily available.…

Numerical Analysis · Mathematics 2015-06-19 Julianne Chung , Matthias Chung

Imbalanced datasets present a significant challenge for machine learning models, often leading to biased predictions. To address this issue, data augmentation techniques are widely used in natural language processing (NLP) to generate new…

Computation and Language · Computer Science 2023-04-21 Gabriel O. Assunção , Rafael Izbicki , Marcos O. Prates

As instruction-tuned large language models (LLMs) evolve, aligning pretrained foundation models presents increasing challenges. Existing alignment strategies, which typically leverage diverse and high-quality data sources, often overlook…

Computation and Language · Computer Science 2024-06-10 Yikun Wang , Rui Zheng , Liang Ding , Qi Zhang , Dahua Lin , Dacheng Tao

The recent success of machine learning models, especially large-scale classifiers and language models, relies heavily on training with massive data. These data are often collected from online sources. This raises serious concerns about the…

Artificial Intelligence · Computer Science 2025-11-12 Ruihan Zhang , Jun Sun , Ee-Peng Lim , Peixin Zhang

Class imbalance in binary classification tasks remains a significant challenge in machine learning, often resulting in poor performance on minority classes. This study comprehensively evaluates three widely-used strategies for handling…

Machine Learning · Computer Science 2024-10-01 Mohamed Abdelhamid , Abhyuday Desai

Despite the recent advances in abstractive text summarization, current summarization models still suffer from generating factually inconsistent summaries, reducing their utility for real-world application. We argue that the main reason for…

Computation and Language · Computer Science 2023-10-16 Polina Zablotskaia , Misha Khalman , Rishabh Joshi , Livio Baldini Soares , Shoshana Jakobovits , Joshua Maynez , Shashi Narayan

Class-imbalance is a common problem in machine learning practice. Typical Imbalanced Learning (IL) methods balance the data via intuitive class-wise resampling or reweighting. However, previous studies suggest that beyond class-imbalance,…

Machine Learning · Computer Science 2022-11-24 Zhining Liu , Pengfei Wei , Zhepei Wei , Boyang Yu , Jing Jiang , Wei Cao , Jiang Bian , Yi Chang

Recently, deep learning models have achieved great success in computer vision applications, relying on large-scale class-balanced datasets. However, imbalanced class distributions still limit the wide applicability of these models due to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Yechan Kim , Younkwan Lee , Moongu Jeon