English
Related papers

Related papers: Robust mislabel logistic regression without modeli…

200 papers

One important issue commonly encountered in the analysis of microarray data is to decide which and how many genes should be selected for further studies. For discriminant microarray data analyses based on statistical models, such as the…

Quantitative Methods · Quantitative Biology 2009-11-09 Wentian Li , Fengzhu Sun , Ivo Grosse

Although linear regression models are fundamental tools in statistical science, the estimation results can be sensitive to outliers. While several robust methods have been proposed in frequentist frameworks, statistical inference is not…

Methodology · Statistics 2020-07-15 Shintaro Hashimoto , Shonosuke Sugasawa

We apply the network Lasso to solve binary classification and clustering problems for network-structured data. To this end, we generalize ordinary logistic regression to non-Euclidean data with an intrinsic network structure. The resulting…

Machine Learning · Computer Science 2018-08-15 Henrik Ambos , Nguyen Tran , Alexander Jung

Many popular linear classifiers, such as logistic regression, boosting, or SVM, are trained by optimizing a margin-based risk function. Traditionally, these risk functions are computed based on a labeled dataset. We develop a novel…

Machine Learning · Computer Science 2010-07-23 Krishnakumar Balasubramanian , Pinar Donmez , Guy Lebanon

This paper considers the problem of matrix-variate logistic regression. It derives the fundamental error threshold on estimating low-rank coefficient matrices in the logistic regression problem by obtaining a lower bound on the minimax…

Machine Learning · Computer Science 2022-05-10 Batoul Taki , Mohsen Ghassemi , Anand D. Sarwate , Waheed U. Bajwa

We consider the problem of linear fitting of noisy data in the case of broad (say $\alpha$-stable) distributions of random impacts ("noise"), which can lack even the first moment. This situation, common in statistical physics of small…

Data Analysis, Statistics and Probability · Physics 2015-05-27 Eugene B. Postnikov , Igor M. Sokolov

A learned generative model often produces biased statistics relative to the underlying data distribution. A standard technique to correct this bias is importance sampling, where samples from the model are weighted by the likelihood ratio…

Machine Learning · Statistics 2019-11-05 Aditya Grover , Jiaming Song , Alekh Agarwal , Kenneth Tran , Ashish Kapoor , Eric Horvitz , Stefano Ermon

Robust inferential methods based on divergences measures have shown an appealing trade-off between efficiency and robustness in many different statistical models. In this paper, minimum density power divergence estimators (MDPDEs) for the…

Statistics Theory · Mathematics 2023-12-06 A. Felipe , M. Jaenada , P. Miranda , L. Pardo

Learning linear predictors with the logistic loss---both in stochastic and online settings---is a fundamental task in machine learning and statistics, with direct connections to classification and boosting. Existing "fast rates" for this…

Machine Learning · Computer Science 2018-12-17 Dylan J. Foster , Satyen Kale , Haipeng Luo , Mehryar Mohri , Karthik Sridharan

Incorrectly labelled training data are frustratingly ubiquitous in both benchmark and specially curated datasets. Such mislabelling clearly adversely affects the performance and generalizability of models trained through supervised learning…

Machine Learning · Computer Science 2025-11-27 Nicholas Pellegrino , David Szczecina , Paul Fieguth

Consider semi-supervised learning for classification, where both labeled and unlabeled data are available for training. The goal is to exploit both datasets to achieve higher prediction accuracy than just using labeled data alone. We…

Machine Learning · Statistics 2019-06-20 Xinwei Zhang , Zhiqiang Tan

Data imbalance is easily found in annotated data when the observations of certain continuous label values are difficult to collect for regression tasks. When they come to molecule and polymer property predictions, the annotated graph…

Machine Learning · Computer Science 2023-05-23 Gang Liu , Tong Zhao , Eric Inae , Tengfei Luo , Meng Jiang

Building classification models that predict a binary class label on the basis of high dimensional multi-omics datasets poses several challenges, due to the typically widely differing characteristics of the data layers in terms of number of…

Methodology · Statistics 2020-08-04 Alessandra Cabassi , Denis Seyres , Mattia Frontini , Paul D. W. Kirk

The tracking method based on the extreme learning machine (ELM) is efficient and effective. ELM randomly generates input weights and biases in the hidden layer, and then calculates and computes the output weights by reducing the iterative…

Machine Learning · Computer Science 2018-07-27 Jing Zhang , Huibing Wang , Yonggong Ren

The logistic regression analysis proposed by Schouten et al. (Stat Med. 1993;12:1733-1745) has been a standard method in current statistical analysis of case-cohort studies, and it enables effective estimation of risk ratio from selected…

Methodology · Statistics 2023-01-19 Hisashi Noma

Firth-type logistic regression has become a standard approach for the analysis of binary outcomes with small samples. Whereas it reduces the bias in maximum likelihood estimates of coefficients, bias towards 1/2 is introduced in the…

Methodology · Statistics 2021-01-20 Rainer Puhr , Georg Heinze , Mariana Nold , Lara Lusa , Angelika Geroldinger

In complex survey data, each sampled observation has assigned a sampling weight, indicating the number of units that it represents in the population. Whether sampling weights should or not be considered in the estimation process of model…

Methodology · Statistics 2024-09-20 Amaia Iparragirre , Irantzu Barrio , Jorge Aramendi , Inmaculada Arostegui

A solution to control for nonresponse bias consists of multiplying the design weights of respondents by the inverse of estimated response probabilities to compensate for the nonrespondents. Maximum likelihood and calibration are two…

Methodology · Statistics 2023-10-27 Caren Hasler

With the success of pre-trained visual-language (VL) models such as CLIP in visual representation tasks, transferring pre-trained models to downstream tasks has become a crucial paradigm. Recently, the prompt tuning paradigm, which draws…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Jingsheng Gao , Jiacheng Ruan , Suncheng Xiang , Zefang Yu , Ke Ji , Mingye Xie , Ting Liu , Yuzhuo Fu

This article introduces an iterative distributed computing estimator for the multinomial logistic regression model with large choice sets. Compared to the maximum likelihood estimator, the proposed iterative distributed estimator achieves…

Econometrics · Economics 2024-12-03 Yanqin Fan , Yigit Okar , Xuetao Shi