English
Related papers

Related papers: An efficient Fisher-scoring algorithm for fitting …

200 papers

The widespread use of maximum Jeffreys'-prior penalized likelihood in binomial-response generalized linear models, and in logistic regression, in particular, are supported by the results of Kosmidis and Firth (2021, Biometrika), who show…

Methodology · Statistics 2024-06-10 Patrick Zietkiewicz , Ioannis Kosmidis

Fisher-consistent loss functions play a fundamental role in the construction of successful binary margin-based classifiers. In this paper we establish the Fisher-consistency condition for multicategory classification problems. Our approach…

Applications · Statistics 2009-01-27 Hui Zou , Ji Zhu , Trevor Hastie

Uncertainty estimation is a key factor that makes deep learning reliable in practical applications. Recently proposed evidential neural networks explicitly account for different uncertainties by treating the network's outputs as evidence to…

Machine Learning · Computer Science 2023-07-03 Danruo Deng , Guangyong Chen , Yang Yu , Furui Liu , Pheng-Ann Heng

We present a semi-supervised learning algorithm for learning discrete factor analysis models with arbitrary structure on the latent variables. Our algorithm assumes that every latent variable has an "anchor", an observed variable with only…

Machine Learning · Statistics 2015-11-12 Yoni Halpern , Steven Horng , David Sontag

In many statistical problems, the data distribution is specified through a generative process for which the likelihood function is analytically intractable, yet inference on the associated model parameters remains of primary interest. We…

Methodology · Statistics 2026-04-01 Haoyu Jiang , Yuexi Wang , Yun Yang

In observational studies, propensity scores are commonly estimated by maxi- mum likelihood but may fail to balance high-dimensional pre-treatment covariates even after specification search. We introduce a general framework that unifies and…

Methodology · Statistics 2017-03-22 Qingyuan Zhao

In this paper we present an unsupervised method to learn the weights with which the scores of multiple classifiers must be combined in classifier fusion settings. We also introduce a novel metric for ranking instances based on an index…

Machine Learning · Computer Science 2015-02-09 Anurag Kumar , Bhiksha Raj

Fisher Discriminant Analysis (FDA) is a subspace learning method which minimizes and maximizes the intra- and inter-class scatters of data, respectively. Although, in FDA, all the pairs of classes are treated the same way, some classes are…

Machine Learning · Statistics 2020-07-01 Benyamin Ghojogh , Milad Sikaroudi , H. R. Tizhoosh , Fakhri Karray , Mark Crowley

We study the problem of estimating a continuous ability parameter from sequential binary responses by actively asking questions with varying difficulties, a setting that arises naturally in adaptive testing and online preference learning.…

Machine Learning · Statistics 2025-10-10 Sanghwa Kim , Dohyun Ahn , Seungki Min

This paper introduces a novel approach to active feature acquisition for classification, which is the task of sequentially selecting the most informative subset of features to achieve optimal prediction performance during testing while…

Machine Learning · Computer Science 2023-06-27 Ali Mirzaei , Vahid Pourahmadi , Hamid Sheikhzadeh , Alireza Abdollahpourrostam

Linear mixed models are widely used to analyze non-independent data, but inference for fixed effects can be unreliable under misspecification of the random-effects distribution, inaccurate Fisher information estimation, or convergence…

Methodology · Statistics 2026-05-01 Angela Andreella , Livio Finos

Matrix valued data has become increasingly prevalent in many applications. Most of the existing clustering methods for this type of data are tailored to the mean model and do not account for the dependence structure of the features, which…

Machine Learning · Statistics 2023-12-07 Inbeom Lee , Siyi Deng , Yang Ning

Fisher's Method of Maximum Likelihood is shown to be a procedure for the construction of likelihood intervals or regions, instead of a procedure of point estimation. Based on Fisher's articles and books it is justified that by estimation…

Statistics Theory · Mathematics 2008-07-23 Esa Uusipaikka

We examine a special case of the multilevel factor model, with covariance given by multilevel low rank (MLR) matrix~\cite{parshakova2023factor}. We develop a novel, fast implementation of the expectation-maximization algorithm, tailored for…

Machine Learning · Statistics 2025-08-26 Tetiana Parshakova , Trevor Hastie , Stephen Boyd

In this paper, we introduce a novel methodology for characterising the performance of deep learning networks (ResNets and DenseNet) with respect to training convergence and generalisation as a function of mini-batch size and learning rate…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Zhibin Liao , Tom Drummond , Ian Reid , Gustavo Carneiro

We establish parameter inference for the Poisson canonical polyadic (PCP) model of tensor count data through a latent-variable formulation. Our approach exploits the property that any random tensor that follows the PCP model can be derived…

Statistics Theory · Mathematics 2025-11-26 Carlos Llosa-Vite , Daniel M. Dunlavy , Richard B. Lehoucq , Oscar López , Arvind Prasadan

We propose a class of models based on Fisher's Linear Discriminant (FLD) in the context of domain adaptation. The class is the convex combination of two hypotheses: i) an average hypothesis representing previously seen source tasks and ii)…

Signal Processing · Electrical Eng. & Systems 2024-03-05 Hayden S. Helm , Ashwin De Silva , Joshua T. Vogelstein , Carey E. Priebe , Weiwei Yang

Gravitational-wave astronomers often wish to characterize the expected parameter-estimation accuracy of future observations. The Fisher matrix provides a lower bound on the spread of the maximum-likelihood estimator across noise…

General Relativity and Quantum Cosmology · Physics 2011-11-08 Michele Vallisneri

Many real-world optimization problems contain parameters that are unknown before deployment time, either due to stochasticity or to lack of information (e.g., demand or travel times in delivery problems). A common strategy in such cases is…

Connectivity estimation is challenging in the context of high-dimensional data. A useful preprocessing step is to group variables into clusters, however, it is not always clear how to do so from the perspective of connectivity estimation.…

Machine Learning · Statistics 2018-05-25 Ricardo Pio Monti , Aapo Hyvärinen