English
Related papers

Related papers: A new First-Order mixture integer-valued threshold…

200 papers

We study the local statistics of orthogonal polynomial ensembles near a hard edge, subject to a multiplicative deformation of the measure. Probabilistically, this deformation corresponds to a position-dependent conditional thinning of the…

Mathematical Physics · Physics 2026-02-23 Leslie Molag , Guilherme L. F. Silva , Lun Zhang

Orthogonal least square (OLS) is an important sparse signal recovery algorithm for compressive sensing, which enjoys superior probability of success over other well-known recovery algorithms under conditions of correlated measurement…

Information Theory · Computer Science 2018-08-02 Samrat Mukhopadhyay , Siddhartha Satpathi , Mrityunjoy Chakraborty

To conduct regression analysis for data contaminated with outliers, many approaches have been proposed for simultaneous outlier detection and robust regression, so is the approach proposed in this manuscript. This new approach is called…

Methodology · Statistics 2016-03-25 Xiaoli Gao , Yixin Fang

Model order selection (MOS) in linear regression models is a widely studied problem in signal processing. Techniques based on information theoretic criteria (ITC) are algorithms of choice in MOS problems. This article proposes a novel…

Information Theory · Computer Science 2019-01-30 Sreejith Kallummil , Sheetal Kalyani

This paper proposes a piecewise autoregression for general integer-valued time series. The conditional mean of the process depends on a parameter which is piecewise constant over time. We derive an inference procedure based on a penalized…

Statistics Theory · Mathematics 2019-11-05 Mamadou Lamine Diop , William Kengne

Output thresholding is the technique to search for the best threshold to be used during inference for any classifiers that can produce probability estimates on train and testing datasets. It is particularly useful in high imbalance…

Machine Learning · Computer Science 2024-05-21 Baran Koseoglu , Luca Traverso , Mohammed Topiwalla , Egor Kraev , Zoltan Szopory

This paper presents a minimalist neural regression network as an aggregate of independent identical regression blocks that are trained simultaneously. Moreover, it introduces a new multiplicative parameter, shared by all the neural units of…

Machine Learning · Computer Science 2016-07-06 Soheil Keshmiri

Robust estimators and Wald-type tests are developed for the multinomial logistic regression based on $\phi$-divergence measures. The robustness of the proposed estimators and tests is proved through the study of their influence functions…

Statistics Theory · Mathematics 2021-02-08 Elena Castilla , Pedro J. Chocano

This work provides the first finite-time convergence guarantees for linearly constrained stochastic bilevel optimization using only first-order methods, requiring solely gradient information without any Hessian computations or second-order…

Optimization and Control · Mathematics 2025-11-18 Cac Phan , Kai Wang

Learning invariant representations is a critical first step in a number of machine learning tasks. A common approach corresponds to the so-called information bottleneck principle in which an application dependent function of mutual…

Machine Learning · Computer Science 2021-02-17 Aditya Kumar Akash , Vishnu Suresh Lokhande , Sathya N. Ravi , Vikas Singh

Vector autoregressive (VAR) processes are ubiquitously used in economics, finance, and biology. Order selection is an essential step in fitting VAR models. While many order selection methods exist, all come with weaknesses. Order selection…

Methodology · Statistics 2025-11-26 Michael Hellstern , Ali Shojaie

We present exact mixed-integer linear programming formulations for verifying the performance of first-order methods for parametric quadratic optimization. We formulate the verification problem as a mixed-integer linear program where the…

Optimization and Control · Mathematics 2026-05-29 Vinit Ranjan , Jisun Park , Stefano Gualandi , Andrea Lodi , Bartolomeo Stellato

In this paper, we study chance constrained mixed integer program with consideration of recourse decisions and their incurred cost, developed on a finite discrete scenario set. Through studying a non-traditional bilinear mixed integer…

Optimization and Control · Mathematics 2016-10-05 Bo Zeng , Yu An , Ludwig Kuznia

We propose Conformal Mixed-Integer Constraint Learning (C-MICL), a novel framework that provides probabilistic feasibility guarantees for data-driven constraints in optimization problems. While standard Mixed-Integer Constraint Learning…

Machine Learning · Computer Science 2025-06-05 Daniel Ovalle , Lorenz T. Biegler , Ignacio E. Grossmann , Carl D. Laird , Mateo Dulce Rubio

Multinomial processing tree (MPT) models are tools for disentangling the contributions of latent cognitive processes in a given experimental paradigm. The present note analyzes MPT models subject to order constraints on subsets of its…

Applications · Statistics 2014-11-11 Karl Christoph Klauer , Henrik Singmann , David Kellen

We introduce the implicitly constrained least squares (ICLS) classifier, a novel semi-supervised version of the least squares classifier. This classifier minimizes the squared loss on the labeled data among the set of parameters implied by…

Machine Learning · Statistics 2017-01-31 Jesse H. Krijthe , Marco Loog

A new method for analyzing high-dimensional categorical data, Linear Latent Structure (LLS) analysis, is presented. LLS models belong to the family of latent structure models, which are mixture distribution models constrained to satisfy the…

Probability · Mathematics 2007-06-13 Mikhail Kovtun , Igor Akushevich , Kenneth G. Manton , H. Dennis Tolley

Penalized logistic regression methods are frequently used to investigate the relationship between a binary outcome and a set of explanatory variables. The model performance can be assessed by measures such as the concordance statistic…

Methodology · Statistics 2021-01-20 Angelika Geroldinger , Lara Lusa , Mariana Nold , Georg Heinze

We introduce a detailed analysis of the convergence of first-order methods with composite noise (sum of relative and absolute) in gradient for convex and smooth function minimization. This paper illustrates instances of practical problems…

Optimization and Control · Mathematics 2026-03-16 Artem Vasin , Alexander Gasnikov

The graphical lasso is a widely used algorithm for fitting undirected Gaussian graphical models. However, for inference on functionals of edge values in the learned graph, standard tools lack formal statistical guarantees, such as control…

Methodology · Statistics 2025-04-01 Sofia Guglielmini , Gerda Claeskens , Snigdha Panigrahi