English
Related papers

Related papers: SLOE: A Faster Method for Statistical Inference in…

200 papers

Strongly log-concave (SLC) distributions are a rich class of discrete probability distributions over subsets of some ground set. They are strictly more general than strongly Rayleigh (SR) distributions such as the well-known determinantal…

Machine Learning · Computer Science 2019-06-14 Joshua Robinson , Suvrit Sra , Stefanie Jegelka

In statistics and machine learning, logistic regression is a widely-used supervised learning technique primarily employed for binary classification tasks. When the number of observations greatly exceeds the number of predictor variables, we…

Machine Learning · Statistics 2024-04-02 Agniva Chowdhury , Pradeep Ramuhalli

To address the problem of multicollinearity in the logistic regression model, in this paper we propose a new estimator called Stochastic restricted almost unbiased logistic Liu-estimator (SRAULLE) when the prior information is available in…

Statistics Theory · Mathematics 2017-11-29 Nagarajah Varathan , Pushpakanthie Wijekoon

There are many practical applications based on the Least Square Error (LSE) approximation. It is based on a square error minimization 'on a vertical' axis. The LSE method is simple and easy also for analytical purposes. However, if data…

Graphics · Computer Science 2018-02-22 Vaclav Skala

Multimodal medical image segmentation often faces missing modalities at inference, which induces disagreement among modality experts and makes fusion unstable, particularly on small foreground structures. We propose Consistency Learning of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Xinyu Tong , Meihua Zhou , Bowu Fan , Haitao Li

We describe $k$-MLE, a fast and efficient local search algorithm for learning finite statistical mixtures of exponential families such as Gaussian mixture models. Mixture models are traditionally learned using the expectation-maximization…

Machine Learning · Computer Science 2016-11-15 Frank Nielsen

Logistic regression is a widely used statistical model to describe the relationship between a binary response variable and predictor variables in data sets. It is often used in machine learning to identify important predictor variables.…

Optimization and Control · Mathematics 2021-12-30 Jérôme Darbon , Gabriel P. Langlois

The logistic loss function is often advocated in machine learning and statistics as a smooth and strictly convex surrogate for the 0-1 loss. In this paper we investigate the question of whether these smoothness and convexity properties make…

Machine Learning · Computer Science 2014-05-16 Elad Hazan , Tomer Koren , Kfir Y. Levy

Penalized logistic regression is extremely useful for binary classification with large number of covariates (higher than the sample size), having several real life applications, including genomic disease classification. However, the…

Methodology · Statistics 2023-04-10 Ayanendranath Basu , Abhik Ghosh , María Jaenada , Leandro Pardo

To solve key biomedical problems, experimentalists now routinely measure millions or billions of features (dimensions) per sample, with the hope that data science techniques will be able to build accurate data-driven inferences. Because…

The lasso is the most famous sparse regression and feature selection method. One reason for its popularity is the speed at which the underlying optimization problem can be solved. Sorted L-One Penalized Estimation (SLOPE) is a…

Optimization and Control · Mathematics 2024-05-14 Johan Larsson , Quentin Klopfenstein , Mathurin Massias , Jonas Wallin

In this paper we propose a new sampling-free approach to solve Bayesian model inversion problems that is an extension of the previously proposed spectral likelihood expansions (SLE) method. Our approach, called stochastic spectral…

Computation · Statistics 2021-04-21 P. -R. Wagner , S. Marelli , B. Sudret

In linear regression, SLOPE is a new convex analysis method that generalizes the Lasso via the sorted L1 penalty: larger fitted coefficients are penalized more heavily. This magnitude-dependent regularization requires an input of penalty…

Machine Learning · Statistics 2021-12-14 Yiliang Zhang , Zhiqi Bu

Inference for high-dimensional logistic regression models using penalized methods has been a challenging research problem. As an illustration, a major difficulty is the significant bias of the Lasso estimator, which limits its direct…

Methodology · Statistics 2024-10-29 Yuming Zhang , Stéphane Guerrier , Runze Li

Symbolic control problems aim to synthesize control policies for dynamical systems under complex temporal specifications. For such problems, Signal Temporal Logic (STL) is increasingly used as the formal specification language due to its…

Systems and Control · Electrical Eng. & Systems 2023-05-17 Shirantha Welikala , Hai Lin , Panos J. Antsaklis

In this paper, we aim to learn a low-dimensional Euclidean representation from a set of constraints of the form "item j is closer to item i than item k". Existing approaches for this "ordinal embedding" problem require expensive…

Machine Learning · Computer Science 2019-10-29 Nikhil Ghosh , Yuxin Chen , Yisong Yue

Improving the alignment of language models with human preferences remains an active research challenge. Previous approaches have primarily utilized Reinforcement Learning from Human Feedback (RLHF) via online RL methods such as Proximal…

Computation and Language · Computer Science 2024-01-25 Tianqi Liu , Yao Zhao , Rishabh Joshi , Misha Khalman , Mohammad Saleh , Peter J. Liu , Jialu Liu

The transition density of a stochastic, logistic population growth model with multiplicative intrinsic noise is analytically intractable. Inferring model parameter values by fitting such stochastic differential equation (SDE) models to data…

Applications · Statistics 2015-08-17 Jonathan Heydari , Conor Lawless , David A. Lydall , Darren J. Wilkinson

In the fields of clinical trials, biomedical surveys, marketing, banking, with dichotomous response variable, the logistic regression is considered as an alternative convenient approach to linear regression. In this paper, we develop a…

Statistics Theory · Mathematics 2025-12-29 Debraj Das , Priyam Das

The generation quality of large language models (LLMs) is often improved by utilizing inference-time sequence-level scaling methods (e.g., Chain-of-Thought). We introduce hyper-parallel scaling, a complementary framework that improves…

Artificial Intelligence · Computer Science 2025-10-15 Soheil Zibakhsh , Mohammad Samragh , Kumari Nishu , Lauren Hannah , Arnav Kundu , Minsik Cho