English
Related papers

Related papers: Likelihood Adaptively Modified Penalties

200 papers

Machine learning assumes a pivotal role in our data-driven world. The increasing scale of models and datasets necessitates quick and reliable algorithms for model training. This dissertation investigates adaptivity in machine learning…

Machine Learning · Computer Science 2023-11-20 Slavomír Hanzely

We consider a nonlinear polynomial regression model in which we wish to test the null hypothesis of structural stability in the regression parameters against the alternative of a break at an unknown time. We derive the extreme value…

Statistics Theory · Mathematics 2008-10-23 Alexander Aue , Lajos Horváth , Marie Hušková , Piotr Kokoszka

Adversarial examples are a pervasive phenomenon of machine learning models where seemingly imperceptible perturbations to the input lead to misclassifications for otherwise statistically accurate models. In this paper we study how the…

Machine Learning · Computer Science 2020-02-11 Marc Khoury

Additive models belong to the class of structured nonparametric regression models that do not suffer from the curse of dimensionality. Finding the additive components that are nonzero when the true model is assumed to be sparse is an…

Methodology · Statistics 2025-05-08 Suneel Babu Chatla , Abhijit Mandal

Variational methods for parameter estimation are an active research area, potentially offering computationally tractable heuristics with theoretical performance bounds. We build on recent work that applies such methods to network data, and…

Statistics Theory · Mathematics 2013-10-30 Peter Bickel , David Choi , Xiangyu Chang , Hai Zhang

Regression adjustments are often considered by investigators to improve the estimation efficiency of causal effect in randomized experiments when there exists many pre-experiment covariates. In this paper, we provide conditions that…

Statistics Theory · Mathematics 2018-09-25 Hanzhong Liu , Yuehan Yang

Composite likelihoods are a class of alternatives to the full likelihood which are widely used in many situations in which the likelihood itself is intractable. A composite likelihood may be computed without the need to specify the full…

Statistics Theory · Mathematics 2014-01-08 Helen Ogden

This paper is concerned with the selection of fixed effects along with the estimation of fixed effects, random effects and variance components in the linear mixed-effects model. We introduce a selection procedure based on an adaptive ridge…

Methodology · Statistics 2017-05-08 Eric Adjakossa , Grégory Nuel

Random-effects models are frequently used to synthesise information from different studies in meta-analysis. While likelihood-based inference is attractive both in terms of limiting properties and of implementation, its application in…

Methodology · Statistics 2018-02-16 Ioannis Kosmidis , Annamaria Guolo , Cristiano Varin

A common approach to detect multiple changepoints is to minimise a measure of data fit plus a penalty that is linear in the number of changepoints. This paper shows that the general finite sample behaviour of such a method can be related to…

Statistics Theory · Mathematics 2022-08-15 Chao Zheng , Idris A. Eckley , Paul Fearnhead

Comparisons are made for the amount of agreement of the composite likelihood information criteria and their full likelihood counterparts when making decisions among the fits of different models, and some properties of penalty term for…

Statistics Theory · Mathematics 2014-10-17 Chi Tim Ng , Harry Joe

Targeted maximum likelihood estimation is a general methodology combining flexible ensemble learning and semiparametric efficiency theory in a two-step procedure for estimation of causal parameters. Proposed targeted maximum likelihood…

Methodology · Statistics 2021-06-22 Helene Charlotte Wiese Rytgaard , Frank Eriksson , Mark van der Laan

Recent developments in linear system identification have proposed the use of non-parameteric methods, relying on regularization strategies, to handle the so-called bias/variance trade-off. This paper introduces an impulse response estimator…

Systems and Control · Computer Science 2014-10-01 Giulia Prando , Alessandro Chiuso , Gianluigi Pillonetto

Variable selection is an old and pervasive problem in regression analysis. One solution is to impose a lasso penalty to shrink parameter estimates toward zero and perform continuous model selection. The lasso-penalized mixture of linear…

Applications · Statistics 2016-05-04 Luke R. Lloyd-Jones , Hien D. Nguyen , Geoffrey J. McLachlan

Asymptotic properties, both consistency and weak convergence, of estimators arising in a general class of dynamic recurrent event models are presented. The class of models take into account the impact of interventions after each event…

Statistics Theory · Mathematics 2019-11-19 Edsel A. Pena

We present a flexible framework for learning predictive models that approximately satisfy the equalized odds notion of fairness. This is achieved by introducing a general discrepancy functional that rigorously quantifies violations of this…

Machine Learning · Statistics 2020-06-09 Yaniv Romano , Stephen Bates , Emmanuel J. Candès

Robustness of linear systems with constant coefficients is considered. There exist methods and tools for analyzing the stability of systems with random or deterministic uncertainties. At the same time, there are no approaches for the…

Optimization and Control · Mathematics 2020-12-08 Andrey Tremba

Estimations of physical parameters using data usually involve non-uniform experimental efficiencies. In this article, a method of maximum likelihood fit is introduced using the efficiency as a weight, while the probability distribution…

Data Analysis, Statistics and Probability · Physics 2023-08-31 Chenxu Yu , Yanxi Zhang

In this paper introduces a new family of continuous distributions namely the Poison transmuted-G family of distribution is proposed by inducing two addition parameter on the base line G distribution. Some of its mathematical properties…

Statistics Theory · Mathematics 2020-05-12 Laba Handique , Subrata Chakraborty

Constraint tightening to non-conservatively guarantee recursive feasibility and stability in Stochastic Model Predictive Control is addressed. Stability and feasibility requirements are considered separately, highlighting the difference…

Systems and Control · Computer Science 2016-05-13 Matthias Lorenzen , Fabrizio Dabbene , Roberto Tempo , Frank Allgöwer