English
Related papers

Related papers: Finite-sample risk bounds for maximum likelihood e…

200 papers

This work explores the nature of augmented importance sampling in safety-constrained model predictive control problems. When operating in a constrained environment, sampling based model predictive control and motion planning typically…

Systems and Control · Electrical Eng. & Systems 2022-04-13 Manan Gandhi , Hassan Almubarak , Yuichiro Aoyama , Evangelos Theodorou

Penalization of the likelihood by Jeffreys' invariant prior, or by a positive power thereof, is shown to produce finite-valued maximum penalized likelihood estimates in a broad class of binomial generalized linear models. The class of…

Statistics Theory · Mathematics 2020-03-25 Ioannis Kosmidis , David Firth

This paper considers the problem of semi-parametric proportional hazards model fitting for interval, left and right censored survival times. We adopt a more versatile penalized likelihood method to estimate the baseline hazard and the…

Methodology · Statistics 2019-04-16 Jun Ma , Dominique-Laurent Couturier , Stephane Heritier , Ian Marschner

We prove new upper and lower bounds for sample complexity of finding an $\epsilon$-optimal policy of an infinite-horizon average-reward Markov decision process (MDP) given access to a generative model. When the mixing time of the…

Machine Learning · Computer Science 2021-06-15 Yujia Jin , Aaron Sidford

We study finite episodic Markov decision processes incorporating dynamic risk measures to capture risk sensitivity. To this end, we present two model-based algorithms applied to \emph{Lipschitz} dynamic risk measures, a wide range of risk…

Machine Learning · Computer Science 2023-06-06 Hao Liang , Zhi-quan Luo

We study the problem of learning policies that maximize cumulative reward while satisfying safety constraints, even when the real environment differs from a simulator or nominal model. We focus on robust constrained Markov decision…

Machine Learning · Computer Science 2025-11-12 Sourav Ganguly , Arnob Ghosh

This paper proposes a computationally tractable algorithm for learning infinite-horizon average-reward linear Markov decision processes (MDPs) and linear mixture MDPs under the Bellman optimality condition. While guaranteeing computational…

Machine Learning · Computer Science 2024-09-25 Woojin Chae , Dabeen Lee

This paper extends some prominent statistical results including \emph{Fisher Theorem and Wilks phenomenon} to the penalized maximum likelihood estimation with a quadratic penalization. It appears that sharp expansions for the penalized MLE…

Methodology · Statistics 2015-08-11 Vladimir Spokoiny

We study the law of the iterated logarithm (LIL) for the maximum likelihood estimation of the parameters (as a convex optimization problem) in the generalized linear models with independent or weakly dependent ($\rho$-mixing, $m$-dependent)…

Statistics Theory · Mathematics 2020-04-28 Xiaowei Yang , Shuang Song , Huiming Zhang

Recent years have witnessed the success of adaptive (or unified) approaches in estimating symmetric properties of discrete distributions, where one first obtains a distribution estimator independent of the target property, and then plugs…

Statistics Theory · Mathematics 2021-03-04 Yanjun Han

Model attribution is a critical component of deep neural networks (DNNs) for its interpretability to complex models. Recent studies bring up attention to the security of attribution methods as they are vulnerable to attribution attacks that…

Machine Learning · Computer Science 2023-03-02 Fan Wang , Adams Wai-Kin Kong

We solve the problem of estimating the distribution of presumed i.i.d. observations for the total variation loss. Our approach is based on density models and is versatile enough to cope with many different ones, including some density…

Statistics Theory · Mathematics 2024-01-05 Y. Baraud , H. Halconruy , G. Maillard

We study the Cox models with semiparametric relative risk, which can be partially linear with one nonparametric component, or multiple additive or nonadditive nonparametric components. A penalized partial likelihood procedure is proposed to…

Statistics Theory · Mathematics 2010-10-20 Pang Du , Shuangge Ma , Hua Liang

This article concerns the performance limits of strictly causal state estimation for linear systems with fixed, but uncertain, parameters belonging to a finite set. In particular, we provide upper and lower bounds on the smallest achievable…

Optimization and Control · Mathematics 2024-03-29 Olle Kjellqvist

Non-probability samples become increasingly popular in survey statistics but may suffer from selection biases that limit the generalizability of results to the target population. We consider integrating a non-probability sample with a…

Methodology · Statistics 2019-08-26 Shu Yang , Jae Kwang Kim , Rui Song

The likelihood function of a finite mixture model is a non-convex function with multiple local maxima and commonly used iterative algorithms such as EM will converge to different solutions depending on initial conditions. In this paper we…

Machine Learning · Computer Science 2016-08-19 Elad Mezuman , Yair Weiss

We propose a penalized likelihood method to fit the bivariate categorical response regression model. Our method allows practitioners to estimate which predictors are irrelevant, which predictors only affect the marginal distributions of the…

Methodology · Statistics 2022-01-25 Aaron J. Molstad , Adam J. Rothman

This paper investigates the finite-sample prediction risk of the high-dimensional least squares estimator. We derive the central limit theorem for the prediction risk when both the sample size and the number of features tend to infinity.…

Machine Learning · Statistics 2020-08-17 Zeng Li , Chuanlong Xie , Qinwen Wang

We study the problem of learning multivariate log-concave densities with respect to a global loss function. We obtain the first upper bound on the sample complexity of the maximum likelihood estimator (MLE) for a log-concave density on…

Statistics Theory · Mathematics 2018-12-06 Timothy Carpenter , Ilias Diakonikolas , Anastasios Sidiropoulos , Alistair Stewart

Outcome-dependent sampling designs are common in many different scientific fields including epidemiology, ecology, and economics. As with all observational studies, such designs often suffer from unmeasured confounding, which generally…

Methodology · Statistics 2020-10-13 Erin E. Gabriel , Michael C. Sachs , Arvid Sjölander
‹ Prev 1 3 4 5 6 7 10 Next ›