中文
相关论文

相关论文: Sharp oracle inequalities and slope heuristic for …

200 篇论文

In this paper, we consider nonlinear optimization problems with a stochastic objective and deterministic equality constraints. We propose a Trust-Region Stochastic Sequential Quadratic Programming (TR-SSQP) method and establish its…

最优化与控制 · 数学 2026-04-02 Yuchen Fang , Javad Lavaei , Sen Na

The paper focuses on the automatic selection of the grouped explanatory variables in an high-dimensional model, when the model errors are asymmetric. After introducing the model and notations, we define the adaptive group LASSO expectile…

统计理论 · 数学 2022-03-14 Angelo Alcaraz , Gabriela Ciuperca

In this thesis we study adaptive nonparametric regression with noise misspecification and the complexity of approximation of random fields in dependence of the dimension. First, we consider the problem of pointwise estimation in…

统计理论 · 数学 2012-08-15 Nora Serdyukova

This is the second part of the research project initiated in Cleanthous et al (2024). We deal with the problem of the adaptive estimation of the $\mathbb{L}_2$-norm of a probability density on $\mathbb{R}^d$, $d\geq 1$, from independent…

统计理论 · 数学 2024-05-28 Galatia Cleanthous , Athanasios G. Georgiadis , Oleg V. Lepski

We study high-dimensional drift estimation for L\'evy-driven Ornstein--Uhlenbeck processes based on discrete observations. Assuming sparsity of the drift matrix, we analyze Lasso and Slope estimators constructed from approximate likelihoods…

统计理论 · 数学 2026-03-09 Niklas Dexheimer , Natalia Jeszka

Approximate inference in dynamic systems is the problem of estimating the state of the system given a sequence of actions and partial observations. High precision estimation is fundamental in many applications like diagnosis, natural…

人工智能 · 计算机科学 2012-06-18 Hannaneh Hajishirzi , Eyal Amir

This paper consider penalized empirical loss minimization of convex loss functions with unknown non-linear target functions. Using the elastic net penalty we establish a finite sample oracle inequality which bounds the loss of our estimator…

统计理论 · 数学 2013-12-13 Mehmet Caner , Anders Bredahl Kock

In this paper, we focus on the variable selection techniques for a class of semiparametric spatial regression models which allow one to study the effects of explanatory variables in the presence of the spatial information. The spatial…

统计方法学 · 统计学 2021-06-03 Guannan Wang , Jue Wang

Due to its low computational cost, Lasso is an attractive regularization method for high-dimensional statistical settings. In this paper, we consider multivariate counting processes depending on an unknown function parameter to be estimated…

统计理论 · 数学 2015-04-08 Niels Richard Hansen , Patricia Reynaud-Bouret , Vincent Rivoirard

Semiparametric discrete choice models are widely used in a variety of practical applications. While these models are point identified in the presence of continuous covariates, they can become partially identified when covariates are…

计量经济学 · 经济学 2024-05-29 Shakeeb Khan , Tatiana Komarova , Denis Nekipelov

Simulation-based inference techniques are indispensable for parameter estimation of mechanistic and simulable models with intractable likelihoods. While traditional statistical approaches like approximate Bayesian computation and Bayesian…

统计方法学 · 统计学 2024-03-08 Ryan P. Kelly , David J. Nott , David T. Frazier , David J. Warne , Chris Drovandi

Several classical adaptive optimization algorithms, such as line search and trust region methods, have been recently extended to stochastic settings where function values, gradients, and Hessians in some cases, are estimated via stochastic…

最优化与控制 · 数学 2023-10-02 Billy Jin , Katya Scheinberg , Miaolan Xie

Penalized spline estimation with discrete difference penalties (P-splines) is a popular estimation method for semiparametric models, but the classical least-squares estimator is highly sensitive to deviations from its ideal model…

统计方法学 · 统计学 2022-03-24 Ioannis Kalogridis , Stefan Van Aelst

Choosing a shrinkage method can be done by selecting a penalty from a list of pre-specified penalties or by constructing a penalty based on the data. If a list of penalties for a class of linear models is given, we provide comparisons based…

统计方法学 · 统计学 2022-01-10 Dean Dustin , Bertrand Clarke , Jennifer Clarke

We consider the problem of estimating the parameters of a Gaussian or binary distribution in such a way that the resulting undirected graphical model is sparse. Our approach is to solve a maximum likelihood problem with an added l_1-norm…

人工智能 · 计算机科学 2007-07-06 Onureena Banerjee , Laurent El Ghaoui , Alexandre d'Aspremont

Covariance regression offers an effective way to model the large covariance matrix with the auxiliary similarity matrices. In this work, we propose a sparse covariance regression (SCR) approach to handle the potentially high-dimensional…

统计方法学 · 统计学 2024-10-17 Yuan Gao , Zhiyuan Zhang , Zhanrui Cai , Xuening Zhu , Tao Zou , Hansheng Wang

In this paper, we study randomized methods for feedback design of uncertain systems. The first contribution is to derive the sample complexity of various constrained control problems. In particular, we show the key role played by the…

系统与控制 · 计算机科学 2014-07-22 T. Alamo , R. Tempo , A. Luque , D. R. Ramirez

This work introduces and compares approaches for estimating rare-event probabilities related to the number of edges in the random geometric graph on a Poisson point process. In the one-dimensional setting, we derive closed-form expressions…

概率论 · 数学 2020-07-14 Christian Hirsch , Sarat B. Moka , Thomas Taimre , Dirk P. Kroese

This study investigates the limitations of applying Markov Chain Monte Carlo (MCMC) methods to arbitrary objective functions, focusing on a two-block MCMC framework which alternates between Metropolis-Hastings and Gibbs sampling. While such…

机器学习 · 统计学 2026-02-17 Jared N. Lakhani , Etienne Pienaar

An interior-point algorithm framework is proposed, analyzed, and tested for solving nonlinearly constrained continuous optimization problems. The main setting of interest is when the objective and constraint functions may be nonlinear…

最优化与控制 · 数学 2024-08-30 Frank E. Curtis , Xin Jiang , Qi Wang