中文
相关论文

相关论文: Learning Heteroscedastic Models by Convex Programm…

200 篇论文

Causal models are important tools to understand complex phenomena and predict the outcome of controlled experiments, also known as interventions. In this work, we present statistical rates of estimation for linear cyclic causal models under…

统计理论 · 数学 2019-06-11 Jan-Christian Hütter , Philippe Rigollet

This paper aims to build an estimate of an unknown density of the data with measurement error as a linear combination of functions from a dictionary. Inspired by the penalization approach, we propose the weighted Elastic-net penalized…

统计理论 · 数学 2020-07-07 Xiaowei Yang , Huiming Zhang , Haoyu Wei , Shouzheng Zhang

Sparse regularization such as $\ell_1$ regularization is a quite powerful and widely used strategy for high dimensional learning problems. The effectiveness of sparse regularization has been supported practically and theoretically by…

机器学习 · 统计学 2018-02-23 Masaaki Takada , Taiji Suzuki , Hironori Fujisawa

The Lasso is a computationally efficient regression regularization procedure that can produce sparse estimators when the number of predictors (p) is large. Oracle inequalities provide probability loss bounds for the Lasso estimator at a…

机器学习 · 统计学 2017-07-21 Cheryl J. Flynn , Clifford M. Hurvich , Jeffrey S. Simonoff

We consider in this paper the problem of estimating a parameter matrix from observations which are affected by two types of noise components: (i) a sparse noise sequence which, whenever nonzero can have arbitrarily large amplitude (ii) and…

系统与控制 · 计算机科学 2017-11-07 Laurent Bako

We consider the problems of estimation and selection of parameters endowed with a known group structure, when the groups are assumed to be sign-coherent, that is, gathering either nonnegative, nonpositive or null parameters. To tackle this…

统计方法学 · 统计学 2015-03-19 Julien Chiquet , Yves Grandvalet , Camille Charbonnier

Sparse high dimensional graphical model selection is a popular topic in contemporary machine learning. To this end, various useful approaches have been proposed in the context of $\ell_1$-penalized estimation in the Gaussian framework.…

统计计算 · 统计学 2022-02-04 Sang-Yun Oh , Onkar Dalal , Kshitij Khare , Bala Rajaratnam

We consider the sparse estimation for stochastic processes with possibly infinite-dimensional nuisance parameters, by using the Dantzig selector which is a sparse estimation method similar to $Z$-estimation. When a consistent estimator for…

统计理论 · 数学 2026-02-24 Kou Fujimori , Koji Tsukuda

Non-convex regularizers usually improve the performance of sparse estimation in practice. To prove this fact, we study the conditions of sparse estimations for the sharp concave regularizers which are a general family of non-convex…

机器学习 · 计算机科学 2014-02-13 Zheng Pan , Changshui Zhang

In this paper, we study problem of estimating a sparse regression vector with correct support in the presence of outlier samples. The inconsistency of lasso-type methods is well known in this scenario. We propose a combinatorial version of…

机器学习 · 计算机科学 2023-06-23 Adarsh Barik , Jean Honorio

For high dimensional sparse linear regression problems, we propose a sequential convex relaxation algorithm (iSCRA-TL1) by solving inexactly a sequence of truncated $\ell_1$-norm regularized minimization problems, in which the working index…

统计理论 · 数学 2024-11-05 Shujun Bi , Yonghua Yang , Shaohua Pan

A wide range of problems in computational science and engineering require estimation of sparse eigenvectors for high dimensional systems. Here, we propose two variants of the Truncated Orthogonal Iteration to compute multiple leading…

数值分析 · 数学 2021-03-26 Hexuan Liu , Aleksandr Aravkin

Given $n$ i.i.d. observations of a random vector $(X,Z)$, where $X$ is a high-dimensional vector and $Z$ is a low-dimensional index variable, we study the problem of estimating the conditional inverse covariance matrix $\Omega(z) =…

机器学习 · 统计学 2014-12-25 Jialei Wang , Mladen Kolar

This paper studies the problem of estimating a large coefficient matrix in a multiple response linear regression model when the coefficient matrix could be both of low rank and sparse in the sense that most nonzero entries concentrate on a…

统计方法学 · 统计学 2016-03-18 Zhuang Ma , Zongming Ma , Tingni Sun

We investigate a generalized framework to estimate a latent low-rank plus sparse tensor, where the low-rank tensor often captures the multi-way principal components and the sparse tensor accounts for potential model mis-specifications or…

统计方法学 · 统计学 2022-04-15 Jian-Feng Cai , Jingyang Li , Dong Xia

Clustering high-dimensional data often requires some form of dimensionality reduction, where clustered variables are separated from "noise-looking" variables. We cast this problem as finding a low-dimensional projection of the data which is…

机器学习 · 统计学 2016-08-30 Nicolas Flammarion , Balamurugan Palaniappan , Francis Bach

Due to its low computational cost, Lasso is an attractive regularization method for high-dimensional statistical settings. In this paper, we consider multivariate counting processes depending on an unknown function parameter to be estimated…

统计理论 · 数学 2015-04-08 Niels Richard Hansen , Patricia Reynaud-Bouret , Vincent Rivoirard

Suppose we observe samples of a subset of a collection of random variables. No additional information is provided about the number of latent variables, nor of the relationship between the latent and observed variables. Is it possible to…

统计理论 · 数学 2012-11-05 Venkat Chandrasekaran , Pablo A. Parrilo , Alan S. Willsky

In tracking of time-varying low-rank models of time-varying matrices, we present a method robust to both uniformly-distributed measurement noise and arbitrarily-distributed ``sparse'' noise. In theory, we bound the tracking error. In…

最优化与控制 · 数学 2020-02-05 Albert Akhriev , Jakub Marecek , Andrea Simonetto

Convex clustering, a convex relaxation of k-means clustering and hierarchical clustering, has drawn recent attentions since it nicely addresses the instability issue of traditional nonconvex clustering methods. Although its computational…

统计方法学 · 统计学 2019-01-01 Binhuan Wang , Yilong Zhang , Will Wei Sun , Yixin Fang