English
Related papers

Related papers: Change-point detection in variance-covariance matr…

200 papers

We expand the scope of the alternating direction method of multipliers (ADMM). Specifically, we show that ADMM, when employed to solve problems with multiaffine constraints that satisfy certain verifiable assumptions, converges to the set…

Optimization and Control · Mathematics 2019-10-24 Wenbo Gao , Donald Goldfarb , Frank E. Curtis

We present in this paper a novel approach for training deterministic auto-encoders. We show that by adding a well chosen penalty term to the classical reconstruction cost function, we can achieve results that equal or surpass those attained…

Artificial Intelligence · Computer Science 2011-04-22 Salah Rifai , Xavier Muller , Xavier Glorot , Gregoire Mesnil , Yoshua Bengio , Pascal Vincent

We investigate a class of general combinatorial graph problems, including MAX-CUT and community detection, reformulated as quadratic objectives over nonconvex constraints and solved via the alternating direction method of multipliers…

Systems and Control · Electrical Eng. & Systems 2022-09-09 Chuangchuang Sun

We consider the problem of detecting a change in mean in a sequence of Gaussian vectors. Under the alternative hypothesis, the change occurs only in some subset of the components of the vector. We propose a test of the presence of a…

Statistics Theory · Mathematics 2014-02-28 Farida Enikeeva , Zaid Harchaoui

We investigate a class of general combinatorial graph problems, including MAX-CUT and community detection, reformulated as quadratic objectives over nonconvex constraints and solved via the alternating direction method of multipliers…

Optimization and Control · Mathematics 2018-05-29 Chuangchuang Sun , Yifan Sun , Ran Dai

Mixtures of matrix Gaussian distributions provide a probabilistic framework for clustering continuous matrix-variate data, which are becoming increasingly prevalent in various fields. Despite its widespread adoption and successful…

Computation · Statistics 2023-07-21 Andrea Cappozzo , Alessandro Casa , Michael Fop

We consider the problem of selective inference after solving a (randomized) convex statistical learning program in the form of a penalized or constrained loss function. Our first main result is a change-of-measure formula that describes…

Statistics Theory · Mathematics 2016-09-20 Xiaoying Tian Harris , Snigdha Panigrahi , Jelena Markovic , Nan Bi , Jonathan Taylor

In this work, we consider to improve the model estimation efficiency by aggregating the neighbors' information as well as identify the subgroup membership for each node in the network. A tree-based $l_1$ penalty is proposed to save the…

Machine Learning · Statistics 2019-05-29 Xin Zhang , Jia Liu , Zhengyuan Zhu

We propose a two-step procedure to detect cointegration in high-dimensional settings, focusing on sparse relationships. First, we use the adaptive LASSO to identify the small subset of integrated covariates driving the equilibrium…

Methodology · Statistics 2026-03-05 Jesus Gonzalo , Jean-Yves Pitarakis

We study the problem of estimating from data, a sparse approximation to the inverse covariance matrix. Estimating a sparsity constrained inverse covariance matrix is a key component in Gaussian graphical model learning, but one that is…

Machine Learning · Statistics 2011-06-28 Suvrit Sra , Dongmin Kim

We analyze a weighted Frobenius loss for approximating symmetric positive definite matrices in the context of preconditioning iterative solvers. Unlike the standard Frobenius norm, the weighted loss penalizes error components associated…

Numerical Analysis · Mathematics 2025-09-23 Vladislav Trifonov , Ivan Oseledets , Ekaterina Muravleva

In this paper, we study a dynamic version of the sharing problem, in which a dynamic system cost function composed of time-variant local costs of subsystems and a shared time-variant cost of the whole system is minimized. A dynamic…

Optimization and Control · Mathematics 2017-03-16 Xuanyu Cao , K. J. Ray Liu

We study online changepoint detection in the context of a linear regression model. We propose a class of heavily weighted statistics based on the CUSUM process of the regression residuals, which are specifically designed to ensure timely…

Methodology · Statistics 2024-02-08 Fabrizio Ghezzi , Eduardo Rossi , Lorenzo Trapani

In this paper, we propose two new algorithms for maximum-likelihood estimation (MLE) of high dimensional sparse covariance matrices. Unlike most of the state of-the-art methods, which either use regularization techniques or penalize the…

Methodology · Statistics 2023-05-12 Ghania Fatima , Prabhu Babu , Petre Stoica

This paper is concerned with the selection of fixed effects along with the estimation of fixed effects, random effects and variance components in the linear mixed-effects model. We introduce a selection procedure based on an adaptive ridge…

Methodology · Statistics 2017-05-08 Eric Adjakossa , Grégory Nuel

In this paper, we study the estimation and inference of change points under a functional linear regression model with changes in the slope function. We present a novel Functional Regression Binary Segmentation (FRBS) algorithm which is…

Methodology · Statistics 2026-02-02 Shivam Kumar , Haotian Xu , Haeran Cho , Daren Wang

The Alternating Direction Method of Multipliers (ADMM) is widely used for linearly constrained convex problems. It is proven to have an $o(1/\sqrt{K})$ nonergodic convergence rate and a faster $O(1/K)$ ergodic rate after ergodic averaging,…

Numerical Analysis · Mathematics 2018-12-13 Huan Li , Zhouchen Lin

Graphical models are frequently used to explore networks, such as genetic networks, among a set of variables. This is usually carried out via exploring the sparsity of the precision matrix of the variables under consideration. Penalized…

Applications · Statistics 2009-08-17 Jianqing Fan , Yang Feng , Yichao Wu

This paper studies the unsupervised change point detection problem in time series of networks using the Separable Temporal Exponential-family Random Graph Model (STERGM). Inherently, dynamic network patterns are complex due to dyadic and…

Methodology · Statistics 2025-09-01 Yik Lun Kei , Hangjian Li , Yanzhen Chen , Oscar Hernan Madrid Padilla

A method for change point detection is proposed. We consider a univariate sequence of independent random variables with piecewise constant expectation and variance, apart from which the distribution may vary periodically. We aim to detect…

Methodology · Statistics 2021-06-23 Michael Messer