English
Related papers

Related papers: Joint Inverse Covariances Estimation with Mutual L…

200 papers

This paper presents a method for jointly estimating the state, input, and parameters of linear systems in an online fashion. The method is specially designed for measurements that are corrupted with non-Gaussian noise or outliers, which are…

Systems and Control · Electrical Eng. & Systems 2022-04-13 Jean-Sébastien Brouillon , Keith Moffat , Florian Dörfler , Giancarlo Ferrari-Trecate

Covariance selection seeks to estimate a covariance matrix by maximum likelihood while restricting the number of nonzero inverse covariance matrix coefficients. A single penalty parameter usually controls the tradeoff between log likelihood…

Optimization and Control · Mathematics 2010-10-12 Vijay Krishnamurthy , Alexandre d'Aspremont

We consider the problem of precision matrix estimation where, due to extraneous confounding of the underlying precision matrix, the data are independent but not identically distributed. While such confounding occurs in many scientific…

Machine Learning · Statistics 2019-07-01 Sinong Geng , Mladen Kolar , Oluwasanmi Koyejo

Randomized iterative algorithms have attracted much attention in recent years because they can approximately solve large-scale linear systems of equations without accessing the entire coefficient matrix. In this paper, we propose two novel…

Numerical Analysis · Mathematics 2021-10-22 Kui Du , Xiao-Hui Sun

We propose generalized additive partial linear models for complex data which allow one to capture nonlinear patterns of some covariates, in the presence of linear components. The proposed method improves estimation efficiency and increases…

Statistics Theory · Mathematics 2014-05-26 Li Wang , Lan Xue , Annie Qu , Hua Liang

Turning pass-through network architectures into iterative ones, which use their own output as input, is a well-known approach for boosting performance. In this paper, we argue that such architectures offer an additional benefit: The…

Artificial Intelligence · Computer Science 2025-05-27 Nikita Durasov , Doruk Oner , Jonathan Donier , Hieu Le , Pascal Fua

Optimization plays an important role in solving many inverse problems. Indeed, the task of inversion often either involves or is fully cast as a solution of an optimization problem. In this light, the mere non-linear, non-convex, and…

Optimization and Control · Mathematics 2017-12-04 Nan Ye , Farbod Roosta-Khorasani , Tiangang Cui

In cryo-electron microscopy, the 3D electric potentials of an ensemble of molecules are projected along arbitrary viewing directions to yield noisy 2D images. The volume maps representing these potentials typically exhibit a great deal of…

Applications · Statistics 2018-02-08 Joakim Andén , Amit Singer

Analyzing large samples of high-dimensional data under dependence is a challenging statistical problem as long time series may have change points, most importantly in the mean and the marginal covariances, for which one needs valid tests.…

Methodology · Statistics 2022-11-07 Fabian Mies , Ansgar Steland

A new approach to solving eigenvalue optimization problems for large structured matrices is proposed and studied. The class of optimization problems considered is related to computing structured pseudospectra and their extremal points, and…

Numerical Analysis · Mathematics 2022-06-22 Nicola Guglielmi , Christian Lubich , Stefano Sicilia

This paper studies methods for testing and estimating change-points in the covariance structure of a high-dimensional linear time series. The assumed framework allows for a large class of multivariate linear processes (including vector…

Statistics Theory · Mathematics 2020-01-14 Ansgar Steland

In this paper, we propose a novel framework for the joint identification of system dynamics and noise covariance in linear systems, under general noise distributions beyond Gaussian. Specifically, we would like to simultaneously estimate…

Systems and Control · Electrical Eng. & Systems 2026-04-16 Yang Hu , Na Li

The inversion of linear systems is a fundamental step in many inverse problems. Computational challenges exist when trying to invert large linear systems, where limited computing resources mean that only part of the system can be kept in…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-05 Yushan Gao , Thomas Blumensath

Cointegration analysis is used to estimate the long-run equilibrium relations between several time series. The coefficients of these long-run equilibrium relations are the cointegrating vectors. In this paper, we provide a sparse estimator…

Methodology · Statistics 2015-01-07 Ines Wilms , Christophe Croux

This paper proposes a Matrix Error Correction Model to identify cointegration relations in matrix-valued time series. We hereby allow separate cointegrating relations along the rows and columns of the matrix-valued time series and use…

Econometrics · Economics 2025-01-27 Alain Hecq , Ivan Ricardo , Ines Wilms

Empirical studies show that real world networks often exhibit multiple scales of topological descriptions. However, it is still an open problem how to identify the intrinsic multiple scales of networks. In this article, we consider…

Physics and Society · Physics 2010-07-27 Hua-Wei Shen , Xue-Qi Cheng , Bin-Xing Fang

Most inverse optimization models impute unspecified parameters of an objective function to make an observed solution optimal for a given optimization problem with a fixed feasible set. We propose two approaches to impute unspecified…

Optimization and Control · Mathematics 2019-07-19 Timothy C. Y. Chan , Neal Kaw

Variance parameter estimation in linear mixed models is a challenge for many classical nonlinear optimization algorithms due to the positive-definiteness constraint of the random effects covariance matrix. We take a completely novel view on…

Machine Learning · Statistics 2022-12-20 Lena Sembach , Jan Pablo Burgard , Volker H. Schulz

Low-rank matrix approximations are often used to help scale standard machine learning algorithms to large-scale problems. Recently, matrix coherence has been used to characterize the ability to extract global information from a subset of…

Machine Learning · Statistics 2010-09-07 Mehryar Mohri , Ameet Talwalkar

Bayesian inverse problems use observed data to update a prior probability distribution for an unknown state or parameter of a scientific system to a posterior distribution conditioned on the data. In many applications, the unknown parameter…

Numerical Analysis · Mathematics 2026-05-12 Josie König , Elizabeth Qian , Melina A. Freitag