English
Related papers

Related papers: Performance Analysis of the Decentralized Eigendec…

200 papers

This paper aims to develop a new and robust approach to feature representation. Motivated by the success of Auto-Encoders, we first theoretical summarize the general properties of all algorithms that are based on traditional Auto-Encoders:…

Machine Learning · Computer Science 2018-10-24 Zeng Yu , Tianrui Li , Ning Yu , Yi Pan , Hongmei Chen , Bing Liu

This paper presents a strategy for a posteriori error estimation for substructured problems solved by non-overlapping domain decomposition methods. We focus on global estimates of the discretization error obtained through the error in…

Numerical Analysis · Mathematics 2012-09-03 Augustin Parret-Fréaud , Christian Rey , Pierre Gosselet , Frédéric Feyel

Pragmatic trials evaluating health care interventions often adopt cluster randomization due to scientific or logistical considerations. Previous reviews have shown that co-primary endpoints are common in pragmatic trials but infrequently…

Methodology · Statistics 2022-05-03 Siyun Yang , Mirjam Moerbeek , Monica Taljaard , Fan Li

Subspace-based signal processing techniques, such as the Estimation of Signal Parameters via Rotational Invariant Techniques (ESPRIT) algorithm, are popular methods for spectral estimation. These algorithms can achieve the so-called…

Information Theory · Computer Science 2024-10-29 Zhiyan Ding , Ethan N. Epperly , Lin Lin , Ruizhe Zhang

In this work, we consider the use of a model-based decoder in combination with an unsupervised learning strategy for direction-of-arrival (DoA) estimation. Relying only on unlabeled training data we show in our analysis that we can…

Signal Processing · Electrical Eng. & Systems 2023-11-29 Franz Weißer , Michael Baur , Wolfgang Utschick

This paper investigates the eigenvalue computation problem of the dual quaternion Hermitian matrix closely related to multi-agent group control. Recently, power method was proposed by Cui and Qi in Journal of Scientific Computing, 100…

Numerical Analysis · Mathematics 2025-05-22 Yongjun Chen , Liping Zhang

Compressed sensing typically deals with the estimation of a system input from its noise-corrupted linear measurements, where the number of measurements is smaller than the number of input components. The performance of the estimation…

Information Theory · Computer Science 2016-11-17 Jin Tan , Danielle Carmon , Dror Baron

We develop a novel formulation of the Performance Estimation Problem (PEP) for decentralized optimization whose size is independent of the number of agents in the network. The PEP approach allows computing automatically the worst-case…

Optimization and Control · Mathematics 2023-02-20 Sebastien Colla , Julien M. Hendrickx

This work considers a computationally and statistically efficient parameter estimation method for a wide class of latent variable models---including Gaussian mixture models, hidden Markov models, and latent Dirichlet allocation---which…

Machine Learning · Computer Science 2014-11-17 Anima Anandkumar , Rong Ge , Daniel Hsu , Sham M. Kakade , Matus Telgarsky

Classical methods of DOA estimation such as the MUSIC algorithm are based on estimating the signal and noise subspaces from the sample covariance matrix. For a small number of samples, such methods are exposed to performance breakdown, as…

Statistics Theory · Mathematics 2023-07-19 Mahdi Shaghaghi , Sergiy A. Vorobyov

Due to the rapid growth of smart agents such as weakly connected computational nodes and sensors, developing decentralized algorithms that can perform computations on local agents becomes a major research direction. This paper considers the…

Machine Learning · Computer Science 2021-02-09 Haishan Ye , Tong Zhang

An estimation problem of fundamental interest is that of phase synchronization, in which the goal is to recover a collection of phases using noisy measurements of relative phases. It is known that in the Gaussian noise setting, the maximum…

Optimization and Control · Mathematics 2016-11-02 Huikang Liu , Man-Chung Yue , Anthony Man-Cho So

Sparsity in the eigenvectors of signal covariance matrices is exploited in this paper for compression and denoising. Dimensionality reduction (DR) and quantization modules present in many practical compression schemes such as transform…

Applications · Statistics 2015-06-03 Ioannis D. Schizas , Georgios B. Giannakis

Standard maximum likelihood estimation cannot be applied to discrete energy-based models in the general case because the computation of exact model probabilities is intractable. Recent research has seen the proposal of several new…

Machine Learning · Computer Science 2012-02-20 Benjamin Marlin , Nando de Freitas

Eigendecomposition (ED) is widely used in deep networks. However, the backpropagation of its results tends to be numerically unstable, whether using ED directly or approximating it with the Power Iteration method, particularly when dealing…

Machine Learning · Computer Science 2019-06-28 Wei Wang , Zheng Dang , Yinlin Hu , Pascal Fua , Mathieu Salzmann

Spectral methods have myriad applications in high-dimensional statistics and data science, and while previous works have primarily focused on $\ell_2$ or $\ell_{2,\infty}$ eigenvector and singular vector perturbation theory, in many…

Statistics Theory · Mathematics 2026-05-11 Joshua Agterberg

Many complex systems can be reduced to their key components through spectrally decomposing matrices that capture their dynamics. These matrices can in turn be constructed from data, often by least-squares fitting: examples of algorithms to…

Numerical Analysis · Mathematics 2026-05-18 Caroline Wormell

We present a new power method to obtain solutions of eigenvalue problems. The method can determine not only the dominant or lowest eigenvalues but also all eigenvalues without the need for a deflation procedure. The method uses a functional…

Numerical Analysis · Mathematics 2024-10-08 I Wayan Sudiarta , Hadi Susanto

Distributed and decentralized optimization are key for the control of networked systems. Application examples include distributed model predictive control and distributed sensing or estimation. Non-linear systems, however, lead to problems…

Optimization and Control · Mathematics 2023-07-06 Alexander Engelmann , Gösta Stomberg , Timm Faulwasser

Principal component analysis is an important pattern recognition and dimensionality reduction tool in many applications. Principal components are computed as eigenvectors of a maximum likelihood covariance $\widehat{\Sigma}$ that…

Statistics Theory · Mathematics 2017-10-30 Raphael Hauser , Raul Kangro , Jüri Lember , Heinrich Matzinger