English
Related papers

Related papers: Underdetermined Blind Identification via $k$-Spars…

200 papers

In this paper, we propose a learning approach for sparse code multiple access (SCMA) signal detection by using a deep neural network via unfolding the procedure of message passing algorithm (MPA). The MPA can be converted to a sparsely…

Information Theory · Computer Science 2018-08-27 Chao Lu , Wei Xu , Hong Shen , Hua Zhang , Xiaohu You

A process centric view of robust PCA (RPCA) allows its fast approximate implementation based on a special form o a deep neural network with weights shared across all layers. However, empirically this fast approximation to RPCA fails to find…

Neural and Evolutionary Computing · Computer Science 2014-12-30 Maximilian Karl , Christian Osendorfer

Dataset biases are notoriously detrimental to model robustness and generalization. The identify-emphasize paradigm appears to be effective in dealing with unknown biases. However, we discover that it is still plagued by two challenges: A,…

Machine Learning · Computer Science 2023-02-23 Bowen Zhao , Chen Chen , Qian-Wei Wang , Anfeng He , Shu-Tao Xia

Given two sets of variables, derived from a common set of samples, sparse Canonical Correlation Analysis (CCA) seeks linear combinations of a small number of variables in each set, such that the induced canonical variables are maximally…

Machine Learning · Statistics 2016-05-31 Megasthenis Asteris , Anastasios Kyrillidis , Oluwasanmi Koyejo , Russell Poldrack

Stationary subspace analysis (SSA) is a blind source separation framework that decomposes linearly mixed multivariate data into stationary and nonstationary components. We extend SSA to spatially indexed data by introducing spatial…

Methodology · Statistics 2026-05-20 Perttu Saarela , Klaus Nordhausen , Jaakko Pere , Anne M. Ruiz

For many years, a combination of principal component analysis (PCA) and independent component analysis (ICA) has been used for blind source separation (BSS). However, it remains unclear why these linear methods work well with real-world…

Machine Learning · Statistics 2020-12-15 Takuya Isomura , Taro Toyoizumi

Robust principal component analysis (RPCA) is a powerful method for learning low-rank feature representation of various visual data. However, for certain types as well as significant amount of error corruption, it fails to yield…

Computer Vision and Pattern Recognition · Computer Science 2018-01-24 Niannan Xue , Jiankang Deng , Shiyang Cheng , Yannis Panagakis , Stefanos Zafeiriou

This paper develops new variance-reduction techniques for the forward-reflected-backward splitting (FRBS) method to solve a class of possibly nonmonotone stochastic composite inclusions. Unlike unbiased estimators such as mini-batching,…

Machine Learning · Computer Science 2026-03-17 Quoc Tran-Dinh , Nghia Nguyen-Trung

We consider two areas of research that have been developing in parallel over the last decade: blind source separation (BSS) and electromagnetic source estimation (ESE). BSS deals with the recovery of source signals when only mixtures of…

Data Analysis, Statistics and Probability · Physics 2015-01-22 Kevin H. Knuth , Herbert G. Vaughan

Process monitoring based on neural networks is getting more and more attention. Compared with classical neural networks, high-order neural networks have natural advantages in dealing with heteroscedastic data. However, high-order neural…

Machine Learning · Computer Science 2021-12-22 Peng Jingchao , Zhao Haitao , Hu Zhengwei

Sparse Subspace Clustering (SSC) is one of the most popular methods for clustering data points into their underlying subspaces. However, SSC may suffer from heavy computational burden. Orthogonal Matching Pursuit applied on SSC accelerates…

Machine Learning · Computer Science 2020-01-08 Wenqi Zhu , Yuesheng Zhu , Li Zhong , Shuai Yang

Accurate land cover segmentation of spectral images is challenging and has drawn widespread attention in remote sensing due to its inherent complexity. Although significant efforts have been made for developing a variety of methods, most of…

Image and Video Processing · Electrical Eng. & Systems 2021-11-30 Carlos Hinojosa , Esteban Vera , Henry Arguello

For multi-source data, blocks of variable information from certain sources are likely missing. Existing methods for handling missing data do not take structures of block-wise missing data into consideration. In this paper, we propose a…

Methodology · Statistics 2020-04-07 Fei Xue , Annie Qu

Blind source separation (BSS), i.e., the decoupling of unknown signals that have been mixed in an unknown way, has been a topic of great interest in the signal processing community for the last decade, covering a wide range of applications…

Machine Learning · Statistics 2016-03-11 Eleftherios Kofidis

An improved version of the sparse multiway kernel spectral clustering (KSC) is presented in this brief. The original algorithm is derived from weighted kernel principal component (KPCA) analysis formulated within the primal-dual…

Machine Learning · Computer Science 2023-10-23 Mihaly Novak , Rocco Langone , Carlos Alzate , Johan Suykens

Non-gaussian component analysis (NGCA) introduced in offered a method for high dimensional data analysis allowing for identifying a low-dimensional non-Gaussian component of the whole distribution in an iterative and structure adaptive way.…

Statistics Theory · Mathematics 2009-04-24 Elmar Diederichs , Anatoli Juditsky , Vladimir Spokoiny , Christof Schuette

We consider the problem of maximizing the variance explained from a data matrix using orthogonal sparse principal components that have a support of fixed cardinality. While most existing methods focus on building principal components (PCs)…

Optimization and Control · Mathematics 2022-10-14 Dimitris Bertsimas , Driss Lahlou Kitane

Representational similarity analysis (RSA) is a multivariate technique to investigate cortical representations of objects or constructs. While avoiding ill-posed matrix inversions that plague multivariate approaches in the presence of many…

Methodology · Statistics 2021-12-03 Roberto Viviani

This paper aims at developing a clustering approach with spectral images directly from CASSI compressive measurements. The proposed clustering method first assumes that compressed measurements lie in the union of multiple low-dimensional…

Image and Video Processing · Electrical Eng. & Systems 2019-11-06 Jianchen Zhu , Tong Zhang , Shengjie Zhao , Carlos Hinojosa , Zengli Liu , Gonzalo R. Arce

Due to the unobservability of confoundings, there has been widespread concern about how to compute causality quantitatively. To address this challenge, proxy-based negative control approaches have been commonly adopted, where auxiliary…

Optimization and Control · Mathematics 2022-11-09 Zhiheng Zhang