English
Related papers

Related papers: Distortion Contribution Analysis with the Best Lin…

200 papers

This paper delivers improved theoretical guarantees for the convex programming approach in low-rank matrix estimation, in the presence of (1) random noise, (2) gross sparse outliers, and (3) missing data. This problem, often dubbed as…

Machine Learning · Statistics 2022-09-13 Yuxin Chen , Jianqing Fan , Cong Ma , Yuling Yan

We introduce COLA, a self-supervised pre-training approach for learning a general-purpose representation of audio. Our approach is based on contrastive learning: it learns a representation which assigns high similarity to audio segments…

Sound · Computer Science 2020-10-22 Aaqib Saeed , David Grangier , Neil Zeghidour

Computing the rate-distortion function for continuous sources is commonly regarded as a standard continuous optimization problem. When numerically addressing this problem, a typical approach involves discretizing the source space and…

Information Theory · Computer Science 2024-05-02 Lingyi Chen , Shitong Wu , Wenyi Zhang , Huihui Wu , Hao Wu

Non-Gaussian component analysis (NGCA) is a problem in multidimensional data analysis which, since its formulation in 2006, has attracted considerable attention in statistics and machine learning. In this problem, we have a random variable…

Machine Learning · Computer Science 2019-07-25 Navin Goyal , Abhishek Shetty

Decentralized optimization, particularly the class of decentralized composite convex optimization (DCCO) problems, has found many applications. Due to ubiquitous communication congestion and random dropouts in practice, it is highly…

Optimization and Control · Mathematics 2022-10-12 Changxin Liu , Zirui Zhou , Jian Pei , Yong Zhang , Yang Shi

We propose Deep Multiset Canonical Correlation Analysis (dMCCA) as an extension to representation learning using CCA when the underlying signal is observed across multiple (more than two) modalities. We use deep learning framework to learn…

Machine Learning · Computer Science 2023-02-09 Krishna Somandepalli , Naveen Kumar , Ruchir Travadi , Shrikanth Narayanan

Principal component analysis (PCA) is a widely used dimension reduction tool in the analysis of many kind of high-dimensional data. It is used in signal processing, mechanical engineering, psychometrics, and other fields under different…

Methodology · Statistics 2014-01-15 Ngoc Mai Tran , Maria Osipenko , Wolfgang Karl Haerdle

Synthesizing realistic images involves computing high-dimensional light-transport integrals. In practice, these integrals are numerically estimated via Monte Carlo integration. The error of this estimation manifests itself as conspicuous…

Graphics · Computer Science 2022-04-06 Vassillen Chizhov , Iliyan Georgiev , Karol Myszkowski , Gurprit Singh

Quadratic discriminant analysis (QDA) is a widely used classification technique. Based on a training dataset, each class in the data is characterized by an estimate of its center and shape, which can then be used to assign unseen…

Methodology · Statistics 2021-01-13 Iwein Vranckx , Jakob Raymaekers , Bart De Ketelaere , Peter J. Rousseeuw , Mia Hubert

Multivariate signal processing is often based on dimensionality reduction techniques. We propose a new method, Dynamical Component Analysis (DyCA), leading to a classification of the underlying dynamics and - for a certain type of dynamics…

Signal Processing · Electrical Eng. & Systems 2019-03-19 Bastian Seifert , Katharina Korn , Steffen Hartmann , Christian Uhl

Principal Component Analysis (PCA) is a fundamental data preprocessing tool in the world of machine learning. While PCA is often thought of as a dimensionality reduction method, the purpose of PCA is actually two-fold: dimension reduction…

Machine Learning · Computer Science 2023-01-25 Arpita Gang , Waheed U. Bajwa

Array structures based on the sum and difference co-arrays provide more degrees of freedom (DOF). However, since the growth of DOF is limited by a single case of sum and difference co-arrays, the paper aims to design a sparse linear array…

Signal Processing · Electrical Eng. & Systems 2025-04-24 Si Wang , Guoqiang Xiao

Several methods have been proposed to explain Deep Neural Network (DNN). However, to our knowledge, only classification networks have been studied to try to determine which input dimensions motivated the decision. Furthermore, as there is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-16 Mégane Millan , Catherine Achard

In this paper, we study the convergence rate of the DCA (Difference-of-Convex Algorithm), also known as the convex-concave procedure, with two different termination criteria that are suitable for smooth and nonsmooth decompositions…

Optimization and Control · Mathematics 2023-02-24 Hadi Abbaszadehpeivasti , Etienne de Klerk , Moslem Zamani

We investigate a difference-of-convex (DC) formulation where the second term is allowed to be weakly convex. We examine the precise behavior of a single iteration of the difference-of-convex algorithm (DCA), providing a tight…

Optimization and Control · Mathematics 2026-01-23 Teodor Rotaru , Panagiotis Patrinos , François Glineur

Discriminant analysis (DA) is one of the most popular methods for classification due to its conceptual simplicity, low computational cost, and often solid performance. In its standard form, DA uses the arithmetic mean and sample covariance…

Methodology · Statistics 2026-05-12 Mia Hubert , Jakob Raymaekers , Peter J. Rousseeuw

Angular x-ray cross-correlation analysis (XCCA) is an approach to study the structure of disordered systems using the results of x-ray scattering experiments. In this paper we summarize recent theoretical developments related to the Fourier…

Disordered Systems and Neural Networks · Physics 2013-10-16 R. P. Kurta , M. Altarelli , I. A. Vartanyants

In this work, we consider the application of model-based deep learning in nonlinear principal component analysis (PCA). Inspired by the deep unfolding methodology, we propose a task-based deep learning approach, referred to as Deep-RLS,…

Signal Processing · Electrical Eng. & Systems 2020-11-19 Zahra Esmaeilbeig , Shahin Khobahi , Mojtaba Soltanalian

A robust and sparse Direction of Arrival (DOA) estimator is derived for array data that follows a Complex Elliptically Symmetric (CES) distribution with zero-mean and finite second-order moments. The derivation allows to choose the loss…

Statistics Theory · Mathematics 2023-07-31 Christoph F. Mecklenbräuker , Peter Gerstoft , Esa Ollila , Yongsung Park

The restoration of nonlinearly distorted audio signals, alongside the identification of the applied memoryless nonlinear operation, is studied. The paper focuses on the difficult but practically important case in which both the nonlinearity…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-13 Michal Švento , Eloi Moliner , Lauri Juvela , Alec Wright , Vesa Välimäki