English
Related papers

Related papers: Learning Independent Features with Adversarial Net…

200 papers

Independent component analysis (ICA) is now a widely used solution for the analysis of multi-subject functional magnetic resonance imaging (fMRI) data. Independent vector analysis (IVA) generalizes ICA to multiple datasets, i.e., to…

Signal Processing · Electrical Eng. & Systems 2023-11-10 Trung Vu , Francisco Laport , Hanlu Yang , Vince D. Calhoun , Tulay Adali

Likelihood based-learning of graphical models faces challenges of computational-complexity and robustness to model mis-specification. This paper studies methods that fit parameters directly to maximize a measure of the accuracy of predicted…

Machine Learning · Computer Science 2014-07-04 Justin Domke

Here, a separation theorem about Independent Subspace Analysis (ISA), a generalization of Independent Component Analysis (ICA) is proven. According to the theorem, ISA estimation can be executed in two steps under certain conditions. In the…

Statistics Theory · Mathematics 2007-06-13 Zoltan Szabo , Barnabas Poczos , Andras Lorincz

This paper investigates a general robust one-shot aggregation framework for distributed and federated Independent Component Analysis (ICA) problem. We propose a geometric median-based aggregation algorithm that leverages $k$-means…

Machine Learning · Computer Science 2025-05-28 Dian Jin , Xin Bing , Yuqian Zhang

Many scientific and engineering applications are formulated as inverse problems associated with stochastic models. In such cases the unknown quantities are distributions. The applicability of traditional methods is limited because of their…

Numerical Analysis · Mathematics 2019-10-16 Kailai Xu , Eric Darve

We propose a framework for adversarial training that relies on a sample rather than a single sample point as the fundamental unit of discrimination. Inspired by discrepancy measures and two-sample tests between probability distributions, we…

Machine Learning · Computer Science 2017-07-11 Chengtao Li , David Alvarez-Melis , Keyulu Xu , Stefanie Jegelka , Suvrit Sra

Independent component analysis (ICA) is an unsupervised learning method popular in functional magnetic resonance imaging (fMRI). Group ICA has been used to search for biomarkers in neurological disorders including autism spectrum disorder…

Methodology · Statistics 2021-01-14 Yuxuan Zhao , David S. Matteson , Mary Beth Nebel , Stewart H. Mostofsky , Benjamin Risk

As a seminal tool in self-supervised representation learning, contrastive learning has gained unprecedented attention in recent years. In essence, contrastive learning aims to leverage pairs of positive and negative samples for…

Machine Learning · Computer Science 2022-02-01 Ching-Yun Ko , Jeet Mohapatra , Sijia Liu , Pin-Yu Chen , Luca Daniel , Lily Weng

Conditional independence testing is a fundamental problem underlying causal discovery and a particularly challenging task in the presence of nonlinear and high-dimensional dependencies. Here a fully non-parametric test for continuous data…

Machine Learning · Statistics 2017-09-06 Jakob Runge

In this paper, we investigate the problem of classifying feature vectors with mutually independent but non-identically distributed elements. First, we show the importance of this problem. Next, we propose a classifier and derive an…

Machine Learning · Computer Science 2021-09-01 Farzad Shahrivari , Nikola Zlatanov

User dependence remains one of the most difficult general problems in Human Activity Recognition (HAR), in particular when using wearable sensors. This is due to the huge variability of the way different people execute even the simplest…

Signal Processing · Electrical Eng. & Systems 2021-10-26 Sungho Suh , Vitor Fortes Rey , Paul Lukowicz

This work investigates adversarial training in the context of margin-based linear classifiers in the high-dimensional regime where the dimension $d$ and the number of data points $n$ diverge with a fixed ratio $\alpha = n / d$. We introduce…

Machine Learning · Statistics 2026-01-13 Kasimir Tanner , Matteo Vilucchio , Bruno Loureiro , Florent Krzakala

Independent component analysis (ICA) has become a popular multivariate analysis and signal processing technique with diverse applications. This paper is targeted at discussing theoretical large sample properties of ICA unmixing matrix…

Methodology · Statistics 2012-12-18 Pauliina Ilmonen , Klaus Nordhausen , Hannu Oja , Esa Ollila

Fairness is becoming a rising concern w.r.t. machine learning model performance. Especially for sensitive fields such as criminal justice and loan decision, eliminating the prediction discrimination towards a certain group of population…

Machine Learning · Computer Science 2019-09-09 Xiaoqian Wang , Heng Huang

A core task in multi-modal learning is to integrate information from multiple feature spaces (e.g., text and audio), offering modality-invariant essential representations of data. Recent research showed that, classical tools such as {\it…

Machine Learning · Computer Science 2024-10-02 Subash Timilsina , Sagar Shrestha , Xiao Fu

Previous analytical studies of on-line Independent Component Analysis (ICA) learning rules have focussed on asymptotic stability and efficiency. In practice the transient stages of learning will often be more significant in determining the…

Disordered Systems and Neural Networks · Physics 2007-05-23 Magnus Rattray

The decomposition of a sample of images on a relevant subspace is a recurrent problem in many different fields from Computer Vision to medical image analysis. We propose in this paper a new learning principle and implementation of the…

Applications · Statistics 2012-03-19 Stéphanie Allassonniére , Laurent Younes

Many machine learning algorithms are based on the assumption that training examples are drawn independently. However, this assumption does not hold anymore when learning from a networked sample because two or more training examples may…

Artificial Intelligence · Computer Science 2017-06-06 Yuyi Wang , Jan Ramon , Zheng-Chu Guo

In the image classification task, deep neural networks frequently rely on bias attributes that are spuriously correlated with a target class in the presence of dataset bias, resulting in degraded performance when applied to data without…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jeonghoon Park , Chaeyeon Chung , Juyoung Lee , Jaegul Choo

In imitation learning from observation IfO, a learning agent seeks to imitate a demonstrating agent using only observations of the demonstrated behavior without access to the control signals generated by the demonstrator. Recent methods…

Machine Learning · Computer Science 2021-04-02 Faraz Torabi , Garrett Warnell , Peter Stone