English
Related papers

Related papers: Learnability and Competition in High-Dimensional M…

200 papers

Regression and Bayesian accounts of in-context learning (ICL) explain how demonstrations can induce predictors, while mechanistic analyses often identify compact activation directions that steer prompted behavior. However, it remains…

Machine Learning · Computer Science 2026-05-20 Wei Tang , Xinyan Jiang , Fakhri Karray , Lijie Hu

Spatial Independent Components Analysis (ICA) is increasingly used in the context of functional Magnetic Resonance Imaging (fMRI) to study cognition and brain pathologies. Salient features present in some of the extracted Independent…

Compositional automata learning is attracting attention as an analysis technique for complex black-box systems. It exploits a target system's internal compositional structure to reduce complexity. In this paper, we identify system…

Formal Languages and Automata Theory · Computer Science 2025-08-07 Hiroya Fujinami , Masaki Waga , Jie An , Kohei Suenaga , Nayuta Yanagisawa , Hiroki Iseri , Ichiro Hasuo

Independent Component Analysis (ICA) is a computational technique for revealing latent factors that underlie sets of measurements or signals. It has become a standard technique in functional neuroimaging. In functional neuroimaging, so…

Principal Component Analysis (PCA) is a fundamental tool for data visualization, denoising, and dimensionality reduction. It is widely popular in Statistics, Machine Learning, Computer Vision, and related fields. However, PCA is well-known…

Machine Learning · Statistics 2023-07-21 Debolina Paul , Saptarshi Chakraborty , Swagatam Das

Self-supervised learning can be used for mitigating the greedy needs of Vision Transformer networks for very large fully-annotated datasets. Different classes of self-supervised learning offer representations with either good contextual…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Spyros Gidaris , Andrei Bursuc , Oriane Simeoni , Antonin Vobecky , Nikos Komodakis , Matthieu Cord , Patrick Pérez

Independent component analysis (ICA) is a popular tool for investigating brain organization in neuroscience research. In fMRI studies, an important goal is to study how brain networks are modulated by subjects' clinical and demographic…

Computation · Statistics 2020-04-08 Joshua Lukemire , Yikai Wang , Amit Verma , Ying Guo

In many settings, we have multiple data sets (also called views) that capture different and overlapping aspects of the same phenomenon. We are often interested in finding patterns that are unique to one or to a subset of the views. For…

Machine Learning · Computer Science 2015-07-15 Rong Ge , James Zou

Nonlinear independent component analysis (ICA) is a general framework for unsupervised representation learning, and aimed at recovering the latent variables in data. Recent practical methods perform nonlinear ICA by solving a series of…

Machine Learning · Computer Science 2019-11-04 Hiroaki Sasaki , Takashi Takenouchi , Ricardo Monti , Aapo Hyvärinen

Iterative learning control (ILC) improves the performance of a repetitive system by learning from previous trials. ILC can be combined with Model Predictive Control (MPC) to mitigate non-repetitive disturbances, thus improving overall…

Systems and Control · Electrical Eng. & Systems 2025-03-26 Riccardo Zuliani , Efe C. Balta , Alisa Rupenyan , John Lygeros

This paper investigates a general robust one-shot aggregation framework for distributed and federated Independent Component Analysis (ICA) problem. We propose a geometric median-based aggregation algorithm that leverages $k$-means…

Machine Learning · Computer Science 2025-05-28 Dian Jin , Xin Bing , Yuqian Zhang

Recent studies have explored the working mechanisms of In-Context Learning (ICL). However, they mainly focus on classification and simple generation tasks, limiting their broader application to more complex generation tasks in practice. To…

Computation and Language · Computer Science 2025-03-14 Zhenyu Liu , Dongfang Li , Xinshuo Hu , Xinping Zhao , Yibin Chen , Baotian Hu , Min Zhang

Latent variable discovery is a central problem in data analysis with a broad range of applications in applied science. In this work, we consider data given as an invertible mixture of two statistically independent components and assume that…

Machine Learning · Statistics 2023-03-08 Uri Shaham , Jonathan Svirsky , Ori Katz , Ronen Talmon

We present a polynomial-time algorithm for robustly learning an unknown affine transformation of the standard hypercube from samples, an important and well-studied setting for independent component analysis (ICA). Specifically, given an…

Data Structures and Algorithms · Computer Science 2023-02-27 He Jia , Pravesh K . Kothari , Santosh S. Vempala

Latent component identification from unknown nonlinear mixtures is a foundational challenge in machine learning, with applications in tasks such as disentangled representation learning and causal inference. Prior work in nonlinear…

Machine Learning · Computer Science 2025-10-22 Hoang-Son Nguyen , Xiao Fu

Conditional independence (CI) is central to causal inference, feature selection, and graphical modeling, yet it is untestable in many settings without additional assumptions. Existing CI tests often rely on restrictive structural…

Machine Learning · Computer Science 2025-12-23 Alek Frohlich , Vladimir Kostic , Karim Lounici , Daniel Perazzo , Massimiliano Pontil

Application of independent component analysis (ICA) as an unmixing and image clustering technique for high spatial resolution Raman maps is reported. A hyperspectral map of a fixed human cell was collected by a Raman micro spectrometer in a…

Quantitative Methods · Quantitative Biology 2022-01-02 M. Hamed Mozaffari , Li-Lin Tay

Marine controlled source electromagnetic (CSEM) sensing method used for the detection of hydrocarbons based reservoirs in seabed logging application does not perform well due to the presence of the airwaves (or sea-surface). These airwaves…

Other Computer Science · Computer Science 2013-03-12 Adeel Ansari , Afza Bt Shafie , Abas B Md Said , Seema Ansari

Extracting meaningful latent representations from high-dimensional sequential data is a crucial challenge in machine learning, with applications spanning natural science and engineering. We introduce InfoDPCCA, a dynamic probabilistic…

Machine Learning · Computer Science 2025-06-11 Shiqin Tang , Shujian Yu

Supervised operator learning is an emerging machine learning paradigm with applications to modeling the evolution of spatio-temporal dynamical systems and approximating general black-box relationships between functional data. We propose a…