English
Related papers

Related papers: Learning Nonlinear Factor Models with Unknown Mono…

200 papers

We study the problem of learning mixtures of low-rank models, i.e. reconstructing multiple low-rank matrices from unlabelled linear measurements of each. This problem enriches two widely studied settings -- low-rank matrix sensing and mixed…

Machine Learning · Statistics 2021-03-10 Yanxi Chen , Cong Ma , H. Vincent Poor , Yuxin Chen

Fully nonparametric methods for regression from functional data have poor accuracy from a statistical viewpoint, reflecting the fact that their convergence rates are slower than nonparametric rates for the estimation of high-dimensional…

Statistics Theory · Mathematics 2012-11-22 Dong Chen , Peter Hall , Hans-Georg Müller

We develop latent variable models for Bayesian learning based low-rank matrix completion and reconstruction from linear measurements. For under-determined systems, the developed methods are shown to reconstruct low-rank matrices when…

Machine Learning · Statistics 2015-01-26 Martin Sundin , Cristian R. Rojas , Magnus Jansson , Saikat Chatterjee

Many real-world datasets contain hidden structure that cannot be detected by simple linear correlations between input features. For example, latent factors may influence the data in a coordinated way, even though their effect is invisible…

In the wild, we often encounter collections of sequential data such as electrocardiograms, motion capture, genomes, and natural language, and sequences may be multichannel or symbolic with nonlinear dynamics. We introduce a new method to…

Machine Learning · Computer Science 2024-06-12 Jonathan Y. Zhou , Yao Xie

Link prediction is a fundamental task in statistical network analysis. Recent advances have been made on learning flexible nonparametric Bayesian latent feature models for link prediction. In this paper, we present a max-margin learning…

Machine Learning · Computer Science 2016-02-25 Jun Zhu , Jiaming Song , Bei Chen

This paper proposes a novel method for learning highly nonlinear, multivariate functions from examples. Our method takes advantage of the property that continuous functions can be approximated by polynomials, which in turn are representable…

Machine Learning · Computer Science 2020-05-05 Sandor Szedmak , Anna Cichonska , Heli Julkunen , Tapio Pahikkala , Juho Rousu

Factor analysis aims to determine latent factors, or traits, which summarize a given data set. Inter-battery factor analysis extends this notion to multiple views of the data. In this paper we show how a nonlinear, nonparametric version of…

Machine Learning · Statistics 2016-04-19 Andreas Damianou , Neil D. Lawrence , Carl Henrik Ek

Reconstructing the parameters that encode the influence between model variables based on time-series measurements represents an outstanding question in the theory of complex network-coupled systems. Here, we propose a solution to this…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Melvyn Tyloo

This work focuses on the problem of unraveling nonlinearly mixed latent components in an unsupervised manner. The latent components are assumed to reside in the probability simplex, and are transformed by an unknown post-nonlinear mixing…

Machine Learning · Computer Science 2021-09-15 Qi Lyu , Xiao Fu

We study the problem of learning Single-Index Models under the $L_2^2$ loss in the agnostic model. We give an efficient learning algorithm, achieving a constant factor approximation to the optimal loss, that succeeds under a range of…

Machine Learning · Computer Science 2024-02-28 Nikos Zarifis , Puqian Wang , Ilias Diakonikolas , Jelena Diakonikolas

Nearly all identifiability results in unsupervised representation learning inspired by, e.g., independent component analysis, factor analysis, and causal representation learning, rely on assumptions of additive independent noise or…

Machine Learning · Computer Science 2025-03-24 Yujia Zheng , Yang Liu , Jiaxiong Yao , Yingyao Hu , Kun Zhang

High-dimensional data often exhibit variation that can be captured by lower dimensional factors. For high-dimensional data from multiple studies or environments, one goal is to understand which underlying factors are common to all studies,…

Machine Learning · Statistics 2026-01-27 Gemma E. Moran , Anandi Krishnan

Factor models are widely used to reduce dimensionality in modeling high-dimensional data. However, there remains a need for models that can be reliably fit in modest sample sizes and are identifiable, interpretable, and flexible. To address…

Methodology · Statistics 2025-06-19 Maoran Xu , Steven Winter , Amy H. Herring , David B. Dunson

We present a max-margin nonparametric latent feature model, which unites the ideas of max-margin learning and Bayesian nonparametrics to discover discriminative latent features for link prediction and automatically infer the unknown latent…

Machine Learning · Computer Science 2012-06-22 Jun Zhu

In traditional logistic regression models, the link function is often assumed to be linear and continuous in predictors. Here, we consider a threshold model that all continuous features are discretized into ordinal levels, which further…

Methodology · Statistics 2022-02-18 Yinan Lin , Wen Zhou , Zhi Geng , Gexin Xiao , Jianxin Yin

We consider a high-dimensional monotone single index model (hdSIM), which is a semiparametric extension of a high-dimensional generalize linear model (hdGLM), where the link function is unknown, but constrained with monotone and…

Statistics Theory · Mathematics 2021-05-18 Ran Dai , Hyebin Song , Rina Foygel Barber , Garvesh Raskutti

In this paper, we focus on learning a linear time-invariant (LTI) model with low-dimensional latent variables but high-dimensional observations. We provide an algorithm that recovers the high-dimensional features, i.e. column space of the…

Systems and Control · Electrical Eng. & Systems 2024-06-27 Yuyang Zhang , Shahriar Talebi , Na Li

This paper addresses a kernel-based learning problem for a network of agents locally observing a latent multidimensional, nonlinear phenomenon in a noisy environment. We propose a learning algorithm that requires only mild a priori…

Multiagent Systems · Computer Science 2024-04-16 Krzysztof Kowalczyk , Paweł Wachel , Cristian R. Rojas

We introduce the nonparametric metadata dependent relational (NMDR) model, a Bayesian nonparametric stochastic block model for network data. The NMDR allows the entities associated with each node to have mixed membership in an unbounded…

Machine Learning · Computer Science 2012-07-03 Dae Il Kim , Michael Hughes , Erik Sudderth
‹ Prev 1 2 3 10 Next ›