English
Related papers

Related papers: Efficient Learning of Mixed Membership Models

200 papers

Many vision-related tasks benefit from reasoning over multiple modalities to leverage complementary views of data in an attempt to learn robust embedding spaces. Most deep learning-based methods rely on a late fusion technique whereby…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Austin Reiter , Menglin Jia , Pu Yang , Ser-Nam Lim

Medical imaging involves high-dimensional data, yet their acquisition is obtained for limited samples. Multivariate predictive models have become popular in the last decades to fit some external variables from imaging data, and standard…

Applications · Statistics 2018-06-18 Jérôme-Alexis Chevalier , Joseph Salmon , Bertrand Thirion

We present a new mixed finite element method for a class of parabolic equations with $p$-Laplacian and nonlinear memory. The applicability, stability and convergence of the method are studied. First, the problem is written in a mixed…

Numerical Analysis · Mathematics 2022-03-18 Rui M. P. Almeida , José C. M. Duque , Belchior C. X. Mário

This work studies the combinatorial optimization problem of finding an optimal core tensor shape, also called multilinear rank, for a size-constrained Tucker decomposition. We give an algorithm with provable approximation guarantees for its…

Data Structures and Algorithms · Computer Science 2024-06-19 Mehrdad Ghadiri , Matthew Fahrbach , Gang Fu , Vahab Mirrokni

Tensor completion is a natural higher-order generalization of matrix completion where the goal is to recover a low-rank tensor from sparse observations of its entries. Existing algorithms are either heuristic without provable guarantees,…

Data Structures and Algorithms · Computer Science 2023-07-14 Allen Liu , Ankur Moitra

Multimodal research is an emerging field of artificial intelligence, and one of the main research problems in this field is multimodal fusion. The fusion of multimodal data is the process of integrating multiple unimodal representations…

Artificial Intelligence · Computer Science 2018-06-04 Zhun Liu , Ying Shen , Varun Bharadhwaj Lakshminarasimhan , Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

Tensor decomposition has been extensively used as a tool for exploratory analysis. Motivated by neuroscience applications, we study tensor decomposition with Boolean factors. The resulting optimization problem is challenging due to the…

Machine Learning · Computer Science 2020-11-13 Sung-En Chang , Xun Zheng , Ian E. H. Yen , Pradeep Ravikumar , Rose Yu

Maximizing a monotone submodular function is a fundamental task in machine learning. In this paper, we study the deletion robust version of the problem under the classic matroids constraint. Here the goal is to extract a small size summary…

Data Structures and Algorithms · Computer Science 2024-02-20 Paul Dütting , Federico Fusco , Silvio Lattanzi , Ashkan Norouzi-Fard , Morteza Zadimoghaddam

Tensor decompositions, which represent an $N$-order tensor using approximately $N$ factors of much smaller dimensions, can significantly reduce the number of parameters. This is particularly beneficial for high-order tensors, as the number…

Machine Learning · Computer Science 2025-06-23 Zhen Qin , Michael B. Wakin , Zhihui Zhu

A serious problem in learning probabilistic models is the presence of hidden variables. These variables are not observed, yet interact with several of the observed variables. Detecting hidden variables poses two problems: determining the…

Machine Learning · Computer Science 2013-01-14 Gal Elidan , Nir Friedman

In this paper we derive an efficient algorithm to learn the parameters of structured predictors in general graphical models. This algorithm blends the learning and inference tasks, which results in a significant speedup over traditional…

Machine Learning · Computer Science 2013-09-02 Tamir Hazan , Alexander Schwing , David McAllester , Raquel Urtasun

Mixture proportion estimation (MPE) is the problem of estimating the weight of a component distribution in a mixture, given samples from the mixture and component. This problem constitutes a key part in many "weakly supervised learning"…

Machine Learning · Computer Science 2016-06-01 Harish G. Ramaswamy , Clayton Scott , Ambuj Tewari

Reinforcement learning algorithms typically consider discrete-time dynamics, even though the underlying systems are often continuous in time. In this paper, we introduce a model-based reinforcement learning algorithm that represents…

Machine Learning · Computer Science 2023-11-01 Lenart Treven , Jonas Hübotter , Bhavya Sukhija , Florian Dörfler , Andreas Krause

The use of machine learning algorithms is an attractive way to produce very fast detector simulations for scattering reactions that can otherwise be computationally expensive. Here we develop a factorised approach where we deal with each…

Data Analysis, Statistics and Probability · Physics 2022-07-26 D. Darulis , R. Tyson , D. G. Ireland , D. I. Glazier , B. McKinnon , P. Pauli

We study the design of sample-efficient algorithms for reinforcement learning in the presence of rich, high-dimensional observations, formalized via the Block MDP problem. Existing algorithms suffer from either 1) computational…

Machine Learning · Computer Science 2023-04-13 Zakaria Mhammedi , Dylan J. Foster , Alexander Rakhlin

Determining whether a dataset was part of a machine learning model's training data pool can reveal privacy vulnerabilities, a challenge often addressed through membership inference attacks (MIAs). Traditional MIAs typically require access…

Machine Learning · Computer Science 2025-06-03 Yongchao Huang

In this paper, we aim at the completion problem of high order tensor data with missing entries. The existing tensor factorization and completion methods suffer from the curse of dimensionality when the order of tensor N>>3. To overcome this…

Numerical Analysis · Computer Science 2017-09-15 Longhao Yuan , Qibin Zhao , Jianting Cao

For many tasks of data analysis, we may only have the information of the explanatory variable and the evaluation of the response values are quite expensive. While it is impractical or too costly to obtain the responses of all units, a…

Computation · Statistics 2023-04-07 Wei Zheng , Ting Tian , Xueqin Wang

Gaussian mixture models (GMMs) are fundamental tools in statistical and data sciences. We study the moments of multivariate Gaussians and GMMs. The $d$-th moment of an $n$-dimensional random variable is a symmetric $d$-way tensor of size…

Machine Learning · Statistics 2022-03-23 João M. Pereira , Joe Kileel , Tamara G. Kolda

Noise-tolerant PAC learning of linear models has been of central interests in machine learning community since the last century. In recent years, many computationally-efficient algorithms have been proposed for the problem of learning…

Machine Learning · Computer Science 2026-05-19 Rita Adhikari , Shiwei Zeng