English
Related papers

Related papers: High-dimensional density estimation with tensorizi…

200 papers

Leveraging the recently emerging geometric approach to multivariate extremes and the flexibility of normalising flows on the hypersphere, we propose a principled deep-learning-based methodology that enables accurate joint tail extrapolation…

Methodology · Statistics 2025-05-07 Lambert De Monte , Raphaël Huser , Ioannis Papastathopoulos , Jordan Richards

We introduce an algorithmic framework based on tensor networks for computing fluid flows around immersed objects in curvilinear coordinates. We show that the tensor network simulations can be carried out solely using highly compressed…

A promising class of generative models maps points from a simple distribution to a complex distribution through an invertible neural network. Likelihood-based training of these models requires restricting their architectures to allow cheap…

Machine Learning · Computer Science 2018-10-23 Will Grathwohl , Ricky T. Q. Chen , Jesse Bettencourt , Ilya Sutskever , David Duvenaud

Dimensionality reduction is an effective method for learning high-dimensional data, which can provide better understanding of decision boundaries in human-readable low-dimensional subspace. Linear methods, such as principal component…

Machine Learning · Computer Science 2020-07-09 Koji Maruhashi , Heewon Park , Rui Yamaguchi , Satoru Miyano

Several interesting generative learning algorithms involve a complex probability distribution over many random variables, involving intractable normalization constants or latent variable normalization. Some of them may even not have an…

Machine Learning · Computer Science 2014-05-13 Yoshua Bengio , Li Yao , Kyunghyun Cho

Classical regression methods treat covariates as a vector and estimate a corresponding vector of regression coefficients. Modern applications in medical imaging generate covariates of more complex form such as multidimensional arrays…

Methodology · Statistics 2013-10-22 Hua Zhou , Lexin Li , Hongtu Zhu

This study proposes a data condensation method for multivariate kernel density estimation by genetic algorithm. First, our proposed algorithm generates multiple subsamples of a given size with replacement from the original sample. The…

Methodology · Statistics 2022-03-04 Kiheiji Nishida

To address the common problem of high dimensionality in tensor regressions, we introduce a generalized tensor random projection method that embeds high-dimensional tensor-valued covariates into low-dimensional subspaces with minimal loss of…

Methodology · Statistics 2025-10-03 Roberto Casarin , Radu Craiu , Qing Wang

We introduce manifold-learning flows (M-flows), a new class of generative models that simultaneously learn the data manifold as well as a tractable probability density on that manifold. Combining aspects of normalizing flows, GANs,…

Machine Learning · Statistics 2020-11-16 Johann Brehmer , Kyle Cranmer

Tuning of measurement models is challenging in real-world applications of sequential Monte Carlo methods. Recent advances in differentiable particle filters have led to various efforts to learn measurement models through neural networks.…

Artificial Intelligence · Computer Science 2022-03-17 Xiongjie Chen , Yunpeng Li

The convergence of many numerical optimization techniques is highly dependent on the initial guess given to the solver. To address this issue, we propose a novel approach that utilizes tensor methods to initialize existing optimization…

Robotics · Computer Science 2023-11-23 Suhan Shetty , Teguh Lembono , Tobias Loew , Sylvain Calinon

Existing machine learning methods for causal inference usually estimate quantities expressed via the mean of potential outcomes (e.g., average treatment effect). However, such quantities do not capture the full information about the…

Machine Learning · Computer Science 2023-06-21 Valentyn Melnychuk , Dennis Frauen , Stefan Feuerriegel

Most currently used tensor regression models for high-dimensional data are based on Tucker decomposition, which has good properties but loses its efficiency in compressing tensors very quickly as the order of tensors increases, say greater…

Methodology · Statistics 2024-03-20 Yuefeng Si , Yingying Zhang , Yuxi Cai , Chunling Liu , Guodong Li

Density estimation is a fundamental task in statistics and machine learning applications. Kernel density estimation is a powerful tool for non-parametric density estimation in low dimensions; however, its performance is poor in higher…

Machine Learning · Computer Science 2022-08-08 Joseph A. Gallego , Fabio A. González

We describe a method to computationally estimate the probability density function of a univariate random variable by applying the maximum entropy principle with some local conditions given by Gaussian functions. The estimation errors and…

Statistics Theory · Mathematics 2012-06-21 Mihail-Ioan Pop

We propose a framework for discrete scientific data compression based on the tensor-train (TT) decomposition. Our approach is tailored to handle unstructured output data from discrete element method (DEM) simulations, demonstrating its…

Numerical Analysis · Mathematics 2022-10-18 Saibal De , Eduardo Corona , Paramsothy Jayakumar , Shravan Veerapaneni

Beyond their origin in modeling many-body quantum systems, tensor networks have emerged as a promising class of models for solving machine learning problems, notably in unsupervised generative learning. While possessing many desirable…

Machine Learning · Computer Science 2024-07-26 Alex Meiburg , Jing Chen , Jacob Miller , Raphaëlle Tihon , Guillaume Rabusseau , Alejandro Perdomo-Ortiz

The identification of nonlinear dynamics from observations is essential for the alignment of the theoretical ideas and experimental data. The last, in turn, is often corrupted by the side effects and noise of different natures, so…

Machine Learning · Computer Science 2020-06-08 Anna Shalova , Ivan Oseledets

This study enhances a crowd density estimation algorithm originally designed for image-based analysis by adapting it for video-based scenarios. The proposed method integrates a denoising probabilistic model that utilizes diffusion processes…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Balachandra Devarangadi Sunil , Rakshith Venkatesh , Shantanu Todmal

We want to approximate general multivariate probability density functions by deterministic sample sets. For optimal sampling, the closeness to the given continuous density has to be assessed. This is a difficult challenge in multivariate…

Systems and Control · Electrical Eng. & Systems 2020-01-01 Uwe D. Hanebeck