English
Related papers

Related papers: PSD Representations for Effective Probability Mode…

200 papers

We want to approximate general multivariate probability density functions by deterministic sample sets. For optimal sampling, the closeness to the given continuous density has to be assessed. This is a difficult challenge in multivariate…

Systems and Control · Electrical Eng. & Systems 2020-01-01 Uwe D. Hanebeck

In this paper, we propose a convex optimization-based estimation of sparse and smooth power spectral densities (PSDs) of complex-valued random processes from mixtures of realizations. While the PSDs are related to the magnitude of the…

Signal Processing · Electrical Eng. & Systems 2024-01-23 Hiroki Kuroda , Daichi Kitahara , Eiichi Yoshikawa , Hiroshi Kikuchi , Tomoo Ushio

Submodular continuous functions are a category of (generally) non-convex/non-concave functions with a wide spectrum of applications. We characterize these functions and demonstrate that they can be maximized efficiently with approximation…

Machine Learning · Computer Science 2019-05-07 Andrew An Bian , Baharan Mirzasoleiman , Joachim M. Buhmann , Andreas Krause

We propose $\textit{weighted inner product similarity}$ (WIPS) for neural network-based graph embedding. In addition to the parameters of neural networks, we optimize the weights of the inner product by allowing positive and negative…

Machine Learning · Computer Science 2019-06-04 Geewook Kim , Akifumi Okuno , Kazuki Fukui , Hidetoshi Shimodaira

In this paper, we propose a novel, effective and efficient probabilistic pruning criterion for probabilistic similarity queries on uncertain data. Our approach supports a general uncertainty model using continuous probabilistic density…

A random set is a generalisation of a random variable, i.e. a set-valued random variable. The random set theory allows a unification of other uncertainty descriptions such as interval variable, mass belief function in Dempster-Shafer theory…

Numerical Analysis · Mathematics 2018-11-27 Truong-Vinh Hoang , Hermann G. Matthies

Experimental evidence indicates that simple models outperform complex deep networks on many unsupervised similarity tasks. We provide a simple yet rigorous explanation for this behaviour by introducing the concept of an optimal…

Artificial Intelligence · Computer Science 2018-05-10 Vitalii Zhelezniak , Dan Busbridge , April Shen , Samuel L. Smith , Nils Y. Hammerla

One of the theoretical pillars that sustain certain machine learning models are universal approximation theorems, which prove that they can approximate all functions from a function class to arbitrary precision. Independently, classical…

Disordered Systems and Neural Networks · Physics 2026-04-28 Tobias Reinhart , Gemma De les Coves

In this work, we address the challenge of multi-task image generation with limited data for denoising diffusion probabilistic models (DDPM), a class of generative models that produce high-quality images by reversing a noisy diffusion…

Machine Learning · Computer Science 2023-11-29 Delaram Pirhayatifard , Mohammad Taha Toghani , Guha Balakrishnan , César A. Uribe

We propose new semi-supervised nonnegative matrix factorization (SSNMF) models for document classification and provide motivation for these models as maximum likelihood estimators. The proposed SSNMF models simultaneously provide both a…

Integrating probability and non-probability samples is increasingly important, yet unknown sampling mechanisms in non-probability sources complicate identification and efficient estimation. We develop semiparametric theory for dual-frame…

Methodology · Statistics 2026-01-14 Kosuke Morikawa , Jae Kwang Kim

In this paper we parameterize non-negative matrices of sum one and rank at most two. More precisely, we give a family of parameterizations using the least possible number of parameters. We also show how these parameterizations relate to a…

Computation · Statistics 2009-11-10 Enrico Carlini , Fabio Rapallo

Kernel mean embeddings are a popular tool that consists in representing probability measures by their infinite-dimensional mean embeddings in a reproducing kernel Hilbert space. When the kernel is characteristic, mean embeddings can be used…

Machine Learning · Computer Science 2021-06-29 Boris Muzellec , Francis Bach , Alessandro Rudi

We propose a systematic procedure for the approximation of density functionals in density functional theory that consists of two parts. First, for the efficient approximation of a general density functional, we introduce an efficient ansatz…

Strongly Correlated Electrons · Physics 2016-08-29 Michael Lubasch , Johanna I. Fuks , Heiko Appel , Angel Rubio , J. Ignacio Cirac , Mari-Carmen Bañuls

We provide finite-sample distribution approximations, that are uniform in the parameter, for inference in linear mixed models. Focus is on variances and covariances of random effects in cases where existing theory fails because their…

Statistics Theory · Mathematics 2025-07-29 Karl Oskar Ekvall , Matteo Bottai

We review the class of species sampling models (SSM). In particular, we investigate the relation between the exchangeable partition probability function (EPPF) and the predictive probability function (PPF). It is straightforward to define a…

Methodology · Statistics 2013-06-12 Jaeyong Lee , Fernando A. Quintana , Peter Müller , Lorenzo Trippa

This paper develops a comprehensive probabilistic setup to compute approximating functions in active subspaces. Constantine et al. proposed the active subspace method in (Constantine et al., 2014) to reduce the dimension of computational…

Probability · Mathematics 2019-04-09 Mario Teixeira Parente

Our goal is to provide a review of deep learning methods which provide insight into structured high-dimensional data. Rather than using shallow additive architectures common to most statistical models, deep learning uses layers of…

Machine Learning · Statistics 2023-10-11 Nick Polson , Vadim Sokolov

We introduce an alternative formulation of the exact stochastic simulation algorithm (SSA) for sampling trajectories of the chemical master equation for a well-stirred system of coupled chemical reactions. Our formulation is based on…

Quantitative Methods · Quantitative Biology 2015-05-13 Rajesh Ramaswamy , Nélido González-Segredo , Ivo F. Sbalzarini

The reverse engineering problem with probabilities and sequential behavior is introducing here, using the expression of an algorithm. The solution is partially founded, because we solve the problem only if we have a Probabilistic Sequential…

Dynamical Systems · Mathematics 2007-08-13 Maria A. Avino-Diaz