English
Related papers

Related papers: Provable Gaussian Embedding with One Observation

200 papers

Gaussian Processes (GPs) are known to provide accurate predictions and uncertainty estimates even with small amounts of labeled data by capturing similarity between data points through their kernel function. However traditional GP kernels…

Machine Learning · Computer Science 2021-11-16 Ankur Mallick , Chaitanya Dwivedi , Bhavya Kailkhura , Gauri Joshi , T. Yong-Jin Han

We introduce a scalable Bayesian preference learning method for identifying convincing arguments in the absence of gold-standard rat- ings or rankings. In contrast to previous work, we avoid the need for separate methods to perform quality…

Computation and Language · Computer Science 2018-06-08 Edwin Simpson , Iryna Gurevych

Vision-Language Models (VLMs) learn joint representations by mapping images and text into a shared latent space. However, recent research highlights that deterministic embeddings from standard VLMs often struggle to capture the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Aishwarya Venkataramanan , Paul Bodesheim , Joachim Denzler

Gaussian state space models have been used for decades as generative models of sequential data. They admit an intuitive probabilistic interpretation, have a simple functional form, and enjoy widespread adoption. We introduce a unified…

Machine Learning · Statistics 2016-12-06 Rahul G. Krishnan , Uri Shalit , David Sontag

A well-designed vectorized representation is crucial for the learning systems natively based on 3D Gaussian Splatting. While 3DGS enables efficient and explicit 3D reconstruction, its parameter-based representation remains hard to learn as…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yuelin Xin , Yuheng Liu , Xiaohui Xie , Xinke Li

Bayesian inference on structured models typically relies on the ability to infer posterior distributions of underlying hidden variables. However, inference in implicit models or complex posterior distributions is hard. A popular tool for…

Machine Learning · Statistics 2016-12-16 Theofanis Karaletsos

Understanding the impact of data structure on the computational tractability of learning is a key challenge for the theory of neural networks. Many theoretical works do not explicitly model training data, or assume that inputs are drawn…

Machine Learning · Statistics 2022-05-23 Sebastian Goldt , Bruno Loureiro , Galen Reeves , Florent Krzakala , Marc Mézard , Lenka Zdeborová

We propose an Gaussian Mixture Model (GMM) learning algorithm, based on our previous work of GMM expansion idea. The new algorithm brings more robustness and simplicity than classic Expectation Maximization (EM) algorithm. It also improves…

Machine Learning · Computer Science 2023-09-07 Weiguo Lu , Xuan Wu , Deng Ding , Gangnan Yuan

Recent work in learning ontologies (hierarchical and partially-ordered structures) has leveraged the intrinsic geometry of spaces of learned representations to make predictions that automatically obey complex structural constraints. We…

Computation and Language · Computer Science 2017-08-03 Xiang Li , Luke Vilnis , Andrew McCallum

Relational representation learning transforms relational data into continuous and low-dimensional vector representations. However, vector-based representations fall short in capturing crucial properties of relational data that are complex…

Machine Learning · Computer Science 2024-09-25 Bo Xiong

Supervised manifold learning methods learn data representations by preserving the geometric structure of data while enhancing the separation between data samples from different classes. In this work, we propose a theoretical study of…

Machine Learning · Computer Science 2018-01-08 Elif Vural , Christine Guillemot

The versatility of exponential families, along with their attendant convexity properties, make them a popular and effective statistical model. A central issue is learning these models in high-dimensions, such as when there is some sparsity…

Machine Learning · Computer Science 2015-05-19 Sham M. Kakade , Ohad Shamir , Karthik Sridharan , Ambuj Tewari

Humans rely on effective representations to learn from few examples and abstract useful information from sensory data. Inducing such representations in machine learning models has been shown to improve their performance on various…

Machine Learning · Computer Science 2025-02-03 Raja Marjieh , Sreejan Kumar , Declan Campbell , Liyi Zhang , Gianluca Bencomo , Jake Snell , Thomas L. Griffiths

Deep Gaussian Processes learn probabilistic data representations for supervised learning by cascading multiple Gaussian Processes. While this model family promises flexible predictive distributions, exact inference is not tractable.…

Machine Learning · Statistics 2020-10-23 Jakob Lindinger , David Reeb , Christoph Lippert , Barbara Rakitsch

Most of existing embedding based recommendation models use embeddings (vectors) corresponding to a single fixed point in low-dimensional space, to represent users and items. Such embeddings fail to precisely represent the users/items with…

Information Retrieval · Computer Science 2020-06-22 Junyang Jiang , Deqing Yang , Yanghua Xiao , Chenlu Shen

We consider the challenging problem of statistical inference for exponential-family random graph models based on a single observation of a random graph with complex dependence. To facilitate statistical inference, we consider random graphs…

Statistics Theory · Mathematics 2020-03-13 Michael Schweinberger

This work represents a natural coalescence of two important lines of work: learning mixtures of Gaussians and algorithmic robust statistics. In particular we give the first provably robust algorithm for learning mixtures of any constant…

Data Structures and Algorithms · Computer Science 2021-07-27 Allen Liu , Ankur Moitra

Affordances are fundamental descriptors of relationships between actions, objects and effects. They provide the means whereby a robot can predict effects, recognize actions, select objects and plan its behavior according to desired goals.…

Robotics · Computer Science 2024-02-12 Pedro Osório , Alexandre Bernardino , Ruben Martinez-Cantin , José Santos-Victor

Gaussian graphical models provide a powerful framework to reveal the conditional dependency structure between multivariate variables. The process of uncovering the conditional dependency network is known as structure learning. Bayesian…

Methodology · Statistics 2024-07-30 Lucas Vogels , Reza Mohammadi , Marit Schoonhoven , S. Ilker Birbil

Word embedding, which encodes words into vectors, is an important starting point in natural language processing and commonly used in many text-based machine learning tasks. However, in most current word embedding approaches, the similarity…

Computation and Language · Computer Science 2018-12-27 Denis Sedov , Zhirong Yang