English
Related papers

Related papers: Statistical Depth Meets Machine Learning: Kernel M…

200 papers

Statistical information is ubiquitous but drawing valid conclusions from it is prohibitively hard. We explain how knowledge graph embeddings can be used to approximate probabilistic inference efficiently using the example of Statistical EL…

Artificial Intelligence · Computer Science 2024-07-17 Yuqicheng Zhu , Nico Potyka , Bo Xiong , Trung-Kien Tran , Mojtaba Nayyeri , Evgeny Kharlamov , Steffen Staab

We propose a nonparametric two-sample test procedure based on Maximum Mean Discrepancy (MMD) for testing the hypothesis that two samples of functions have the same underlying distribution, using kernels defined on function spaces. This…

Statistics Theory · Mathematics 2020-10-20 George Wynne , Andrew B. Duncan

Empirical data can often be considered as samples from a set of probability distributions. Kernel methods have emerged as a natural approach for learning to classify these distributions. Although numerous kernels between distributions have…

Machine Learning · Computer Science 2024-12-02 Oleksii Kachaiev , Stefano Recanatesi

We study the settings for which deep contextual embeddings (e.g., BERT) give large improvements in performance relative to classic pretrained embeddings (e.g., GloVe), and an even simpler baseline---random word embeddings---focusing on the…

Computation and Language · Computer Science 2020-05-20 Simran Arora , Avner May , Jian Zhang , Christopher Ré

With the emergence of deep learning, metric learning has gained significant popularity in numerous machine learning tasks dealing with complex and large-scale datasets, such as information retrieval, object recognition and recommendation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Imam Mustafa Kamal , Hyerim Bae , Ling Liu

While several feature embedding models have been developed in the literature, comparisons of these embeddings have largely focused on their numerical performance in classification-related downstream applications. However, an interpretable…

Machine Learning · Computer Science 2025-08-19 Mohammad Jalali , Bahar Dibaei Nia , Farzan Farnia

Depth is a complexity measure for natural systems of the kind studied in statistical physics and is defined in terms of computational complexity. Depth quantifies the length of the shortest parallel computation required to construct a…

Popular Physics · Physics 2011-11-14 Jon Machta

In many applications of machine learning, a large number of variables are considered. Motivated by machine learning of interacting particle systems, we consider the situation when the number of input variables goes to infinity. First, we…

Machine Learning · Computer Science 2023-10-30 Christian Fiedler , Michael Herty , Sebastian Trimpe

In contrast to regular (simple) networks, hyper networks possess the ability to depict more complex relationships among nodes and store extensive information. Such networks are commonly found in real-world applications, such as in social…

Social and Information Networks · Computer Science 2023-11-08 Shu Liu , Cameron Lai , Fujio Toriumi

Embeddings are now used to underpin a wide variety of data management tasks, including entity resolution, dataset search and semantic type detection. Such applications often involve datasets with numerical columns, but there has been more…

Databases · Computer Science 2024-10-11 Hafiz Tayyab Rauf , Alex Bogatu , Norman W. Paton , Andre Freitas

We propose a differentially private data generation paradigm using random feature representations of kernel mean embeddings when comparing the distribution of true data with that of synthetic data. We exploit the random feature…

Machine Learning · Computer Science 2021-06-02 Frederik Harder , Kamil Adamczewski , Mijung Park

Classical multivariate statistics measures the outlyingness of a point by its Mahalanobis distance from the mean, which is based on the mean and the covariance matrix of the data. A multivariate depth function is a function which, given a…

Methodology · Statistics 2021-05-06 Karl Mosler , Pavlo Mozharovskyi

Graph embedding provides a feasible methodology to conduct pattern classification for graph-structured data by mapping each data into the vectorial space. Various pioneering works are essentially coding method that concentrates on a…

Machine Learning · Computer Science 2022-10-04 Xue Liu , Dan Sun , Xiaobo Cao , Hao Ye , Wei Wei

A statistical model M is a family of probability distributions, characterised by a set of continuous parameters known as the parameter space. This possesses natural geometrical properties induced by the embedding of the family of…

General Relativity and Quantum Cosmology · Physics 2009-10-30 Dorje C. Brody , Lane P. Hughston

An embedding is a function that maps entities from one algebraic structure into another while preserving certain characteristics. Embeddings are being used successfully for mapping relational data or text into vector spaces where they can…

Artificial Intelligence · Computer Science 2019-02-28 Maxat Kulmanov , Wang Liu-Wei , Yuan Yan , Robert Hoehndorf

We adapt concepts, methodology, and theory originally developed in the areas of multidimensional scaling and dimensionality reduction for multivariate data to the functional setting. We focus on classical scaling and Isomap -- prototypical…

Statistics Theory · Mathematics 2022-09-01 Ery Arias-Castro , Wanli Qiao

Embeddings are a basic initial feature extraction step in many machine learning models, particularly in natural language processing. An embedding attempts to map data tokens to a low-dimensional space where similar tokens are mapped to…

Machine Learning · Computer Science 2025-04-10 Golara Ahmadi Azar , Melika Emami , Alyson Fletcher , Sundeep Rangan

Scientific research's mandate is to comprehend and explore the world, as well as to improve it based on experience and knowledge. Knowledge embedding and knowledge discovery are two significant methods of integrating knowledge and data.…

Artificial Intelligence · Computer Science 2022-04-12 Yuntian Chen , Dongxiao Zhang

Dealing with massive data is a challenging task for machine learning. An important aspect of machine learning is function approximation. In the context of massive data, some of the commonly used tools for this purpose are sparsity,…

Machine Learning · Computer Science 2020-07-08 Hrushikesh N Mhaskar

A significant portion of the data today, e.g, social networks, web connections, etc., can be modeled by graphs. A proper analysis of graphs with Machine Learning (ML) algorithms has the potential to yield far-reaching insights into many…

Social and Information Networks · Computer Science 2020-09-11 Taha Atahan Akyildiz , Amro Alabsi Aljundi , Kamer Kaya