English
Related papers

Related papers: On the Information Theoretic Limits of Learning Is…

200 papers

How complex is an Ising model? Usually, this is measured by the computational complexity of its ground state energy problem. Yet, this complexity measure only distinguishes between planar and non-planar interaction graphs, and thus fails to…

Statistical Mechanics · Physics 2025-05-28 Tobias Reinhart , Gemma De les Coves

Disentangled representation learning has recently attracted a significant amount of attention, particularly in the field of image representation learning. However, learning the disentangled representations behind a graph remains largely…

Machine Learning · Computer Science 2020-06-11 Xiaojie Guo , Liang Zhao , Zhao Qin , Lingfei Wu , Amarda Shehu , Yanfang Ye

Graphs are powerful abstractions for capturing complex relationships in diverse application settings. An active area of research focuses on theoretical models that define the generative mechanism of a graph. Yet given the complexity and…

Social and Information Networks · Computer Science 2016-09-19 Rajmonda S. Caceres , Leah Weiner , Matthew C. Schmidt , Benjamin A. Miller , William M. Campbell

Graphs are complex objects that do not lend themselves easily to typical learning tasks. Recently, a range of approaches based on graph kernels or graph neural networks have been developed for graph classification and for representation…

Machine Learning · Computer Science 2022-05-19 Chen Cai , Yusu Wang

In this paper, we find a sample complexity bound for learning a simplex from noisy samples. Assume a dataset of size $n$ is given which includes i.i.d. samples drawn from a uniform distribution over an unknown simplex in $\mathbb{R}^K$,…

Machine Learning · Statistics 2023-05-02 Amir Hossein Saberi , Amir Najafi , Seyed Abolfazl Motahari , Babak H. Khalaj

We explore what could make recognition of particular intersection-defined classes hard. We focus mainly on unit grid intersection graphs (UGIGs), i.e., intersection graphs of unit-length axis-aligned segments and grid intersection graphs…

Computational Geometry · Computer Science 2022-01-24 Irina Mustata , Martin Pergel

In recent work it has been shown that determining a feedforward ReLU neural network to within high uniform accuracy from point samples suffers from the curse of dimensionality in terms of the number of samples needed. As a consequence,…

Machine Learning · Statistics 2024-11-11 Yuanyuan Li , Philipp Grohs , Philipp Petersen

In this paper we propose a method of proving impossibility results based on applying strong data-processing inequalities to estimate mutual information between sets of variables forming certain Markov random fields. The end result is that…

Information Theory · Computer Science 2020-05-22 Yury Polyanskiy , Yihong Wu

When designing an algorithm, one cares about arithmetic/computational complexity, but data movement (I/O) complexity plays an increasingly important role that highly impacts performance and energy consumption. For a given algorithm and a…

Computational Complexity · Computer Science 2024-04-26 Lionel Eyraud-Dubois , Guillaume Iooss , Julien Langou , Fabrice Rastello

We describe a method for generating graphs that provide difficult examples for practical Graph Isomorphism testers. We first give the theoretical construction, showing that we can have a family of graphs without any non-trivial…

Computational Complexity · Computer Science 2019-03-19 Anuj Dawar , Kashif Khan

Graph embeddings learn the structure of networks and represent it in low-dimensional vector spaces. Community structure is one of the features that are recognized and reproduced by embeddings. We show that an iterative procedure, in which a…

Physics and Society · Physics 2024-07-30 Bianka Kovács , Sadamori Kojaku , Gergely Palla , Santo Fortunato

Limits of graphs were initiated recently in the two extreme contexts of dense and bounded degree graphs. This led to elegant limiting structures called graphons and graphings. These approach have been unified and generalized by authors in a…

Combinatorics · Mathematics 2013-12-03 Jaroslav Nesetril , Patrice Ossona De Mendez

In this paper, we analyze the information theoretic lower bound on the necessary number of samples needed for recovering a sparse signal under different compressed sensing settings. We focus on the weighted graph model, a model-based…

Information Theory · Computer Science 2022-09-16 Adarsh Barik , Jean Honorio

We describe here how the recent Wagner's approach for applying reinforcement learning to construct examples in graph theory can be used in the search for critical graphs for small Ramsey numbers. We illustrate this application by providing…

Combinatorics · Mathematics 2024-04-01 Mohammad Ghebleh , Salem Al-Yakoob , Ali Kanso , Dragan Stevanović

Small language models fine-tuned for graph property estimation have demonstrated strong in-distribution performance, yet their generalization capabilities beyond training conditions remain poorly understood. In this work, we systematically…

Machine Learning · Computer Science 2026-04-21 Michal Podstawski

We explore the rigidity of generic frameworks in 3-dimensions whose underlying graph is close to being planar. Specifically we consider apex graphs, edge-apex graphs and their variants and prove independence results in the generic…

Combinatorics · Mathematics 2024-02-28 Sean Dewar , Georg Grasegger , Eleftherios Kastis , Anthony Nixon , Brigitte Servatius

Graph convolutional networks (GCNs) are a widely used method for graph representation learning. To elucidate the capabilities and limitations of GCNs, we investigate their power, as a function of their number of layers, to distinguish…

Machine Learning · Statistics 2020-05-14 Abram Magner , Mayank Baranwal , Alfred O. Hero

Learning on temporal graphs has become a central topic in graph representation learning, with numerous benchmarks indicating the strong performance of state-of-the-art models. However, recent work has raised concerns about the reliability…

Machine Learning · Computer Science 2026-04-03 Abigail J. Hayes , Tobias Schumacher , Markus Strohmaier

Hierarchical structure and repetition are prevalent in graphs originating from nature or engineering. These patterns can be represented by a class of parametric-structure graphs, which are defined by templates that generate structure by way…

Data Structures and Algorithms · Computer Science 2020-11-16 Tal Ben-Nun , Lukas Gianinazzi , Torsten Hoefler , Yishai Oltchik

The adaptive processing of graph data is a long-standing research topic which has been lately consolidated as a theme of major interest in the deep learning community. The snap increase in the amount and breadth of related research has come…

Machine Learning · Computer Science 2020-06-16 Davide Bacciu , Federico Errica , Alessio Micheli , Marco Podda