English
Related papers

Related papers: Universal Lossless Compression of Graphical Data

200 papers

We introduce a general framework for undirected graphical models. It generalizes Gaussian graphical models to a wide range of continuous, discrete, and combinations of different types of data. The models in the framework, called exponential…

Statistics Theory · Mathematics 2019-06-18 Rui Zhuang , Noah Simon , Johannes Lederer

Conditional graph entropy is known to be the minimal rate for a natural functional compression problem with side information at the receiver. In this paper we show that it can be formulated as an alternating minimization problem, which…

Information Theory · Computer Science 2023-09-12 Viktor Harangi , Xueyan Niu , Bo Bai

In the last few decades, research techniques have improved lossless compression ratios by significantly increasing processing time. However, these techniques have not gained popularity in industry because production systems require high…

Network (or graph) sparsification compresses a graph by removing inessential edges. By reducing the data volume, it accelerates or even facilitates many downstream analyses. Still, the accuracy of many sparsification methods, with…

Social and Information Networks · Computer Science 2023-09-28 Zhen Su , Jürgen Kurths , Henning Meyerhenke

Data used for analytics and machine learning often take the form of tables with categorical entries. We introduce a family of lossless compression algorithms for such data that proceed in four steps: $(i)$ Estimate latent variables…

Information Theory · Computer Science 2023-02-21 Andrea Montanari , Eric Weiner

The goal of lossy data compression is to reduce the storage cost of a data set $X$ while retaining as much information as possible about something ($Y$) that you care about. For example, what aspects of an image $X$ contain the most…

Machine Learning · Computer Science 2020-01-16 Max Tegmark , Tailin Wu

Graph algorithms are widely used for decision making and knowledge discovery. To ensure their effectiveness, it is essential that their output remains stable even when subjected to small perturbations to the input because frequent output…

Data Structures and Algorithms · Computer Science 2023-09-15 Soh Kumabe , Yuichi Yoshida

We study finite-sum nonlinear programs with localized variable coupling encoded by a (hyper)graph. We introduce a graph-compliant decomposition framework that brings message passing into continuous optimization in a rigorous, implementable,…

Optimization and Control · Mathematics 2026-01-19 Kuangyu Ding , Marie Maros , Gesualdo Scutari

The burgeoning volume of graph data presents significant computational challenges in training graph neural networks (GNNs), critically impeding their efficiency in various applications. To tackle this challenge, graph condensation (GC) has…

Machine Learning · Computer Science 2024-06-13 Xinyi Gao , Tong Chen , Wentao Zhang , Yayong Li , Xiangguo Sun , Hongzhi Yin

This work presents a maximum entropy principle based algorithm for solving minimum multiway $k$-cut problem defined over static and dynamic {\em digraphs}. A multiway $k$-cut problem requires partitioning the set of nodes in a graph into…

Optimization and Control · Mathematics 2019-07-23 Mayank Baranwal , Amber Srivastava , Srinivasa Salapaka

It is known that modeling an information source via a symbolic dynamical system evolving over the unit interval, leads to a natural lossless compression scheme attaining the entropy rate of the source, under general conditions. We extend…

Information Theory · Computer Science 2010-01-21 Ofer Shayevitz

Finding a maximum-cardinality or maximum-weight matching in (edge-weighted) undirected graphs is among the most prominent problems of algorithmic graph theory. For $n$-vertex and $m$-edge graphs, the best known algorithms run in…

Data Structures and Algorithms · Computer Science 2021-05-10 Tomohiro Koana , Viatcheslav Korenwein , André Nichterlein , Rolf Niedermeier , Philipp Zschoche

The entropy of a graph is a functional depending both on the graph itself and on a probability distribution on its vertex set. This graph functional originated from the problem of source coding in information theory and was introduced by J.…

Combinatorics · Mathematics 2013-11-25 Seyed Saeed Changiz Rezaei

Parameter-free stochastic optimization aims to design algorithms that are agnostic to the underlying problem parameters while still achieving convergence rates competitive with optimally tuned methods. While some parameter-free methods do…

Machine Learning · Computer Science 2026-04-21 Yuheng Zhao , Yu-Hu Yan , Amit Attia , Tomer Koren , Lijun Zhang , Peng Zhao

This study addresses the issue of balancing graph summarization and graph change detection. Graph summarization compresses large-scale graphs into a smaller scale. However, the question remains: To what extent should the original graph be…

Machine Learning · Statistics 2023-12-13 Shintaro Fukushima , Kenji Yamanishi

The performance of a lossy data compression scheme for uniformly biased Boolean messages is investigated via methods of statistical mechanics. Inspired by a formal similarity to the storage capacity problem in the research of neural…

Statistical Mechanics · Physics 2009-11-07 T. Hosaka , Y. Kabashima , H. Nishimori

Graph partitioning is the problem of dividing the nodes of a graph into balanced partitions while minimizing the edge cut across the partitions. Due to its combinatorial nature, many approximate solutions have been developed, including…

Machine Learning · Computer Science 2019-03-05 Azade Nazi , Will Hang , Anna Goldie , Sujith Ravi , Azalia Mirhoseini

In recent deep image compression neural networks, the entropy model plays a critical role in estimating the prior distribution of deep image encodings. Existing methods combine hyperprior with local context in the entropy estimation…

Image and Video Processing · Electrical Eng. & Systems 2023-03-16 Yichen Qian , Zhiyu Tan , Xiuyu Sun , Ming Lin , Dongyang Li , Zhenhong Sun , Hao Li , Rong Jin

Formation mechanisms are fundamental to the study of complex networks, but learning them from observations is challenging. In real-world domains, one often has access only to the final constructed graph, instead of the full construction…

Machine Learning · Computer Science 2020-07-08 Rakshit Trivedi , Jiachen Yang , Hongyuan Zha

Graph representation learning has many real-world applications, from super-resolution imaging, 3D computer vision to drug repurposing, protein classification, social networks analysis. An adequate representation of graph data is vital to…

Machine Learning · Computer Science 2021-12-17 Xuebin Zheng , Bingxin Zhou , Yu Guang Wang , Xiaosheng Zhuang