English
Related papers

Related papers: Dynamic Graph Information Bottleneck

200 papers

This paper presents Hyper-VIB, a hypernetwork-enhanced information bottleneck (IB) approach designed to enable efficient task-oriented communications in 6G collaborative intelligent systems. Leveraging IB theory, our approach enables an…

Information Theory · Computer Science 2025-11-20 Jingchen Peng , Chaowen Deng , Yili Deng , Boxiang Ren , Lu Yang

The Information Bottleneck (IB) objective uses information theory to formulate a task-performance versus robustness trade-off. It has been successfully applied in the standard discriminative classification setting. We pose the question…

Machine Learning · Computer Science 2021-01-13 Lynton Ardizzone , Radek Mackowiak , Carsten Rother , Ullrich Köthe

Deep learning representations are often difficult to interpret, which can hinder their deployment in sensitive applications. Concept Bottleneck Models (CBMs) have emerged as a promising approach to mitigate this issue by learning…

Machine Learning · Computer Science 2026-01-30 Antonio Almudévar , José Miguel Hernández-Lobato , Alfonso Ortega

Deep learning methods for graphs achieve remarkable performance on many node-level and graph-level prediction tasks. However, despite the proliferation of the methods and their success, prevailing Graph Neural Networks (GNNs) neglect…

Machine Learning · Computer Science 2020-11-10 Emily Alsentzer , Samuel G. Finlayson , Michelle M. Li , Marinka Zitnik

Continuous-time dynamic graphs (CTDGs) are essential for modeling interconnected, evolving systems. Traditional methods for extracting knowledge from these graphs often depend on feature engineering or deep learning. Feature engineering is…

Machine Learning · Computer Science 2024-11-08 Ahmad Naser Eddin , Jacopo Bono , David Aparício , Hugo Ferreira , Pedro Ribeiro , Pedro Bizarro

Graph neural networks (GNNs) have shown high potential for a variety of real-world, challenging applications, but one of the major obstacles in GNN research is the lack of large-scale flexible datasets. Most existing public datasets for…

Machine Learning · Computer Science 2023-06-23 Arpandeep Khatua , Vikram Sharma Mailthody , Bhagyashree Taleka , Tengfei Ma , Xiang Song , Wen-mei Hwu

Information bottleneck (IB) is a technique for extracting information in one random variable $X$ that is relevant for predicting another random variable $Y$. IB works by encoding $X$ in a compressed "bottleneck" random variable $M$ from…

Information Theory · Computer Science 2022-11-22 Artemy Kolchinsky , Brendan D. Tracey , David H. Wolpert

We present Deep Graph Infomax (DGI), a general approach for learning node representations within graph-structured data in an unsupervised manner. DGI relies on maximizing mutual information between patch representations and corresponding…

Machine Learning · Statistics 2018-12-24 Petar Veličković , William Fedus , William L. Hamilton , Pietro Liò , Yoshua Bengio , R Devon Hjelm

Information diffusion prediction is a fundamental task for understanding the information propagation process. It has wide applications in such as misinformation spreading prediction and malicious account detection. Previous works either…

Social and Information Networks · Computer Science 2020-06-11 Chunyuan Yuan , Jiacheng Li , Wei Zhou , Yijun Lu , Xiaodan Zhang , Songlin Hu

Dynamic Graph Neural Networks (DGNNs) have gained widespread attention due to their applicability in diverse domains such as traffic network prediction, epidemiological forecasting, and social network analysis. In this paper, we present…

Machine Learning · Computer Science 2025-01-28 Mingyu Guan , Saumia Singhal , Taesoo Kim , Anand Padmanabha Iyer

Graph Neural Networks (GNNs) are powerful tools in representation learning for graphs. However, recent studies show that GNNs are vulnerable to carefully-crafted perturbations, called adversarial attacks. Adversarial attacks can easily fool…

Machine Learning · Computer Science 2020-06-30 Wei Jin , Yao Ma , Xiaorui Liu , Xianfeng Tang , Suhang Wang , Jiliang Tang

Dataset condensation has significantly improved model training efficiency, but its application on devices with different computing power brings new requirements for different data sizes. Thus, condensing multiple scale graphs simultaneously…

Machine Learning · Computer Science 2024-12-24 Xingcheng Fu , Yisen Gao , Beining Yang , Yuxuan Wu , Haodong Qian , Qingyun Sun , Xianxian Li

Dynamic graph learning (DGL) aims to learn informative and temporally-evolving node embeddings to support downstream tasks such as link prediction. A fundamental challenge in DGL lies in effectively modeling both the temporal dynamics and…

Social and Information Networks · Computer Science 2025-06-10 Ling Wang

The fruits of science are relationships made comprehensible, often by way of approximation. While deep learning is an extremely powerful way to find relationships in data, its use in science has been hindered by the difficulty of…

Machine Learning · Computer Science 2022-04-18 Kieran A. Murphy , Dani S. Bassett

Signed Graph Neural Networks (SGNNs) are widely adopted to analyze complex patterns in signed graphs with both positive and negative links. Given the noisy nature of real-world connections, the robustness of SGNN has also emerged as a…

Machine Learning · Computer Science 2025-10-28 Junran Wu , Beng Chin Ooi , Ke Xu

Multimodal graphs, where nodes contain heterogeneous features such as images and text, are increasingly common in real-world applications. Effectively learning on such graphs requires both adaptive intra-modal message passing and efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Xiaobin Hong , Mingkai Lin , Xiaoli Wang , Chaoqun Wang , Wenzhong Li

Learning graph representations is a fundamental task aimed at capturing various properties of graphs in vector space. The most recent methods learn such representations for static networks. However, real world networks evolve over time and…

Social and Information Networks · Computer Science 2019-08-22 Palash Goyal , Sujit Rokka Chhetri , Arquimedes Canedo

Few-shot learning (FSL), which aims to classify unseen classes with few samples, is challenging due to data scarcity. Although various generative methods have been explored for FSL, the entangled generation process of these methods…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Zhuohang Dang , Jihong Wang , Minnan Luo , Chengyou Jia , Caixia Yan , Qinghua Zheng

Graph Neural Networks (GNNs) have recently become increasingly popular due to their ability to learn complex systems of relations or interactions arising in a broad spectrum of problems ranging from biology and particle physics to social…

Machine Learning · Computer Science 2020-10-12 Emanuele Rossi , Ben Chamberlain , Fabrizio Frasca , Davide Eynard , Federico Monti , Michael Bronstein

Data-centric methods have shown great potential in understanding and predicting spatiotemporal dynamics, enabling better design and control of the object system. However, deep learning models often lack interpretability, fail to obey…

Machine Learning · Computer Science 2025-01-07 Yuan Mi , Pu Ren , Hongteng Xu , Hongsheng Liu , Zidong Wang , Yike Guo , Ji-Rong Wen , Hao Sun , Yang Liu