English
Related papers

Related papers: GeoIB: Geometry-Aware Information Bottleneck via S…

200 papers

Few-shot learning (FSL), which aims to classify unseen classes with few samples, is challenging due to data scarcity. Although various generative methods have been explored for FSL, the entangled generation process of these methods…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Zhuohang Dang , Jihong Wang , Minnan Luo , Chengyou Jia , Caixia Yan , Qinghua Zheng

We introduce Graph Concept Bottleneck (GCB) as a new paradigm for self-explainable text-attributed graph learning. GCB maps graphs into a subspace, concept bottleneck, where each concept is a meaningful phrase, and predictions are made…

Machine Learning · Computer Science 2026-04-15 Xiaoxue Han , Libo Zhang , Zining Zhu , Yue Ning

Temporal Graph Neural Networks (TGNN) have the ability to capture both the graph topology and dynamic dependencies of interactions within a graph over time. There has been a growing need to explain the predictions of TGNN models due to the…

Machine Learning · Computer Science 2024-06-21 Sangwoo Seo , Sungwon Kim , Jihyeong Jung , Yoonho Lee , Chanyoung Park

Graph neural networks (GNNs) excel on relational data by passing messages over node features and structure, but they can amplify training data biases, propagating discriminatory attributes and structural imbalances into unfair outcomes.…

Machine Learning · Computer Science 2025-10-30 Chuxun Liu , Debo Cheng , Qingfeng Chen , Jiangzhang Gan , Jiuyong Li , Lin Liu

Multiview data contain information from multiple modalities and have potentials to provide more comprehensive features for diverse machine learning tasks. A fundamental question in multiview analysis is what is the additional information…

Machine Learning · Computer Science 2021-05-18 Feng Bao

Information geometry is a mathematical framework that elucidates the manifold structure of the probability distribution space (p-space), providing a systematic approach to transforming probability distributions (PDs). In this study, we…

Data Analysis, Statistics and Probability · Physics 2025-06-30 Tomotaka Oroguchi , Rintaro Inoue , Masaaki Sugiyama

Multimodal sentiment analysis has received significant attention across diverse research domains. Despite advancements in algorithm design, existing approaches suffer from two critical limitations: insufficient learning of…

Artificial Intelligence · Computer Science 2025-11-04 Huiting Huang , Tieliang Gong , Kai He , Jialun Wu , Erik Cambria , Mengling Feng

We study the problem of distributed information bottleneck, in which multiple encoders separately compress their observations in a manner such that, collectively, the compressed signals preserve as much information as possible about another…

Information Theory · Computer Science 2017-10-04 Inaki Estella Aguerri , Abdellatif Zaidi

Graph Neural Networks (GNNs) have received increasing attention due to their ability to learn from graph-structured data. However, their predictions are often not interpretable. Post-hoc instance-level explanation methods have been proposed…

Machine Learning · Computer Science 2023-07-18 Jiaxing Zhang , Dongsheng Luo , Hua Wei

Although link prediction on graphs has achieved great success with the development of graph neural networks (GNNs), the potential robustness under the edge noise is still less investigated. To close this gap, we first conduct an empirical…

Machine Learning · Computer Science 2023-11-03 Zhanke Zhou , Jiangchao Yao , Jiaxu Liu , Xiawei Guo , Quanming Yao , Li He , Liang Wang , Bo Zheng , Bo Han

Graph data, essential in fields like knowledge representation and social networks, often involves large networks with many nodes and edges. Transmitting these graphs can be highly inefficient due to their size and redundancy for specific…

Machine Learning · Computer Science 2024-09-05 Shujing Li , Yanhu Wang , Shuaishuai Guo , Chenyuan Feng

In this paper, we study a remote source coding scenario in which binary phase shift keying (BPSK) modulation sources are corrupted by additive white Gaussian noise (AWGN). An intermediate node, such as a relay, receives these observations…

Information Theory · Computer Science 2024-05-14 Yi Song , Kai Wan , Zhenyu Liao , Giuseppe Caire

Identifying the dynamical state variables of a system from high-dimensional observations is a central problem across physical sciences. The challenge is that the state variables are not directly observable and must be inferred from raw…

Data Analysis, Statistics and Probability · Physics 2026-04-28 K. Michael Martini , Eslam Abdelaleem , Paarth Gulati , Ilya Nemenman

The immersed boundary (IB) method is an approach to fluid-structure interaction that uses Lagrangian variables to describe the structure and Eulerian variables to describe the fluid. Explicit time stepping schemes for the IB method require…

Numerical Analysis · Mathematics 2017-04-06 Robert D. Guy , Bobby Philip , Boyce E. Griffith

While large-scale pretrained language models have obtained impressive results when fine-tuned on a wide variety of tasks, they still often suffer from overfitting in low-resource scenarios. Since such models are general-purpose feature…

Computation and Language · Computer Science 2021-06-11 Rabeeh Karimi Mahabadi , Yonatan Belinkov , James Henderson

Concept Bottleneck Models (CBMs) aim to deliver interpretable predictions by routing decisions through a human-understandable concept layer, yet they often suffer reduced accuracy and concept leakage that undermines faithfulness. We…

Machine Learning · Computer Science 2026-02-17 Karim Galliamov , Syed M Ahsan Kazmi , Adil Khan , Adín Ramírez Rivera

The task of identifying multimodal image-text representations has garnered increasing attention, particularly with models such as CLIP (Contrastive Language-Image Pretraining), which demonstrate exceptional performance in learning complex…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Zhiyu Zhu , Zhibo Jin , Jiayu Zhang , Nan Yang , Jiahao Huang , Jianlong Zhou , Fang Chen

Modern applications require lightweight neural network models. Most existing neural network pruning methods focus on removing unimportant filters; however, these may result in the loss of statistical information after pruning due to failing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Xiang Liu , Mingchen Li , Xia Li , Leigang Qu , Guansu Wang , Zifan Peng , Yijun Song , Zemin Liu , Linshan Jiang , Jialin Li

Capsule networks (CapsNets) are superior at modeling hierarchical spatial relationships but suffer from two critical limitations: high computational cost due to iterative dynamic routing and poor robustness under input corruptions. To…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Canqun Xiang , Chen Yang , Jiaoyan Zhao

Graph representation learning has shown superior performance in numerous real-world applications, such as finance and social networks. Nevertheless, most existing works might make discriminatory predictions due to insufficient attention to…

Machine Learning · Computer Science 2024-09-05 Ziyi Zhang , Mingxuan Ouyang , Wanyu Lin , Hao Lan , Lei Yang