English

Hypernetwork-Based Adaptive Aggregation for Multimodal Multiple-Instance Learning in Predicting Coronary Calcium Debulking

Computer Vision and Pattern Recognition 2026-01-30 v1

Abstract

In this paper, we present the first attempt to estimate the necessity of debulking coronary artery calcifications from computed tomography (CT) images. We formulate this task as a Multiple-instance Learning (MIL) problem. The difficulty of this task lies in that physicians adjust their focus and decision criteria for device usage according to tabular data representing each patient's condition. To address this issue, we propose a hypernetwork-based adaptive aggregation transformer (HyperAdAgFormer), which adaptively modifies the feature aggregation strategy for each patient based on tabular data through a hypernetwork. The experiments using the clinical dataset demonstrated the effectiveness of HyperAdAgFormer. The code is publicly available at https://github.com/Shiku-Kaito/HyperAdAgFormer.

Keywords

Cite

@article{arxiv.2601.21479,
  title  = {Hypernetwork-Based Adaptive Aggregation for Multimodal Multiple-Instance Learning in Predicting Coronary Calcium Debulking},
  author = {Kaito Shiku and Ichika Seo and Tetsuya Matoba and Rissei Hino and Yasuhiro Nakano and Ryoma Bise},
  journal= {arXiv preprint arXiv:2601.21479},
  year   = {2026}
}

Comments

Accepted to ISBI 2026

R2 v1 2026-07-01T09:25:22.683Z