中文
相关论文

相关论文: Graph Integrated Multimodal Concept Bottleneck Mod…

200 篇论文

As foundational models reshape scientific discovery, a bottleneck persists in dynamical system reconstruction (DSR): the ability to learn across system hierarchies. Many meta-learning approaches have been applied successfully to single…

机器学习 · 计算机科学 2025-06-12 Roussel Desmond Nzoyem , Grant Stevens , Amarpal Sahota , David A. W. Barton , Tom Deakin

Advancements in generative Artificial Intelligence (AI) hold great promise for automating radiology workflows, yet challenges in interpretability and reliability hinder clinical adoption. This paper presents an automated radiology report…

Current deep learning models are not designed to simultaneously address three fundamental questions: predict class labels to solve a given classification task (the "What?"), simulate changes in the situation to evaluate how this impacts…

Concept Bottleneck Models (CBMs) ground image classification on human-understandable concepts to allow for interpretable model decisions. Crucially, the CBM design inherently allows for human interventions, in which expert users are given…

机器学习 · 计算机科学 2024-08-07 Nishad Singhi , Jae Myung Kim , Karsten Roth , Zeynep Akata

The demand for reliable AI systems has intensified the need for interpretable deep neural networks. Concept bottleneck models (CBMs) have gained attention as an effective approach by leveraging human-understandable concepts to enhance…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Sangwon Kim , Dasom Ahn , Byoung Chul Ko , In-su Jang , Kwang-Ju Kim

Mixture-of-Experts (MoE) presents a naturally compatible and scalable framework for multimodal learning, demonstrating strong adaptability across diverse modalities and tasks. Despite its growing success, a comprehensive and systematic…

机器学习 · 计算机科学 2026-05-28 Liangwei Nathan Zheng , Wei Emma Zhang , Olaf Maennel , Lin Yue , Weitong Chen

Combining existing pre-trained expert LLMs is a promising avenue for scalably tackling large-scale and diverse tasks. However, selecting task-level experts is often too coarse-grained, as heterogeneous tasks may require different expertise…

计算与语言 · 计算机科学 2025-07-22 Justin Chih-Yao Chen , Sukwon Yun , Elias Stengel-Eskin , Tianlong Chen , Mohit Bansal

Concept Bottleneck Models (CBMs) decompose image classification into a process governed by interpretable, human-readable concepts. Recent advances in CBMs have used Large Language Models (LLMs) to generate candidate concepts. However, a…

计算与语言 · 计算机科学 2025-06-03 Yiwen Jiang , Deval Mehta , Wei Feng , Zongyuan Ge

As machine learning models in critical fields increasingly grapple with multimodal data, they face the dual challenges of handling a wide array of modalities, often incomplete due to missing elements, and the temporal irregularity and…

机器学习 · 计算机科学 2025-04-10 Xing Han , Huy Nguyen , Carl Harris , Nhat Ho , Suchi Saria

Concept-based explanation methods, such as concept bottleneck models (CBMs), aim to improve the interpretability of machine learning models by linking their decisions to human-understandable concepts, under the critical assumption that such…

人工智能 · 计算机科学 2025-02-03 Halil Ibrahim Aysel , Xiaohao Cai , Adam Prugel-Bennett

Graph data are inherently complex and heterogeneous, leading to a high natural diversity of distributional shifts. However, it remains unclear how to build machine learning architectures that generalize to the complex distributional shifts…

机器学习 · 计算机科学 2024-10-29 Shirley Wu , Kaidi Cao , Bruno Ribeiro , James Zou , Jure Leskovec

Continual learning (CL) has garnered significant attention because of its ability to adapt to new tasks that arrive over time. Catastrophic forgetting (of old tasks) has been identified as a major issue in CL, as the model adapts to new…

机器学习 · 计算机科学 2025-02-20 Hongbo Li , Sen Lin , Lingjie Duan , Yingbin Liang , Ness B. Shroff

Graph neural networks (GNNs) are gaining popularity for processing graph-structured data. In real-world scenarios, graph data within the same dataset can vary significantly in scale. This variability leads to depth-sensitivity, where the…

机器学习 · 计算机科学 2024-11-06 Zelin Yao , Chuang Liu , Xianke Meng , Yibing Zhan , Jia Wu , Shirui Pan , Wenbin Hu

The rise of graph-structured data has driven major advances in Graph Machine Learning (GML), where graph embeddings (GEs) map features from Knowledge Graphs (KGs) into vector spaces, enabling tasks like node classification and link…

机器学习 · 计算机科学 2026-01-27 Rosario Napoli , Gabriele Morabito , Antonio Celesti , Massimo Villari , Maria Fazio

Reliable channel estimation (CE) is fundamental for robust communication in dynamic wireless environments, where models must generalize across varying conditions such as signal-to-noise ratios (SNRs), the number of resource blocks (RBs),…

信号处理 · 电气工程与系统科学 2025-09-22 Tianyu Li , Yan Xin , Jianzhong , Zhang

Recent unified models integrate multimodal understanding and generation within a single framework. However, an "understanding-generation gap" persists, where models can capture user intent but often fail to translate this semantic knowledge…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Qingyang Liu , Bingjie Gao , Canmiao Fu , Zhipeng Huang , Chen Li , Feng Wang , Shuochen Chang , Shaobo Wang , Yali Wang , Keming Ye , Jiangtong Li , Li Niu

Larger networks generally have greater representational power at the cost of increased computational complexity. Sparsifying such networks has been an active area of research but has been generally limited to static regularization or…

计算机视觉与模式识别 · 计算机科学 2019-04-15 Xin Wang , Fisher Yu , Lisa Dunlap , Yi-An Ma , Ruth Wang , Azalia Mirhoseini , Trevor Darrell , Joseph E. Gonzalez

The sparse Mixture-of-Experts (MoE) architecture of large language models (LLMs) confronts an inherent issue of load imbalance arising from the simplistic linear router strategy, which ultimately causes the instability and inefficient…

机器学习 · 计算机科学 2025-11-25 Ting Bai , Yue Yu , Le Huang , Zenan Xu , Chuan Shi

In this paper, we introduce an explainable algorithm designed from a multi-modal foundation model, that performs fast and explainable image classification. Drawing inspiration from CLIP-based Concept Bottleneck Models (CBMs), our method…

计算机视觉与模式识别 · 计算机科学 2024-06-03 Rémi Kazmierczak , Eloïse Berthier , Goran Frehse , Gianni Franchi

Concept Bottleneck Models (CBNMs) are deep learning models that provide interpretability by enforcing a bottleneck layer where predictions are based exclusively on human-understandable concepts. However, this constraint also restricts…

机器学习 · 计算机科学 2025-10-17 David Debot , Giuseppe Marra