English
Related papers

Related papers: Concepts' Information Bottleneck Models

200 papers

Deep learning approaches have recently been extensively explored for the prognostics of industrial assets. However, they still suffer from a lack of interpretability, which hinders their adoption in safety-critical applications. To improve…

Machine Learning · Computer Science 2024-05-29 Florent Forest , Katharina Rombach , Olga Fink

Estimating individual level treatment effects (ITE) from observational data is a challenging and important area in causal machine learning and is commonly considered in diverse mission-critical applications. In this paper, we propose an…

Machine Learning · Computer Science 2019-06-10 Sungyub Kim , Yongsu Baek , Sung Ju Hwang , Eunho Yang

The advent of large language models (LLMs) has revolutionized the field of natural language processing, yet they might be attacked to produce harmful content. Despite efforts to ethically align LLMs, these are often fragile and can be…

Computation and Language · Computer Science 2024-10-11 Zichuan Liu , Zefan Wang , Linjie Xu , Jinyu Wang , Lei Song , Tianchun Wang , Chunlin Chen , Wei Cheng , Jiang Bian

Concept Bottleneck Models (CBMs) have recently been proposed to address the 'black-box' problem of deep neural networks, by first mapping images to a human-understandable concept space and then linearly combining concepts for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Sukrut Rao , Sweta Mahajan , Moritz Böhle , Bernt Schiele

The increasing complexity of AI models, especially in deep learning, has raised concerns about transparency and accountability, particularly in high-stakes applications like medical diagnostics, where opaque models can undermine trust.…

Cryptography and Security · Computer Science 2024-11-26 Songning Lai , Yu Huang , Jiayu Yang , Gaoxiang Huang , Wenshuo Chen , Yutao Yue

Successful group meetings, such as those implemented in group behavioral-change programs, work meetings, and other social contexts, must promote individual goal setting and execution while strengthening the social relationships within the…

Computation and Language · Computer Science 2025-08-07 Xinyu Zhao , Zhen Tan , Maya Enisman , Minjae Seo , Marta R. Durantini , Dolores Albarracin , Tianlong Chen

There is growing interest in concept-based models (CBMs) that combine high-performance and interpretability by acquiring and reasoning with a vocabulary of high-level concepts. A key requirement is that the concepts be interpretable.…

Machine Learning · Computer Science 2022-10-19 Emanuele Marconato , Andrea Passerini , Stefano Teso

Concept bottleneck models are interpretable predictive models that are often used in domains where model trust is a key priority, such as healthcare. They identify a small number of human-interpretable concepts in the data, which they then…

Machine Learning · Computer Science 2024-12-25 Katrina Brown , Marton Havasi , Finale Doshi-Velez

Information Bottleneck (IB) is a generalization of rate-distortion theory that naturally incorporates compression and relevance trade-offs for learning. Though the original IB has been extensively studied, there has not been much…

Machine Learning · Computer Science 2019-10-08 Thanh T. Nguyen , Jaesik Choi

Benefiting from large-scale pretrained vision language models (VLMs), the performance of visual question answering (VQA) has approached human oracles. However, finetuning such models on limited data often suffers from overfitting and poor…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Jingjing Jiang , Ziyi Liu , Nanning Zheng

Concept bottleneck models perform classification by first predicting which of a list of human provided concepts are true about a datapoint. Then a downstream model uses these predicted concept labels to predict the target label. The…

Machine Learning · Computer Science 2022-11-08 Joshua Lockhart , Nicolas Marchesotti , Daniele Magazzeni , Manuela Veloso

The Information Bottleneck (IB) principle facilitates effective representation learning by preserving label-relevant information while compressing irrelevant information. However, its strong reliance on accurate labels makes it inherently…

Machine Learning · Computer Science 2025-12-12 Yi Huang , Qingyun Sun , Yisen Gao , Haonan Yuan , Xingcheng Fu , Jianxin Li

Concept Bottleneck Models (CBMs) try to make the decision-making process transparent by exploring an intermediate concept space between the input image and the output prediction. Existing CBMs just learn coarse-grained relations between the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Yan Xie , Zequn Zeng , Hao Zhang , Yucheng Ding , Yi Wang , Zhengjue Wang , Bo Chen , Hongwei Liu

Models based on human-understandable concepts have received extensive attention to improve model interpretability for trustworthy artificial intelligence in the field of medical image analysis. These methods can provide convincing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Hongmei Wang , Junlin Hou , Hao Chen

Interpretability is a crucial factor in building reliable models for various medical applications. Concept Bottleneck Models (CBMs) enable interpretable image classification by utilizing human-understandable concepts as intermediate…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Injae Kim , Jongha Kim , Joonmyung Choi , Hyunwoo J. Kim

Concept Bottleneck Models (CBMs) enable interpretable image classification by structuring predictions around human-understandable concepts, but extending this paradigm to video remains challenging due to the difficulty of extracting…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Patrick Knab , Sascha Marton , Philipp J. Schubert , Drago Guggiana , Christian Bartelt

The Information Bottleneck (IB) framework is a general characterization of optimal representations obtained using a principled approach for balancing accuracy and complexity. Here we present a new framework, the Dual Information Bottleneck…

Information Theory · Computer Science 2020-06-09 Zoe Piran , Ravid Shwartz-Ziv , Naftali Tishby

Accurately assessing student knowledge is central to education. Cognitive Diagnosis (CD) models estimate student proficiency at a fixed point in time, while Knowledge Tracing (KT) methods model evolving knowledge states to predict future…

Computation and Language · Computer Science 2026-02-10 Antonin Berthon , Mihaela van der Schaar

Leveraging high-quality joint representations from multimodal data can greatly enhance model performance in various machine-learning based applications. Recent multimodal learning methods, based on the multimodal information bottleneck…

Machine Learning · Computer Science 2025-05-27 Qilong Wu , Yiyang Shao , Jun Wang , Xiaobo Sun

The widespread adoption of deep learning models in computer vision has intensified concerns about interpretability. Despite strong performance, these models are often treated as black boxes, with limited systematic investigation of their…

Machine Learning · Computer Science 2026-05-13 Konstantinos P. Panousis , Diego Marcos