中文
相关论文

相关论文: Knowledge Distillation to Ensemble Global and Inte…

200 篇论文

Machine learning models, particularly the black-box models, are widely favored for their outstanding predictive capabilities. However, they often face scrutiny and criticism due to the lack of interpretability. Paradoxically, their strong…

统计方法学 · 统计学 2025-09-17 Xuetao Lu , J. Jack Lee

In this work, we introduce InfoDisent, a hybrid approach to explainability based on the information bottleneck principle. InfoDisent enables the disentanglement of information in the final layer of any pretrained model into atomic concepts,…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Łukasz Struski , Dawid Rymarczyk , Jacek Tabor

Concept bottleneck models are interpretable predictive models that are often used in domains where model trust is a key priority, such as healthcare. They identify a small number of human-interpretable concepts in the data, which they then…

机器学习 · 计算机科学 2024-12-25 Katrina Brown , Marton Havasi , Finale Doshi-Velez

Today's deep learning systems deliver high performance based on end-to-end training. While they deliver strong performance, these systems are hard to interpret. To address this issue, we propose Semantic Bottleneck Networks (SBN): deep…

计算机视觉与模式识别 · 计算机科学 2019-07-30 Max Losch , Mario Fritz , Bernt Schiele

In the semantic segmentation of remote sensing images, acquiring complete ground objects is critical for achieving precise analysis. However, this task is severely hindered by two major challenges: high intra-class variance and high…

计算机视觉与模式识别 · 计算机科学 2025-08-07 Junyi Wang , Jinjiang Li , Guodong Fan , Yakun Ju , Xiang Fang , Alex C. Kot

The need for interpretable models has fostered the development of self-explainable classifiers. Prior approaches are either based on multi-stage optimization schemes, impacting the predictive performance of the model, or produce…

The transparency of deep learning models is essential for clinical diagnostics. Concept Bottleneck Model provides clear decision-making processes for diagnosis by transforming the latent space of black-box models into human-understandable…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Yiheng Dong , Yi Lin , Xin Yang

Interpretability is crucial to enhance trust in machine learning models for medical diagnostics. However, most state-of-the-art image classifiers based on neural networks are not interpretable. As a result, clinicians often resort to known…

While deep learning has achieved impressive performance in time series forecasting, it becomes increasingly crucial to understand its decision-making process for building trust in high-stakes scenarios. Existing interpretable models often…

机器学习 · 计算机科学 2026-03-02 Ziheng Peng , Shijie Ren , Xinyue Gu , Linxiao Yang , Xiting Wang , Liang Sun

Diffusion distillation models effectively accelerate reverse sampling by compressing the process into fewer steps. However, these models still exhibit a performance gap compared to their pre-trained diffusion model counterparts, exacerbated…

计算机视觉与模式识别 · 计算机科学 2024-12-13 Geon Yeong Park , Sang Wan Lee , Jong Chul Ye

Distributed quantum machine learning faces significant challenges due to heterogeneous client data and variations in local model structures, which hinder global model aggregation. To address these challenges, we propose a knowledge…

量子物理 · 物理学 2025-09-23 Kai Yu , Binbin Cai , Song Lin

We focus on Multimodal Machine Reading Comprehension (M3C) where a model is expected to answer questions based on given passage (or context), and the context and the questions can be in different modalities. Previous works such as RecipeQA…

计算机视觉与模式识别 · 计算机科学 2021-10-25 Pritish Sahu , Karan Sikka , Ajay Divakaran

Deep models based on vision transformer (ViT) and convolutional neural network (CNN) have demonstrated remarkable performance on natural datasets. However, these models may not be similar in medical imaging, where abnormal regions cover…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Ahmad Chaddad , Yihang Wu , Xianrui Chen

Knowledge distillation from large language models (LLMs) assumes that the teacher's output distribution is a high-quality training signal. On reasoning tasks, this assumption is frequently violated. A model's intermediate representations…

计算与语言 · 计算机科学 2026-03-16 Ryan Brown , Chris Russell

Transformer-based models have shown promising performance on tabular data compared to their classical counterparts such as neural networks and Gradient Boosted Decision Trees (GBDTs) in scenarios with limited training data. They utilize…

机器学习 · 计算机科学 2025-11-21 Pasan Dissanayake , Sanghamitra Dutta

This paper proposes a novel Deep Positive-Negative Prototype (DPNP) model that combines prototype-based learning (PbL) with discriminative methods to improve class compactness and separability in deep neural networks. While PbL…

机器学习 · 计算机科学 2025-01-07 Ramin Zarei-Sabzevar , Ahad Harati

The problem of forecasting spatiotemporal events such as crimes and accidents is crucial to public safety and city management. Besides accuracy, interpretability is also a key requirement for spatiotemporal forecasting models to justify the…

机器学习 · 计算机科学 2024-12-23 Bang An , Xun Zhou , Zirui Zhou , Ronilo Ragodos , Zenglin Xu , Jun Luo

Concept Bottleneck Models (CBMs) provide a basis for semantic abstractions within a neural network architecture. Such models have primarily been seen through the lens of interpretability so far, wherein they offer transparency by inferring…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Deepika SN Vemuri , Gautham Bellamkonda , Aditya Pola , Vineeth N Balasubramanian

Current state-of-the-art object detectors are at the expense of high computational costs and are hard to deploy to low-end devices. Knowledge distillation, which aims at training a smaller student network by transferring knowledge from a…

计算机视觉与模式识别 · 计算机科学 2020-06-24 Ruoyu Sun , Fuhui Tang , Xiaopeng Zhang , Hongkai Xiong , Qi Tian

Background: Breast cancer has the highest prevalence in women globally. The classification and diagnosis of breast cancer and its histopathological images have always been a hot spot of clinical concern. In Computer-Aided Diagnosis (CAD),…

计算机视觉与模式识别 · 计算机科学 2022-05-11 Yuchao Zheng , Chen Li , Xiaomin Zhou , Haoyuan Chen , Hao Xu , Yixin Li , Haiqing Zhang , Xiaoyan Li , Hongzan Sun , Xinyu Huang , Marcin Grzegorzek