English
Related papers

Related papers: TimeX++: Learning Time-Series Explanations with In…

200 papers

Multivariate time series have many applications, from healthcare and meteorology to life science. Although deep learning models have shown excellent predictive performance for time series, they have been criticised for being "black-boxes"…

Machine Learning · Computer Science 2024-05-06 Qiqi Su , Christos Kloukinas , Artur d'Avila Garcez

Information bottleneck is an information-theoretic principle of representation learning that aims to learn a maximally compressed representation that preserves as much information about labels as possible. Under this principle, two…

Information Theory · Computer Science 2023-11-08 Yuyan Ni , Yanyan Lan , Ao Liu , Zhiming Ma

Decisions of complex language understanding models can be rationalized by limiting their inputs to a relevant subsequence of the original text. A rationale should be as concise as possible without significantly degrading task performance,…

Computation and Language · Computer Science 2020-11-04 Bhargavi Paranjape , Mandar Joshi , John Thickstun , Hannaneh Hajishirzi , Luke Zettlemoyer

Information Theory (IT) has been used in Machine Learning (ML) from early days of this field. In the last decade, advances in Deep Neural Networks (DNNs) have led to surprising improvements in many applications of ML. The result has been a…

Machine Learning · Computer Science 2019-04-09 Hassan Hafez-Kolahi , Shohreh Kasaei

Unpacking and comprehending how black-box machine learning algorithms make decisions has been a persistent challenge for researchers and end-users. Explaining time-series predictive models is useful for clinical applications with high…

Machine Learning · Computer Science 2023-05-09 Amin Nayebi , Sindhu Tipirneni , Chandan K Reddy , Brandon Foreman , Vignesh Subbian

The Information Bottleneck (IB) objective uses information theory to formulate a task-performance versus robustness trade-off. It has been successfully applied in the standard discriminative classification setting. We pose the question…

Machine Learning · Computer Science 2021-01-13 Lynton Ardizzone , Radek Mackowiak , Carsten Rother , Ullrich Köthe

Time Series Imputation (TSI), which aims to recover missing values in temporal data, remains a fundamental challenge due to the complex and often high-rate missingness in real-world scenarios. Existing models typically optimize the…

Machine Learning · Computer Science 2025-10-07 Jie Yang , Kexin Zhang , Guibin Zhang , Philip S. Yu , Kaize Ding

Time series analysis provides essential insights for real-world system dynamics and informs downstream decision-making, yet most existing methods often overlook the rich contextual signals present in auxiliary modalities. To bridge this…

Machine Learning · Computer Science 2026-03-24 Yushan Jiang , Wenchao Yu , Geon Lee , Dongjin Song , Kijung Shin , Wei Cheng , Yanchi Liu , Haifeng Chen

Most of state of the art methods applied on time series consist of deep learning methods that are too complex to be interpreted. This lack of interpretability is a major drawback, as several applications in the real world are critical…

Machine Learning · Computer Science 2021-04-05 Thomas Rojat , Raphaël Puget , David Filliat , Javier Del Ser , Rodolphe Gelin , Natalia Díaz-Rodríguez

Mechanistic interpretability focuses on reverse engineering the internal mechanisms learned by neural networks. We extend our focus and propose to mechanistically forward engineer using our framework based on Concept Bottleneck Models. In…

Machine Learning · Computer Science 2025-12-01 Angela van Sprang , Erman Acar , Willem Zuidema

Although deep neural networks have been immensely successful, there is no comprehensive theoretical understanding of how they work or are structured. As a result, deep networks are often seen as black boxes with unclear interpretations and…

Machine Learning · Computer Science 2022-02-22 Ravid Shwartz-Ziv

The fruits of science are relationships made comprehensible, often by way of approximation. While deep learning is an extremely powerful way to find relationships in data, its use in science has been hindered by the difficulty of…

Machine Learning · Computer Science 2022-04-18 Kieran A. Murphy , Dani S. Bassett

Temporal Graph Neural Networks (TGNN) have the ability to capture both the graph topology and dynamic dependencies of interactions within a graph over time. There has been a growing need to explain the predictions of TGNN models due to the…

Machine Learning · Computer Science 2024-06-21 Sangwoo Seo , Sungwon Kim , Jihyeong Jung , Yoonho Lee , Chanyoung Park

Deep clustering uncovers hidden patterns and groups in complex time series data, yet its opaque decision-making limits use in safety-critical settings. This survey offers a structured overview of explainable deep clustering for time series,…

Machine Learning · Computer Science 2025-10-21 Udo Schlegel , Gabriel Marques Tavares , Thomas Seidl

Many high-performing machine learning models are not interpretable. As they are increasingly used in decision scenarios that can critically affect individuals, it is necessary to develop tools to better understand their outputs. Popular…

Artificial Intelligence · Computer Science 2023-05-30 Laura State , Salvatore Ruggieri , Franco Turini

Bidirectional language models have better context understanding and perform better than unidirectional models on natural language understanding tasks, yet the theoretical reasons behind this advantage remain unclear. In this work, we…

Computation and Language · Computer Science 2025-10-10 Md Kowsher , Nusrat Jahan Prottasha , Shiyun Xu , Shetu Mohanto , Ozlem Garibay , Niloofar Yousefi , Chen Chen

The Information Bottleneck (IB) method (\cite{tishby2000information}) provides an insightful and principled approach for balancing compression and prediction for representation learning. The IB objective $I(X;Z)-\beta I(Y;Z)$ employs a…

Machine Learning · Computer Science 2019-10-23 Tailin Wu , Ian Fischer , Isaac L. Chuang , Max Tegmark

Deep Neural Networks (DNNs) are analyzed via the theoretical framework of the information bottleneck (IB) principle. We first show that any DNN can be quantified by the mutual information between the layers and the input and output…

Machine Learning · Computer Science 2015-03-10 Naftali Tishby , Noga Zaslavsky

Explaining time series classification models is crucial, particularly in high-stakes applications such as healthcare and finance, where transparency and trust play a critical role. Although numerous time series classification methods have…

Machine Learning · Computer Science 2025-10-28 Bosong Huang , Ming Jin , Yuxuan Liang , Johan Barthelemy , Debo Cheng , Qingsong Wen , Chenghao Liu , Shirui Pan

Recent advances in deep learning have driven rapid progress in time series forecasting, yet many state-of-the-art models continue to struggle with robust performance in real-world applications, even when they achieve strong results on…

Machine Learning · Computer Science 2025-10-24 Qitai Tan , Yiyun Chen , Mo Li , Ruiwen Gu , Yilin Su , Xiao-Ping Zhang