English
Related papers

Related papers: DEPARA: Deep Attribution Graph for Deep Knowledge …

200 papers

Accurate modelling and quantification of predictive uncertainty is crucial in deep learning since it allows a model to make safer decisions when the data is ambiguous and facilitates the users' understanding of the model's confidence in its…

Machine Learning · Statistics 2025-08-26 Soumyasundar Pal , Liheng Ma , Amine Natik , Yingxue Zhang , Mark Coates

Previous transfer learning methods based on deep network assume the knowledge should be transferred between the same hidden layers of the source domain and the target domains. This assumption doesn't always hold true, especially when the…

Machine Learning · Computer Science 2018-09-25 Jianzhe Lin , Qi Wang , Rabab Ward , Z. Jane Wang

Graph neural networks (GNNs) are conventionally trained on a per-domain, per-task basis. It creates a significant barrier in transferring the acquired knowledge to different, heterogeneous data setups. This paper introduces GraphBridge, a…

Machine Learning · Computer Science 2025-03-04 Li Ju , Xingyi Yang , Qi Li , Xinchao Wang

Pretraining has been widely explored to augment the adaptability of graph learning models to transfer knowledge from large datasets to a downstream task, such as link prediction or classification. However, the gap between training…

Information Retrieval · Computer Science 2024-03-29 Mingdai Yang , Zhiwei Liu , Liangwei Yang , Xiaolong Liu , Chen Wang , Hao Peng , Philip S. Yu

Recent advances in generic large models, such as GPT and DeepSeek, have motivated the introduction of universality to graph pre-training, aiming to learn rich and generalizable knowledge across diverse domains using graph representations to…

Machine Learning · Computer Science 2026-02-27 Lianze Shan , Jitao Zhao , Dongxiao He , Siqi Liu , Jiaxu Cui , Weixiong Zhang

Purpose: Neural networks have received recent interest for reconstruction of undersampled MR acquisitions. Ideally network performance should be optimized by drawing the training and testing data from the same domain. In practice, however,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Salman Ul Hassan Dar , Muzaffer Özbey , Ahmet Burak Çatlı , Tolga Çukur

Currently, Deep Learning (DL) components within a Case-Based Reasoning (CBR) application often lack the comprehensive integration of available domain knowledge. The trend within machine learning towards so-called Informed machine learning…

Artificial Intelligence · Computer Science 2021-07-01 Maximilian Hoffmann , Ralph Bergmann

Graph Neural Networks (GNNs) are an emerging research field. This specialized Deep Neural Network (DNN) architecture is capable of processing graph structured data and bridges the gap between graph processing and Deep Learning (DL). As…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-24 Jana Vatter , Ruben Mayer , Hans-Arno Jacobsen

Multimodal Graph Neural Networks (MGNNs) have shown strong potential for learning from multimodal attributed graphs, yet most existing approaches rely on tightly coupled architectures that suffer from prohibitive computational overhead. In…

Artificial Intelligence · Computer Science 2026-05-13 Daohan Su , Hao Liu , Xunkai Li , Yinlin Zhu , Xiong Yongfu , Yi Liu , Hongchao Qin , Rong-Hua Li , Guoren Wang

Graph neural networks (GNNs) learn representations from network data with naturally distributed architectures, rendering them well-suited candidates for decentralized learning. Oftentimes, this decentralized graph support changes with time…

Machine Learning · Computer Science 2020-10-27 Zhan Gao , Fernando Gama , Alejandro Ribeiro

Understanding what information neural networks capture is an essential problem in deep learning, and studying whether different models capture similar features is an initial step to achieve this goal. Previous works sought to define metrics…

Machine Learning · Computer Science 2020-07-27 Yunzhen Feng , Runtian Zhai , Di He , Liwei Wang , Bin Dong

Many paralinguistic tasks are closely related and thus representations learned in one domain can be leveraged for another. In this paper, we investigate how knowledge can be transferred between three paralinguistic tasks: speaker, emotion,…

Machine Learning · Computer Science 2017-06-13 John Gideon , Soheil Khorram , Zakaria Aldeneh , Dimitrios Dimitriadis , Emily Mower Provost

Despite the notable success of deep neural networks (DNNs) in solving complex tasks, the training process still remains considerable challenges. A primary obstacle is the substantial time required for training, particularly as high…

Machine Learning · Computer Science 2025-09-09 Viet Hoang Pham , Hyo-Sung Ahn

Diffusion Probabilistic Models (DPMs) have recently demonstrated impressive results on various generative tasks.Despite its promises, the learned representations of pre-trained DPMs, however, have not been fully understood. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Xingyi Yang , Xinchao Wang

While deep neural networks have excellent results in many fields, they are susceptible to interference from attacking samples resulting in erroneous judgments. Feature-level attacks are one of the effective attack types, which targets the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Zhibo Jin , Zhiyu Zhu , Xinyi Wang , Jiayu Zhang , Jun Shen , Huaming Chen

Transferring knowledge from a teacher neural network pretrained on the same or a similar task to a student neural network can significantly improve the performance of the student neural network. Existing knowledge transfer approaches match…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Sungsoo Ahn , Shell Xu Hu , Andreas Damianou , Neil D. Lawrence , Zhenwen Dai

As graph representation learning often suffers from label scarcity problems in real-world applications, researchers have proposed graph domain adaptation (GDA) as an effective knowledge-transfer paradigm across graphs. In particular, to…

Machine Learning · Computer Science 2024-12-31 Boshen Shi , Yongqing Wang , Fangda Guo , Bingbing Xu , Huawei Shen , Xueqi Cheng

The sensor-based human activity recognition (HAR) in mobile application scenarios is often confronted with sensor modalities variation and annotated data deficiency. Given this observation, we devised a graph-inspired deep learning approach…

Computer Vision and Pattern Recognition · Computer Science 2023-01-09 Yan Yan , Tianzheng Liao , Jinjin Zhao , Jiahong Wang , Liang Ma , Wei Lv , Jing Xiong , Lei Wang

Most efforts in interpretability in deep learning have focused on (1) extracting explanations of a specific downstream task in relation to the input features and (2) imposing constraints on the model, often at the expense of predictive…

Machine Learning · Computer Science 2022-02-22 Marco Bertolini , Djork-Arné Clevert , Floriane Montanari

Sharing knowledge between tasks is vital for efficient learning in a multi-task setting. However, most research so far has focused on the easier case where knowledge transfer is not harmful, i.e., where knowledge from one task cannot…

Machine Learning · Computer Science 2019-07-08 Timo Bram , Gino Brunner , Oliver Richter , Roger Wattenhofer