中文
相关论文

相关论文: GNN's Uncertainty Quantification using Self-Distil…

200 篇论文

Knowledge graphs (KGs) serve as fundamental structures for organizing interconnected data across diverse domains. However, most KGs remain incomplete, limiting their effectiveness in downstream applications. Knowledge graph completion (KGC)…

人工智能 · 计算机科学 2025-05-20 Lingzhi Wang , Pengcheng Huang , Haotian Li , Yuliang Wei , Guodong Xin , Rui Zhang , Donglin Zhang , Zhenzhou Ji , Wei Wang

Graph Neural Networks have achieved impressive results across diverse network modeling tasks, but accurately estimating uncertainty on graphs remains difficult, especially under distributional shifts. Unlike traditional uncertainty…

机器学习 · 计算机科学 2025-10-15 Fred Xu , Thomas Markovich

Considering the fact that students have different abilities to understand the knowledge imparted by teachers, a multi-granularity distillation mechanism is proposed for transferring more understandable knowledge for student networks. A…

计算机视觉与模式识别 · 计算机科学 2021-09-06 Baitan Shao , Ying Chen

Machine-learned potentials (MLPs) have revolutionized materials discovery by providing accurate and efficient predictions of molecular and material properties. Graph Neural Networks (GNNs) have emerged as a state-of-the-art approach due to…

机器学习 · 计算机科学 2025-04-18 Tirtha Vinchurkar , Kareem Abdelmaqsoud , John R. Kitchin

Recent years have witnessed great success in handling graph-related tasks with Graph Neural Networks (GNNs). Despite their great academic success, Multi-Layer Perceptrons (MLPs) remain the primary workhorse for practical industrial…

机器学习 · 计算机科学 2023-06-06 Lirong Wu , Jun Xia , Haitao Lin , Zhangyang Gao , Zicheng Liu , Guojiang Zhao , Stan Z. Li

Knowledge graphs automatically constructed from text are increasingly used in real-world applications. However, their inherent noise, fragmentation, and semantic inconsistencies significantly affect the performance of Graph Neural Networks…

机器学习 · 计算机科学 2026-05-08 Othmane Kabal , Mounira Harzallah , Fabrice Guillet , Hideaki Takeda , Ryutaro Ichise

Despite the popularity of Convolutional Neural Networks (CNN), the problem of uncertainty quantification (UQ) of CNN has been largely overlooked. Lack of efficient UQ tools severely limits the application of CNN in certain areas, such as…

机器学习 · 计算机科学 2026-04-15 Hongfei Du , Emre Barut , Fang Jin

Despite plentiful successes achieved by graph representation learning in various domains, the training of graph neural networks (GNNs) still remains tenaciously challenging due to the tremendous computational overhead needed for sizable…

机器学习 · 计算机科学 2025-05-28 Yurui Lai , Taiyan Zhang , Renchi Yang

Bayesian neural networks (BNN) and deep ensembles are principled approaches to estimate the predictive uncertainty of a deep learning model. However their practicality in real-time, industrial-scale applications are limited due to their…

机器学习 · 计算机科学 2020-10-27 Jeremiah Zhe Liu , Zi Lin , Shreyas Padhy , Dustin Tran , Tania Bedrax-Weiss , Balaji Lakshminarayanan

Multitude of deep learning models have been proposed for node classification in graphs. However, they tend to perform poorly under labeled-data scarcity. Although Few-shot learning for graphs has been introduced to overcome this problem,…

机器学习 · 计算机科学 2026-02-02 Appan Rakaraddi , Lam Siew-Kei , Mahardhika Pratama , Marcus de Carvalho

Knowledge distillation (KD) has shown to be effective to boost the performance of graph neural networks (GNNs), where the typical objective is to distill knowledge from a deeper teacher GNN into a shallower student GNN. However, it is often…

机器学习 · 计算机科学 2023-11-17 Kaituo Feng , Yikun Miao , Changsheng Li , Ye Yuan , Guoren Wang

Bayesian Neural Networks (BNNs) provide principled uncertainty quantification but suffer from substantial computational and memory overhead compared to deterministic networks. While quantization techniques have successfully reduced resource…

机器学习 · 计算机科学 2025-12-12 Hendrik Borras , Yong Wu , Bernhard Klein , Holger Fröning

The performance of decoders in Quantum Error Correction (QEC) is key to realizing practical quantum computers. In recent years, Graph Neural Networks (GNNs) have emerged as a promising approach, but their training methodologies are not yet…

量子物理 · 物理学 2025-08-07 Ryota Ikeda

Uncertainty estimation is pivotal in machine learning, especially for classification tasks, as it improves the robustness and reliability of models. We introduce a novel `Epistemic Wrapping' methodology aimed at improving uncertainty…

Graph Neural Networks (GNNs) achieve high performance but can be opaque to humans, making it difficult to understand and compare the many proposed architectures. While existing explainability methods attribute individual predictions to…

机器学习 · 计算机科学 2026-05-11 Debolina Halder Lina , Arlei Silva

Uncertainty estimation in deep learning has become a leading research field in medical image analysis due to the need for safe utilisation of AI algorithms in clinical practice. Most approaches for uncertainty estimation require sampling…

图像与视频处理 · 电气工程与系统科学 2022-04-12 Kaisar Kushibar , Víctor Manuel Campello , Lidia Garrucho Moras , Akis Linardos , Petia Radeva , Karim Lekadir

Automatic emotion recognition based on multichannel Electroencephalography (EEG) holds great potential in advancing human-computer interaction. However, several significant challenges persist in existing research on algorithmic emotion…

机器学习 · 计算机科学 2023-10-24 Hongxiang Gao , Xiangyao Wang , Zhenghua Chen , Min Wu , Zhipeng Cai , Lulu Zhao , Jianqing Li , Chengyu Liu

Accurate uncertainty quantification is a major challenge in deep learning, as neural networks can make overconfident errors and assign high confidence predictions to out-of-distribution (OOD) inputs. The most popular approaches to estimate…

Convolutional neural networks have been widely deployed in various application scenarios. In order to extend the applications' boundaries to some accuracy-crucial domains, researchers have been investigating approaches to boost accuracy…

机器学习 · 计算机科学 2019-05-21 Linfeng Zhang , Jiebo Song , Anni Gao , Jingwei Chen , Chenglong Bao , Kaisheng Ma

While neural networks have demonstrated impressive performance across various tasks, accurately quantifying uncertainty in their predictions is essential to ensure their trustworthiness and enable widespread adoption in critical systems.…

机器学习 · 统计学 2025-11-11 Joseph Wilson , Chris van der Heide , Liam Hodgkinson , Fred Roosta