中文
相关论文

相关论文: Exploring Graph-Transformer Out-of-Distribution Ge…

200 篇论文

Gradient-based meta-learning (GBML) algorithms are able to fast adapt to new tasks by transferring the learned meta-knowledge, while assuming that all tasks come from the same distribution (in-distribution, ID). However, in the real world,…

计算机视觉与模式识别 · 计算机科学 2023-03-14 Min Zhang , Zifeng Zhuang , Zhitao Wang , Donglin Wang , Wenbin Li

Graph neural networks are powerful architectures for structured datasets. However, current methods struggle to represent long-range dependencies. Scaling the depth or width of GNNs is insufficient to broaden receptive fields as larger GNNs…

机器学习 · 计算机科学 2022-01-24 Zhanghao Wu , Paras Jain , Matthew A. Wright , Azalia Mirhoseini , Joseph E. Gonzalez , Ion Stoica

Background. Commonly, Deep Neural Networks (DNNs) generalize well on samples drawn from a distribution similar to that of the training set. However, DNNs' predictions are brittle and unreliable when the test samples are drawn from a…

机器学习 · 计算机科学 2022-04-01 Matan Haroush , Tzviel Frostig , Ruth Heller , Daniel Soudry

In recent years, graph neural networks (GNNs) have been widely applied in tackling combinatorial optimization problems. However, existing methods still suffer from limited accuracy when addressing that on complex graphs and exhibit poor…

机器学习 · 计算机科学 2025-11-13 Yuyao Long

Graph Neural Networks (GNNs) with numerical node features and graph structure as inputs have demonstrated superior performance on various supervised learning tasks with graph data. However the numerical node features utilized by GNNs are…

机器学习 · 计算机科学 2022-06-20 Jiuhai Chen , Jonas Mueller , Vassilis N. Ioannidis , Tom Goldstein , David Wipf

As deep neural networks (DNNs) become increasingly common, concerns about their robustness do as well. A longstanding problem for deployed DNNs is their behavior in the face of unfamiliar inputs; specifically, these models tend to be…

机器学习 · 计算机科学 2025-01-23 Esha Datta , Johanna Hennig , Eva Domschot , Connor Mattes , Michael R. Smith

Graph Neural Networks (GNNs) have received considerable attention on graph-structured data learning for a wide variety of tasks. The well-designed propagation mechanism which has been demonstrated effective is the most fundamental part of…

机器学习 · 计算机科学 2021-01-29 Meiqi Zhu , Xiao Wang , Chuan Shi , Houye Ji , Peng Cui

Successful deep neural networks discover salient features of data. We show when and why they fail to learn out-of-distribution (OOD)-relevant representations from an in-distribution (ID) training window. This requires decoupling feature…

机器学习 · 计算机科学 2026-05-14 Leonel Aguilar , Jan Nagler , Christoph Hoelscher , Nino Antulov-Fantulin

Graph neural networks (GNNs) have demonstrated their effectiveness in various tasks supported by their generalization capabilities. However, the current analysis of GNN generalization relies on the assumption that training and testing data…

机器学习 · 计算机科学 2024-09-11 Zhiyang Wang , Juan Cervino , Alejandro Ribeiro

Graphs are a highly expressive abstraction for modeling entities and their relations, such as molecular structures, social networks, and traffic networks. Deep Graph Networks (DGNs) have emerged as a family of deep learning models that can…

机器学习 · 计算机科学 2024-10-16 Alessio Gravina

Graph Transformer (GT), as a special type of Graph Neural Networks (GNNs), utilizes multi-head attention to facilitate high-order message passing. However, this also imposes several limitations in node classification applications: 1) nodes…

机器学习 · 计算机科学 2024-10-16 Jiajun Zhou , Xuanze Chen , Chenxuan Xie , Yu Shanqing , Qi Xuan , Xiaoniu Yang

Over the last decade, graph neural networks (GNNs) have made significant progress in numerous graph machine learning tasks. In real-world applications, where domain shifts occur and labels are often unavailable for a new target domain,…

机器学习 · 计算机科学 2024-11-21 Zepeng Zhang , Olga Fink

Machine learning models, while progressively advanced, rely heavily on the IID assumption, which is often unfulfilled in practice due to inevitable distribution shifts. This renders them susceptible and untrustworthy for deployment in…

机器学习 · 计算机科学 2024-03-05 Han Yu , Jiashuo Liu , Xingxuan Zhang , Jiayun Wu , Peng Cui

Graph classification is an important area in both modern research and industry. Multiple applications, especially in chemistry and novel drug discovery, encourage rapid development of machine learning models in this area. To keep up with…

机器学习 · 计算机科学 2022-11-08 Jakub Adamczyk

We characterized the generalization capabilities of DNN-based encoding models when predicting neuronal responses from the visual cortex. We collected \textit{MacaqueITBench}, a large-scale dataset of neural population responses from the…

信号处理 · 电气工程与系统科学 2024-06-26 Spandan Madan , Will Xiao , Mingran Cao , Hanspeter Pfister , Margaret Livingstone , Gabriel Kreiman

Graph Neural Networks (GNNs) show strong expressive power on graph data mining, by aggregating information from neighbors and using the integrated representation in the downstream tasks. The same aggregation methods and parameters for each…

机器学习 · 计算机科学 2022-03-22 Xiaojun Ma , Qin Chen , Yuanyi Ren , Guojie Song , Liang Wang

Climate change is increasingly disrupting agricultural systems, making accurate crop yield forecasting essential for food security. While deep learning models have shown promise in yield prediction using satellite and weather data, their…

机器学习 · 计算机科学 2025-10-10 Aditya Chakravarty

Learning on molecule graphs has become an increasingly important topic in AI for science, which takes full advantage of AI to facilitate scientific discovery. Existing solutions on modeling molecules utilize Graph Neural Networks (GNNs) to…

机器学习 · 计算机科学 2025-05-13 Limin Li , Kuo Yang , Wenjie Du , Pengkun Wang , Zhengyang Zhou , Yang Wang

Many applications of machine learning require a model to make accurate pre-dictions on test examples that are distributionally different from training ones, while task-specific labels are scarce during training. An effective approach to…

机器学习 · 计算机科学 2020-02-20 Weihua Hu , Bowen Liu , Joseph Gomes , Marinka Zitnik , Percy Liang , Vijay Pande , Jure Leskovec

Modern AI models excel in controlled settings but often fail in real-world scenarios where data distributions shift unpredictably - a challenge known as domain generalisation (DG). This paper tackles this limitation by rigorously evaluating…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Hamza Riaz , Alan F. Smeaton