English
Related papers

Related papers: DiGRAF: Diffeomorphic Graph-Adaptive Activation Fu…

200 papers

Artificial neural networks typically have a fixed, non-linear activation function at each neuron. We have designed a novel form of piecewise linear activation function that is learned independently for each neuron using gradient descent.…

Neural and Evolutionary Computing · Computer Science 2015-04-22 Forest Agostinelli , Matthew Hoffman , Peter Sadowski , Pierre Baldi

A central question in neuroscience is how self-organizing dynamic interactions in the brain emerge on their relatively static structural backbone. Due to the complexity of spatial and temporal dependencies between different brain areas,…

Neurons and Cognition · Quantitative Biology 2020-10-15 Simon Wein , Wilhelm Malloni , Ana Maria Tomé , Sebastian M. Frank , Gina-Isabelle Henze , Stefan Wüst , Mark W. Greenlee , Elmar W. Lang

Recommender systems are essential components of modern online platforms which presents personalized content in various domain. The traditional collaborative filtering methods depends on static user-item interaction graphs and a limited…

Information Retrieval · Computer Science 2026-05-08 Aadarsh Senapati , Neha Kujur , Vivek Yelleti

In the past, research on a single low dimensional activation function in networks has led to internal covariate shift and gradient deviation problems. A relatively small research area is how to use function combinations to provide property…

Machine Learning · Computer Science 2024-05-08 Xiaoyan Su , Yinghao Zhu , Run Li

In recent years, Dynamic Graph (DG) representations have been increasingly used for modeling dynamic systems due to their ability to integrate both topological and temporal information in a compact representation. Dynamic graphs allow to…

Machine Learning · Computer Science 2023-04-13 Leshanshui Yang , Sébastien Adam , Clément Chatelain

Graph Retrieval-Augmented Generation (GRAG or Graph RAG) architectures aim to enhance language understanding and generation by leveraging external knowledge. However, effectively capturing and integrating the rich semantic information…

Computation and Language · Computer Science 2025-01-29 Karishma Thakrar

Graph neural networks (GNNs) are gaining increasing popularity as a promising approach to machine learning on graphs. Unlike traditional graph workloads where each vertex/edge is associated with a scalar, GNNs attach a feature tensor to…

Machine Learning · Computer Science 2020-09-30 Yuwei Hu , Zihao Ye , Minjie Wang , Jiali Yu , Da Zheng , Mu Li , Zheng Zhang , Zhiru Zhang , Yida Wang

Deep neural networks often suffer from poor performance or even training failure due to the ill-conditioned problem, the vanishing/exploding gradient problem, and the saddle point problem. In this paper, a novel method by acting the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Mei Liu , Liangming Chen , Xiaohao Du , Long Jin , Mingsheng Shang

Inspired by the immense success of deep learning, graph neural networks (GNNs) are widely used to learn powerful node representations and have demonstrated promising performance on different graph learning tasks. However, most real-world…

Machine Learning · Computer Science 2020-01-24 Kaize Ding , Yichuan Li , Jundong Li , Chenghao Liu , Huan Liu

Implicit graph neural networks have gained popularity in recent years as they capture long-range dependencies while improving predictive performance in static graphs. Despite the tussle between performance degradation due to the…

Machine Learning · Computer Science 2024-06-27 Yongjian Zhong , Hieu Vu , Tianbao Yang , Bijaya Adhikari

Recent advances in Graph Neural Networks (GNNs) have revolutionized graph-structured data modeling, yet traditional GNNs struggle with complex heterogeneous structures prevalent in real-world scenarios. Despite progress in handling…

Machine Learning · Computer Science 2025-01-07 Zongwei Li , Lianghao Xia , Hua Hua , Shijie Zhang , Shuangyang Wang , Chao Huang

Graph neural networks (GNNs) have achieved tremendous success in the task of graph classification and its diverse downstream real-world applications. Despite the huge success in learning graph representations, current GNN models have…

Social and Information Networks · Computer Science 2023-09-07 Xin Wang , Heng Chang , Beini Xie , Tian Bian , Shiji Zhou , Daixin Wang , Zhiqiang Zhang , Wenwu Zhu

Graph Neural Networks (GNN) have emerged as a popular and standard approach for learning from graph-structured data. The literature on GNN highlights the potential of this evolving research area and its widespread adoption in real-life…

Machine Learning · Computer Science 2024-03-25 Sukhdeep Singh , Anuj Sharma , Vinod Kumar Chauhan

In the past decades, many graph drawing techniques have been proposed for generating aesthetically pleasing graph layouts. However, it remains a challenging task since different layout methods tend to highlight different characteristics of…

Machine Learning · Computer Science 2021-06-30 Xiaoqi Wang , Kevin Yen , Yifan Hu , Han-Wei Shen

We propose an adaptive node feature selection approach for graph neural networks (GNNs) that identifies and removes unnecessary features during training. The ability to measure how features contribute to model output is key for interpreting…

Machine Learning · Computer Science 2026-05-04 Ali Azizpour , Madeline Navarro , Santiago Segarra

Spectral-based graph neural networks (SGNNs) have been attracting increasing attention in graph representation learning. However, existing SGNNs are limited in implementing graph filters with rigid transforms (e.g., graph Fourier or…

Machine Learning · Computer Science 2022-01-05 Mingxing Xu , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong , Pascal Frossard

Graph Neural Networks (GNNs) have excelled in handling graph-structured data, attracting significant research interest. However, two primary challenges have emerged: interference between topology and attributes distorting node…

Machine Learning · Computer Science 2024-11-19 Yachao Yang , Yanfeng Sun , Jipeng Guo , Junbin Gao , Shaofan Wang , Fujiao Ju , Baocai Yin

Graph Neural Networks (GNNs) have demonstrated remarkable success in various domains such as social networks, molecular chemistry, and more. A crucial component of GNNs is the pooling procedure, in which the node features calculated by the…

Machine Learning · Computer Science 2026-05-19 Yaniv Galron , Hadar Sinai , Haggai Maron , Moshe Eliasof

Anomaly detection in dynamic networks is critical for applications from cybersecurity to industrial monitoring, yet existing methods face challenges in energy efficiency, temporal precision, and adaptability. This paper introduces…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Abdul Joseph Fofanah , Lian Wen , David Chen , Tsungcheng Yao , Kwabena Sarpong

Existing Graph Neural Networks (GNNs) are limited to process graphs each of whose vertices is represented by a vector or a single value, limited their representing capability to describe complex objects. In this paper, we propose the first…

Machine Learning · Computer Science 2024-07-02 Jiongshu Wang , Jing Yang , Jiankang Deng , Hatice Gunes , Siyang Song