English
Related papers

Related papers: Heterogeneous Graph Neural Networks with Loss-decr…

200 papers

Heterogeneous Graph Neural Networks (HGNNs) are a class of powerful deep learning methods widely used to learn representations of heterogeneous graphs. Despite the fast development of HGNNs, they still face some challenges such as…

Machine Learning · Computer Science 2023-05-29 Xiao Yang , Xuejiao Zhao , Zhiqi Shen

As large language models (LLMs) continue to scale and new GPUs are released even more frequently, there is an increasing demand for LLM post-training in heterogeneous environments to fully leverage underutilized mid-range or…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-14 Yongjun He , Shuai Zhang , Jiading Gai , Xiyuan Zhang , Boran Han , Bernie Wang , Huzefa Rangwala , George Karypis

Scene understanding plays an important role in several high-level computer vision applications, such as autonomous vehicles, intelligent video surveillance, or robotics. However, too few solutions have been proposed for indoor/outdoor scene…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ayman Beghdadi , Azeddine Beghdadi , Mohib Ullah , Faouzi Alaya Cheikh , Malik Mallem

Heterogeneous graph neural networks (HGNNs) have emerged as powerful algorithms for processing heterogeneous graphs (HetGs), widely used in many critical fields. To capture both structural and semantic information in HetGs, HGNNs first…

Hardware Architecture · Computer Science 2024-04-29 Runzhen Xue , Dengke Han , Mingyu Yan , Mo Zou , Xiaocheng Yang , Duo Wang , Wenming Li , Zhimin Tang , John Kim , Xiaochun Ye , Dongrui Fan

Imbalanced node classification in graph neural networks (GNNs) happens when some labels are much more common than others, which causes the model to learn unfairly and perform badly on the less common classes. To solve this problem, we…

Machine Learning · Computer Science 2026-02-04 Abdul Joseph Fofanah , Lian Wen , David Chen , Shaoyang Zhang

Heterogeneous graph neural networks (HGNNs) have exhibited exceptional efficacy in modeling the complex heterogeneity in heterogeneous information networks (HINs). The critical advantage of HGNNs is their ability to handle diverse node and…

Machine Learning · Computer Science 2023-08-16 Xinyi Gao , Wentao Zhang , Tong Chen , Junliang Yu , Hung Quoc Viet Nguyen , Hongzhi Yin

Distributed training is a novel approach to accelerate Deep Neural Networks (DNN) training, but common training libraries fall short of addressing the distributed cases with heterogeneous processors or the cases where the processing nodes…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-17 Ali HeydariGorji , Siavash Rezaei , Mahdi Torabzadehkashi , Hossein Bobarshad , Vladimir Alves , Pai H. Chou

Heterogeneous graph neural architecture search (HGNAS) represents a powerful tool for automatically designing effective heterogeneous graph neural networks. However, existing HGNAS algorithms suffer from inefficient searches and unstable…

Artificial Intelligence · Computer Science 2023-12-15 Haoyuan Dong , Yang Gao , Haishuai Wang , Hong Yang , Peng Zhang

The construction of spatiotemporal networks using graph convolution networks (GCNs) has become one of the most popular methods for predicting traffic signals. However, when using a GCN for traffic speed prediction, the conventional approach…

Machine Learning · Computer Science 2022-09-07 JunKyu Jang , Sung-Hyuk Park

Graph neural networks (GNNs) have demonstrated excellent performance in semi-supervised node classification tasks. Despite this, two primary challenges persist: heterogeneity and heterophily. Each of these two challenges can significantly…

Machine Learning · Computer Science 2025-04-14 Kangkang Lu , Yanhua Yu , Zhiyong Huang , Yunshan Ma , Xiao Wang , Meiyu Liang , Yuling Wang , Yimeng Ren , Tat-Seng Chua

Short text classification is a fundamental task in natural language processing. It is hard due to the lack of context information and labeled data in practice. In this paper, we propose a new method called SHINE, which is based on graph…

Computation and Language · Computer Science 2021-11-02 Yaqing Wang , Song Wang , Quanming Yao , Dejing Dou

A dynamic graph (DG) is frequently encountered in numerous real-world scenarios. Consequently, A dynamic graph convolutional network (DGCN) has been successfully applied to perform precise representation learning on a DG. However,…

Machine Learning · Computer Science 2025-04-23 Minglian Han

Graph Convolutional Network (GCN) has achieved extraordinary success in learning effective task-specific representations of nodes in graphs. However, regarding Heterogeneous Information Network (HIN), existing HIN-oriented GCN methods still…

Machine Learning · Computer Science 2021-09-09 Yaming Yang , Ziyu Guan , Jianxin Li , Wei Zhao , Jiangtao Cui , Quan Wang

Recently many first and second order variants of SGD have been proposed to facilitate training of Deep Neural Networks (DNNs). A common limitation of these works stem from the fact that they use the same learning rate across all instances…

Machine Learning · Computer Science 2021-05-31 Shreyas Saxena , Nidhi Vyas , Dennis DeCoste

Significant advances have been made recently on training neural networks, where the main challenge is in solving an optimization problem with abundant critical points. However, existing approaches to address this issue crucially rely on a…

Machine Learning · Computer Science 2019-02-28 Weihao Gao , Ashok Vardhan Makkuva , Sewoong Oh , Pramod Viswanath

Heterogeneous Graph Neural Networks (HGNNs) are effective for modeling Heterogeneous Information Networks (HINs), which encode complex multi-typed entities and relations. However, HGNNs often suffer from type information loss and structural…

Machine Learning · Computer Science 2025-12-12 Ming-Yi Hong , Miao-Chen Chiang , Youchen Teng , Yu-Hsiang Wang , Chih-Yu Wang , Che Lin

With the rapid development of the World Wide Web (WWW), heterogeneous graphs (HG) have explosive growth. Recently, heterogeneous graph neural network (HGNN) has shown great potential in learning on HG. Current studies of HGNN mainly focus…

Social and Information Networks · Computer Science 2023-02-27 Jiayan Guo , Lun Du , Wendong Bi , Qiang Fu , Xiaojun Ma , Xu Chen , Shi Han , Dongmei Zhang , Yan Zhang

As the demand for user privacy grows, controlled data removal (machine unlearning) is becoming an important feature of machine learning models for data-sensitive Web applications such as social networks and recommender systems.…

Machine Learning · Computer Science 2023-07-04 Chao Pan , Eli Chien , Olgica Milenkovic

Predicting Remaining Useful Life (RUL) plays a crucial role in the prognostics and health management of industrial systems that involve a variety of interrelated sensors. Given a constant stream of time series sensory data from such…

Artificial Intelligence · Computer Science 2025-08-07 Zhihao Wen , Yuan Fang , Pengcheng Wei , Fayao Liu , Zhenghua Chen , Min Wu

Convolutional Neural Networks (CNNs) have recently led to incredible breakthroughs on a variety of pattern recognition problems. Banks of finite impulse response filters are learned on a hierarchy of layers, each contributing more abstract…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Felipe Petroski Such , Shagan Sah , Miguel Dominguez , Suhas Pillai , Chao Zhang , Andrew Michael , Nathan Cahill , Raymond Ptucha