English
Related papers

Related papers: Towards Lightweight and Automated Representation L…

200 papers

GPUs are critical for compute-intensive applications, yet emerging workloads such as recommender systems, graph analytics, and data analytics often exceed GPU memory capacity. Existing solutions allow GPUs to use CPU DRAM or SSDs as…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-27 Zhuoping Yang , Jinming Zhuang , Xingzhen Chen , Alex K. Jones , Peipei Zhou

Unified graph representation learning aims to generate node embeddings, which can be applied to multiple downstream applications of graph analytics. However, existing studies based on graph neural networks and language models either suffer…

Computation and Language · Computer Science 2025-08-05 Wenbo Shang , Xuliang Zhu , Xin Huang

We propose Distributed Neighbor Expansion (Distributed NE), a parallel and distributed graph partitioning method that can scale to trillion-edge graphs while providing high partitioning quality. Distributed NE is based on a new heuristic,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-24 Masatoshi Hanai , Toyotaro Suzumura , Wen Jun Tan , Elvis Liu , Georgios Theodoropoulos , Wentong Cai

How can we solve semi-supervised node classification in various graphs possibly with noisy features and structures? Graph neural networks (GNNs) have succeeded in many graph mining tasks, but their generalizability to various graph…

Machine Learning · Computer Science 2023-06-19 Jaemin Yoo , Meng-Chieh Lee , Shubhranshu Shekhar , Christos Faloutsos

Graph neural networks (GNNs) process large-scale graphs consisting of a hundred billion edges. In contrast to traditional deep learning, unique behaviors of the emerging GNNs are engaged with a large set of graphs and embedding data on…

Hardware Architecture · Computer Science 2022-01-25 Miryeong Kwon , Donghyun Gouk , Sangwon Lee , Myoungsoo Jung

Multi-task learning has shown considerable promise for improving the performance of deep learning-driven vision systems for the purpose of robotic grasping. However, high architectural and computational complexity can result in poor…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Alexander Wong , Yifan Wu , Saad Abbasi , Saeejith Nair , Yuhao Chen , Mohammad Javad Shafiee

This paper describes a new method for representing embedding tables of graph neural networks (GNNs) more compactly via tensor-train (TT) decomposition. We consider the scenario where (a) the graph data that lack node features, thereby…

Machine Learning · Computer Science 2022-06-22 Chunxing Yin , Da Zheng , Israt Nisa , Christos Faloutos , George Karypis , Richard Vuduc

Deep neural networks (DNNs) form the cornerstone of modern AI services, supporting a wide range of applications, including autonomous driving, chatbots, and recommendation systems. As models increase in size and complexity, DNN workloads…

Machine Learning · Computer Science 2025-11-14 Xiaokai Wang , Shaoyuan Huang , Yuting Li , Xiaofei Wang

Deploying large language models (LLMs) on edge devices is crucial for delivering fast responses and ensuring data privacy. However, the limited storage, weight, and power of edge devices make it difficult to deploy LLM-powered applications.…

Hardware Architecture · Computer Science 2025-06-04 Chunlin Tian , Xinpeng Qin , Kahou Tam , Li Li , Zijian Wang , Yuanzhe Zhao , Minglei Zhang , Chengzhong Xu

Graph neural networks (GNNs) have emerged as the state of the art for a variety of graph-related tasks and have been widely used in Heterogeneous Graphs (HetGs), where meta-paths help encode specific semantics between various node types.…

Machine Learning · Computer Science 2025-02-25 Xuqi Mao , Zhenying He , X. Sean Wang

This paper proposed LightSleepNet - a light-weight, 1-d Convolutional Neural Network (CNN) based personalized architecture for real-time sleep staging, which can be implemented on various mobile platforms with limited hardware resources.…

Signal Processing · Electrical Eng. & Systems 2024-01-25 Yiqiao Liao , Chao Zhang , Milin Zhang , Zhihua Wang , Xiang Xie

Deep learning implementations on CPUs (Central Processing Units) are gaining more traction. Enhanced AI capabilities on commodity x86 architectures are commercially appealing due to the reuse of existing hardware and virtualization ease. A…

Machine Learning · Computer Science 2021-03-22 Shabnam Daghaghi , Nicholas Meisburger , Mengnan Zhao , Yong Wu , Sameh Gobriel , Charlie Tai , Anshumali Shrivastava

Graph representation learning has recently been applied to a broad spectrum of problems ranging from computer graphics and chemistry to high energy physics and social media. The popularity of graph neural networks has sparked interest, both…

Machine Learning · Computer Science 2020-11-05 Fabrizio Frasca , Emanuele Rossi , Davide Eynard , Ben Chamberlain , Michael Bronstein , Federico Monti

Real-world node embedding applications often contain hundreds of billions of edges with high-dimension node features. Scaling node embedding systems to efficiently support these applications remains a challenging problem. In this paper we…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-19 Wanjing Wei , Yangzihao Wang , Pin Gao , Shijie Sun , Donghai Yu

Dynamic Network Embedding (DNE) has recently attracted considerable attention due to the advantage of network embedding in various fields and the dynamic nature of many real-world networks. An input dynamic network to DNE is often assumed…

Social and Information Networks · Computer Science 2021-12-01 Chengbin Hou , Guoji Fu , Peng Yang , Zheng Hu , Shan He , Ke Tang

Graph Neural Networks (GNNs) are proven to be powerful models to generate node embedding for downstream applications. However, due to the high computation complexity of GNN inference, it is hard to deploy GNNs for large-scale or real-time…

Machine Learning · Computer Science 2021-05-11 Hongkuan Zhou , Ajitesh Srivastava , Hanqing Zeng , Rajgopal Kannan , Viktor Prasanna

The Internet of Agents is propelling edge computing toward agentic AI and edge general intelligence (EGI). However, deploying multi-agent service (MAS) on resource-constrained edge infrastructure presents severe challenges. MAS service…

Networking and Internet Architecture · Computer Science 2026-01-06 Runze Zheng , Yuqing Zheng , Zhengyi Cheng , Long Luo , Haoxiang Luo , Gang Sun , Hongfang Yu , Dusit Niyato

With new accelerator hardware for DNN, the computing power for AI applications has increased rapidly. However, as DNN algorithms become more complex and optimized for specific applications, latency requirements remain challenging, and it is…

Machine Learning · Computer Science 2021-05-10 Matthias Wess , Matvey Ivanov , Anvesh Nookala , Christoph Unger , Alexander Wendt , Axel Jantsch

Standardized DNN models that have been proved to perform well on machine learning tasks are widely used and often adopted as-is to solve downstream tasks, forming the transfer learning paradigm. However, when serving multiple instances of…

Machine Learning · Computer Science 2020-09-29 Joo Seong Jeong , Soojeong Kim , Gyeong-In Yu , Yunseong Lee , Byung-Gon Chun

We propose a new method for embedding graphs while preserving directed edge information. Learning such continuous-space vector representations (or embeddings) of nodes in a graph is an important first step for using network information…

Machine Learning · Computer Science 2017-09-15 Sami Abu-El-Haija , Bryan Perozzi , Rami Al-Rfou