English
Related papers

Related papers: Language of Network: A Generative Pre-trained Mode…

200 papers

Self-supervised learning (SSL) on graphs generates node and graph representations (i.e., embeddings) that can be used for downstream tasks such as node classification, node clustering, and link prediction. Graph SSL is particularly useful…

Machine Learning · Computer Science 2025-09-26 Jiali Chen , Avijit Mukherjee

Deep learning methods have advanced quickly in brain imaging analysis over the past few years, but they are usually restricted by the limited labeled data. Pre-trained model on unlabeled data has presented promising improvement in feature…

Neurons and Cognition · Quantitative Biology 2024-08-22 Jinlong Hu , Yangmin Huang , Nan Wang , Shoubin Dong

Masked language modeling has become a standard pretraining objective for training encoder-based language models. In this approach, certain tokens in the input are masked, and the model learns to predict them using the surrounding context.…

Artificial Intelligence · Computer Science 2026-05-28 Gokul Srinivasagan , Kai Hartung , Munir Georges

Graph convolution network (GCN) attracts intensive research interest with broad applications. While existing work mainly focused on designing novel GCN architectures for better performance, few of them studied a practical yet challenging…

Machine Learning · Computer Science 2020-10-16 Xiaoming Liu , Qirui Li , Chao Shen , Xi Peng , Yadong Zhou , Xiaohong Guan

Predicting properties of nodes in a graph is an important problem with applications in a variety of domains. Graph-based Semi-Supervised Learning (SSL) methods aim to address this problem by labeling a small subset of the nodes as seeds and…

Machine Learning · Computer Science 2019-02-13 Shikhar Vashishth , Prateek Yadav , Manik Bhandari , Partha Talukdar

Pre-trained models for Natural Languages (NL) like BERT and GPT have been recently shown to transfer well to Programming Languages (PL) and largely benefit a broad set of code-related tasks. Despite their success, most current methods…

Computation and Language · Computer Science 2021-09-03 Yue Wang , Weishi Wang , Shafiq Joty , Steven C. H. Hoi

With the development of autonomous vehicle technology, the controller area network (CAN) bus has become the de facto standard for an in-vehicle communication system because of its simplicity and efficiency. However, without any encryption…

Cryptography and Security · Computer Science 2022-04-05 Thien-Nu Hoang , Daehee Kim

Text classification aims to assign labels to textual units by making use of global information. Recent studies have applied graph neural network (GNN) to capture the global word co-occurrence in a corpus. Existing approaches require that…

Computation and Language · Computer Science 2022-06-02 Kunze Wang , Soyeon Caren Han , Josiah Poon

Real-world Knowledge Graphs (KGs) often suffer from incompleteness, which limits their potential performance. Knowledge Graph Completion (KGC) techniques aim to address this issue. However, traditional KGC methods are computationally…

Computation and Language · Computer Science 2023-11-03 Alla Chepurova , Aydar Bulatov , Yuri Kuratov , Mikhail Burtsev

In this paper, we propose a Generative Translation Classification Network (GTCN) for improving visual classification accuracy in settings where classes are visually similar and data is scarce. For this purpose, we propose joint learning…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 ByungIn Yoo , Tristan Sylvain , Yoshua Bengio , Junmo Kim

Textual graphs are ubiquitous in real-world applications, featuring rich text information with complex relationships, which enables advanced research across various fields. Textual graph representation learning aims to generate…

Machine Learning · Computer Science 2024-08-22 Wenbin Hu , Huihao Jing , Qi Hu , Haoran Li , Yangqiu Song

The task of link prediction aims to solve the problem of incomplete knowledge caused by the difficulty of collecting facts from the real world. GCNs-based models are widely applied to solve link prediction problems due to their…

Artificial Intelligence · Computer Science 2022-09-07 Shuanglong Yao , Dechang Pi , Junfu Chen , Yufei Liu , Zhiyuan Wu

The message-passing mechanism of graph convolutional networks (i.e., GCNs) enables label information to reach more unlabeled neighbors, thereby increasing the utilization of labels. However, the additional label information does not always…

Machine Learning · Computer Science 2025-05-23 Jincheng Huang , Yujie Mo , Xiaoshuang Shi , Lei Feng , Xiaofeng Zhu

Network traffic classification, which has numerous applications from security to billing and network provisioning, has become a cornerstone of today's computer networks. Previous studies have developed traffic classification techniques…

Networking and Internet Architecture · Computer Science 2020-05-19 Shahbaz Rezaei , Xin Liu

Recently, there has been a surge in the use of generated data to enhance the performance of downstream models, largely due to the advancements in pre-trained language models. However, most prevailing methods trained generative and…

Computation and Language · Computer Science 2023-09-26 Tong Wu , Hao Wang , Zhongshen Zeng , Wei Wang , Hai-Tao Zheng , Jiaxing Zhang

Machine learning models underpin many modern financial systems for use cases such as fraud detection and churn prediction. Most are based on supervised learning with hand-engineered features, which relies heavily on the availability of…

Machine Learning · Computer Science 2024-01-05 Piotr Skalski , David Sutton , Stuart Burrell , Iker Perez , Jason Wong

Machine learning (ML) is promising in accurately detecting malicious flows in encrypted network traffic; however, it is challenging to collect a training dataset that contains a sufficient amount of encrypted malicious data with correct…

Cryptography and Security · Computer Science 2023-09-12 Yuqi Qing , Qilei Yin , Xinhao Deng , Yihao Chen , Zhuotao Liu , Kun Sun , Ke Xu , Jia Zhang , Qi Li

The heavy traffic congestion problem has always been a concern for modern cities. To alleviate traffic congestion, researchers use reinforcement learning (RL) to develop better traffic signal control (TSC) algorithms in recent years.…

Machine Learning · Computer Science 2020-09-18 Chang Liu , Huichu Zhang , Weinan Zhang , Guanjie Zheng , Yong Yu

The increasing success of Machine Learning (ML) and Deep Learning (DL) has recently re-sparked interest towards traffic classification. While classification of known traffic is a well investigated subject with supervised classification…

Machine Learning · Computer Science 2021-09-28 Lixuan Yang , Alessandro Finamore , Feng Jun , Dario Rossi

Large-scale datasets play a fundamental role in training deep learning models. However, dataset collection is difficult in domains that involve sensitive information. Collaborative learning techniques provide a privacy-preserving solution,…

Machine Learning · Computer Science 2020-04-23 Mert Bülent Sarıyıldız , Ramazan Gökberk Cinbiş , Erman Ayday