English
Related papers

Related papers: PLM-GNN: A Webpage Classification Method based on …

200 papers

We focus on graph classification using a graph neural network (GNN) model that precomputes the node features using a bank of neighborhood aggregation graph operators arranged in parallel. These GNN models have a natural advantage of reduced…

Machine Learning · Computer Science 2022-11-23 Siddhant Doshi , Sundeep Prabhakar Chepuri

The ability of knowledge graphs to represent complex relationships at scale has led to their adoption for various needs including knowledge representation, question-answering, and recommendation systems. Knowledge graphs are often…

Computation and Language · Computer Science 2023-05-18 Jason Youn , Ilias Tagkopoulos

Protein language models (pLMs) pre-trained on vast protein sequence databases excel at various downstream tasks but often lack the structural knowledge essential for some biological applications. To address this, we introduce a method to…

Click-through rate (CTR) prediction is an essential task in web applications such as online advertising and recommender systems, whose features are usually in multi-field form. The key of this task is to model feature interactions among…

Information Retrieval · Computer Science 2020-07-27 Zekun Li , Zeyu Cui , Shu Wu , Xiaoyu Zhang , Liang Wang

In the realm of personalization, integrating diverse information sources such as consumption signals and content-based representations is becoming increasingly critical to build state-of-the-art solutions. In this regard, two of the biggest…

Information Retrieval · Computer Science 2024-03-13 Andreas Damianou , Francesco Fabbri , Paul Gigioli , Marco De Nadai , Alice Wang , Enrico Palumbo , Mounia Lalmas

In many important graph data processing applications the acquired information includes both node features and observations of the graph topology. Graph neural networks (GNNs) are designed to exploit both sources of evidence but they do not…

Machine Learning · Computer Science 2021-10-28 Eli Chien , Jianhao Peng , Pan Li , Olgica Milenkovic

Recently, text classification model based on graph neural network (GNN) has attracted more and more attention. Most of these models adopt a similar network paradigm, that is, using pre-training node embedding initialization and two-layer…

Computation and Language · Computer Science 2023-01-26 Jiayuan Chen , Boyu Zhang , Yinfei Xu , Meng Wang

The problem of answering questions using knowledge from pre-trained language models (LMs) and knowledge graphs (KGs) presents two challenges: given a QA context (question and answer choice), methods need to (i) identify relevant knowledge…

Computation and Language · Computer Science 2022-12-14 Michihiro Yasunaga , Hongyu Ren , Antoine Bosselut , Percy Liang , Jure Leskovec

Large Language Models (LLMs) have been increasingly studied as neural knowledge bases for supporting knowledge-intensive applications such as question answering and fact checking. However, the structural organization of their knowledge…

Machine Learning · Computer Science 2026-01-16 Utkarsh Sahu , Zhisheng Qi , Mahantesh Halappanavar , Nedim Lipka , Ryan A. Rossi , Franck Dernoncourt , Yu Zhang , Yao Ma , Yu Wang

In this work, we adhere to explore a Multi-Tasking learning (MTL) based network to perform document attribute classification such as the font type, font size, font emphasis and scanning resolution classification of a document image. To…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Tanmoy Mondal , Abhijit Das , Zuheng Ming

Pre-trained Language Models (PLMs) which are trained on large text corpus via self-supervised learning method, have yielded promising performance on various tasks in Natural Language Processing (NLP). However, though PLMs with huge…

Computation and Language · Computer Science 2023-08-31 Linmei Hu , Zeyi Liu , Ziwang Zhao , Lei Hou , Liqiang Nie , Juanzi Li

Web measurements are a well-established methodology for assessing the security and privacy landscape of the Internet. However, existing top lists of popular websites are unlabeled and lack semantic information about the nature of the…

Cryptography and Security · Computer Science 2026-05-01 Simone Bozzolan , Stefano Calzavara , Lorenzo Cazzaro

We propose the fully explainable Decision Tree Graph Neural Network (DT+GNN) architecture. In contrast to existing black-box GNNs and post-hoc explanation methods, the reasoning of DT+GNN can be inspected at every step. To achieve this, we…

Machine Learning · Computer Science 2022-05-27 Peter Müller , Lukas Faber , Karolis Martinkus , Roger Wattenhofer

Knowledge Graphs (KGs) represent human-crafted factual knowledge in the form of triplets (head, relation, tail), which collectively form a graph. Question Answering over KGs (KGQA) is the task of answering natural questions grounding the…

Computation and Language · Computer Science 2024-05-31 Costas Mavromatis , George Karypis

This paper presents a new Graph Neural Network (GNN) type using feature-wise linear modulation (FiLM). Many standard GNN variants propagate information along the edges of a graph by computing "messages" based only on the representation of…

Machine Learning · Computer Science 2020-06-29 Marc Brockschmidt

Knowledge representation learning has been commonly adopted to incorporate knowledge graph (KG) into various online services. Although existing knowledge representation learning methods have achieved considerable performance improvement,…

Machine Learning · Computer Science 2022-05-18 Binbin Hu , Zhiyang Hu , Zhiqiang Zhang , Jun Zhou , Chuan Shi

Large language models (LLMs) have fueled many intelligent web agents, but most existing ones perform far from satisfying in real-world web navigation tasks due to three factors: (1) the complexity of HTML text data (2) versatility of…

Computation and Language · Computer Science 2024-10-15 Hanyu Lai , Xiao Liu , Iat Long Iong , Shuntian Yao , Yuxuan Chen , Pengbo Shen , Hao Yu , Hanchen Zhang , Xiaohan Zhang , Yuxiao Dong , Jie Tang

Spectral Graph Neural Networks (SGNNs) have achieved remarkable performance in tasks such as node classification due to their ability to learn flexible filters. Typically, these filters are learned under the supervision of downstream tasks,…

Machine Learning · Computer Science 2025-08-06 Kangkang Lu , Yanhua Yu , Zhiyong Huang , Tat-Seng Chua

Knowledge graphs have emerged to be promising datastore candidates for context augmentation during Retrieval Augmented Generation (RAG). As a result, techniques in graph representation learning have been simultaneously explored alongside…

Information Retrieval · Computer Science 2025-03-20 Md Shahir Zaoad , Niamat Zawad , Priyanka Ranade , Richard Krogman , Latifur Khan , James Holt

This study presents a hybrid deep learning architecture that integrates LSTM, CNN, and an Attention mechanism to enhance the classification of web content based on text. Pretrained GloVe embeddings are used to represent words as dense…

Computation and Language · Computer Science 2025-12-29 Mykola Kuz , Ihor Lazarovych , Mykola Kozlenko , Mykola Pikuliak , Andrii Kvasniuk