English
Related papers

Related papers: Boosting Relational Deep Learning with Pretrained …

200 papers

Time, cost, and energy efficiency are critical considerations in Deep-Learning (DL), particularly when processing long texts. Transformers, which represent the current state of the art, exhibit quadratic computational complexity relative to…

Computation and Language · Computer Science 2025-07-11 Fardin Rastakhiz

Reinforcement learning is well known for its ability to model sequential tasks and learn latent data patterns adaptively. Deep learning models have been widely explored and adopted in regression and classification tasks. However, deep…

Machine Learning · Computer Science 2025-06-17 Thanveer Shaik , Xiaohui Tao , Haoran Xie , Lin Li , Jianming Yong , Yuefeng Li

This work presents a novel approach to tabular data prediction leveraging graph structure learning and graph neural networks. Despite the prevalence of tabular data in real-world applications, traditional deep learning methods often…

Machine Learning · Computer Science 2023-05-26 Jay Chiehen Liao , Cheng-Te Li

Predicting links in sparse, continuously evolving networks is a central challenge in network science. Conventional heuristic methods and deep learning models, including Graph Neural Networks (GNNs), are typically designed for static graphs…

Social and Information Networks · Computer Science 2026-02-17 Nafiseh Sadat Sajadi , Behnam Bahrak , Mahdi Jafari Siavoshani

Graph neural networks (GNNs) are powerful models that have been successful in various graph representation learning tasks. Whereas gradient boosted decision trees (GBDT) often outperform other machine learning methods when faced with…

Machine Learning · Computer Science 2021-04-01 Sergei Ivanov , Liudmila Prokhorenkova

Relational prediction tasks are fundamental in many real-world applications, where data are naturally stored in relational databases (RDBs). Relational Deep Learning (RDL) addresses this problem by modeling RDBs as graphs and applying graph…

Machine Learning · Computer Science 2026-05-21 Yi Huang , Qingyun Sun , Jia Li , Xingcheng Fu , Jianxin Li

Capturing long-range dependencies in feature representations is crucial for many visual recognition tasks. Despite recent successes of deep convolutional networks, it remains challenging to model non-local context relations between visual…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Songyang Zhang , Shipeng Yan , Xuming He

Nowadays, neural networks play an important role in the task of relation classification. By designing different neural architectures, researchers have improved the performance to a large extent in comparison with traditional methods.…

Computation and Language · Computer Science 2016-10-14 Yan Xu , Ran Jia , Lili Mou , Ge Li , Yunchuan Chen , Yangyang Lu , Zhi Jin

Link prediction is a classical problem in graph analysis with many practical applications. For directed graphs, recently developed deep learning approaches typically analyze node similarities through contrastive learning and aggregate…

Machine Learning · Computer Science 2025-06-26 Yuyang Zhang , Xu Shen , Yu Xie , Ka-Chun Wong , Weidun Xie , Chengbin Peng

Generalized planning using deep reinforcement learning (RL) combined with graph neural networks (GNNs) has shown promising results in various symbolic planning domains described by PDDL. However, existing approaches typically represent…

Artificial Intelligence · Computer Science 2025-11-11 Sangwoo Jeon , Juchul Shin , Gyeong-Tae Kim , YeonJe Cho , Seongwoo Kim

Despite their impressive performance, Deep Neural Networks (DNNs) typically underperform Gradient Boosting Trees (GBTs) on many tabular-dataset learning tasks. We propose that applying a different regularization coefficient to each weight…

Machine Learning · Statistics 2018-10-25 Ira Shavitt , Eran Segal

Deep learning (DL) models for tabular data problems (e.g. classification, regression) are currently receiving increasingly more attention from researchers. However, despite the recent efforts, the non-DL algorithms based on gradient-boosted…

Machine Learning · Computer Science 2023-10-27 Yury Gorishniy , Ivan Rubachev , Nikolay Kartashev , Daniil Shlenskii , Akim Kotelnikov , Artem Babenko

Graph neural networks (GNNs) have shown promising performance for knowledge graph reasoning. A recent variant of GNN called progressive relational graph neural network (PRGNN), utilizes relational rules to infer missing knowledge in…

Computation and Language · Computer Science 2023-10-23 Shuhan Wu , Huaiyu Wan , Wei Chen , Yuting Wu , Junfeng Shen , Youfang Lin

Graph Neural Networks (GNNs) demonstrate their significance by effectively modeling complex interrelationships within graph-structured data. To enhance the credibility and robustness of GNNs, it becomes exceptionally crucial to bolster…

Machine Learning · Computer Science 2023-12-18 Hang Gao , Chengyu Yao , Jiangmeng Li , Lingyu Si , Yifan Jin , Fengge Wu , Changwen Zheng , Huaping Liu

Relational data stored in RDBMS is foundational to many real-world applications across domains such as e-commerce, finance, and sociality. While deep neural networks (DNNs) have achieved strong performance on tabular data with a single…

Databases · Computer Science 2026-05-15 Lingze Zeng , Shaofeng Cai , Changshuo Liu , Zhongle Xie , Yuncheng Wu , Beng Chin Ooi

Relational deep learning (RDL) settles among the most exciting advances in machine learning for relational databases, leveraging the representational power of message passing graph neural networks (GNNs) to derive useful knowledge and run…

Information Retrieval · Computer Science 2025-03-24 Alejandro Ariza-Casabona , Nikos Kanakaris , Daniele Malitesta

Recent advances have demonstrated the effectiveness of graph-based learning on relational databases (RDBs) for predictive tasks. Such approaches require transforming RDBs into graphs, a process we refer to as RDB-to-graph modeling, where…

Machine Learning · Computer Science 2025-10-29 Dongwon Choi , Sunwoo Kim , Juyeon Kim , Kyungho Kim , Geon Lee , Shinhwan Kang , Myunghwan Kim , Kijung Shin

Tabular data prediction (TDP) is one of the most popular industrial applications, and various methods have been designed to improve the prediction performance. However, existing works mainly focus on feature interactions and ignore sample…

Machine Learning · Computer Science 2021-08-23 Xiawei Guo , Yuhan Quan , Huan Zhao , Quanming Yao , Yong Li , Weiwei Tu

Relational databases are extensively utilized in a variety of modern information system applications, and they always carry valuable data patterns. There are a huge number of data mining or machine learning tasks conducted on relational…

Machine Learning · Computer Science 2023-12-05 Han Zhang , Quan Gan , David Wipf , Weinan Zhang

Recently, significant attention has been given to the idea of viewing relational databases as heterogeneous graphs, enabling the application of graph neural network (GNN) technology for predictive tasks. However, existing GNN methods…

Machine Learning · Computer Science 2025-02-26 Francesco Ferrini , Antonio Longa , Andrea Passerini , Manfred Jaeger