English
Related papers

Related papers: Representation Learning on Hyper-Relational and Nu…

200 papers

Multi-graph learning is crucial for extracting meaningful signals from collections of heterogeneous graphs. However, effectively integrating information across graphs with differing topologies, scales, and semantics, often in the absence of…

Machine Learning · Computer Science 2026-02-02 Zahra Moslemi , Ziyi Liang , Norbert Fortin , Babak Shahbaba

Transformer architectures, capable of capturing sequential dependencies in the history of user interactions, have become the dominant approach in sequential recommender systems. Despite their success, such models consider sequence elements…

Information Retrieval · Computer Science 2026-03-02 Artur Gimranov , Viacheslav Yusupov , Elfat Sabitov , Tatyana Matveeva , Anton Lysenko , Ruslan Israfilov , Evgeny Frolov

Deep Neural Networks (DNNs) demonstrate remarkable capabilities in learning complex hierarchical data representations, but the nature of these representations remains largely unknown. Existing global explainability methods, such as Network…

Machine Learning · Computer Science 2024-01-19 Kirill Bykov , Laura Kopf , Shinichi Nakajima , Marius Kloft , Marina M. -C. Höhne

Recent deep learning approaches for representation learning on graphs follow a neighborhood aggregation procedure. We analyze some important properties of these models, and propose a strategy to overcome those. In particular, the range of…

Machine Learning · Computer Science 2018-06-27 Keyulu Xu , Chengtao Li , Yonglong Tian , Tomohiro Sonobe , Ken-ichi Kawarabayashi , Stefanie Jegelka

Knowledge graphs are important resources for many artificial intelligence tasks but often suffer from incompleteness. In this work, we propose to use pre-trained language models for knowledge graph completion. We treat triples in knowledge…

Computation and Language · Computer Science 2019-09-12 Liang Yao , Chengsheng Mao , Yuan Luo

Graph is a universe data structure that is widely used to organize data in real-world. Various real-word networks like the transportation network, social and academic network can be represented by graphs. Recent years have witnessed the…

Machine Learning · Computer Science 2021-11-23 Xueyi Liu , Jie Tang

Contextual word representations, typically trained on unstructured, unlabeled text, do not contain any explicit grounding to real world entities and are often unable to remember facts about those entities. We propose a general method to…

Computation and Language · Computer Science 2019-11-01 Matthew E. Peters , Mark Neumann , Robert L. Logan , Roy Schwartz , Vidur Joshi , Sameer Singh , Noah A. Smith

Knowledge graphs have emerged as an important model for studying complex multi-relational data. This has given rise to the construction of numerous large scale but incomplete knowledge graphs encoding information extracted from various…

Machine Learning · Computer Science 2018-07-24 Rakshit Trivedi , Bunyamin Sisman , Jun Ma , Christos Faloutsos , Hongyuan Zha , Xin Luna Dong

Generating informative scene graphs from images requires integrating and reasoning from various graph components, i.e., objects and relationships. However, current scene graph generation (SGG) methods, including the unbiased SGG methods,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Yibing Zhan , Zhi Chen , Jun Yu , BaoSheng Yu , Dacheng Tao , Yong Luo

A large-scale knowledge graph enhances reproducibility in biomedical data discovery by providing a standardized, integrated framework that ensures consistent interpretation across diverse datasets. It improves generalizability by connecting…

Methodology · Statistics 2024-10-11 Suqi Liu , Tianxi Cai , Xiaoou Li

Recent studies have highlighted the limitations of message-passing based graph neural networks (GNNs), e.g., limited model expressiveness, over-smoothing, over-squashing, etc. To alleviate these issues, Graph Transformers (GTs) have been…

Machine Learning · Computer Science 2023-03-06 Qiheng Mao , Zemin Liu , Chenghao Liu , Jianling Sun

In this work, we introduce a hypergraph representation learning framework called Hypergraph Neural Networks (HNN) that jointly learns hyperedge embeddings along with a set of hyperedge-dependent embeddings for each node in the hypergraph.…

Machine Learning · Computer Science 2023-01-02 Ryan Aponte , Ryan A. Rossi , Shunan Guo , Jane Hoffswell , Nedim Lipka , Chang Xiao , Gromit Chan , Eunyee Koh , Nesreen Ahmed

Recently, heterogeneous graph neural networks (HGNNs) have achieved impressive success in representation learning by capturing long-range dependencies and heterogeneity at the node level. However, few existing studies have delved into the…

Machine Learning · Computer Science 2024-04-17 Jinhui Yuan , Shan Lu , Peibo Duan , Jieyue He

Entity images could provide significant visual information for knowledge representation learning. Most conventional methods learn knowledge representations merely from structured triples, ignoring rich visual information extracted from…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Ruobing Xie , Zhiyuan Liu , Huanbo Luan , Maosong Sun

Path-based relational reasoning over knowledge graphs has become increasingly popular due to a variety of downstream applications such as question answering in dialogue systems, fact prediction, and recommender systems. In recent years,…

Machine Learning · Computer Science 2020-03-16 Mandana Saebi , Steven Krieg , Chuxu Zhang , Meng Jiang , Nitesh Chawla

Quaternion contains one real part and three imaginary parts, which provided a more expressive hypercomplex space for learning knowledge graph. Existing quaternion embedding models measure the plausibility of a triplet either through…

Machine Learning · Computer Science 2024-12-13 Weihua Wang , Qiuyu Liang , Feilong Bao , Guanglai Gao

Link prediction on knowledge graphs (KGs) has been extensively studied on binary relational KGs, wherein each fact is represented by a triple. A significant amount of important knowledge, however, is represented by hyper-relational facts…

Artificial Intelligence · Computer Science 2023-06-06 Bo Xiong , Mojtaba Nayyer , Shirui Pan , Steffen Staab

A key feature of neural models is that they can produce semantic vector representations of objects (texts, images, speech, etc.) ensuring that similar objects are close to each other in the vector space. While much work has focused on…

Computation and Language · Computer Science 2023-03-01 Teven Le Scao , Claire Gardent

Graph representation learning models aim to represent the graph structure and its features into low-dimensional vectors in a latent space, which can benefit various downstream tasks, such as node classification and link prediction. Due to…

Machine Learning · Computer Science 2023-04-27 Thanh Sang Nguyen , Jooho Lee , Van Thuy Hoang , O-Joun Lee

Learning to fuse vision and language information and representing them is an important research problem with many applications. Recent progresses have leveraged the ideas of pre-training (from language modeling) and attention layers in…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Bowen Zhang , Hexiang Hu , Vihan Jain , Eugene Ie , Fei Sha