English
Related papers

Related papers: Relphormer: Relational Graph Transformer for Knowl…

200 papers

Entity alignment is the task of linking entities with the same real-world identity from different knowledge graphs (KGs), which has been recently dominated by embedding-based methods. Such approaches work by learning KG representations so…

Computation and Language · Computer Science 2019-08-23 Yuting Wu , Xiao Liu , Yansong Feng , Zheng Wang , Rui Yan , Dongyan Zhao

Graph transformer has been proven as an effective graph learning method for its adoption of attention mechanism that is capable of capturing expressive representations from complex topological and feature information of graphs. Graph…

Machine Learning · Computer Science 2024-03-26 Dongqi Fu , Zhigang Hua , Yan Xie , Jin Fang , Si Zhang , Kaan Sancak , Hao Wu , Andrey Malevich , Jingrui He , Bo Long

Graph Transformers (GTs) show considerable potential in graph representation learning. The architecture of GTs typically integrates Graph Neural Networks (GNNs) with global attention mechanisms either in parallel or as a precursor to…

Machine Learning · Computer Science 2026-02-04 Gang Wu , Zhengwei Wang

Incorporating factual knowledge into pre-trained language models (PLM) such as BERT is an emerging trend in recent NLP studies. However, most of the existing methods combine the external knowledge integration module with a modified…

Computation and Language · Computer Science 2022-05-06 Yinquan Lu , Haonan Lu , Guirong Fu , Qun Liu

Nowadays, Knowledge graphs (KGs) have been playing a pivotal role in AI-related applications. Despite the large sizes, existing KGs are far from complete and comprehensive. In order to continuously enrich KGs, automatic knowledge…

Computation and Language · Computer Science 2021-11-12 Zhao Zhang , Fuzhen Zhuang , Hengshu Zhu , Chao Li , Hui Xiong , Qing He , Yongjun Xu

Retrieval Augmented Generation (RAG) has enjoyed increased attention in the recent past and recent advancements in Large Language Models (LLMs) have highlighted the importance of integrating world knowledge into these systems. Current RAG…

Computation and Language · Computer Science 2025-04-11 Joel Barmettler , Abraham Bernstein , Luca Rossetto

Using Large Language Models (LLMs) to process graph-structured data is an active research area, yet current state-of-the-art approaches typically rely on multi-step pipelines with Graph Neural Network (GNN) encoders that compress rich…

Machine Learning · Computer Science 2026-05-12 Dario Vajda

Given the broad application of infrared technology across diverse fields, there is an increasing emphasis on investigating super-resolution techniques for infrared images within the realm of deep learning. Despite the impressive results of…

Image and Video Processing · Electrical Eng. & Systems 2024-01-25 Feiwei Qin , Kang Yan , Changmiao Wang , Ruiquan Ge , Yong Peng , Kai Zhang

Learning representations on large graphs is a long-standing challenge due to the inter-dependence nature. Transformers recently have shown promising performance on small graphs thanks to its global attention for capturing all-pair…

Machine Learning · Computer Science 2024-09-16 Qitian Wu , Kai Yang , Hengrui Zhang , David Wipf , Junchi Yan

The pursuit of automated scientific discovery has fueled progress from symbolic logic to modern AI, forging new frontiers in reasoning and pattern recognition. Transformers function as potential systems, where every possible relationship…

Artificial Intelligence · Computer Science 2025-01-15 Markus J. Buehler

Complex Logical Query Answering (CLQA) over incomplete knowledge graphs is a challenging task. Recently, Query Embedding (QE) methods are proposed to solve CLQA by performing multi-hop logical reasoning. However, most of them only consider…

Machine Learning · Computer Science 2024-06-24 Chongzhi Zhang , Zhiping Peng , Junhao Zheng , Linghao Wang , Ruifeng Shi , Qianli Ma

Hyper-relational knowledge graphs (KGs) contain additional key-value pairs, providing more information about the relations. In many scenarios, the same relation can have distinct key-value pairs, making the original triple fact more…

Artificial Intelligence · Computer Science 2024-03-05 Yonglin Jing

In heterogeneous graphs, we can observe complex structures such as tree-like or hierarchical structures. Recently, the hyperbolic space has been widely adopted in many studies to effectively learn these complex structures. Although these…

Machine Learning · Computer Science 2026-01-14 Jongmin Park , Seunghoon Han , Hyewon Lee , Won-Yong Shin , Sungsu Lim

Hyper-relational Knowledge Graphs (HRKGs) extend traditional KGs beyond binary relations, enabling the representation of contextual, provenance, and temporal information in domains, such as historical events, sensor data, video content, and…

Machine Learning · Computer Science 2025-04-01 Shusaku Egami , Kyoumoto Matsushita , Takanori Ugai , Ken Fukuda

Dynamic graph representation learning strategies are based on different neural architectures to capture the graph evolution over time. However, the underlying neural architectures require a large amount of parameters to train and suffer…

Machine Learning · Computer Science 2020-11-12 Stefanos Antaris , Dimitrios Rafailidis

Information extraction methods proved to be effective at triple extraction from structured or unstructured data. The organization of such triples in the form of (head entity, relation, tail entity) is called the construction of Knowledge…

Artificial Intelligence · Computer Science 2022-08-25 Mohamad Zamini , Hassan Reza , Minou Rabiei

Knowledge-based visual question answering (QA) aims to answer a question which requires visually-grounded external knowledge beyond image content itself. Answering complex questions that require multi-hop reasoning under weak supervision is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Yu-Jung Heo , Eun-Sol Kim , Woo Suk Choi , Byoung-Tak Zhang

Knowledge graph (KG) representation learning aims to encode entities and relations into dense continuous vector spaces such that knowledge contained in a dataset could be consistently represented. Dense embeddings trained from KG datasets…

Machine Learning · Computer Science 2022-04-18 Tong Yang , Yifei Wang , Long Sha , Jan Engelbrecht , Pengyu Hong

Incorporating knowledge graph as side information has become a new trend in recommendation systems. Recent studies regard items as entities of a knowledge graph and leverage graph neural networks to assist item encoding, yet by considering…

Information Retrieval · Computer Science 2022-11-22 Lingyun Lu , Bang Wang , Zizhuo Zhang , Shenghao Liu , Han Xu

Multimodal learning has been a field of increasing interest, aiming to combine various modalities in a single joint representation. Especially in the area of visiolinguistic (VL) learning multiple models and techniques have been developed,…

Machine Learning · Computer Science 2024-03-26 Maria Lymperaiou , Giorgos Stamou