English
Related papers

Related papers: Structure Guided Multi-modal Pre-trained Transform…

200 papers

Graph generation is a critical task in numerous domains, including molecular design and social network analysis, due to its ability to model complex relationships and structured data. While most modern graph generative models utilize…

Machine Learning · Computer Science 2025-06-04 Xiaohui Chen , Yinkai Wang , Jiaxing He , Yuanqi Du , Soha Hassoun , Xiaolin Xu , Li-Ping Liu

Can language models (LM) ground question-answering (QA) tasks in the knowledge base via inherent relational reasoning ability? While previous models that use only LMs have seen some success on many QA tasks, more recent methods include…

Computation and Language · Computer Science 2023-06-07 Yujie Lu , Siqi Ouyang , Kairui Zhou

Knowledge graph reasoning plays a vital role in various applications and has garnered considerable attention. Recently, path-based methods have achieved impressive performance. However, they may face limitations stemming from constraints in…

Artificial Intelligence · Computer Science 2024-12-18 Junnan Liu , Qianren Mao , Weifeng Jiang , Jianxin Li

Knowledge graph completion (KGC), the task of predicting missing information based on the existing relational data inside a knowledge graph (KG), has drawn significant attention in recent years. However, the predictive power of KGC methods…

Computation and Language · Computer Science 2023-05-26 Weihang Zhang , Ovidiu Serban , Jiahao Sun , Yi-ke Guo

Knowledge-based visual question answering (VQA) is a vision-language task that requires an agent to correctly answer image-related questions using knowledge that is not presented in the given image. It is not only a more challenging task…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Mingxiao Li , Marie-Francine Moens

Biomedical Knowledge Graphs (BKGs) integrate diverse datasets to elucidate complex relationships within the biomedical field. Effective link prediction on these graphs can uncover valuable connections, such as potential novel drug-disease…

Computation and Language · Computer Science 2025-07-01 Tien Dang , Viet Thanh Duy Nguyen , Minh Tuan Le , Truong-Son Hy

Recognizing multiple labels of an image is a practical yet challenging task, and remarkable progress has been achieved by searching for semantic regions and exploiting label dependencies. However, current works utilize RNN/LSTM to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Tianshui Chen , Liang Lin , Riquan Chen , Xiaolu Hui , Hefeng Wu

In natural language processing (NLP) and computer vision (CV), the successful application of foundation models across diverse tasks has demonstrated their remarkable potential. However, despite the rich structural and textual information…

Computation and Language · Computer Science 2025-05-29 Yin Hua , Zhiqiang Liu , Mingyang Chen , Zheng Fang , Chi Man Wong , Lingxiao Li , Chi Man Vong , Huajun Chen , Wen Zhang

Large language model (LLM) based knowledge graph completion (KGC) aims to predict the missing triples in the KGs with LLMs. However, research about LLM-based KGC fails to sufficiently harness LLMs' inference proficiencies, overlooking…

Computation and Language · Computer Science 2024-04-16 Yichi Zhang , Zhuo Chen , Lingbing Guo , Yajing Xu , Wen Zhang , Huajun Chen

Knowledge graph (KG) foundation models aim to generalize across graphs with unseen entities and relations by learning transferable relational structure. However, most existing methods primarily emphasize relation-level universality, while…

Artificial Intelligence · Computer Science 2026-05-15 Yisen Gao , Jiaxin Bai , Haoyu Huang , Zhongwei Xie , Yufei Li , Hong Ting Tsang , Sirui Han , Yangqiu Song

Relational learning is an essential task in the domain of knowledge representation, particularly in knowledge graph completion (KGC). While relational learning in traditional single-modal settings has been extensively studied, exploring it…

Machine Learning · Computer Science 2024-12-05 Rui Cai , Shichao Pei , Xiangliang Zhang

Knowledge Graph Foundation Models (KGFMs) have shown promise in enabling zero-shot reasoning over unseen graphs by learning transferable patterns. However, most existing KGFMs rely solely on graph structure, overlooking the rich semantic…

Computation and Language · Computer Science 2025-09-22 Arvindh Arun , Sumit Kumar , Mojtaba Nayyeri , Bo Xiong , Ponnurangam Kumaraguru , Antonio Vergari , Steffen Staab

A foundation model like GPT elicits many emergent abilities, owing to the pre-training with broad inclusion of data and the use of the powerful Transformer architecture. While foundation models in natural languages are prevalent, can we…

Machine Learning · Computer Science 2025-06-18 Ziyuan Tang , Jie Chen

Large Language Models (LLMs) have demonstrated remarkable capabilities in many real-world applications. Nonetheless, LLMs are often criticized for their tendency to produce hallucinations, wherein the models fabricate incorrect statements…

Computation and Language · Computer Science 2024-06-05 Qinggang Zhang , Junnan Dong , Hao Chen , Daochen Zha , Zailiang Yu , Xiao Huang

Knowledge graphs (KGs) consisting of a large number of triples have become widespread recently, and many knowledge graph embedding (KGE) methods are proposed to embed entities and relations of a KG into continuous vector spaces. Such…

Machine Learning · Computer Science 2022-05-09 Mingyang Chen , Wen Zhang , Yushan Zhu , Hongting Zhou , Zonggang Yuan , Changliang Xu , Huajun Chen

Mind-map generation aims to process a document into a hierarchical structure to show its central idea and branches. Such a manner is more conducive to understanding the logic and semantics of the document than plain text. Recently, a…

Computation and Language · Computer Science 2023-12-20 Zhuowei Zhang , Mengting Hu , Yinhao Bai , Zhen Zhang

Signed Graph Neural Networks (SGNNs) are effective in learning expressive representations for signed graphs but typically require substantial task-specific labels, limiting their applicability in label-scarce industrial scenarios. In…

Machine Learning · Computer Science 2025-08-19 Zian Zhai , Sima Qing , Xiaoyang Wang , Wenjie Zhang

Entities may have complex interactions in a knowledge graph (KG), such as multi-step relationships, which can be viewed as graph contextual information of the entities. Traditional knowledge representation learning (KRL) methods usually…

Computation and Language · Computer Science 2020-12-08 Bin He , Di Zhou , Jing Xie , Jinghui Xiao , Xin Jiang , Qun Liu

Transformers have attained outstanding performance across various modalities, owing to their simple but powerful scaled-dot-product (SDP) attention mechanisms. Researchers have attempted to migrate Transformers to graph learning, but most…

Machine Learning · Computer Science 2026-01-30 Liheng Ma , Soumyasundar Pal , Yingxue Zhang , Philip H. S. Torr , Mark Coates

Vision-Language Models (VLMs) have demonstrated remarkable capabilities in aligning and understanding multimodal signals, yet their potential to reason over structured data, where multimodal entities are connected through explicit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jiajin Liu , Dongzhe Fan , Chuanhao Ji , Daochen Zha , Qiaoyu Tan