English
Related papers

Related papers: Hybrid Transformer with Multi-level Fusion for Mul…

200 papers

Multimodal machine learning is an emerging area of research, which has received a great deal of scholarly attention in recent years. Up to now, there are few studies on multimodal Emotion Recognition in Conversation (ERC). Since Graph…

Multimedia · Computer Science 2023-12-05 Jiang Li , Xiaoping Wang , Guoqing Lv , Zhigang Zeng

Recent advances in CV and NLP have inspired researchers to develop general-purpose graph foundation models through pre-training across diverse domains. However, a fundamental challenge arises from the substantial differences in graph…

Social and Information Networks · Computer Science 2025-06-02 Shuo Wang , Bokui Wang , Zhixiang Shen , Boyan Deng , Zhao Kang

Accurately predicting the behavior of complex dynamical systems, characterized by high-dimensional multivariate time series(MTS) in interconnected sensor networks, is crucial for informed decision-making in various applications to minimize…

Machine Learning · Computer Science 2024-08-23 Sagar Srinivas Sakhinana , Krishna Sai Sudhir Aripirala , Shivam Gupta , Venkataramana Runkana

Knowledge Graphs (KGs) provide a structured representation of knowledge but often suffer from challenges of incompleteness. To address this, link prediction or knowledge graph completion (KGC) aims to infer missing new facts based on…

Machine Learning · Computer Science 2025-01-03 Wenkai Tu , Guojia Wan , Zhengchun Shang , Bo Du

Multi-modal knowledge graphs (MMKGs), which ground various non-symbolic data (e.g., images and videos) into symbols, have attracted attention as resources enabling knowledge processing and machine learning across modalities. However, the…

Artificial Intelligence · Computer Science 2024-08-29 Shusaku Egami , Takahiro Ugai , Swe Nwe Nwe Htun , Ken Fukuda

Knowledge Tracing (KT) aims to model a student's learning trajectory and predict performance on the next question. A key challenge is how to better represent the relationships among students, questions, and knowledge concepts (KCs).…

Artificial Intelligence · Computer Science 2026-01-26 Chi Yu , Hongyu Yuan , Zhiyi Duan

Multi-modal knowledge graph reasoning (MMKGR) aims to predict the missing links by exploiting both graph structure information and multi-modal entity contents. Most existing works are designed for a transductive setting, which learns…

Computation and Language · Computer Science 2026-02-19 Yichi Zhang , Zhuo Chen , Lingbing Guo , Wen Zhang , Huajun Chen

Knowledge graphs (KGs) play a key role in promoting various multimedia and AI applications. However, with the explosive growth of multi-modal information, traditional knowledge graph completion (KGC) models cannot be directly applied. This…

Multimedia · Computer Science 2025-05-29 Linyu Li , Zhi Jin , Yichi Zhang , Dongming Jin , Chengfeng Dou , Yuanpeng He , Xuan Zhang , Haiyan Zhao

Multi-Modal Entity Alignment (MMEA) is a critical task that aims to identify equivalent entity pairs across multi-modal knowledge graphs (MMKGs). However, this task faces challenges due to the presence of different types of information,…

Computation and Language · Computer Science 2023-10-11 Qian Li , Cheng Ji , Shu Guo , Zhaoji Liang , Lihong Wang , Jianxin Li

Knowledge graph completion (KGC) aims to predict missing facts in knowledge graphs (KGs), which is crucial as modern KGs remain largely incomplete. While training KGC models on multiple aligned KGs can improve performance, previous methods…

Computation and Language · Computer Science 2023-12-19 Wei Tang , Zhiqian Wu , Yixin Cao , Yong Liao , Pengyuan Zhou

As the field of remote sensing is evolving, we witness the accumulation of information from several modalities, such as multispectral (MS), hyperspectral (HSI), LiDAR etc. Each of these modalities possess its own distinct characteristics…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Rupak Bose , Shivam Pande , Biplab Banerjee

Knowledge graph completion (KGC) aims to discover missing relationships between entities in knowledge graphs (KGs). Most prior KGC work focuses on learning embeddings for entities and relations through a simple scoring function. Yet, a…

Artificial Intelligence · Computer Science 2023-07-13 Yun-Cheng Wang , Xiou Ge , Bin Wang , C. -C. Jay Kuo

Embedding based Knowledge Graph (KG) Completion has gained much attention over the past few years. Most of the current algorithms consider a KG as a multidirectional labeled graph and lack the ability to capture the semantics underlying the…

Artificial Intelligence · Computer Science 2024-07-12 Mehwish Alam , Frank van Harmelen , Maribel Acosta

Real-world Knowledge Graphs (KGs) often suffer from incompleteness, which limits their potential performance. Knowledge Graph Completion (KGC) techniques aim to address this issue. However, traditional KGC methods are computationally…

Computation and Language · Computer Science 2023-11-03 Alla Chepurova , Aydar Bulatov , Yuri Kuratov , Mikhail Burtsev

Image fusion aims to synthesize a single high-quality image from a pair of inputs captured under challenging conditions, such as differing exposure levels or focal depths. A core challenge lies in effectively handling disparities in dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Mingwei Tang , Jiahao Nie , Guang Yang , Ziqing Cui , Jie Li

Multimodal knowledge graphs (MMKGs) enrich traditional knowledge graphs (KGs) by incorporating diverse modalities such as images and text. multimodal knowledge graph completion (MMKGC) seeks to exploit these heterogeneous signals to infer…

Computation and Language · Computer Science 2025-08-12 Yongkang Xiao , Rui Zhang

Retrieval Augmented Generation (RAG) has gradually emerged as a promising paradigm for enhancing the accuracy and factual consistency of content generated by large language models (LLMs). However, existing RAG studies primarily focus on…

Information Retrieval · Computer Science 2025-07-24 Qikai Wei , Huansheng Ning , Chunlong Han , Jianguo Ding

The Knowledge Graph-to-Text Generation task aims to convert structured knowledge graphs into coherent and human-readable natural language text. Recent efforts in this field have focused on enhancing pre-trained language models (PLMs) by…

Computation and Language · Computer Science 2024-09-24 Shanshan Wang , Chun Zhang , Ning Zhang

Knowledge graph (KG) based Collaborative Filtering is an effective approach to personalizing recommendation systems for relatively static domains such as movies and books, by leveraging structured information from KG to enrich both item and…

Information Retrieval · Computer Science 2022-04-05 Weizhe Lin , Linjun Shou , Ming Gong , Pei Jian , Zhilin Wang , Bill Byrne , Daxin Jiang

The coordination of autonomous agents in dynamic environments is hampered by the semantic gap between high-level mission objectives and low-level planner inputs. To address this, we introduce a framework centered on a Knowledge Graph (KG)…

Artificial Intelligence · Computer Science 2025-10-27 Edward Holmberg , Elias Ioup , Mahdi Abdelguerfi