English
Related papers

Related papers: TMTE: Effective Multimodal Graph Learning with Tas…

200 papers

Knowledge graph embedding, which aims to learn the low-dimensional representations of entities and relationships, has attracted considerable research efforts recently. However, most knowledge graph embedding methods focus on the structural…

Machine Learning · Computer Science 2020-07-23 Yonghui Xu , Shengjie Sun , Yuan Miao , Dong Yang , Xiaonan Meng , Yi Hu , Ke Wang , Hengjie Song , Chuanyan Miao

Multimodal alignment is commonly learned from isolated image-text pairs via CLIP-style dual encoders, leaving the relational context among entities largely unused. Multimodal attributed graphs (MAGs), where nodes carry multimodal attributes…

Machine Learning · Computer Science 2026-05-18 Xu Wang , Xunkai Li , Yinlin Zhu , Rong-Hua Li , Guoren Wang

Topological Machine Learning (TML) is an emerging field that leverages techniques from algebraic topology to analyze complex data structures in ways that traditional machine learning methods may not capture. This tutorial provides a…

Machine Learning · Computer Science 2024-09-05 Baris Coskunuzer , Cüneyt Gürcan Akçora

In this paper, we present a new MTL framework that searches for structures optimized for multiple tasks with diverse graph topologies and shares features among tasks. We design a restricted DAG-based central network with read-in/read-out…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Wonhyeok Choi , Sunghoon Im

Real-world multimodal knowledge graphs (MKGs) are inherently heterogeneous, modeling entities that are associated with diverse modalities. Traditional knowledge graph embedding (KGE) methods excel at learning continuous representations of…

Artificial Intelligence · Computer Science 2026-03-16 Athanasios Efthymiou , Stevan Rudinac , Monika Kackovic , Nachoem Wijnberg , Marcel Worring

Representation learning on text-attributed graphs (TAGs) integrates structural connectivity with rich textual semantics, enabling applications in diverse domains. Current methods largely rely on contrastive learning to maximize cross-modal…

Graphics · Computer Science 2025-10-15 Heng Zhang , Tianyi Zhang , Yuling Shi , Xiaodong Gu , Yaomin Shen , Zijian Zhang , Yilei Yuan , Hao Zhang , Jin Huang

Multimodal data plays a critical role in web-based recommendation systems, where information from diverse modalities such as vision and text enhances representation learning. However, real-world multimodal datasets often suffer from…

Information Retrieval · Computer Science 2026-05-04 Yuan Li , Jun Hu , Jiaxin Jiang , Bryan Hooi , Bingsheng He

Human communication is multimodal in nature; it is through multiple modalities such as language, voice, and facial expressions, that opinions and emotions are expressed. Data in this domain exhibits complex multi-relational and temporal…

Computation and Language · Computer Science 2021-04-30 Jianing Yang , Yongxin Wang , Ruitao Yi , Yuying Zhu , Azaan Rehman , Amir Zadeh , Soujanya Poria , Louis-Philippe Morency

Feature transformation methods aim to find an optimal mathematical feature-feature crossing process that generates high-value features and improves the performance of downstream machine learning tasks. Existing frameworks, though designed…

Machine Learning · Computer Science 2025-04-25 Xiaohan Huang , Dongjie Wang , Zhiyuan Ning , Ziyue Qiao , Qingqing Long , Haowei Zhu , Yi Du , Min Wu , Yuanchun Zhou , Meng Xiao

Knowledge Tracing (KT) aims to model a student's learning trajectory and predict performance on the next question. A key challenge is how to better represent the relationships among students, questions, and knowledge concepts (KCs).…

Artificial Intelligence · Computer Science 2026-01-26 Chi Yu , Hongyu Yuan , Zhiyi Duan

Automatically detecting/segmenting object(s) that blend in with their surroundings is difficult for current models. A major challenge is that the intrinsic similarities between such foreground objects and background surroundings make the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Qiang Zhai , Xin Li , Fan Yang , Chenglizhao Chen , Hong Cheng , Deng-Ping Fan

Benefiting from the powerful expressive capability of graphs, graph-based approaches have achieved impressive performance in various biomedical applications. Most existing methods tend to define the adjacency matrix among samples manually…

Machine Learning · Computer Science 2021-07-02 Shuai Zheng , Zhenfeng Zhu , Zhizhe Liu , Zhenyu Guo , Yang Liu , Yao Zhao

Multimodal recommendation systems (MMRS) have received considerable attention from the research community due to their ability to jointly utilize information from user behavior and product images and text. Previous research has two main…

Information Retrieval · Computer Science 2024-07-18 Guojiao Lin , Zhen Meng , Dongjie Wang , Qingqing Long , Yuanchun Zhou , Meng Xiao

The cold-start problem is a long-standing challenge in recommender systems due to the lack of user-item interactions, which significantly hurts the recommendation effect over new users and items. Recently, meta-learning based methods…

Information Retrieval · Computer Science 2024-05-07 Yuxiang Shi , Yue Ding , Bo Chen , Yuyang Huang , Yule Wang , Ruiming Tang , Dong Wang

The multi-modal entity alignment (MMEA) aims to find all equivalent entity pairs between multi-modal knowledge graphs (MMKGs). Rich attributes and neighboring entities are valuable for the alignment task, but existing works ignore…

Computation and Language · Computer Science 2023-04-05 Qian Li , Shu Guo , Yangyifei Luo , Cheng Ji , Lihong Wang , Jiawei Sheng , Jianxin Li

Graph classification is an important learning task for graph-structured data. Graph neural networks (GNNs) have recently gained growing attention in graph learning and have shown significant improvements in many important graph problems.…

Machine Learning · Computer Science 2024-01-31 Tao Wen , Elynn Chen , Yuzhou Chen

Biomedical knowledge graphs are increasingly large, dynamic, and multimodal, driven by rapid advances in biotechnology such as high-throughput sequencing. Machine learning models can infer previously unobserved biomedical relationships and…

Machine Learning · Computer Science 2026-05-12 Yousef A. Radwan , Yao Li , Qing Qing , Ziqi Xu , Qixin Zhang , Yongcheng Jing , Renqiang Luo , Xikun Zhang

Multimodal recommendation enhances ranking by integrating user-item interactions with item content, which is particularly effective under sparse feedback and long-tail distributions. However, multimodal signals are inherently heterogeneous…

Artificial Intelligence · Computer Science 2026-02-27 Ji Dai , Quan Fang , Dengsheng Cai

Multi-task optimization is a powerful approach for solving a large number of tasks in parallel. However, existing algorithms face distinct limitations: Population-based methods scale poorly and remain underexplored for large task sets.…

Machine Learning · Computer Science 2026-04-27 Julian Hatzky , Thomas Bartz-Beielstein , A. E. Eiben , Anil Yaman

Robust multimodal visual analytics remains challenging when heterogeneous modalities provide complementary but input-dependent evidence for decision-making.Existing multimodal learning methods mainly rely on fixed fusion modules or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Tianyi Liu , Yiming Li , Wenqian Wang , Jiaojiao Wang , Chen Cai , Yi Wang , Kim-Hui Yap