English
Related papers

Related papers: Multi-modal Contrastive Representation Learning fo…

200 papers

Modality representation learning is an important problem for multimodal sentiment analysis (MSA), since the highly distinguishable representations can contribute to improving the analysis effect. Previous works of MSA have usually focused…

Multimedia · Computer Science 2023-01-31 Peipei Liu , Xin Zheng , Hong Li , Jie Liu , Yimo Ren , Hongsong Zhu , Limin Sun

Entity alignment aims to match identical entities across different knowledge graphs (KGs). Graph neural network-based entity alignment methods have achieved promising results in Euclidean space. However, KGs often contain complex…

Computation and Language · Computer Science 2024-12-09 Cunda Wang , Weihua Wang , Qiuyu Liang , Feilong Bao , Guanglai Gao

Entity alignment, which is a prerequisite for creating a more comprehensive Knowledge Graph (KG), involves pinpointing equivalent entities across disparate KGs. Contemporary methods for entity alignment have predominantly utilized knowledge…

Computation and Language · Computer Science 2024-01-31 Linyao Yang , Hongyang Chen , Xiao Wang , Jing Yang , Fei-Yue Wang , Han Liu

Entity alignment (EA) is to identify equivalent entities across different knowledge graphs (KGs), which can help fuse these KGs into a more comprehensive one. Previous EA methods mainly focus on aligning a pair of KGs, and to the best of…

Computation and Language · Computer Science 2025-02-12 Yaming Yang , Zhe Wang , Ziyu Guan , Wei Zhao , Weigang Lu , Xinyan Huang , Jiangtao Cui , Xiaofei He

Multi-view representation learning has developed rapidly over the past decades and has been applied in many fields. However, most previous works assumed that each view is complete and aligned. This leads to an inevitable deterioration in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Yiming Wang , Dongxia Chang , Zhiqiang Fu , Jie Wen , Yao Zhao

Cross-lingual named entity recognition (CrossNER) faces challenges stemming from uneven performance due to the scarcity of multilingual corpora, especially for non-English data. While prior efforts mainly focus on data-driven transfer…

Computation and Language · Computer Science 2024-02-22 Ying Mo , Jian Yang , Jiahao Liu , Qifan Wang , Ruoyu Chen , Jingang Wang , Zhoujun Li

As a crucial extension of entity alignment (EA), multi-modal entity alignment (MMEA) aims to identify identical entities across disparate knowledge graphs (KGs) by exploiting associated visual information. However, existing MMEA approaches…

Artificial Intelligence · Computer Science 2023-08-02 Zhuo Chen , Lingbing Guo , Yin Fang , Yichi Zhang , Jiaoyan Chen , Jeff Z. Pan , Yangning Li , Huajun Chen , Wen Zhang

This study explores the application of self-supervised learning techniques for event sequences. It is a key modality in various applications such as banking, e-commerce, and healthcare. However, there is limited research on self-supervised…

Modeling various aspects that make a music piece unique is a challenging task, requiring the combination of multiple sources of information. Deep learning is commonly used to obtain representations using various sources of information, such…

Sound · Computer Science 2021-04-05 Andres Ferraro , Xavier Favory , Konstantinos Drossos , Yuntae Kim , Dmitry Bogdanov

Multi-modal entity alignment aims to identify equivalent entities between two multi-modal Knowledge graphs by integrating multi-modal data, such as images and text, to enrich the semantic representations of entities. However, existing…

Artificial Intelligence · Computer Science 2026-01-21 Zhifei Li , Ziyue Qin , Xiangyu Luo , Xiaoju Hou , Yue Zhao , Miao Zhang , Zhifang Huang , Kui Xiao , Bing Yang

Self-supervised entity alignment (EA) aims to link equivalent entities across different knowledge graphs (KGs) without seed alignments. The current SOTA self-supervised EA method draws inspiration from contrastive learning, originally…

Computation and Language · Computer Science 2022-10-11 Kaisheng Zeng , Zhenhao Dong , Lei Hou , Yixin Cao , Minghao Hu , Jifan Yu , Xin Lv , Juanzi Li , Ling Feng

Entity alignment (EA) is the task of identifying the entities that refer to the same real-world object but are located in different knowledge graphs (KGs). For entities to be aligned, existing EA solutions treat them separately and generate…

Computation and Language · Computer Science 2021-01-06 Weixin Zeng , Xiang Zhao , Jiuyang Tang , Xuemin Lin , Paul Groth

Entity alignment (EA) for knowledge graphs (KGs) plays a critical role in knowledge engineering. Existing EA methods mostly focus on utilizing the graph structures and entity attributes (including literals), but ignore images that are…

Artificial Intelligence · Computer Science 2023-03-14 Yangning Li , Jiaoyan Chen , Yinghui Li , Yuejia Xiang , Xi Chen , Hai-Tao Zheng

Multi-Modal Entity Alignment aims to discover identical entities across heterogeneous knowledge graphs. While recent studies have delved into fusion paradigms to represent entities holistically, the elimination of features irrelevant to…

Computation and Language · Computer Science 2024-07-24 Yani Huang , Xuefeng Zhang , Richong Zhang , Junfan Chen , Jaein Kim

Entity-aware image captioning aims to describe named entities and events related to the image by utilizing the background knowledge in the associated article. This task remains challenging as it is difficult to learn the association between…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Wentian Zhao , Yao Hu , Heda Wang , Xinxiao Wu , Jiebo Luo

Multimodal learning from document data has achieved great success lately as it allows to pre-train semantically meaningful features as a prior into a learnable downstream task. In this paper, we approach the document classification problem…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Souhail Bakkali , Zuheng Ming , Mickael Coustaty , Marçal Rusiñol , Oriol Ramos Terrades

Humans perceive the world through multisensory integration, blending the information of different modalities to adapt their behavior. Contrastive learning offers an appealing solution for multimodal self-supervised learning. Indeed, by…

Machine Learning · Computer Science 2025-03-06 Benoit Dufumier , Javiera Castillo-Navarro , Devis Tuia , Jean-Philippe Thiran

Multi-modal entity alignment (MMEA) aims to identify equivalent entities across heterogeneous multi-modal knowledge graphs (MMKGs), where each entity is described by attributes from various modalities. Existing methods typically assume that…

Machine Learning · Computer Science 2025-10-22 Haobin Li , Yijie Lin , Peng Hu , Mouxing Yang , Xi Peng

Entity alignment (EA) aims to discover the equivalent entities in different knowledge graphs (KGs), which play an important role in knowledge engineering. Recently, EA with dangling entities has been proposed as a more realistic setting,…

Computation and Language · Computer Science 2023-04-11 Jin Xu , Yangning Li , Xiangjin Xie , Yinghui Li , Niu Hu , Haitao Zheng , Yong Jiang

Representing entities and relations in an embedding space is a well-studied approach for machine learning on relational data. Existing approaches, however, primarily focus on simple link structure between a finite set of entities, ignoring…

Artificial Intelligence · Computer Science 2018-09-11 Pouya Pezeshkpour , Liyan Chen , Sameer Singh