English
Related papers

Related papers: Swift and Sure: Hardness-aware Contrastive Learnin…

200 papers

Knowledge graph (KG) embeddings have shown great power in learning representations of entities and relations for link prediction tasks. Previous work usually embeds KGs into a single geometric space such as Euclidean space (zero curved),…

Machine Learning · Computer Science 2022-06-28 Zongsheng Cao , Qianqian Xu , Zhiyong Yang , Xiaochun Cao , Qingming Huang

Universal multimodal embedding models play a critical role in tasks such as interleaved image-text retrieval, multimodal RAG, and multimodal clustering. However, our empirical results indicate that existing LMM-based embedding models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhibin Lan , Liqiang Niu , Fandong Meng , Jie Zhou , Jinsong Su

Decentralized training enables learning with distributed datasets generated at different locations without relying on a central server. In realistic scenarios, the data distribution across these sparsely connected learning agents can be…

Machine Learning · Computer Science 2025-02-27 Sakshi Choudhary , Sai Aparna Aketi , Kaushik Roy

Knowledge graph (KG) embedding aims at embedding entities and relations in a KG into a lowdimensional latent representation space. Existing KG embedding approaches model entities andrelations in a KG by utilizing real-valued ,…

Machine Learning · Computer Science 2021-03-24 Chengjin Xu , Mojtaba Nayyeri , Yung-Yu Chen , Jens Lehmann

Graph Neural Networks (GNNs) often suffer from degree bias in node classification tasks, where prediction performance varies across nodes with different degrees. Several approaches, which adopt Graph Contrastive Learning (GCL), have been…

Machine Learning · Computer Science 2025-06-06 Jingyu Hu , Hongbo Bo , Jun Hong , Xiaowei Liu , Weiru Liu

Many mathematical models have been leveraged to design embeddings for representing Knowledge Graph (KG) entities and relations for link prediction and many downstream tasks. These mathematically-inspired models are not only highly scalable…

Artificial Intelligence · Computer Science 2023-09-25 Xiou Ge , Yun-Cheng Wang , Bin Wang , C. -C. Jay Kuo

Learning generalizable self-supervised graph representations for downstream tasks is challenging. To this end, Contrastive Learning (CL) has emerged as a leading approach. The embeddings of CL are arranged on a hypersphere where similarity…

Machine Learning · Computer Science 2025-02-25 Yifei Zhang , Hao Zhu , Menglin Yang , Jiahong Liu , Rex Ying , Irwin King , Piotr Koniusz

Learning low-dimensional representations for entities and relations in knowledge graphs using contrastive estimation represents a scalable and effective method for inferring connectivity patterns. A crucial aspect of contrastive learning…

Machine Learning · Computer Science 2020-10-08 Kian Ahrabian , Aarash Feizi , Yasmin Salehi , William L. Hamilton , Avishek Joey Bose

Albeit having gained significant progress lately, large-scale graph representation learning remains expensive to train and deploy for two main reasons: (i) the repetitive computation of multi-hop message passing and non-linearity in graph…

Machine Learning · Computer Science 2023-03-10 Zhenshuo Zhang , Yun Zhu , Haizhou Shi , Siliang Tang

Incorporating Knowledge Graphs (KG) into recommeder system has attracted considerable attention. Recently, the technical trend of Knowledge-aware Recommendation (KGR) is to develop end-to-end models based on graph neural networks (GNNs).…

Information Retrieval · Computer Science 2022-08-23 Ding Zou , Wei Wei , Ziyang Wang , Xian-Ling Mao , Feida Zhu , Rui Fang , Dangyang Chen

Knowledge embeddings (KE) represent a knowledge graph (KG) by embedding entities and relations into continuous vector spaces. Existing methods are mainly structure-based or description-based. Structure-based methods learn representations…

Computation and Language · Computer Science 2023-06-30 Xintao Wang , Qianyu He , Jiaqing Liang , Yanghua Xiao

Knowledge graph embedding (KGE) models are extensively studied for knowledge graph completion, yet their evaluation remains constrained by unrealistic benchmarks. Standard evaluation metrics rely on the closed-world assumption, which…

Machine Learning · Computer Science 2025-06-11 Nasim Shirvani-Mahdavi , Farahnaz Akrami , Chengkai Li

Dynamic graphs with ordered sequences of events between nodes are prevalent in real-world industrial applications such as e-commerce and social platforms. However, representation learning for dynamic graphs has posed great computational…

Machine Learning · Computer Science 2021-12-16 Xinshi Chen , Yan Zhu , Haowen Xu , Mengyang Liu , Liang Xiong , Muhan Zhang , Le Song

Knowledge graphs (KGs) consisting of triples are always incomplete, so it's important to do Knowledge Graph Completion (KGC) by predicting missing triples. Multi-Source KG is a common situation in real KG applications which can be viewed as…

Computation and Language · Computer Science 2020-10-27 Mingyang Chen , Wen Zhang , Zonggang Yuan , Yantao Jia , Huajun Chen

Representation Learning of words and Knowledge Graphs (KG) into low dimensional vector spaces along with its applications to many real-world scenarios have recently gained momentum. In order to make use of multiple KG embeddings for…

Computation and Language · Computer Science 2020-04-16 Russa Biswas , Mehwish Alam , Harald Sack

Previous knowledge graph embedding approaches usually map entities to representations and utilize score functions to predict the target entities, yet they typically struggle to reason rare or emerging unseen entities. In this paper, we…

Computation and Language · Computer Science 2023-08-01 Peng Wang , Xin Xie , Xiaohan Wang , Ningyu Zhang

Learning good feature embeddings for images often requires substantial training data. As a consequence, in settings where training data is limited (e.g., few-shot and zero-shot learning), we are typically forced to use a generic feature…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Xin Wang , Fisher Yu , Ruth Wang , Trevor Darrell , Joseph E. Gonzalez

Translation-based knowledge graph embedding has been one of the most important branches for knowledge representation learning since TransE came out. Although many translation-based approaches have achieved some progress in recent years, the…

Artificial Intelligence · Computer Science 2022-09-20 Long Yu , Zhicong Luo , Huanyong Liu , Deng Lin , Hongzhu Li , Yafeng Deng

Knowledge graph embedding (KGE) relies on the geometry of the embedding space to encode semantic and structural relations. Existing methods place all entities on one homogeneous manifold, Euclidean, spherical, hyperbolic, or their…

Machine Learning · Computer Science 2025-12-11 Zhengquan Luo , Guy Tadmor , Or Amar , David Zeevi , Zhiqiang Xu

Label distribution learning (LDL) is a new machine learning paradigm for solving label ambiguity. Since it is difficult to directly obtain label distributions, many studies are focusing on how to recover label distributions from logical…

Machine Learning · Computer Science 2023-05-17 Yifei Wang , Yiyang Zhou , Jihua Zhu , Xinyuan Liu , Wenbiao Yan , Zhiqiang Tian