English
Related papers

Related papers: Self-Supervised Learning of Contextual Embeddings …

200 papers

Link prediction in knowledge graphs requires integrating structural information and semantic context to infer missing entities. While large language models offer strong generative reasoning capabilities, their limited exploitation of…

Computation and Language · Computer Science 2025-09-09 Mengxue Yang , Chun Yang , Jiaqi Zhu , Jiafan Li , Jingqi Zhang , Yuyang Li , Ying Li

Graphs model complex relationships between entities, with nodes and edges capturing intricate connections. Node representation learning involves transforming nodes into low-dimensional embeddings. These embeddings are typically used as…

Machine Learning · Computer Science 2024-11-04 Ying-Chun Lin , Jennifer Neville

Most of the existing multi-relational network embedding methods, e.g., TransE, are formulated to preserve pair-wise connectivity structures in the networks. With the observations that significant triangular connectivity structures and…

Social and Information Networks · Computer Science 2018-06-11 Xin Li , Huiting Hong , Lin Liu , William K. Cheung

Most existing random walk based network embedding methods often follow only one of two principles, homophily or structural equivalence. In real world networks, however, nodes exhibit a mixture of homophily and structural equivalence, which…

Social and Information Networks · Computer Science 2020-10-27 Chen Cui , Ning Yang , Philip S. Yu

Vision-language co-embedding networks, such as CLIP, provide a latent embedding space with semantic information that is useful for downstream tasks. We hypothesize that the embedding space can be disentangled to separate the information on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Zhi Li , Hau Phan , Matthew Emigh , Austin J. Brockmeier

Representation learning on heterogeneous graphs aims to obtain meaningful node representations to facilitate various downstream tasks, such as node classification and link prediction. Existing heterogeneous graph learning methods are…

Machine Learning · Computer Science 2022-04-19 Le Yu , Leilei Sun , Bowen Du , Chuanren Liu , Weifeng Lv , Hui Xiong

Network representation learning (NRL) methods have received significant attention over the last years thanks to their success in several graph analysis problems, including node classification, link prediction, and clustering. Such methods…

Machine Learning · Computer Science 2021-11-11 Abdulkadir Çelikkanat , Fragkiskos D. Malliaros

Heterogeneous Information Network (HIN) embedding refers to the low-dimensional projections of the HIN nodes that preserve the HIN structure and semantics. HIN embedding has emerged as a promising research field for network analysis as it…

Machine Learning · Computer Science 2021-08-10 Rayyan Ahmad Khan , Martin Kleinsteuber

Scene graph generation aims to produce structured representations for images, which requires to understand the relations between objects. Due to the continuous nature of deep neural networks, the prediction of scene graphs is divided into…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Meng Wei , Chun Yuan , Xiaoyu Yue , Kuo Zhong

Attributed network embedding aims to learn low-dimensional vector representations for nodes in a network, where each node contains rich attributes/features describing node content. Because network topology structure and node attributes…

Social and Information Networks · Computer Science 2018-10-17 Daokun Zhang , Jie Yin , Xingquan Zhu , Chengqi Zhang

Evolving networks are complex data structures that emerge in a wide range of systems in science and engineering. Learning expressive representations for such networks that encode their structural connectivity and temporal evolution is…

Machine Learning · Computer Science 2024-08-26 Amirhossein Nouranizadeh , Fatemeh Tabatabaei Far , Mohammad Rahmati

The topological information is essential for studying the relationship between nodes in a network. Recently, Network Representation Learning (NRL), which projects a network into a low-dimensional vector space, has been shown their…

Social and Information Networks · Computer Science 2019-02-19 Guoji Fu , Chengbin Hou , Xin Yao

graph neural networks (GNNs) are the dominant paradigm for modeling and handling graph structure data by learning universal node representation. The traditional way of training GNNs depends on a great many labeled data, which results in…

Machine Learning · Computer Science 2022-09-12 Shuai Ma , Jian-wei Liu , Xin Zuo

Networks are ubiquitous structure that describes complex relationships between different entities in the real world. As a critical component of prediction task over nodes in networks, learning the feature representation of nodes has become…

Machine Learning · Computer Science 2018-09-10 Hansheng Xue , Jiajie Peng , Xuequn Shang

Cross-modal retrieval methods have been significantly improved in last years with the use of deep neural networks and large-scale annotated datasets such as ImageNet and Places. However, collecting and annotating such datasets requires a…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Yash Patel , Lluis Gomez , Marçal Rusiñol , Dimosthenis Karatzas , C. V. Jawahar

Existing network embedding approaches tackle the problem of learning low-dimensional node representations. However, networks can also be seen in the light of edges interlinking pairs of nodes. The broad goal of this paper is to introduce…

Social and Information Networks · Computer Science 2020-11-12 Giuseppe Pirrò

Contextualised word embeddings generated from Neural Language Models (NLMs), such as BERT, represent a word with a vector that considers the semantics of the target word as well its context. On the other hand, static word embeddings such as…

Computation and Language · Computer Science 2021-10-07 Yi Zhou , Danushka Bollegala

Network embedding is a method to learn low-dimensional representation vectors for nodes in complex networks. In real networks, nodes may have multiple tags but existing methods ignore the abundant semantic and hierarchical information of…

Social and Information Networks · Computer Science 2020-09-25 Junshan Wang , Zhicong Lu , Guojie Song , Yue Fan , Lun Du , Wei Lin

Large-scale network embedding is to learn a latent representation for each node in an unsupervised manner, which captures inherent properties and structural information of the underlying graph. In this field, many popular approaches are…

Machine Learning · Computer Science 2020-12-11 Shengzhong Zhang , Zengfeng Huang , Haicang Zhou , Ziang Zhou

In network representation learning we learn how to represent heterogeneous information networks in a low-dimensional space so as to facilitate effective search, classification, and prediction solutions. Previous network representation…

Artificial Intelligence · Computer Science 2021-05-19 Yang Fang , Xiang Zhao , Yifan Chen , Weidong Xiao , Maarten de Rijke