English
Related papers

Related papers: Structure Aware Negative Sampling in Knowledge Gra…

200 papers

Contrastive learning on graphs aims at extracting distinguishable high-level representations of nodes. In this paper, we theoretically illustrate that the entropy of a dataset can be approximated by maximizing the lower bound of the mutual…

Machine Learning · Computer Science 2023-07-27 Yixuan Ma , Xiaolin Zhang , Peng Zhang , Kun Zhan

Scene graphs are a powerful structured representation of the underlying content of images, and embeddings derived from them have been shown to be useful in multiple downstream tasks. In this work, we employ a graph convolutional network to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Paridhi Maheshwari , Ritwick Chaudhry , Vishwa Vinay

Negative sampling, which samples negative triplets from non-observed ones in knowledge graph (KG), is an essential step in KG embedding. Recently, generative adversarial network (GAN), has been introduced in negative sampling. By sampling…

Machine Learning · Computer Science 2021-07-15 Yongqi Zhang , Quanming Yao , Lei Chen

Knowledge Graphs (KGs) are fundamental resources in knowledge-intensive tasks in NLP. Due to the limitation of manually creating KGs, KG Completion (KGC) has an important role in automatically completing KGs by scoring their links with KG…

Computation and Language · Computer Science 2024-07-08 Xincan Feng , Hidetaka Kamigaito , Katsuhiko Hayashi , Taro Watanabe

Large-scale network embedding is to learn a latent representation for each node in an unsupervised manner, which captures inherent properties and structural information of the underlying graph. In this field, many popular approaches are…

Machine Learning · Computer Science 2020-12-11 Shengzhong Zhang , Zengfeng Huang , Haicang Zhou , Ziang Zhou

Advanced graph neural networks have shown great potentials in graph classification tasks recently. Different from node classification where node embeddings aggregated from local neighbors can be directly used to learn node labels, graph…

Machine Learning · Computer Science 2022-03-16 Hao Jia , Junzhong Ji , Minglong Lei

The pixel-wise dense prediction tasks based on weakly supervisions currently use Class Attention Maps (CAM) to generate pseudo masks as ground-truth. However, the existing methods typically depend on the painstaking training modules, which…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Yanpeng Sun , Zechao Li

Graph contrastive learning (GCL) aims to contrast positive-negative counterparts to learn the node embeddings, whereas graph data augmentation methods are employed to generate these positive-negative samples. The variation, quantity, and…

Machine Learning · Computer Science 2025-03-05 Adnan Ali , Jinlong Li , Huanhuan Chen , Ali Kashif Bashir

Sample selection improves the efficiency and effectiveness of machine learning models by providing informative and representative samples. Typically, samples can be modeled as a sample graph, where nodes are samples and edges represent…

Machine Learning · Computer Science 2025-03-04 Tianchi Xie , Jiangning Zhu , Guozu Ma , Minzhi Lin , Wei Chen , Weikai Yang , Shixia Liu

Contrastive learning has been widely studied in sentence representation learning. However, earlier works mainly focus on the construction of positive examples, while in-batch samples are often simply treated as negative examples. This…

Computation and Language · Computer Science 2023-05-18 Jinghao Deng , Fanqi Wan , Tao Yang , Xiaojun Quan , Rui Wang

The objective of unsupervised graph representation learning (GRL) is to learn a low-dimensional space of node embeddings that reflect the structure of a given unlabeled graph. Existing algorithms for this task rely on negative sampling…

Machine Learning · Computer Science 2021-01-22 M. Maruf , Anuj Karpatne

We introduce Contrastive FUSE, a fast and unified framework for scalable node representation learning in graphs with partially available pairwise node labels and no available node features. Unlike existing methods, we directly optimize a…

Machine Learning · Computer Science 2026-05-20 Sujan Chakraborty , Saptarshi Bej

Negative sampling (NS) strategies play a crucial role in knowledge graph representation. In order to overcome the limitations of existing negative sampling strategies, such as vulnerability to false negatives, limited generalization, and…

Artificial Intelligence · Computer Science 2025-11-12 Haoning Li , Qinghua Huang

Representation learning has emerged as a powerful paradigm for extracting valuable latent features from complex, high-dimensional data. In financial domains, learning informative representations for assets can be used for tasks like sector…

Machine Learning · Computer Science 2024-07-29 Rian Dolphin , Barry Smyth , Ruihai Dong

Graph representation learning has attracted lots of attention recently. Existing graph neural networks fed with the complete graph data are not scalable due to limited computation and memory costs. Thus, it remains a great challenge to…

Machine Learning · Computer Science 2020-11-24 Yizhu Jiao , Yun Xiong , Jiawei Zhang , Yao Zhang , Tianqi Zhang , Yangyong Zhu

Knowledge Graph Representation Learning (KGRL), or Knowledge Graph Embedding (KGE), is essential for AI applications such as knowledge construction and information retrieval. These models encode entities and relations into lower-dimensional…

Artificial Intelligence · Computer Science 2024-10-22 Tiroshan Madushanka , Ryutaro Ichise

Graph contrastive learning has emerged as a powerful tool for unsupervised graph representation learning. The key to the success of graph contrastive learning is to acquire high-quality positive and negative samples as contrasting pairs for…

Machine Learning · Computer Science 2023-05-19 Haoran Yang , Hongxu Chen , Sixiao Zhang , Xiangguo Sun , Qian Li , Xiangyu Zhao , Guandong Xu

The key towards learning informative node representations in graphs lies in how to gain contextual information from the neighbourhood. In this work, we present a simple-yet-effective self-supervised node representation learning strategy via…

Machine Learning · Computer Science 2022-03-24 Wei Dong , Junsheng Wu , Yi Luo , Zongyuan Ge , Peng Wang

Learning node-level representations of heterophilic graphs is crucial for various applications, including fraudster detection and protein function prediction. In such graphs, nodes share structural similarity identified by the equivalence…

Machine Learning · Computer Science 2023-08-22 Asif Khan , Amos Storkey

Contrastive learning produces coherent semantic feature embeddings by encouraging positive samples to cluster closely while separating negative samples. However, existing contrastive learning methods lack principled guarantees on coverage…

Machine Learning · Computer Science 2026-03-30 Yahya Alkhatib , Wee Peng Tay