English
Related papers

Related papers: High-Frequency-aware Hierarchical Contrastive Sele…

200 papers

Graph structured data, specifically text-attributed graphs (TAG), effectively represent relationships among varied entities. Such graphs are essential for semi-supervised node classification tasks. Graph Neural Networks (GNNs) have emerged…

Machine Learning · Computer Science 2024-04-18 Kaiwen Dong , Zhichun Guo , Nitesh V. Chawla

Representation learning on text-attributed graphs (TAGs) has attracted significant interest due to its wide-ranging real-world applications, particularly through Graph Neural Networks (GNNs). Traditional GNN methods focus on encoding the…

Machine Learning · Computer Science 2024-10-07 Xingyu Ji , Jiale Liu , Lu Li , Maojun Wang , Zeyu Zhang

Leveraging domain knowledge including fingerprints and functional groups in molecular representation learning is crucial for chemical property prediction and drug discovery. When modeling the relation between graph structure and molecular…

Machine Learning · Computer Science 2021-03-25 Yin Fang , Haihong Yang , Xiang Zhuang , Xin Shao , Xiaohui Fan , Huajun Chen

With the increasing prevalence of cross-domain Text-Attributed Graph (TAG) Data (e.g., citation networks, recommendation systems, social networks, and ai4science), the integration of Graph Neural Networks (GNNs) and Large Language Models…

Machine Learning · Computer Science 2024-12-18 Xunkai Li , Zhengyu Wu , Jiayi Wu , Hanwen Cui , Jishuo Jia , Rong-Hua Li , Guoren Wang

In this paper, we provide a theory of using graph neural networks (GNNs) for multi-node representation learning (where we are interested in learning a representation for a set of more than one node, such as link). We know that GNN is…

Machine Learning · Computer Science 2022-01-19 Muhan Zhang , Pan Li , Yinglong Xia , Kai Wang , Long Jin

Graph neural networks (GNNs) are deep learning models designed specifically for graph data, and they typically rely on node features as the input to the first layer. When applying such a type of network on the graph without node features,…

Graph neural networks for heterogeneous graph embedding is to project nodes into a low-dimensional space by exploring the heterogeneity and semantics of the heterogeneous graph. However, on the one hand, most of existing heterogeneous graph…

Machine Learning · Computer Science 2022-12-01 Zezhi Shao , Yongjun Xu , Wei Wei , Fei Wang , Zhao Zhang , Feida Zhu

Graph contrastive learning (GCL) has recently emerged as a new concept which allows for capitalizing on the strengths of graph neural networks (GNNs) to learn rich representations in a wide variety of applications which involve abundant…

Machine Learning · Computer Science 2024-06-26 Yuzhou Chen , Jose Frias , Yulia R. Gel

Hierarchical multi-label text classification (HMTC) aims at utilizing a label hierarchy in multi-label classification. Recent approaches to HMTC deal with the problem of imposing an over-constrained premise on the output space by using…

Computation and Language · Computer Science 2024-06-21 Simon Yu , Jie He , Víctor Gutiérrez-Basulto , Jeff Z. Pan

Graph Neural Networks (GNNs) have become powerful tools in modeling graph-structured data in recommender systems. However, real-life recommendation scenarios usually involve heterogeneous relationships (e.g., social-aware user influence,…

Information Retrieval · Computer Science 2023-03-03 Mengru Chen , Chao Huang , Lianghao Xia , Wei Wei , Yong Xu , Ronghua Luo

Evolving networks are complex data structures that emerge in a wide range of systems in science and engineering. Learning expressive representations for such networks that encode their structural connectivity and temporal evolution is…

Machine Learning · Computer Science 2024-08-26 Amirhossein Nouranizadeh , Fatemeh Tabatabaei Far , Mohammad Rahmati

Unsupervised graph representation learning is a non-trivial topic. The success of contrastive methods in the unsupervised representation learning on structured data inspires similar attempts on the graph. Existing graph contrastive learning…

Machine Learning · Computer Science 2024-04-02 Tianyu Zhang , Yuxiang Ren , Wenzheng Feng , Weitao Du , Xuecang Zhang

Recent years, graph contrastive learning (GCL), which aims to learn representations from unlabeled graphs, has made great progress. However, the existing GCL methods mostly adopt human-designed graph augmentations, which are sensitive to…

Social and Information Networks · Computer Science 2023-06-30 Xiao Shen , Dewang Sun , Shirui Pan , Xi Zhou , Laurence T. Yang

Graph unlearning aims to remove a subset of graph entities (i.e. nodes and edges) from a graph neural network (GNN) trained on the graph. Unlike machine unlearning for models trained on Euclidean-structured data, effectively unlearning a…

Machine Learning · Computer Science 2025-03-06 Hong kyu Lee , Qiuchen Zhang , Carl Yang , Li Xiong

To extract robust deep representations from long sequential modeling of speech data, we propose a self-supervised learning approach, namely Contrastive Separative Coding (CSC). Our key finding is to learn such representations by separating…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-02 Jun Wang , Max W. Y. Lam , Dan Su , Dong Yu

We study self-supervised learning on graphs using contrastive methods. A general scheme of prior methods is to optimize two-view representations of input graphs. In many studies, a single graph-level representation is computed as one of the…

Machine Learning · Computer Science 2021-07-22 Xinyi Xu , Cheng Deng , Yaochen Xie , Shuiwang Ji

Conventional unsupervised hashing methods usually take advantage of similarity graphs, which are either pre-computed in the high-dimensional space or obtained from random anchor points. On the one hand, existing methods uncouple the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Yuming Shen , Jie Qin , Jiaxin Chen , Mengyang Yu , Li Liu , Fan Zhu , Fumin Shen , Ling Shao

Self-supervised learning on graphs can be bifurcated into contrastive and generative methods. Contrastive methods, also known as graph contrastive learning (GCL), have dominated graph self-supervised learning in the past few years, but the…

Machine Learning · Computer Science 2024-02-13 Liang Wang , Xiang Tao , Qiang Liu , Shu Wu , Liang Wang

The goal of representation learning of knowledge graph is to encode both entities and relations into a low-dimensional embedding spaces. Many recent works have demonstrated the benefits of knowledge graph embedding on knowledge graph…

Artificial Intelligence · Computer Science 2019-10-11 Wenqiang Liu , Hongyun Cai , Xu Cheng , Sifa Xie , Yipeng Yu , Hanyu Zhang

Temporal Graph Learning, which aims to model the time-evolving nature of graphs, has gained increasing attention and achieved remarkable performance recently. However, in reality, graph structures are often incomplete and noisy, which…

Machine Learning · Computer Science 2023-08-16 Haozhen Zhang , Xueting Han , Xi Xiao , Jing Bai