English
Related papers

Related papers: Uncovering Capabilities of Model Pruning in Graph …

200 papers

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

Machine Learning · Statistics 2016-11-23 Elad Hoffer , Itay Hubara , Nir Ailon

This paper focuses on learning representation on the whole graph level in an unsupervised manner. Learning graph-level representation plays an important role in a variety of real-world issues such as molecule property prediction, protein…

Machine Learning · Computer Science 2024-01-08 Ge Wang , Zelin Zang , Jiangbin Zheng , Jun Xia , Stan Z. Li

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

Machine Learning · Computer Science 2022-03-01 Nikunj Saunshi , Jordan Ash , Surbhi Goel , Dipendra Misra , Cyril Zhang , Sanjeev Arora , Sham Kakade , Akshay Krishnamurthy

Dependency trees help relation extraction models capture long-range relations between words. However, existing dependency-based models either neglect crucial information (e.g., negation) by pruning the dependency trees too aggressively, or…

Computation and Language · Computer Science 2018-09-28 Yuhao Zhang , Peng Qi , Christopher D. Manning

The popularity of self-supervised learning has made it possible to train models without relying on labeled data, which saves expensive annotation costs. However, most existing self-supervised contrastive learning methods often overlook the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Weiquan Li , Xianzhong Long , Yun Li

Recent studies show that graph convolutional network (GCN) often performs worse for low-degree nodes, exhibiting the so-called structural unfairness for graphs with long-tailed degree distributions prevalent in the real world. Graph…

Machine Learning · Computer Science 2022-10-07 Ruijia Wang , Xiao Wang , Chuan Shi , Le Song

Graph pattern mining methods can extract informative and useful patterns from large-scale graphs and capture underlying principles through the overwhelmed information. Contrast analysis serves as a keystone in various fields and has…

Social and Information Networks · Computer Science 2018-02-20 Jingbo Shang , Xiyao Shi , Meng Jiang , Liyuan Liu , Timothy Hanratty , Jiawei Han

As the basic element of graph-structured data, node has been recognized as the main object of study in graph representation learning. A single node intuitively has multiple node-centered subgraphs from the whole graph (e.g., one person in a…

Artificial Intelligence · Computer Science 2023-09-01 Dong Li , Wenjun Wang , Minglai Shao , Chen Zhao

Graph neural networks (GNNs) have achieved remarkable success in various domains, yet they often struggle with domain adaptation due to significant structural distribution shifts and insufficient exploration of transferable patterns. One of…

Machine Learning · Computer Science 2025-10-16 Haoyu Zhang , Yuxuan Cheng , Wenqi Fan , Yulong Chen , Yifan Zhang

Learning representations of images that are invariant to sensitive or unwanted attributes is important for many tasks including bias removal and cross domain retrieval. Here, our objective is to learn representations that are invariant to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Jonathan Kahana , Yedid Hoshen

Most existing graph-based semi-supervised hyperspectral image classification methods rely on superpixel partitioning techniques. However, they suffer from misclassification of certain pixels due to inaccuracies in superpixel boundaries,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yuqing Zhang , Qi Han , Ligeng Wang , Kai Cheng , Bo Wang , Kun Zhan

What matters for contrastive learning? We argue that contrastive learning heavily relies on informative features, or "hard" (positive or negative) features. Early works include more informative features by applying complex data…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Jiangmeng Li , Wenwen Qiang , Changwen Zheng , Bing Su , Hui Xiong

Graph contrastive learning (GCL) has emerged as a representative graph self-supervised method, achieving significant success. The currently prevalent optimization objective for GCL is InfoNCE. Typically, it employs augmentation techniques…

Machine Learning · Computer Science 2024-03-22 Yulan Hu , Sheng Ouyang , Jingyu Liu , Ge Chen , Zhirui Yang , Junchen Wan , Fuzheng Zhang , Zhongyuan Wang , Yong Liu

We consider unsupervised domain adaptation (UDA), where labeled data from a source domain (e.g., photographs) and unlabeled data from a target domain (e.g., sketches) are used to learn a classifier for the target domain. Conventional UDA…

Machine Learning · Computer Science 2022-12-05 Kendrick Shen , Robbie Jones , Ananya Kumar , Sang Michael Xie , Jeff Z. HaoChen , Tengyu Ma , Percy Liang

Graph contrastive learning (GCL) has been widely used as an effective self-supervised learning method for graph representation learning. However, how to apply adequate and stable graph augmentation to generating proper views for contrastive…

Machine Learning · Computer Science 2025-01-09 Yanchen Xu , Siqi Huang , Hongyuan Zhang , Xuelong Li

Recent works explore learning graph representations in a self-supervised manner. In graph contrastive learning, benchmark methods apply various graph augmentation approaches. However, most of the augmentation methods are non-learnable,…

Machine Learning · Computer Science 2022-05-30 Hang Gao , Jiangmeng Li , Wenwen Qiang , Lingyu Si , Fuchun Sun , Changwen Zheng

Graph Convolutional Network (GCN) has exhibited remarkable potential in improving graph-based clustering. To handle the general clustering scenario without a prior graph, these models estimate an initial graph beforehand to apply GCN.…

Machine Learning · Computer Science 2024-04-04 Mulin Chen , Bocheng Wang , Xuelong Li

Graphs are present in many real-world applications, such as financial fraud detection, commercial recommendation, and social network analysis. But given the high cost of graph annotation or labeling, we face a severe graph label-scarcity…

Machine Learning · Computer Science 2022-08-08 Zhen Tan , Kaize Ding , Ruocheng Guo , Huan Liu

Learning on text-attributed graphs (TAGs), in which nodes are associated with one or more texts, has been the subject of much recent work. However, most approaches tend to make strong assumptions about the downstream task of interest, are…

Computation and Language · Computer Science 2024-07-11 William Brannon , Wonjune Kang , Suyash Fulay , Hang Jiang , Brandon Roy , Deb Roy , Jad Kabbara

Graph representation learning is fundamental for analyzing graph-structured data. Exploring invariant graph representations remains a challenge for most existing graph representation learning methods. In this paper, we propose a cross-view…

Machine Learning · Computer Science 2025-04-15 Jie Chen , Hua Mao , Wai Lok Woo , Chuanbin Liu , Xi Peng