English
Related papers

Related papers: Pre-Training and Prompting for Few-Shot Node Class…

200 papers

The "Graph pre-training and fine-tuning" paradigm has significantly improved Graph Neural Networks(GNNs) by capturing general knowledge without manual annotations for downstream tasks. However, due to the immense gap of data and tasks…

Machine Learning · Computer Science 2024-02-22 Yuchen Yan , Peiyan Zhang , Zheng Fang , Qingqing Long

Pre-training on graph neural networks (GNNs) aims to learn transferable knowledge for downstream tasks with unlabeled data, and it has recently become an active research area. The success of graph pre-training models is often attributed to…

Machine Learning · Computer Science 2023-11-22 Jiarong Xu , Renhong Huang , Xin Jiang , Yuxuan Cao , Carl Yang , Chunping Wang , Yang Yang

Many applications of machine learning require a model to make accurate pre-dictions on test examples that are distributionally different from training ones, while task-specific labels are scarce during training. An effective approach to…

Machine Learning · Computer Science 2020-02-20 Weihua Hu , Bowen Liu , Joseph Gomes , Marinka Zitnik , Percy Liang , Vijay Pande , Jure Leskovec

Transferring knowledge from one domain to another is of practical importance for many tasks in natural language processing, especially when the amount of available data in the target domain is limited. In this work, we propose a novel…

Computation and Language · Computer Science 2022-06-17 Ali Davody , David Ifeoluwa Adelani , Thomas Kleinbauer , Dietrich Klakow

In real-world scenarios, texts in a graph are often linked by multiple semantic relations (e.g., papers in an academic graph are referenced by other publications, written by the same author, or published in the same venue), where text…

Computation and Language · Computer Science 2024-07-16 Bowen Jin , Wentao Zhang , Yu Zhang , Yu Meng , Han Zhao , Jiawei Han

Few-shot node classification aims at classifying nodes with limited labeled nodes as references. Recent few-shot node classification methods typically learn from classes with abundant labeled nodes (i.e., meta-training classes) and then…

Machine Learning · Computer Science 2023-01-10 Song Wang , Yushun Dong , Kaize Ding , Chen Chen , Jundong Li

The emergence of graph foundation models (GFMs), particularly those incorporating language models (LMs), has revolutionized graph learning and demonstrated remarkable performance on text-attributed graphs (TAGs). However, compared to…

Cryptography and Security · Computer Science 2025-10-17 Xiaoyu Xue , Yuni Lai , Chenxi Huang , Yulin Zhu , Gaolei Li , Xiaoge Zhang , Kai Zhou

Few-shot slot tagging becomes appealing for rapid domain transfer and adaptation, motivated by the tremendous development of conversational dialogue systems. In this paper, we propose a vector projection network for few-shot slot tagging,…

Computation and Language · Computer Science 2020-09-23 Su Zhu , Ruisheng Cao , Lu Chen , Kai Yu

Pretrained language models have improved zero-shot text classification by allowing the transfer of semantic knowledge from the training data in order to classify among specific label sets in downstream tasks. We propose a simple way to…

Computation and Language · Computer Science 2023-10-24 Lingyu Gao , Debanjan Ghosh , Kevin Gimpel

Graph Neural Networks (GNNs) have made significant advancements in node classification, but their success relies on sufficient labeled nodes per class in the training data. Real-world graph data often exhibits a long-tail distribution with…

Machine Learning · Computer Science 2025-07-01 Qilong Yan , Yufeng Zhang , Jinghao Zhang , Jingpu Duan , Jian Yin

Graph Neural Networks have demonstrated great success in various fields of multimedia. However, the distribution shift between the training and test data challenges the effectiveness of GNNs. To mitigate this challenge, Test-Time Training…

Machine Learning · Computer Science 2024-04-23 Jiaxin Zhang , Yiqi Wang , Xihong Yang , Siwei Wang , Yu Feng , Yu Shi , Ruicaho Ren , En Zhu , Xinwang Liu

With the continuous development of natural language processing (NLP) technology, text classification tasks have been widely used in multiple application fields. However, obtaining labeled data is often expensive and difficult, especially in…

Computation and Language · Computer Science 2025-02-14 Jia Gao , Shuangquan Lyu , Guiran Liu , Binrong Zhu , Hongye Zheng , Xiaoxuan Liao

We introduce the Rule-to-Tag (R2T) framework, a hybrid approach that integrates a multi-tiered system of linguistic rules directly into a neural network's training objective. R2T's novelty lies in its adaptive loss function, which includes…

Computation and Language · Computer Science 2025-10-17 Mamadou K. Keita , Christopher Homan , Sebastien Diarra

The effectiveness of prompt learning has been demonstrated in different pre-trained language models. By formulating suitable template and choosing representative label mapping, prompt learning can be used as an efficient knowledge probe.…

Computation and Language · Computer Science 2022-11-01 Jinta Weng , Yue Hu , Jing Qiu , Heyan Huan

Detecting social bias in text is challenging due to nuance, subjectivity, and difficulty in obtaining good quality labeled datasets at scale, especially given the evolving nature of social biases and society. To address these challenges, we…

Computation and Language · Computer Science 2022-04-19 Shrimai Prabhumoye , Rafal Kocielnik , Mohammad Shoeybi , Anima Anandkumar , Bryan Catanzaro

Text-attributed graphs (TAGs) present unique challenges in representation learning by requiring models to capture both the semantic richness of node-associated texts and the structural dependencies of the graph. While graph neural networks…

Computation and Language · Computer Science 2026-05-26 Azadeh Beiranvand , Seyed Mehdi Vahidipour

Few-shot slot tagging is an emerging research topic in the field of Natural Language Understanding (NLU). With sufficient annotated data from source domains, the key challenge is how to train and adapt the model to another target domain…

Computation and Language · Computer Science 2021-09-14 Zezhong Wang , Hongru Wang , Kwan Wai Chung , Jia Zhu , Gabriel Pui Cheong Fung , Kam-Fai Wong

Temporal Interaction Graphs (TIGs) are widely utilized to represent real-world systems. To facilitate representation learning on TIGs, researchers have proposed a series of TIG models. However, these models are still facing two tough gaps…

Artificial Intelligence · Computer Science 2024-03-07 Xi Chen , Siwei Zhang , Yun Xiong , Xixi Wu , Jiawei Zhang , Xiangguo Sun , Yao Zhang , Feng Zhao , Yulin Kang

Graph neural networks (GNNs) have been demonstrated to be powerful in modeling graph-structured data. However, training GNNs usually requires abundant task-specific labeled data, which is often arduously expensive to obtain. One effective…

Machine Learning · Computer Science 2020-06-30 Ziniu Hu , Yuxiao Dong , Kuansan Wang , Kai-Wei Chang , Yizhou Sun

Few-shot classification is a challenging task which aims to formulate the ability of humans to learn concepts from limited prior data and has drawn considerable attention in machine learning. Recent progress in few-shot classification has…

Machine Learning · Computer Science 2020-04-14 Meiyu Huang , Xueshuang Xiang , Yao Xu