English
Related papers

Related papers: Pre-Training and Prompting for Few-Shot Node Class…

200 papers

Recent advancements in Large Language Models (LLMs) and the proliferation of Text-Attributed Graphs (TAGs) across various domains have positioned LLM-enhanced TAG learning as a critical research area. By utilizing rich graph descriptions,…

Machine Learning · Computer Science 2026-05-12 Zihao Zhang , Xunkai Li , Rong-Hua Li , Zhenjun Li , Bing Zhou , Guoren Wang

Prompt-based methods have been successfully applied in sentence-level few-shot learning tasks, mostly owing to the sophisticated design of templates and label words. However, when applied to token-level labeling tasks such as NER, it would…

Computation and Language · Computer Science 2022-11-24 Ruotian Ma , Xin Zhou , Tao Gui , Yiding Tan , Linyang Li , Qi Zhang , Xuanjing Huang

Large Language Models (LLMs) have shown strong performance on text-attributed graphs (TAGs) due to their superior semantic understanding ability on textual node features. However, their effectiveness as predictors in the low-resource…

Machine Learning · Computer Science 2026-04-13 Ruiyao Xu , Kaize Ding

A particularly successful class of approaches for few-shot learning combines language models with prompts -- hand-crafted task descriptions that complement data samples. However, designing prompts by hand for each task commonly requires…

Computation and Language · Computer Science 2023-10-24 Rami Aly , Xingjian Shi , Kaixiang Lin , Aston Zhang , Andrew Gordon Wilson

As an algorithmic framework for learning to learn, meta-learning provides a promising solution for few-shot text classification. However, most existing research fail to give enough attention to class labels. Traditional basic framework…

Computation and Language · Computer Science 2024-12-16 Guanghua Hou , Shuhui Cao , Deqiang Ouyang , Ning Wang

Large-scale pre-trained language models (PLMs) have advanced Graph-to-Text (G2T) generation by processing the linearised version of a graph. However, the linearisation is known to ignore the structural information. Additionally, PLMs are…

Computation and Language · Computer Science 2022-10-20 Jiuzhou Han , Ehsan Shareghi

Topic models have been successfully used for analyzing text documents. However, with existing topic models, many documents are required for training. In this paper, we propose a neural network-based few-shot learning method that can learn a…

Computation and Language · Computer Science 2021-04-20 Tomoharu Iwata

We introduce Label-Combination Prototypical Networks (LC-Protonets) to address the problem of multi-label few-shot classification, where a model must generalize to new classes based on only a few available examples. Extending Prototypical…

Sound · Computer Science 2025-02-11 Charilaos Papaioannou , Emmanouil Benetos , Alexandros Potamianos

Few-shot action recognition in videos is challenging for its lack of supervision and difficulty in generalizing to unseen actions. To address this task, we propose a simple yet effective method, called knowledge prompting, which leverages…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Yuheng Shi , Xinxiao Wu , Hanxi Lin

Transformer-based pre-trained models have emerged as the predominant solution for natural language processing (NLP). Fine-tuning such pre-trained models for downstream tasks often requires a considerable amount of labeled private data. In…

Computation and Language · Computer Science 2023-08-22 Dongqi Cai , Yaozong Wu , Haitao Yuan , Shangguang Wang , Felix Xiaozhu Lin , Mengwei Xu

Text-attributed graphs (TAGs) are prevalent on the web and research over TAGs such as citation networks, e-commerce networks and social networks has attracted considerable attention in the web community. Recently, large language models…

Computation and Language · Computer Science 2024-03-12 Yijian Qin , Xin Wang , Ziwei Zhang , Wenwu Zhu

A variety of machine learning applications expect to achieve rapid learning from a limited number of labeled data. However, the success of most current models is the result of heavy training on big data. Meta-learning addresses this problem…

Machine Learning · Computer Science 2019-06-04 Lu Liu , Tianyi Zhou , Guodong Long , Jing Jiang , Lina Yao , Chengqi Zhang

Few-shot classification aims to adapt to new tasks with limited labeled examples. To fully use the accessible data, recent methods explore suitable measures for the similarity between the query and support images and better high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Kaihui Cheng , Chule Yang , Xiao Liu , Naiyang Guan , Zhiyuan Wang

Everyday tasks come with a target, and pretraining models around this target is what turns them into experts. In this paper, we study target-oriented language model (LM) pretraining by introducing Neuron-Activated Graph Ranking (NAG-based…

Computation and Language · Computer Science 2026-04-20 Zijun Wang , Haoqin Tu , Weidong Zhou , Yiyang Zhou , Xiaohuan Zhou , Bingni Zhang , Weiguo Feng , Taifeng Wang , Cihang Xie , Fengze Liu

Anomaly detection on attributed graphs plays an essential role in applications such as fraud detection, intrusion monitoring, and misinformation analysis. However, text-attributed graphs (TAGs), in which node information is expressed in…

Text classification is vital for Web for Good applications like hate speech and misinformation detection. However, traditional models (e.g., BERT) often fail in dynamic few-shot settings where labeled data are scarce, and target labels…

Computation and Language · Computer Science 2026-01-30 Yubo Wang , Haoyang Li , Fei Teng , Lei Chen

Learning from Text-Attributed Graphs (TAGs) has attracted significant attention due to its wide range of real-world applications. The rapid evolution of language models (LMs) has revolutionized the way we process textual data, which…

Machine Learning · Computer Science 2024-10-25 Rui Xue , Xipeng Shen , Ruozhou Yu , Xiaorui Liu

Recently, few-shot video classification has received an increasing interest. Current approaches mostly focus on effectively exploiting the temporal dimension in videos to improve learning under low data regimes. However, most works have…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Andrés Villa , Juan-Manuel Perez-Rua , Victor Escorcia , Vladimir Araujo , Juan Carlos Niebles , Alvaro Soto

Graphs are pervasive in the real-world, such as social network analysis, bioinformatics, and knowledge graphs. Graph neural networks (GNNs) have great ability in node classification, a fundamental task on graphs. Unfortunately, conventional…

Machine Learning · Computer Science 2024-09-05 Quan Li , Tianxiang Zhao , Lingwei Chen , Junjie Xu , Suhang Wang

We study the problem of node classification on graphs with few-shot novel labels, which has two distinctive properties: (1) There are novel labels to emerge in the graph; (2) The novel labels have only a few representative nodes for…

Machine Learning · Computer Science 2020-10-23 Lin Lan , Pinghui Wang , Xuefeng Du , Kaikai Song , Jing Tao , Xiaohong Guan