中文
相关论文

相关论文: MinPrompt: Graph-based Minimal Prompt Data Augment…

200 篇论文

This survey paper presents a brief overview of recent research on graph data augmentation and few-shot learning. It covers various techniques for graph data augmentation, including node and edge perturbation, graph coarsening, and graph…

机器学习 · 计算机科学 2023-11-28 Kush Kothari , Bhavya Mehta , Reshmika Nambiar , Seema Shrawne

Pre-trained language models (PLM) have achieved remarkable advancement in table-to-text generation tasks. However, the lack of labeled domain-specific knowledge and the topology gap between tabular data and text make it difficult for PLMs…

计算与语言 · 计算机科学 2023-08-21 Zhixin Guo , Minyxuan Yan , Jiexing Qi , Jianping Zhou , Ziwei He , Zhouhan Lin , Guanjie Zheng , Xinbing Wang

Few-shot abstractive summarization has become a challenging task in natural language generation. To support it, we designed a novel soft prompts architecture coupled with a prompt pre-training plus fine-tuning paradigm that is effective and…

计算与语言 · 计算机科学 2022-10-05 Xiaochen Liu , Yang Gao , Yu Bai , Jiawei Li , Yinan Hu , Heyan Huang , Boxing Chen

KBQA is a task that requires to answer questions by using semantic structured information in knowledge base. Previous work in this area has been restricted due to the lack of large semantic parsing dataset and the exponential growth of…

计算与语言 · 计算机科学 2022-01-28 Meihao Fan , Lei Zhang , Siyao Xiao , Yuru Liang

Fine-tuning of Large Language Models (LLMs) for downstream tasks, performed on domain-specific data has shown significant promise. However, commercial use of such LLMs is limited by the high computational cost required for their deployment…

计算与语言 · 计算机科学 2025-03-06 Boris Nazarov , Darya Frolova , Yackov Lubarsky , Alexei Gaissinski , Pavel Kisilev

Classifying scanned documents is a challenging problem that involves image, layout, and text analysis for document understanding. Nevertheless, for certain benchmark datasets, notably RVL-CDIP, the state of the art is closing in to…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Anna Scius-Bertrand , Michael Jungo , Lars Vögtlin , Jean-Marc Spat , Andreas Fischer

Pre-trained language models (PLM) based on transformer neural networks developed in the field of natural language processing (NLP) offer great opportunities to improve automatic content analysis in communication science, especially for the…

We consider the task of few-shot intent detection, which involves training a deep learning model to classify utterances based on their underlying intents using only a small amount of labeled data. The current approach to address this…

计算与语言 · 计算机科学 2024-09-17 Haode Zhang , Haowen Liang , Liming Zhan , Albert Y. S. Lam , Xiao-Ming Wu

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu

Question Answering over Knowledge Graph (KGQA) aims to seek answer entities for the natural language question from a large-scale Knowledge Graph~(KG). To better perform reasoning on KG, recent work typically adopts a pre-trained language…

计算与语言 · 计算机科学 2024-01-02 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Yaliang Li , Ji-Rong Wen

Recent work has shown that fine-tuning large language models (LLMs) on large-scale instruction-following datasets substantially improves their performance on a wide range of NLP tasks, especially in the zero-shot setting. However, even…

计算与语言 · 计算机科学 2023-05-19 Kai Zhang , Bernal Jiménez Gutiérrez , Yu Su

Re-rankers, which order retrieved documents with respect to the relevance score on the given query, have gained attention for the information retrieval (IR) task. Rather than fine-tuning the pre-trained language model (PLM), the large-scale…

信息检索 · 计算机科学 2023-05-24 Sukmin Cho , Soyeong Jeong , Jeongyeon Seo , Jong C. Park

Prompting methods have shown impressive performance in a variety of text mining tasks and applications, especially few-shot ones. Despite the promising prospects, the performance of prompting model largely depends on the design of prompt…

计算与语言 · 计算机科学 2023-06-16 Hongyuan Dong , Weinan Zhang , Wanxiang Che

Prompt-based methods have achieved promising results in most few-shot text classification tasks. However, for readability assessment tasks, traditional prompt methods lackcrucial linguistic knowledge, which has already been proven to be…

计算与语言 · 计算机科学 2024-04-11 Ziyang Wang , Sanwoo Lee , Hsiu-Yuan Huang , Yunfang Wu

Pre-trained language models (PLMs) have exhibited remarkable few-shot learning capabilities when provided a few examples in a natural language prompt as demonstrations of test instances, i.e., in-context learning. However, the performance…

计算与语言 · 计算机科学 2022-12-06 Feng Nie , Meixi Chen , Zhirui Zhang , Xu Cheng

Chain-of-Thought (CoT) prompting along with sub-question generation and answering has enhanced multi-step reasoning capabilities of Large Language Models (LLMs). However, prompting the LLMs to directly generate sub-questions is suboptimal…

计算与语言 · 计算机科学 2024-06-25 Jinyoung Park , Ameen Patel , Omar Zia Khan , Hyunwoo J. Kim , Joo-Kyung Kim

Dialogue understanding tasks often necessitate abundant annotated data to achieve good performance and that presents challenges in low-resource settings. To alleviate this barrier, we explore few-shot data augmentation for dialogue…

Few-shot or zero-shot fact verification only relies on a few or no labeled training examples. In this paper, we propose a novel method called ProToCo, to \underline{Pro}mpt pre-trained language models (PLMs) \underline{To} be…

计算与语言 · 计算机科学 2023-06-06 Fengzhu Zeng , Wei Gao

Question answering (QA) in English has been widely explored, but multilingual datasets are relatively new, with several methods attempting to bridge the gap between high- and low-resourced languages using data augmentation through…

计算与语言 · 计算机科学 2021-06-01 Arnab Debnath , Navid Rajabi , Fardina Fathmiul Alam , Antonios Anastasopoulos

Large Language Models (LLMs) have impressive capabilities in text understanding and zero-shot reasoning. However, delays in knowledge updates may cause them to reason incorrectly or produce harmful results. Knowledge Graphs (KGs) provide…

人工智能 · 计算机科学 2025-04-07 Tu Ao , Yanhua Yu , Yuling Wang , Yang Deng , Zirui Guo , Liang Pang , Pinghui Wang , Tat-Seng Chua , Xiao Zhang , Zhen Cai