中文
相关论文

相关论文: MixPro: Simple yet Effective Data Augmentation for…

200 篇论文

In this paper, we propose MixSpeech, a simple yet effective data augmentation method based on mixup for automatic speech recognition (ASR). MixSpeech trains an ASR model by taking a weighted combination of two different speech features…

计算与语言 · 计算机科学 2021-02-26 Linghui Meng , Jin Xu , Xu Tan , Jindong Wang , Tao Qin , Bo Xu

As an effective approach to tune pre-trained language models (PLMs) for specific tasks, prompt-learning has recently attracted much attention from researchers. By using \textit{cloze}-style language prompts to stimulate the versatile…

计算与语言 · 计算机科学 2021-08-25 Ning Ding , Yulin Chen , Xu Han , Guangwei Xu , Pengjun Xie , Hai-Tao Zheng , Zhiyuan Liu , Juanzi Li , Hong-Gee Kim

Soft prompt tuning techniques have recently gained traction as an effective strategy for the parameter-efficient tuning of pretrained language models, particularly minimizing the required adjustment of model parameters. Despite their…

计算与语言 · 计算机科学 2024-06-11 MohammadAli SadraeiJavaeri , Ehsaneddin Asgari , Alice Carolyn McHardy , Hamid Reza Rabiee

Neural-based models have achieved outstanding performance on slot filling and intent classification, when fairly large in-domain training data are available. However, as new domains are frequently added, creating sizeable data is expensive.…

计算与语言 · 计算机科学 2020-09-09 Samuel Louvan , Bernardo Magnini

Prompt-based methods have achieved promising results in most few-shot text classification tasks. However, for readability assessment tasks, traditional prompt methods lackcrucial linguistic knowledge, which has already been proven to be…

计算与语言 · 计算机科学 2024-04-11 Ziyang Wang , Sanwoo Lee , Hsiu-Yuan Huang , Yunfang Wu

Text-guided image editing finds applications in various creative and practical fields. While recent studies in image generation have advanced the field, they often struggle with the dual challenges of coherent image transformation and…

计算机视觉与模式识别 · 计算机科学 2024-12-18 Rumeysa Bodur , Binod Bhattarai , Tae-Kyun Kim

Sequential recommendation aims to provide users with personalized suggestions based on their historical interactions. When training sequential models, padding is a widely adopted technique for two main reasons: 1) The vast majority of…

信息检索 · 计算机科学 2025-07-16 Yizhou Dang , Yuting Liu , Enneng Yang , Guibing Guo , Linying Jiang , Jianzhe Zhao , Xingwei Wang

This paper proposes a simple yet effective interpolation-based data augmentation approach termed DoubleMix, to improve the robustness of models in text classification. DoubleMix first leverages a couple of simple augmentation operations to…

计算与语言 · 计算机科学 2022-09-13 Hui Chen , Wei Han , Diyi Yang , Soujanya Poria

This paper focuses on the Data Augmentation for low-resource Natural Language Understanding (NLU) tasks. We propose Prompt-based D}ata Augmentation model (PromDA) which only trains small-scale Soft Prompt (i.e., a set of trainable vectors)…

计算与语言 · 计算机科学 2022-03-18 Yufei Wang , Can Xu , Qingfeng Sun , Huang Hu , Chongyang Tao , Xiubo Geng , Daxin Jiang

Finetuning on domain-specific data is a well-established method for enhancing LLM performance on downstream tasks. Training on each dataset produces a new set of model weights, resulting in a multitude of checkpoints saved in-house or on…

机器学习 · 计算机科学 2026-03-12 Sofia Maria Lo Cicero Vaina , Artem Chumachenko , Max Ryabinin

While the numerous parameters in Large Language Models (LLMs) contribute to their superior performance, this massive scale makes them inefficient and memory-hungry. Thus, they are hard to deploy on commodity hardware, such as one single…

计算与语言 · 计算机科学 2023-10-11 Zhaozhuo Xu , Zirui Liu , Beidi Chen , Yuxin Tang , Jue Wang , Kaixiong Zhou , Xia Hu , Anshumali Shrivastava

Prompt tuning is a new few-shot transfer learning technique that only tunes the learnable prompt for pre-trained vision and language models such as CLIP. However, existing prompt tuning methods tend to learn spurious or entangled…

计算机视觉与模式识别 · 计算机科学 2022-11-16 Xuehai He , Diji Yang , Weixi Feng , Tsu-Jui Fu , Arjun Akula , Varun Jampani , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Vision-language foundation models (VLMs) show promise for diverse imaging tasks but often underperform on medical benchmarks. Prior efforts to improve performance include model finetuning, which requires large domain-specific datasets and…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Arnav Singhvi , Vasiliki Bikia , Asad Aali , Akshay Chaudhari , Roxana Daneshjou

Data augmentation techniques are widely used for enhancing the performance of machine learning models by tackling class imbalance issues and data sparsity. State-of-the-art generative language models have been shown to provide significant…

计算与语言 · 计算机科学 2023-01-10 Aleksandra Edwards , Asahi Ushio , Jose Camacho-Collados , Hélène de Ribaupierre , Alun Preece

Current literature demonstrates that Large Language Models (LLMs) are great few-shot learners, and prompting significantly increases their performance on a range of downstream tasks in a few-shot learning setting. An attempt to automate…

计算与语言 · 计算机科学 2023-06-26 Yulin Zhou , Yiren Zhao , Ilia Shumailov , Robert Mullins , Yarin Gal

Deep learning-based pronunciation scoring models highly rely on the availability of the annotated non-native data, which is costly and has scalability issues. To deal with the data scarcity problem, data augmentation is commonly used for…

音频与语音处理 · 电气工程与系统科学 2022-03-04 Kaiqi Fu , Shaojun Gao , Kai Wang , Wei Li , Xiaohai Tian , Zejun Ma

Test-time prompt tuning enhances zero-shot generalization of vision-language models but tends to ignore the relatedness among test samples during inference. Online test-time prompt tuning provides a simple way to leverage the information in…

机器学习 · 计算机科学 2025-01-29 Zehao Xiao , Shilin Yan , Jack Hong , Jiayin Cai , Xiaolong Jiang , Yao Hu , Jiayi Shen , Qi Wang , Cees G. M. Snoek

Although language models (LMs) have boosted the performance of Question Answering, they still need plenty of data. Data annotation, in contrast, is a time-consuming process. This especially applies to Question Answering, where possibly…

计算与语言 · 计算机科学 2024-05-16 Maximilian Schmidt , Andrea Bartezzaghi , Ngoc Thang Vu

Machine learning techniques are used in a wide range of domains. However, machine learning models often suffer from the problem of over-fitting. Many data augmentation methods have been proposed to tackle such a problem, and one of them is…

机器学习 · 统计学 2021-06-21 Masanari Kimura

Fine-tuning pre-trained models is a popular approach in machine learning for solving complex tasks with moderate data. However, fine-tuning the entire pre-trained model is ineffective in federated data scenarios where local data…

机器学习 · 计算机科学 2025-02-28 Pei-Yau Weng , Minh Hoang , Lam M. Nguyen , My T. Thai , Tsui-Wei Weng , Trong Nghia Hoang