English
Related papers

Related papers: CG-BERT: Conditional Text Generation with BERT for…

200 papers

Few-shot learning arises in important practical scenarios, such as when a natural language understanding system needs to learn new semantic labels for an emerging, resource-scarce domain. In this paper, we explore retrieval-based methods…

Computation and Language · Computer Science 2021-04-14 Dian Yu , Luheng He , Yuan Zhang , Xinya Du , Panupong Pasupat , Qi Li

Deep generative models are becoming a cornerstone of modern machine learning. Recent work on conditional generative adversarial networks has shown that learning complex, high-dimensional distributions over natural images is within reach.…

Machine Learning · Computer Science 2019-05-15 Mario Lucic , Michael Tschannen , Marvin Ritter , Xiaohua Zhai , Olivier Bachem , Sylvain Gelly

Intent classification and slot filling are two critical tasks for natural language understanding. Traditionally the two tasks proceeded independently. However, more recently joint models for intent classification and slot filling have…

Computation and Language · Computer Science 2022-03-01 Soyeon Caren Han , Siqu Long , Huichun Li , Henry Weld , Josiah Poon

Intent Detection systems in the real world are exposed to complexities of imbalanced datasets containing varying perception of intent, unintended correlations and domain-specific aberrations. To facilitate benchmarking which can reflect…

Computation and Language · Computer Science 2021-03-25 Gaurav Arora , Chirag Jain , Manas Chaturvedi , Krupal Modi

We propose a novel data augmentation method for labeled sentences called conditional BERT contextual augmentation. Data augmentation methods are often applied to prevent overfitting and improve generalization of deep neural network models.…

Computation and Language · Computer Science 2018-12-18 Xing Wu , Shangwen Lv , Liangjun Zang , Jizhong Han , Songlin Hu

Knowledge distillation has made remarkable achievements in model compression. However, most existing methods require the original training data, which is usually unavailable due to privacy and security issues. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Xinyi Yu , Ling Yan , Yang Yang , Libo Zhou , Linlin Ou

In creativity support and computational co-creativity contexts, the task of discovering appropriate prompts for use with text-to-image generative models remains difficult. In many cases the creator wishes to evoke a certain impression with…

Artificial Intelligence · Computer Science 2023-02-21 Francisco Ibarrola , Rohan Lulham , Kazjon Grace

Generative Adversarial Nets [8] were recently introduced as a novel way to train generative models. In this work we introduce the conditional version of generative adversarial nets, which can be constructed by simply feeding the data, y, we…

Machine Learning · Computer Science 2014-11-10 Mehdi Mirza , Simon Osindero

We propose the use of conversational GPT models for easy and quick few-shot text classification in the financial domain using the Banking77 dataset. Our approach involves in-context learning with GPT-3.5 and GPT-4, which minimizes the…

Computation and Language · Computer Science 2023-08-29 Lefteris Loukas , Ilias Stogiannidis , Prodromos Malakasiotis , Stavros Vassos

This paper evaluates Few-Shot Prompting with Large Language Models for Named Entity Recognition (NER). Traditional NER systems rely on extensive labeled datasets, which are costly and time-consuming to obtain. Few-Shot Prompting or…

Information Retrieval · Computer Science 2024-09-05 Hédi Zeghidi , Ludovic Moncla

The widespread adoption of ChatGPT has raised concerns about its misuse, highlighting the need for robust detection of AI-generated text. Current word-level detectors are vulnerable to paraphrasing or simple prompts (PSP), suffer from…

Computation and Language · Computer Science 2025-09-24 Mo Mu , Dianqiao Lei , Chang Li

Generative feature matching network (GFMN) is an approach for training implicit generative models for images by performing moment matching on features from pre-trained neural networks. In this paper, we present new GFMN formulations that…

Computation and Language · Computer Science 2020-05-12 Inkit Padhi , Pierre Dognin , Ke Bai , Cicero Nogueira dos Santos , Vijil Chenthamarakshan , Youssef Mroueh , Payel Das

Intent understanding plays an important role in dialog systems, and is typically formulated as a supervised learning problem. However, it is challenging and time-consuming to design the intents for a new domain from scratch, which usually…

Computation and Language · Computer Science 2021-12-15 Pengfei Liu , Youzhang Ning , King Keung Wu , Kun Li , Helen Meng

Current fake image detectors trained on large synthetic image datasets perform satisfactorily on limited studied generative models. However, these detectors suffer a notable performance decline over unseen models. Besides, collecting…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Shiyu Wu , Jing Liu , Jing Li , Yequan Wang

We present DiffusionBERT, a new generative masked language model based on discrete diffusion models. Diffusion models and many pre-trained language models have a shared training objective, i.e., denoising, making it possible to combine the…

Computation and Language · Computer Science 2022-12-02 Zhengfu He , Tianxiang Sun , Kuanning Wang , Xuanjing Huang , Xipeng Qiu

AI-generated text detection plays an increasingly important role in various fields. In this study, we developed an efficient AI-generated text detection model based on the BERT algorithm, which provides new ideas and methods for solving…

Computation and Language · Computer Science 2024-10-15 Hao Wang , Jianwei Li , Zhengyu Li

Recent vision-language models outperform vision-only models on many image classification tasks. However, because of the absence of paired text/image descriptions, it remains difficult to fine-tune these models for fine-grained image…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Kathleen M. Lewis , Emily Mu , Adrian V. Dalca , John Guttag

Contextual word embeddings such as BERT have achieved state of the art performance in numerous NLP tasks. Since they are optimized to capture the statistical properties of training data, they tend to pick up on and amplify social…

Computation and Language · Computer Science 2019-06-19 Keita Kurita , Nidhi Vyas , Ayush Pareek , Alan W Black , Yulia Tsvetkov

Subjective bias detection is critical for applications like propaganda detection, content recommendation, sentiment analysis, and bias neutralization. This bias is introduced in natural language via inflammatory words and phrases, casting…

Computation and Language · Computer Science 2020-06-16 Tanvi Dadu , Kartikey Pant , Radhika Mamidi

Few-shot speaker adaptation is a specific Text-to-Speech (TTS) system that aims to reproduce a novel speaker's voice with a few training data. While numerous attempts have been made to the few-shot speaker adaptation system, there is still…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-17 Ji-Hoon Kim , Sang-Hoon Lee , Ji-Hyun Lee , Hong-Gyu Jung , Seong-Whan Lee