中文
相关论文

相关论文: "Mask and Infill" : Applying Masked Language Model…

200 篇论文

Current approaches to cross-lingual sentiment analysis try to leverage the wealth of labeled English data using bilingual lexicons, bilingual vector space embeddings, or machine translation systems. Here we show that it is possible to use a…

计算与语言 · 计算机科学 2017-10-25 Mohamed Abdalla , Graeme Hirst

Sentiment classification has been crucial for many natural language processing (NLP) applications, such as the analysis of movie reviews, tweets, or customer feedback. A sufficiently large amount of data is required to build a robust…

计算与语言 · 计算机科学 2020-08-27 Alberto Poncelas , Pintu Lohar , Andy Way , James Hadley

Self-supervised large language models have demonstrated the ability to perform Machine Translation (MT) via in-context learning, but little is known about where the model performs the task with respect to prompt instructions and…

计算与语言 · 计算机科学 2024-03-08 Suzanna Sia , David Mueller , Kevin Duh

We introduce replacing language model (RLM), a sequence-to-sequence language modeling framework for text style transfer (TST). Our method autoregressively replaces each token of the source sentence with a text span that has a similar…

计算与语言 · 计算机科学 2024-02-29 Pengyu Cheng , Ruineng Li

Recently, sentiment-aware pre-trained language models (PLMs) demonstrate impressive results in downstream sentiment analysis tasks. However, they neglect to evaluate the quality of their constructed sentiment representations; they just…

计算与语言 · 计算机科学 2024-04-02 Jaemin Kim , Yohan Na , Kangmin Kim , Sang Rak Lee , Dong-Kyu Chae

Large Language Models (LLMs) have revolutionised the field of Natural Language Processing (NLP) and have achieved state-of-the-art performance in practically every task in this field. However, the prevalent approach used in text generation,…

计算与语言 · 计算机科学 2024-08-12 Nicolo Micheletti , Samuel Belkadi , Lifeng Han , Goran Nenadic

Masked diffusion language models (dLMs) generate text through bidirectional denoising, yet this capability remains locked for infilling prompts. This limitation is an artifact of the current supervised finetuning (SFT) convention of…

计算与语言 · 计算机科学 2026-04-07 Yoshinari Fujinuma , Keisuke Sakaguchi

Masked language modeling (MLM) pre-training models such as BERT corrupt the input by replacing some tokens with [MASK] and then train a model to reconstruct the original tokens. This is an effective technique which has led to good results…

计算与语言 · 计算机科学 2020-06-11 Andy Wagner , Tiyasa Mitra , Mrinal Iyer , Godfrey Da Costa , Marc Tremblay

Multimodal target/aspect sentiment classification combines multimodal sentiment analysis and aspect/target sentiment classification. The goal of the task is to combine vision and language to understand the sentiment towards a target entity…

计算与语言 · 计算机科学 2021-08-09 Zaid Khan , Yun Fu

Representation learning for text via pretraining a language model on a large corpus has become a standard starting point for building NLP systems. This approach stands in contrast to autoencoders, also trained on raw text, but with the…

计算与语言 · 计算机科学 2021-09-14 Ivan Montero , Nikolaos Pappas , Noah A. Smith

This paper introduces a new data augmentation method for neural machine translation that can enforce stronger semantic consistency both within and across languages. Our method is based on Conditional Masked Language Model (CMLM) which is…

计算与语言 · 计算机科学 2022-09-23 Qiao Cheng , Jin Huang , Yitao Duan

Emotions play a critical role in our everyday lives by altering how we perceive, process and respond to our environment. Affective computing aims to instill in computers the ability to detect and act on the emotions of human actors. A core…

计算与语言 · 计算机科学 2020-08-31 Connor T. Heaton , David M. Schwartz

Speech Self-Supervised Learning (SSL) has demonstrated considerable efficacy in various downstream tasks. Nevertheless, prevailing self-supervised models often overlook the incorporation of emotion-related prior information, thereby…

音频与语音处理 · 电气工程与系统科学 2024-06-12 Rui Liu , Zening Ma

Unsupervised text attribute transfer automatically transforms a text to alter a specific attribute (e.g. sentiment) without using any parallel data, while simultaneously preserving its attribute-independent content. The dominant approaches…

计算与语言 · 计算机科学 2019-12-13 Ke Wang , Hang Hua , Xiaojun Wan

Image captioning model is a cross-modality knowledge discovery task, which targets at automatically describing an image with an informative and coherent sentence. To generate the captions, the previous encoder-decoder frameworks directly…

计算机视觉与模式识别 · 计算机科学 2021-02-24 Ziwei Wang , Yadan Luo , Zi Huang

Sarcasm detection, with its figurative nature, poses unique challenges for affective systems designed to perform sentiment analysis. While these systems typically perform well at identifying direct expressions of emotion, they struggle with…

计算与语言 · 计算机科学 2026-04-21 Ximing Wen , Rezvaneh Rezapour

Identifying argument components from unstructured texts and predicting the relationships expressed among them are two primary steps of argument mining. The intrinsic complexity of these tasks demands powerful learning models. While…

计算与语言 · 计算机科学 2022-03-25 Subhabrata Dutta , Jeevesh Juneja , Dipankar Das , Tanmoy Chakraborty

Sentiment analysis in low-resource languages suffers from a lack of annotated corpora to estimate high-performing models. Machine translation and bilingual word embeddings provide some relief through cross-lingual sentiment approaches.…

计算与语言 · 计算机科学 2018-05-24 Jeremy Barnes , Roman Klinger , Sabine Schulte im Walde

Sentiment analysis benefits from large, hand-annotated resources in order to train and test machine learning models, which are often data hungry. While some languages, e.g., English, have a vast array of these resources, most…

计算与语言 · 计算机科学 2019-06-26 Jeremy Barnes , Roman Klinger

Sentiment transfer is one popular example of a text style transfer task, where the goal is to reverse the sentiment polarity of a text. With a sentiment reversal comes also a reversal in meaning. We introduce a different but related task…

计算与语言 · 计算机科学 2022-04-07 Caleb Ziems , Minzhi Li , Anthony Zhang , Diyi Yang