English
Related papers

Related papers: Evaluating the Evaluation Metrics for Style Transf…

200 papers

Language style transfer is the problem of migrating the content of a source sentence to a target style. In many of its applications, parallel training data are not available and source sentences to be transferred may have arbitrary and…

Computation and Language · Computer Science 2018-08-14 Yanpeng Zhao , Wei Bi , Deng Cai , Xiaojiang Liu , Kewei Tu , Shuming Shi

Alignment with human preferences is an important step in developing accurate and safe large language models. This is no exception in machine translation (MT), where better handling of language nuances and context-specific variations leads…

Machine translation (MT) has become indispensable for cross-border communication in globalized industries like e-commerce, finance, and legal services, with recent advancements in large language models (LLMs) significantly enhancing…

Most existing methods focus on sentiment analysis of textual data. However, recently there has been a massive use of images and videos on social platforms, motivating sentiment analysis from other modalities. Current studies show that…

Machine Learning · Computer Science 2022-10-13 Guilherme Lourenço de Toledo , Ricardo Marcondes Marcacini

At the staggering pace with which the capabilities of large language models (LLMs) are increasing, creating future-proof evaluation sets to assess their understanding becomes more and more challenging. In this paper, we propose a novel…

Computation and Language · Computer Science 2023-12-21 Xenia Ohmer , Elia Bruni , Dieuwke Hupkes

This paper explores the possibilities of image style transfer applied to text maintaining the original transcriptions. Results on different text domains (scene text, machine printed text and handwritten text) and cross modal results…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Raul Gomez , Ali Furkan Biten , Lluis Gomez , Jaume Gibert , Marçal Rusiñol , Dimosthenis Karatzas

Large language models (LLMs) are gaining increasing popularity in both academia and industry, owing to their unprecedented performance in various applications. As LLMs continue to play a vital role in both research and daily use, their…

Computation and Language · Computer Science 2024-01-01 Yupeng Chang , Xu Wang , Jindong Wang , Yuan Wu , Linyi Yang , Kaijie Zhu , Hao Chen , Xiaoyuan Yi , Cunxiang Wang , Yidong Wang , Wei Ye , Yue Zhang , Yi Chang , Philip S. Yu , Qiang Yang , Xing Xie

Expressing in language is subjective. Everyone has a different style of reading and writing, apparently it all boil downs to the way their mind understands things (in a specific format). Language style transfer is a way to preserve the…

Computation and Language · Computer Science 2018-04-12 Ayush Singh , Ritu Palod

Despite the recent success of automatic metrics for assessing translation quality, their application in evaluating the quality of machine-translated chats has been limited. Unlike more structured texts like news, chat conversations are…

Computation and Language · Computer Science 2024-03-14 Sweta Agrawal , Amin Farajian , Patrick Fernandes , Ricardo Rei , André F. T. Martins

The performance of existing text style transfer models is severely limited by the non-parallel datasets on which the models are trained. In non-parallel datasets, no direct mapping exists between sentences of the source and target style;…

Computation and Language · Computer Science 2022-04-19 Ruibo Liu , Chongyang Gao , Chenyan Jia , Guangxuan Xu , Soroush Vosoughi

Simultaneous speech translation (SimulST) systems must balance translation quality with response time, making latency measurement crucial for evaluating their real-world performance. However, there has been a longstanding belief that…

Computation and Language · Computer Science 2024-10-22 Xi Xu , Wenda Xu , Siqi Ouyang , Lei Li

Text Style Transfer (TST) is performable through approaches such as latent space disentanglement, cycle-consistency losses, prototype editing etc. The prototype editing approach, which is known to be quite successful in TST, involves two…

Computation and Language · Computer Science 2022-10-13 Sharan Narasimhan , Pooja Shekar , Suvodip Dey , Maunendra Sankar Desarkar

We investigate cross-lingual sentiment analysis, which has attracted significant attention due to its applications in various areas including market research, politics and social sciences. In particular, we introduce a sentiment analysis…

Machine Learning · Computer Science 2022-02-08 Selim F. Yilmaz , E. Batuhan Kaynak , Aykut Koç , Hamdi Dibeklioğlu , Suleyman S. Kozat

Style transfer TTS has shown impressive performance in recent years. However, style control is often restricted to systems built on expressive speech recordings with discrete style categories. In practical situations, users may be…

Sound · Computer Science 2023-06-02 Guanghou Liu , Yongmao Zhang , Yi Lei , Yunlin Chen , Rui Wang , Zhifei Li , Lei Xie

Despite the success of style transfer in image processing, it has seen limited progress in natural language generation. Part of the problem is that content is not as easily decoupled from style in the text domain. Curiously, in the field of…

Computation and Language · Computer Science 2019-11-11 Katy Gero , Chris Kedzie , Jonathan Reeve , Lydia Chilton

We exploit the pre-trained seq2seq model mBART for multilingual text style transfer. Using machine translated data as well as gold aligned English sentences yields state-of-the-art results in the three target languages we consider. Besides,…

Computation and Language · Computer Science 2022-03-17 Huiyuan Lai , Antonio Toral , Malvina Nissim

A major challenge in the field of Text Generation is evaluation: Human evaluations are cost-intensive, and automated metrics often display considerable disagreement with human judgments. In this paper, we propose a statistical model of Text…

Computation and Language · Computer Science 2023-06-07 Jan Deriu , Pius von Däniken , Don Tuggener , Mark Cieliebak

Language style transfer has attracted more and more attention in the past few years. Recent researches focus on improving neural models targeting at transferring from one style to the other with labeled data. However, transferring across…

Computation and Language · Computer Science 2019-06-04 Hongyu Zang , Xiaojun Wan

In Machine Translation, assessing the quality of a large amount of automatic translations can be challenging. Automatic metrics are not reliable when it comes to high performing systems. In addition, resorting to human evaluators can be…

Computation and Language · Computer Science 2021-05-31 Vânia Mendonça , Ricardo Rei , Luisa Coheur , Alberto Sardinha , Ana Lúcia Santos

Automated source code summarization is a popular software engineering research topic wherein machine translation models are employed to "translate" code snippets into relevant natural language descriptions. Most evaluations of such models…

Software Engineering · Computer Science 2021-06-17 Junayed Mahmud , Fahim Faisal , Raihan Islam Arnob , Antonios Anastasopoulos , Kevin Moran