English
Related papers

Related papers: Low-Level Linguistic Controls for Style Transfer a…

200 papers

This paper introduces a multi-scale speech style modeling method for end-to-end expressive speech synthesis. The proposed method employs a multi-scale reference encoder to extract both the global-scale utterance-level and the local-scale…

Sound · Computer Science 2021-04-09 Xiang Li , Changhe Song , Jingbei Li , Zhiyong Wu , Jia Jia , Helen Meng

Controllable TTS models with natural language prompts often lack the ability for fine-grained control and face a scarcity of high-quality data. We propose a two-stage style-controllable TTS system with language models, utilizing a quantized…

Multimedia · Computer Science 2025-06-04 Yongqi Wang , Chunlei Zhang , Hangting Chen , Zhou Zhao , Dong Yu

Style transfer deals with the algorithms to transfer the stylistic properties of a piece of text into that of another while ensuring that the core content is preserved. There has been a lot of interest in the field of text style transfer…

Computation and Language · Computer Science 2020-05-12 Abhilasha Sancheti , Kundan Krishna , Balaji Vasan Srinivasan , Anandhavelu Natarajan

The field of Text-to-Speech has experienced huge improvements last years benefiting from deep learning techniques. Producing realistic speech becomes possible now. As a consequence, the research on the control of the expressiveness,…

Computation and Language · Computer Science 2019-03-28 Noé Tits , Fengna Wang , Kevin El Haddad , Vincent Pagel , Thierry Dutoit

Unsupervised text style transfer aims at training a generative model that can alter the style of the input sentence while preserving its content without using any parallel data. In this paper, we employ powerful pre-trained large language…

Computation and Language · Computer Science 2023-10-24 Huiyu Mai , Wenhao Jiang , Zhihong Deng

Given the recent progress in language modeling using Transformer-based neural models and an active interest in generating stylized text, we present an approach to leverage the generalization capabilities of a language model to rewrite an…

Computation and Language · Computer Science 2020-11-03 Bakhtiyar Syed , Gaurav Verma , Balaji Vasan Srinivasan , Anandhavelu Natarajan , Vasudeva Varma

Recent fast style transfer methods use a pre-trained convolutional neural network as a feature encoder and a perceptual loss network. Although the pre-trained network is used to generate responses of receptive fields effective for…

Computer Vision and Pattern Recognition · Computer Science 2018-07-05 Minseong Kim , Jongju Shin , Myung-Cheol Roh , Hyun-Chul Choi

End-to-end neural TTS training has shown improved performance in speech style transfer. However, the improvement is still limited by the training data in both target styles and speakers. Inadequate style transfer performance occurs when the…

Sound · Computer Science 2021-06-21 Xiaochun An , Frank K. Soong , Lei Xie

Language models based on the Transformer architecture achieve excellent results in many language-related tasks, such as text classification or sentiment analysis. However, despite the architecture of these models being well-defined, little…

Computation and Language · Computer Science 2025-04-14 Miguel López-Otal , Jorge Gracia , Jordi Bernad , Carlos Bobed , Lucía Pitarch-Ballesteros , Emma Anglés-Herrero

This study investigates how artificial intelligence (AI) recognizes style through style transfer-an AI technique that generates a new image by applying the style of one image to another. Despite the considerable interest that style transfer…

Graphics · Computer Science 2025-04-22 Yunha Yeo , Daeho Um

Text-to-speech models trained on large-scale datasets have demonstrated impressive in-context learning capabilities and naturalness. However, control of speaker identity and style in these models typically requires conditioning on reference…

Sound · Computer Science 2024-02-08 Dan Lyth , Simon King

The difficulty of textual style transfer lies in the lack of parallel corpora. Numerous advances have been proposed for the unsupervised generation. However, significant problems remain with the auto-evaluation of style transfer tasks.…

Computation and Language · Computer Science 2019-10-11 Richard Yuanzhe Pang

In this paper, we propose an efficient transfer leaning methods for training a personalized language model using a recurrent neural network with long short-term memory architecture. With our proposed fast transfer learning schemes, a…

Computation and Language · Computer Science 2017-10-11 Seunghyun Yoon , Hyeongu Yun , Yuna Kim , Gyu-tae Park , Kyomin Jung

Language style is necessary for AI systems to understand and generate diverse human language accurately. However, previous text style transfer primarily focused on sentence-level data-driven approaches, limiting exploration of potential…

Computation and Language · Computer Science 2024-10-15 Huashan Sun , Yixiao Wu , Yuhao Ye , Yizhe Yang , Yinghao Li , Jiawei Li , Yang Gao

Text-driven motion diffusion models are capable of generating realistic human motions, but text alone often struggles to express fine-level nuances of motion, commonly referred to as style. Recent approaches have tackled this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Junhyuk Jeon , Seokhyeon Hong , Junyong Noh

The named concepts and compositional operators present in natural language provide a rich source of information about the kinds of abstractions humans use to navigate the world. Can this linguistic background knowledge improve the…

Computation and Language · Computer Science 2017-11-03 Jacob Andreas , Dan Klein , Sergey Levine

In this paper, we focus on a new practical task, document-scale text content manipulation, which is the opposite of text style transfer and aims to preserve text styles while altering the content. In detail, the input is a set of structured…

Computation and Language · Computer Science 2020-02-25 Xiaocheng Feng , Yawei Sun , Bing Qin , Heng Gong , Yibo Sun , Wei Bi , Xiaojiang Liu , Ting Liu

Numerous recent techniques for text style transfer characterize their approaches as variants of reinforcement learning and preference optimization. In this work, we consider the relationship between these approaches and a class of…

Computation and Language · Computer Science 2024-07-30 Shuai Liu , Jonathan May

Artistic style transfer, a captivating application of generative artificial intelligence, involves fusing the content of one image with the artistic style of another to create unique visual compositions. This paper presents a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Jonayet Miah , Duc M Cao , Md Abu Sayed , Md. Sabbirul Haque

Controlling the style of natural language by disentangling the latent space is an important step towards interpretable machine learning. After the latent space is disentangled, the style of a sentence can be transformed by tuning the style…

Computation and Language · Computer Science 2021-08-04 Lei Sha , Thomas Lukasiewicz