English
Related papers

Related papers: Structuring Latent Spaces for Stylized Response Ge…

200 papers

Text style transfer task requires the model to transfer a sentence of one style to another style while retaining its original content meaning, which is a challenging problem that has long suffered from the shortage of parallel data. In this…

Computation and Language · Computer Science 2019-09-26 Mingyue Shang , Piji Li , Zhenxin Fu , Lidong Bing , Dongyan Zhao , Shuming Shi , Rui Yan

Text-to-Speech (TTS) has recently seen great progress in synthesizing high-quality speech owing to the rapid development of parallel TTS systems, but producing speech with naturalistic prosodic variations, speaking styles and emotional…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-21 Yinghao Aaron Li , Cong Han , Nima Mesgarani

Target-guided response generation enables dialogue systems to smoothly transition a conversation from a dialogue context toward a target sentence. Such control is useful for designing dialogue systems that direct a conversation toward…

Computation and Language · Computer Science 2022-05-20 Prakhar Gupta , Harsh Jhamtani , Jeffrey P. Bigham

Open-domain conversation models have become good at generating natural-sounding dialogue, using very large architectures with billions of trainable parameters. The vast training data required to train these architectures aggregates many…

Computation and Language · Computer Science 2020-09-24 Eric Michael Smith , Diana Gonzalez-Rico , Emily Dinan , Y-Lan Boureau

In this paper, we propose a deep, globally normalized topic model that incorporates structural relationships connecting documents in socially generated corpora, such as online forums. Our model (1) captures discursive interactions along…

Machine Learning · Computer Science 2020-05-11 Nikita Srivatsan , Zachary Wojtowicz , Taylor Berg-Kirkpatrick

Text style transfer aims to modify the style of a sentence while keeping its content unchanged. Recent style transfer systems often fail to faithfully preserve the content after changing the style. This paper proposes a structured content…

Computation and Language · Computer Science 2018-11-02 Youzhi Tian , Zhiting Hu , Zhou Yu

The ability of a dialog system to express prespecified language style during conversations has a direct, positive impact on its usability and on user satisfaction. We introduce a new prototype-to-style (PS) framework to tackle the challenge…

Computation and Language · Computer Science 2020-04-07 Yixuan Su , Yan Wang , Simon Baker , Deng Cai , Xiaojiang Liu , Anna Korhonen , Nigel Collier

This paper presents a novel approach for guiding a Generative Adversarial Network trained on the FashionGen dataset to generate designs corresponding to target fashion styles. Finding the latent vectors in the generator's latent space that…

Neural and Evolutionary Computing · Computer Science 2022-04-05 Imke Grabe , Jichen Zhu , Manex Agirrezabal

In spoken dialogue, even if two current turns are the same sentence, their responses might still differ when they are spoken in different styles. The spoken styles, containing paralinguistic and prosodic information, mark the most…

Computation and Language · Computer Science 2024-05-31 Guan-Ting Lin , Cheng-Han Chiang , Hung-yi Lee

Pre-training models have been proved effective for a wide range of natural language processing tasks. Inspired by this, we propose a novel dialogue generation pre-training framework to support various kinds of conversations, including…

Computation and Language · Computer Science 2020-05-01 Siqi Bao , Huang He , Fan Wang , Hua Wu , Haifeng Wang

Fashionable image generation aims to synthesize images of diverse fashion prevalent around the globe, helping fashion designers in real-time visualization by giving them a basic customized structure of how a specific design preference would…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Krishna Sri Ipsit Mantri , Nevasini Sasikumar

In this paper, we present a hybrid model that combines a neural conversational model and a rule-based graph dialogue system that assists users in scheduling reminders through a chat conversation. The graph based system has high precision…

Computation and Language · Computer Science 2018-10-30 Aniruddha Tammewar , Monik Pamecha , Chirag Jain , Apurva Nagvenkar , Krupal Modi

Grounding dialogue generation by extra knowledge has shown great potentials towards building a system capable of replying with knowledgeable and engaging responses. Existing studies focus on how to synthesize a response with proper…

Computation and Language · Computer Science 2022-04-13 Xueliang Zhao , Tingchen Fu , Chongyang Tao , Wei Wu , Dongyan Zhao , Rui Yan

People talk with diversified styles. For one piece of speech, different talking styles exhibit significant differences in the facial and head pose movements. For example, the "excited" style usually talks with the mouth wide open, while the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Haozhe Wu , Jia Jia , Haoyu Wang , Yishun Dou , Chao Duan , Qingshan Deng

We present a deep generative model for unsupervised text style transfer that unifies previously proposed non-generative techniques. Our probabilistic approach models non-parallel data from two domains as a partially observed parallel…

Computation and Language · Computer Science 2020-05-01 Junxian He , Xinyi Wang , Graham Neubig , Taylor Berg-Kirkpatrick

We introduce StyleFusion-TTS, a prompt and/or audio referenced, style and speaker-controllable, zero-shot text-to-speech (TTS) synthesis system designed to enhance the editability and naturalness of current research literature. We propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Zhiyong Chen , Xinnuo Li , Zhiqi Ai , Shugong Xu

Modern NLP defines the task of style transfer as modifying the style of a given sentence without appreciably changing its semantics, which implies that the outputs of style transfer systems should be paraphrases of their inputs. However,…

Computation and Language · Computer Science 2020-10-13 Kalpesh Krishna , John Wieting , Mohit Iyyer

Text style transfer refers to the task of rephrasing a given text in a different style. While various methods have been proposed to advance the state of the art, they often assume the transfer output follows a delta distribution, and thus…

Computation and Language · Computer Science 2020-02-18 Kevin Lin , Ming-Yu Liu , Ming-Ting Sun , Jan Kautz

This paper tackles the problem of disentangling the latent variables of style and content in language models. We propose a simple yet effective approach, which incorporates auxiliary multi-task and adversarial objectives, for label…

Computation and Language · Computer Science 2018-09-12 Vineet John , Lili Mou , Hareesh Bahuleyan , Olga Vechtomova

There has been considerable progress made towards conversational models that generate coherent and fluent responses; however, this often involves training large language models on large dialogue datasets, such as Reddit. These large…

Computation and Language · Computer Science 2020-10-12 Andrea Madotto , Etsuko Ishii , Zhaojiang Lin , Sumanth Dathathri , Pascale Fung