English
Related papers

Related papers: Prototype-to-Style: Dialogue Generation with Style…

200 papers

Endowing chatbots with a consistent persona is essential to an engaging conversation, yet it remains an unresolved challenge. In this work, we propose a new retrieval-enhanced approach for personalized response generation. Specifically, we…

Computation and Language · Computer Science 2023-06-13 Shuai Liu , Hyundong J. Cho , Marjorie Freedman , Xuezhe Ma , Jonathan May

Dialogue systems play an increasingly important role in various aspects of our daily life. It is evident from recent research that dialogue systems trained on human conversation data are biased. In particular, they can produce responses…

Computation and Language · Computer Science 2020-11-03 Haochen Liu , Wentao Wang , Yiqi Wang , Hui Liu , Zitao Liu , Jiliang Tang

We investigate the task of building open domain, conversational dialogue systems based on large dialogue corpora using generative models. Generative models produce system responses that are autonomously generated word-by-word, opening up…

Computation and Language · Computer Science 2016-04-08 Iulian V. Serban , Alessandro Sordoni , Yoshua Bengio , Aaron Courville , Joelle Pineau

We introduce a language generative model framework for generating a styled paragraph based on a context sentence and a style reference example. The framework consists of a style encoder and a texts decoder. The style encoder extracts a…

Computation and Language · Computer Science 2020-03-03 Kuo-Hao Zeng , Mohammad Shoeybi , Ming-Yu Liu

Natural Language Generation (NLG) for task-oriented dialogue systems focuses on communicating specific content accurately, fluently, and coherently. While these attributes are crucial for a successful dialogue, it is also desirable to…

Computation and Language · Computer Science 2021-09-28 Alicia Y. Tsai , Shereen Oraby , Vittorio Perera , Jiun-Yu Kao , Yuheng Du , Anjali Narayan-Chen , Tagyoung Chung , Dilek Hakkani-Tur

Text-driven style transfer aims to merge the style of a reference image with content described by a text prompt. Recent advancements in text-to-image models have improved the nuance of style transformations, yet significant challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Mingkun Lei , Xue Song , Beier Zhu , Hao Wang , Chi Zhang

Large language models (LLMs) have shown remarkable capabilities in dialogue generation and reasoning, yet their effectiveness in eliciting user-known but concealed information in open-ended conversations remains limited. In many interactive…

Machine Learning · Computer Science 2026-04-16 Tao Wang , Jingyao Lu , Xibo Wang , Haonan Huang , Su Yao , Zhiqiang Hu , Xingyan Chen , Enmao Diao

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

Although text-to-speech (TTS) systems have significantly improved, most TTS systems still have limitations in synthesizing speech with appropriate phrasing. For natural speech synthesis, it is important to synthesize the speech with a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-14 Ji-Sang Hwang , Sang-Hoon Lee , Seong-Whan Lee

In the evolving domain of text-to-image generation, diffusion models have emerged as powerful tools in content creation. Despite their remarkable capability, existing models still face challenges in achieving controlled generation with a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jaeseok Jeong , Junho Kim , Yunjey Choi , Gayoung Lee , Youngjung Uh

Cross-speaker style transfer (CSST) in text-to-speech (TTS) synthesis aims at transferring a speaking style to the synthesised speech in a target speaker's voice. Most previous CSST approaches rely on expensive high-quality data carrying…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-09 Songxiang Liu , Shan Yang , Dan Su , Dong Yu

One of the biggest challenges of end-to-end language generation from meaning representations in dialogue systems is making the outputs more natural and varied. Here we take a large corpus of 50K crowd-sourced utterances in the restaurant…

Computation and Language · Computer Science 2018-09-17 Juraj Juraska , Marilyn Walker

Language models pretrained on text-only corpora often struggle with tasks that require auditory commonsense knowledge. Previous work addresses this problem by augmenting the language model to retrieve knowledge from external audio…

Computation and Language · Computer Science 2025-06-10 Suho Yoo , Hyunjong Ok , Jaeho Lee

End-to-end spoken dialogue models have garnered significant attention because they offer a higher potential ceiling in expressiveness and perceptual ability than cascaded systems. However, the intelligence and expressiveness of current…

Artificial Intelligence · Computer Science 2026-04-17 Yifu Chen , Shengpeng Ji , Qian Chen , Tianle Liang , Yangzhuo Li , Ziqing Wang , Wen Wang , Jingyu Lu , Haoxiao Wang , Xueyi Pu , Fan Zhuo , Zhou Zhao

Dialogue systems without consistent responses are not fascinating. In this study, we build a dialogue system that can respond based on a given character setting (persona) to bring consistency. Considering the trend of the rapidly increasing…

Computation and Language · Computer Science 2022-06-14 Tomohito Kasahara , Daisuke Kawahara , Nguyen Tung , Shengzhe Li , Kenta Shinzato , Toshinori Sato

Despite the remarkable performance of large-scale generative models in open-domain conversation, they are known to be less practical for building real-time conversation systems due to high latency. On the other hand, retrieval models could…

Computation and Language · Computer Science 2021-09-01 Beomsu Kim , Seokjun Seo , Seungju Han , Enkhbayar Erdenee , Buru Chang

Using a sequence-to-sequence framework, many neural conversation models for chit-chat succeed in naturalness of the response. Nevertheless, the neural conversation models tend to give generic responses which are not specific to given…

Computation and Language · Computer Science 2018-05-24 Jonggu Kim , Doyeon Kong , Jong-Hyeok Lee

General-purpose text decoding approaches are usually adopted for dialogue response generation. Although the quality of the generated responses can be improved with dialogue-specific encoding methods, conversational decoding methods are…

Computation and Language · Computer Science 2025-02-26 Yuxuan Yao , Han Wu , Qiling Xu , Linqi Song

Building a dialogue system that can communicate naturally with humans is a challenging yet interesting problem of agent-based computing. The rapid growth in this area is usually hindered by the long-standing problem of data scarcity as…

Computation and Language · Computer Science 2021-04-23 Munazza Zaib , Quan Z. Sheng , Wei Emma Zhang

Image generation based on text-to-image generation models is a task with practical application scenarios that fine-grained styles cannot be precisely described and controlled in natural language, while the guidance information of stylized…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Shuochen Chang