English
Related papers

Related papers: Conditioned Text Generation with Transfer for Clos…

200 papers

We propose a novel conditioned text generation model. It draws inspiration from traditional template-based text generation techniques, where the source provides the content (i.e., what to say), and the template influences how to say it.…

Computation and Language · Computer Science 2019-04-12 Hao Peng , Ankur P. Parikh , Manaal Faruqui , Bhuwan Dhingra , Dipanjan Das

In open-domain conversational systems, it is important but challenging to leverage background knowledge. We can use the incorporation of knowledge to make the generation of dialogue controllable, and can generate more diverse sentences that…

Artificial Intelligence · Computer Science 2021-05-06 Cheng Luo , Dayiheng Liu , Chanjuan Li , Li Lu , Jiancheng Lv

Recent deep learning models have shown improving results to natural language generation (NLG) irrespective of providing sufficient annotated data. However, a modest training data may harm such models performance. Thus, how to build a…

Computation and Language · Computer Science 2018-11-13 Van-Khanh Tran , Le-Minh Nguyen

Current language models decode text token by token according to probabilistic distribution, and determining the appropriate candidates for the next token is crucial to ensure generation quality. This study introduces adaptive decoding, a…

Computation and Language · Computer Science 2024-06-04 Wenhong Zhu , Hongkun Hao , Zhiwei He , Yiming Ai , Rui Wang

Knowledge-grounded dialogue systems are intended to convey information that is based on evidence provided in a given source text. We discuss the challenges of training a generative neural dialogue model for such systems that is controlled…

Computation and Language · Computer Science 2021-07-16 Hannah Rashkin , David Reitter , Gaurav Singh Tomar , Dipanjan Das

In this work, we address the problem of modifying textual attributes of sentences. Given an input sentence and a set of attribute labels, we attempt to generate sentences that are compatible with the conditioning information. To ensure that…

Computation and Language · Computer Science 2018-11-06 Lajanugen Logeswaran , Honglak Lee , Samy Bengio

Recent advancements in self-attention neural network architectures have raised the bar for open-ended text generation. Yet, while current methods are capable of producing a coherent text which is several hundred words long, attaining…

Computation and Language · Computer Science 2020-12-09 Eyal Orbach , Yoav Goldberg

In E-commerce, a key challenge in text generation is to find a good trade-off between word diversity and accuracy (relevance) in order to make generated text appear more natural and human-like. In order to improve the relevance of generated…

Machine Learning · Computer Science 2021-02-24 Huajie Shao , Jun Wang , Haohong Lin , Xuezhou Zhang , Aston Zhang , Heng Ji , Tarek Abdelzaher

We consider the task of data-to-text generation, which aims to create textual output from non-linguistic input. We focus on generating long-form text, i.e., documents with multiple paragraphs, and propose a neural model enhanced with a…

Computation and Language · Computer Science 2022-03-01 Ratish Puduppully , Yao Fu , Mirella Lapata

Natural language serves as a common and straightforward signal for humans to interact seamlessly with machines. Recognizing the importance of this interface, the machine learning community is investing considerable effort in generating data…

Computation and Language · Computer Science 2025-01-03 Shiyu Wang , Yihao Feng , Tian Lan , Ning Yu , Yu Bai , Ran Xu , Huan Wang , Caiming Xiong , Silvio Savarese

Generating relevant responses in a dialog is challenging, and requires not only proper modeling of context in the conversation but also being able to generate fluent sentences during inference. In this paper, we propose a two-step framework…

Computation and Language · Computer Science 2020-11-04 Kashif Khan , Gaurav Sahu , Vikash Balasubramanian , Lili Mou , Olga Vechtomova

Deep latent variable models have been shown to facilitate the response generation for open-domain dialog systems. However, these latent variables are highly randomized, leading to uncontrollable generated responses. In this paper, we…

Computation and Language · Computer Science 2017-07-07 Xiaoyu Shen , Hui Su , Yanran Li , Wenjie Li , Shuzi Niu , Yang Zhao , Akiko Aizawa , Guoping Long

In this paper, we propose three methods for generating synthetic samples to train and evaluate multimodal large language models capable of processing both text and speech inputs. Addressing the scarcity of samples containing both…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Vahid Noroozi , Zhehuai Chen , Somshubra Majumdar , Steve Huang , Jagadeesh Balam , Boris Ginsburg

An important component of achieving language understanding is mastering the composition of sentence meaning, but an immediate challenge to solving this problem is the opacity of sentence vector representations produced by current neural…

Computation and Language · Computer Science 2018-09-12 Allyson Ettinger , Ahmed Elgohary , Colin Phillips , Philip Resnik

In this paper, we focus on task-specific question answering (QA). To this end, we introduce a method for generating exhaustive and high-quality training data, which allows us to train compact (e.g., run on a mobile device), task-specific QA…

Computation and Language · Computer Science 2024-01-25 Hai X. Pham , Isma Hadji , Xinnuo Xu , Ziedune Degutyte , Jay Rainey , Evangelos Kazakos , Afsaneh Fazly , Georgios Tzimiropoulos , Brais Martinez

One of the difficulties in training dialogue systems is the lack of training data. We explore the possibility of creating dialogue data through the interaction between a dialogue system and a user simulator. Our goal is to develop a…

Computation and Language · Computer Science 2021-07-27 Bo-Hsiang Tseng , Yinpei Dai , Florian Kreyssig , Bill Byrne

Goal-oriented dialogue systems are now being widely adopted in industry where it is of key importance to maintain a rapid prototyping cycle for new products and domains. Data-driven dialogue system development has to be adapted to meet this…

Computation and Language · Computer Science 2019-10-04 Igor Shalyminov , Sungjin Lee , Arash Eshghi , Oliver Lemon

Task-oriented dialogue systems help users accomplish tasks such as booking a movie ticket and ordering food via conversation. Generative models parameterized by a deep neural network are widely used for next turn response generation in such…

Computation and Language · Computer Science 2020-10-13 Prasanna Parthasarathi , Arvind Neelakantan , Sharan Narang

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

Automatic question generation can benefit many applications ranging from dialogue systems to reading comprehension. While questions are often asked with respect to long documents, there are many challenges with modeling such long documents.…

Computation and Language · Computer Science 2019-10-24 Luu Anh Tuan , Darsh J Shah , Regina Barzilay