English
Related papers

Related papers: Classification As Decoder: Trading Flexibility For…

200 papers

Generative classifiers offer potential advantages over their discriminative counterparts, namely in the areas of data efficiency, robustness to data shift and adversarial examples, and zero-shot learning (Ng and Jordan,2002; Yogatama et…

Computation and Language · Computer Science 2019-10-02 Xiaoan Ding , Kevin Gimpel

Chatbots based on large language models offer cheap conversation practice opportunities for language learners. However, they are hard to control for linguistic forms that correspond to learners' current needs, such as grammar. We control…

Computation and Language · Computer Science 2025-02-12 Dominik Glandorf , Peng Cui , Detmar Meurers , Mrinmaya Sachan

Expressing in language is subjective. Everyone has a different style of reading and writing, apparently it all boil downs to the way their mind understands things (in a specific format). Language style transfer is a way to preserve the…

Computation and Language · Computer Science 2018-04-12 Ayush Singh , Ritu Palod

End-to-end task-oriented dialog systems usually suffer from the challenge of incorporating knowledge bases. In this paper, we propose a novel yet simple end-to-end differentiable model called memory-to-sequence (Mem2Seq) to address this…

Computation and Language · Computer Science 2018-05-22 Andrea Madotto , Chien-Sheng Wu , Pascale Fung

Acquiring training data to improve the robustness of dialog systems can be a painstakingly long process. In this work, we propose a method to reduce the cost and effort of creating new conversational agents by artificially generating more…

Computation and Language · Computer Science 2022-05-05 Louis Marceau , Raouf Belbahar , Marc Queudot , Nada Naji , Eric Charton , Marie-Jean Meurs

Neural dialogue response generation has gained much popularity in recent years. Maximum Likelihood Estimation (MLE) objective is widely adopted in existing dialogue model learning. However, models trained with MLE objective function are…

Computation and Language · Computer Science 2020-10-14 Hengyi Cai , Hongshen Chen , Yonghao Song , Zhuoye Ding , Yongjun Bao , Weipeng Yan , Xiaofang Zhao

Current works in the generation of personalized dialogue primarily contribute to the agent presenting a consistent personality and driving a more informative response. However, we found that the generated responses from most previous models…

Computation and Language · Computer Science 2022-08-23 Itsugun Cho , Dongyang Wang , Ryota Takahashi , Hiroaki Saito

We test the robustness of debate as a method of scalable oversight by training models to debate with data generated via self-play. In a long-context reading comprehension task, we find that language model based evaluators answer questions…

Computation and Language · Computer Science 2024-09-26 Samuel Arnesen , David Rein , Julian Michael

Recently, there has been a surge in the use of generated data to enhance the performance of downstream models, largely due to the advancements in pre-trained language models. However, most prevailing methods trained generative and…

Computation and Language · Computer Science 2023-09-26 Tong Wu , Hao Wang , Zhongshen Zeng , Wei Wang , Hai-Tao Zheng , Jiaxing Zhang

We present a dialogue generation model that directly captures the variability in possible responses to a given input, which reduces the `boring output' issue of deterministic dialogue models. Experiments show that our model generates more…

Computation and Language · Computer Science 2017-02-21 Kris Cao , Stephen Clark

We introduce a method by which a generative model learning the joint distribution between actions and future states can be used to automatically infer a control scheme for any desired reward function, which may be altered on the fly without…

Machine Learning · Computer Science 2017-03-10 Nicholas Guttenberg , Yen Yu , Ryota Kanai

Most of the existing works for dialogue generation are data-driven models trained directly on corpora crawled from websites. They mainly focus on improving the model architecture to produce better responses but pay little attention to…

Computation and Language · Computer Science 2021-06-23 Xin Li , Piji Li , Yan Wang , Xiaojiang Liu , Wai Lam

We propose a simple and effective modeling framework for controlled generation of multiple, diverse outputs. We focus on the setting of generating the next sentence of a story given its context. As controllable dimensions, we consider…

Computation and Language · Computer Science 2020-06-03 Lifu Tu , Xiaoan Ding , Dong Yu , Kevin Gimpel

We present a model which predicts how individual users of a dialog system understand and produce utterances based on user groups. In contrast to previous work, these user groups are not specified beforehand, but learned in training. We…

Computation and Language · Computer Science 2018-06-18 Nikos Engonopoulos , Christoph Teichmann , Alexander Koller

Automatic evaluation of open-domain dialogue response generation is very challenging because there are many appropriate responses for a given context. Existing evaluation models merely compare the generated response with the ground truth…

Computation and Language · Computer Science 2020-06-15 JinYeong Bak , Alice Oh

Sequence-to-Sequence (Seq2Seq) models have witnessed a notable success in generating natural conversational exchanges. Notwithstanding the syntactically well-formed responses generated by these neural network models, they are prone to be…

Computation and Language · Computer Science 2019-06-05 Nouha Dziri , Ehsan Kamalloo , Kory W. Mathewson , Osmar Zaiane

Fully data driven Chatbots for non-goal oriented dialogues are known to suffer from inconsistent behaviour across their turns, stemming from a general difficulty in controlling parameters like their assumed background personality and…

Computation and Language · Computer Science 2020-03-31 Fabian Galetzka , Chukwuemeka U. Eneh , David Schlangen

Different from other sequential data, sentences in natural language are structured by linguistic grammars. Previous generative conversational models with chain-structured decoder ignore this structure in human language and might generate…

Artificial Intelligence · Computer Science 2018-01-04 Ganbin Zhou , Ping Luo , Rongyu Cao , Yijun Xiao , Fen Lin , Bo Chen , Qing He

With the advent of off-the-shelf intelligent home products and broader internet adoption, researchers increasingly explore smart computing applications that provide easier access to health and wellness resources. AI-based systems like…

Human-Computer Interaction · Computer Science 2021-07-29 Lu Wang , Munif Ishad Mujib , Jake Williams , George Demiris , Jina Huh-Yoo

How do neural language models keep track of number agreement between subject and verb? We show that `diagnostic classifiers', trained to predict number from the internal states of a language model, provide a detailed understanding of how,…

Computation and Language · Computer Science 2021-11-19 Mario Giulianelli , Jacqueline Harding , Florian Mohnert , Dieuwke Hupkes , Willem Zuidema