English
Related papers

Related papers: Adversarial Transformer Language Models for Contex…

200 papers

Target-guided response generation enables dialogue systems to smoothly transition a conversation from a dialogue context toward a target sentence. Such control is useful for designing dialogue systems that direct a conversation toward…

Computation and Language · Computer Science 2022-05-20 Prakhar Gupta , Harsh Jhamtani , Jeffrey P. Bigham

Recent prompt-based approaches allow pretrained language models to achieve strong performances on few-shot finetuning by reformulating downstream tasks as a language modeling problem. In this work, we demonstrate that, despite its…

Computation and Language · Computer Science 2021-09-10 Prasetya Ajie Utama , Nafise Sadat Moosavi , Victor Sanh , Iryna Gurevych

Plausibility Estimation (PE) plays a crucial role for enabling language models to objectively comprehend the real world. While large language models (LLMs) demonstrate remarkable capabilities in PE tasks but sometimes produce trivial…

Computation and Language · Computer Science 2024-12-31 Chong Liu , Zaiwen Feng , Lin Liu , Zhenyun Deng , Jiuyong Li , Ruifang Zhai , Debo Cheng , Li Qin

Task-oriented dialog presents a difficult challenge encompassing multiple problems including multi-turn language understanding and generation, knowledge retrieval and reasoning, and action prediction. Modern dialog systems typically begin…

Following the major success of neural language models (LMs) such as BERT or GPT-2 on a variety of language understanding tasks, recent work focused on injecting (structured) knowledge from external resources into these models. While on the…

Computation and Language · Computer Science 2020-10-13 Anne Lauscher , Olga Majewska , Leonardo F. R. Ribeiro , Iryna Gurevych , Nikolai Rozanov , Goran Glavaš

We present a chatbot implementing a novel dialogue management approach based on logical inference. Instead of framing conversation a sequence of response generation tasks, we model conversation as a collaborative inference process in which…

Computation and Language · Computer Science 2021-11-02 Sarah E. Finch , James D. Finch , Daniil Huryn , William Hutsell , Xiaoyuan Huang , Han He , Jinho D. Choi

Transformers have demonstrated remarkable performance in natural language processing and related domains, as they largely focus on sequential, autoregressive next-token prediction tasks. Yet, they struggle in logical reasoning, not…

Artificial Intelligence · Computer Science 2025-10-08 Renee Ge , Qianli Liao , Tomaso Poggio

Commonsense question answering has demonstrated considerable potential across various applications like assistants and social robots. Although fully fine-tuned pre-trained Language Models(LM) have achieved remarkable performance in…

Computation and Language · Computer Science 2024-05-10 Ruiting Dai , Yuqiao Tan , Lisi Mo , Shuang Liang , Guohao Huo , Jiayi Luo , Yao Cheng

Hate Speech has become a major content moderation issue for online social media platforms. Given the volume and velocity of online content production, it is impossible to manually moderate hate speech related content on any platform. In…

Computation and Language · Computer Science 2021-01-28 Sudhanshu Mishra , Shivangi Prasad , Shubhanshu Mishra

Conversational speech synthesis (CSS) incorporates historical dialogue as supplementary information with the aim of generating speech that has dialogue-appropriate prosody. While previous methods have already delved into enhancing context…

Computation and Language · Computer Science 2023-12-19 Yayue Deng , Jinlong Xue , Yukang Jia , Qifei Li , Yichen Han , Fengping Wang , Yingming Gao , Dengfeng Ke , Ya Li

Reward design for reinforcement learning agents can be difficult in situations where one not only wants the agent to achieve some effect in the world but where one also cares about how that effect is achieved. For example, we might wish for…

Artificial Intelligence · Computer Science 2023-01-25 Xiangyu Peng , Christopher Cui , Wei Zhou , Renee Jia , Mark Riedl

Understanding event and event-centered commonsense reasoning are crucial for natural language processing (NLP). Given an observed event, it is trivial for human to infer its intents and effects, while this type of If-Then reasoning still…

Computation and Language · Computer Science 2019-12-03 Li Du , Xiao Ding , Ting Liu , Zhongyang Li

There have been many recent investigations into prompt-based training of transformer language models for new text genres in low-resource settings. The prompt-based training approach has been found to be effective in generalizing pre-trained…

Computation and Language · Computer Science 2023-06-13 Jennifer D'Souza , Moussab Hrou , Sören Auer

Building a conversational embodied agent to execute real-life tasks has been a long-standing yet quite challenging research goal, as it requires effective human-agent communication, multi-modal understanding, long-range sequential decision…

Artificial Intelligence · Computer Science 2025-09-04 Kaizhi Zheng , Kaiwen Zhou , Jing Gu , Yue Fan , Jialu Wang , Zonglin Di , Xuehai He , Xin Eric Wang

Today, the internet is an integral part of our daily lives, enabling people to be more connected than ever before. However, this greater connectivity and access to information increase exposure to harmful content such as cyber-bullying and…

Social and Information Networks · Computer Science 2023-10-31 Lanqin Yuan , Tianyu Wang , Gabriela Ferraro , Hanna Suominen , Marian-Andrei Rizoiu

The common practice for training commonsense models has gone from-human-to-corpus-to-machine: humans author commonsense knowledge graphs in order to train commonsense models. In this work, we investigate an alternative,…

Computation and Language · Computer Science 2022-11-30 Peter West , Chandra Bhagavatula , Jack Hessel , Jena D. Hwang , Liwei Jiang , Ronan Le Bras , Ximing Lu , Sean Welleck , Yejin Choi

Computational context understanding refers to an agent's ability to fuse disparate sources of information for decision-making and is, therefore, generally regarded as a prerequisite for sophisticated machine reasoning capabilities, such as…

Artificial Intelligence · Computer Science 2020-03-11 Alessandro Oltramari , Jonathan Francis , Cory Henson , Kaixin Ma , Ruwan Wickramarachchi

Defeasible reasoning is the mode of reasoning where conclusions can be overturned by taking into account new evidence. A commonly used method in cognitive science and logic literature is to handcraft argumentation supporting inference…

Computation and Language · Computer Science 2021-06-01 Aman Madaan , Dheeraj Rajagopal , Niket Tandon , Yiming Yang , Eduard Hovy

Natural Language Inference (NLI) is the task of determining whether a premise entails, contradicts, or is neutral with respect to a given hypothesis. The task is often framed as emulating human inferential processes, in which commonsense…

Computation and Language · Computer Science 2026-01-27 Chathuri Jayaweera , Brianna Yanqui , Bonnie Dorr

Many interpretable AI approaches have been proposed to provide plausible explanations for a model's decision-making. However, configuring an explainable model that effectively communicates among computational modules has received less…

Machine Learning · Computer Science 2023-11-09 Jinyung Hong , Keun Hee Park , Theodore P. Pavlic