English
Related papers

Related papers: Improving Dialog Safety using Socially Aware Contr…

200 papers

Models trained on large unlabeled corpora of human interactions will learn patterns and mimic behaviors therein, which include offensive or otherwise toxic behavior and unwanted biases. We investigate a variety of methods to mitigate these…

Computation and Language · Computer Science 2021-08-06 Jing Xu , Da Ju , Margaret Li , Y-Lan Boureau , Jason Weston , Emily Dinan

One challenge for dialogue agents is recognizing feelings in the conversation partner and replying accordingly, a key communicative skill. While it is straightforward for humans to recognize and acknowledge others' feelings in a…

Computation and Language · Computer Science 2019-08-30 Hannah Rashkin , Eric Michael Smith , Margaret Li , Y-Lan Boureau

Conversational speech synthesis (CSS) incorporates historical dialogue as supplementary information with the aim of generating speech that has dialogue-appropriate prosody. While previous methods have already delved into enhancing context…

Computation and Language · Computer Science 2023-12-19 Yayue Deng , Jinlong Xue , Yukang Jia , Qifei Li , Yichen Han , Fengping Wang , Yingming Gao , Dengfeng Ke , Ya Li

Conversational AI systems exhibit a level of human-like behavior that promises to have profound impacts on many aspects of daily life -- how people access information, create content, and seek social support. Yet these models have also…

Human-Computer Interaction · Computer Science 2023-06-21 Christopher M. Homan , Greg Serapio-Garcia , Lora Aroyo , Mark Diaz , Alicia Parrish , Vinodkumar Prabhakaran , Alex S. Taylor , Ding Wang

Conversational AI is increasingly deployed in emotionally charged and ethically sensitive interactions. Previous research has primarily concentrated on emotional benchmarks or static safety checks, overlooking how alignment unfolds in…

Computation and Language · Computer Science 2026-04-06 Jiawen Deng , Wentao Zhang , Ziyun Jiao , Fuji Ren

Neural dialogue response generation has gained much popularity in recent years. Maximum Likelihood Estimation (MLE) objective is widely adopted in existing dialogue model learning. However, models trained with MLE objective function are…

Computation and Language · Computer Science 2020-10-14 Hengyi Cai , Hongshen Chen , Yonghao Song , Zhuoye Ding , Yongjun Bao , Weipeng Yan , Xiaofang Zhao

Most of the existing works for dialogue generation are data-driven models trained directly on corpora crawled from websites. They mainly focus on improving the model architecture to produce better responses but pay little attention to…

Computation and Language · Computer Science 2021-06-23 Xin Li , Piji Li , Yan Wang , Xiaojiang Liu , Wai Lam

Large Language Models' safety remains a critical concern due to their vulnerability to adversarial attacks, which can prompt these systems to produce harmful responses. In the heart of these systems lies a safety classifier, a computational…

Computation and Language · Computer Science 2023-11-02 Jinhwa Kim , Ali Derakhshan , Ian G. Harris

Safety alignment is an essential research topic for real-world AI applications. Despite the multifaceted nature of safety and trustworthiness in AI, current safety alignment methods often focus on a comprehensive notion of safety. By…

Artificial Intelligence · Computer Science 2025-02-05 Thien Q. Tran , Akifumi Wachi , Rei Sato , Takumi Tanabe , Youhei Akimoto

Ensuring that AI agents behave safely and beneficially when interacting with other parties has emerged as one of the central challenges of modern AI safety. While mechanism design, as the theory of designing rules to align individual and…

Computer Science and Game Theory · Computer Science 2026-05-12 Xuanqiang Angelo Huang , Charlie Tharas , Samuele Marro , Van Q. Truong , Bernhard Schölkopf , Emanuele La Malfa , Zhijing Jin

Machine learning approaches often require training and evaluation datasets with a clear separation between positive and negative examples. This risks simplifying and even obscuring the inherent subjectivity present in many tasks. Preserving…

Human-Computer Interaction · Computer Science 2023-06-21 Lora Aroyo , Alex S. Taylor , Mark Diaz , Christopher M. Homan , Alicia Parrish , Greg Serapio-Garcia , Vinodkumar Prabhakaran , Ding Wang

Neural dialog models are known to suffer from problems such as generating unsafe and inconsistent responses. Even though these problems are crucial and prevalent, they are mostly manually identified by model designers through interactions.…

Computation and Language · Computer Science 2021-09-16 Dian Yu , Kenji Sagae

Proactive dialogue system is able to lead the conversation to a goal topic and has advantaged potential in bargain, persuasion and negotiation. Current corpus-based learning manner limits its practical application in real-world scenarios.…

Information Retrieval · Computer Science 2022-04-18 Wenqiang Lei , Yao Zhang , Feifan Song , Hongru Liang , Jiaxin Mao , Jiancheng Lv , Zhenglu Yang , Tat-Seng Chua

Dialogue safety remains a pervasive challenge in open-domain human-machine interaction. Existing approaches propose distinctive dialogue safety taxonomies and datasets for detecting explicitly harmful responses. However, these taxonomies…

Computation and Language · Computer Science 2023-08-01 Huachuan Qiu , Tong Zhao , Anqi Li , Shuai Zhang , Hongliang He , Zhenzhong Lan

Retrieval-based conversational systems learn to rank response candidates for a given dialogue context by computing the similarity between their vector representations. However, training on a single textual form of the multi-turn context…

Computation and Language · Computer Science 2022-04-19 Lahari Poddar , Peiyao Wang , Julia Reinspach

Determining the plausibility of causal relations between clauses is a commonsense reasoning task that requires complex inference ability. The general approach to this task is to train a large pretrained language model on a specific dataset.…

Computation and Language · Computer Science 2021-01-14 Ieva Staliūnaitė , Philip John Gorinski , Ignacio Iacobacci

Social alignment in AI systems aims to ensure that these models behave according to established societal values. However, unlike humans, who derive consensus on value judgments through social interaction, current language models (LMs) are…

Computation and Language · Computer Science 2023-10-31 Ruibo Liu , Ruixin Yang , Chenyan Jia , Ge Zhang , Denny Zhou , Andrew M. Dai , Diyi Yang , Soroush Vosoughi

A rapidly increasing amount of human conversation occurs online. But divisiveness and conflict can fester in text-based interactions on social media platforms, in messaging apps, and on other digital forums. Such toxicity increases…

Human-Computer Interaction · Computer Science 2023-10-24 Lisa P. Argyle , Ethan Busby , Joshua Gubler , Chris Bail , Thomas Howe , Christopher Rytting , David Wingate

Human society had a long history of suffering from cognitive biases leading to social prejudices and mass injustice. The prevalent existence of cognitive biases in large volumes of historical data can pose a threat of being manifested as…

Computers and Society · Computer Science 2020-07-29 Procheta Sen , Debasis Ganguly

Abusive language detection has become an increasingly important task as a means to tackle this type of harmful content in social media. There has been a substantial body of research developing models for determining if a social media post…

Computation and Language · Computer Science 2025-08-19 Raneem Alharthi , Rajwa Alharthi , Aiqi Jiang , Arkaitz Zubiaga