中文
相关论文

相关论文: Improving Dialog Safety using Socially Aware Contr…

200 篇论文

Foundation models such as GPT-4 are fine-tuned to avoid unsafe or otherwise problematic behavior, such as helping to commit crimes or producing racist text. One approach to fine-tuning, called reinforcement learning from human feedback,…

In various natural language processing (NLP) tasks, fine-tuning Pre-trained Language Models (PLMs) often leads to the issue of spurious correlations, which negatively impacts performance, particularly when dealing with out-of-distribution…

计算与语言 · 计算机科学 2025-04-17 Suyoung Bae , Hyojun Kim , YunSeok Choi , Jee-Hyong Lee

Warning: this paper contains content that maybe offensive or upsetting. Recent research in Natural Language Processing (NLP) has advanced the development of various toxicity detection models with the intention of identifying and mitigating…

计算与语言 · 计算机科学 2022-05-06 Ninareh Mehrabi , Ahmad Beirami , Fred Morstatter , Aram Galstyan

Language-capable robots hold unique persuasive power over humans, and thus can help regulate people's behavior and preserve a better moral ecosystem, by rejecting unethical commands and calling out norm violations. However, miscalibrated…

机器人学 · 计算机科学 2022-10-18 Ruchen Wen , Tom Williams

Dialogue topic shift detection is to detect whether an ongoing topic has shifted or should shift in a dialogue, which can be divided into two categories, i.e., response-known task and response-unknown task. Currently, only a few…

计算与语言 · 计算机科学 2023-05-03 Jiangyi Lin , Yaxin Fan , Feng Jiang , Xiaomin Chu , Peifeng Li

Extended interaction with large language models (LLMs) has been linked to the reinforcement of delusional beliefs, a phenomenon attracting growing clinical and public concern. Yet most empirical work evaluates model safety in brief…

人机交互 · 计算机科学 2026-04-24 Luke Nicholls , Robert Hutto , Zephrah Soto , Hamilton Morrin , Thomas Pollak , Raj Korpan , Cheryl Carmichael

We present two categories of model-agnostic adversarial strategies that reveal the weaknesses of several generative, task-oriented dialogue models: Should-Not-Change strategies that evaluate over-sensitivity to small and…

计算与语言 · 计算机科学 2018-09-07 Tong Niu , Mohit Bansal

Engaging learners in dialogue around controversial issues is essential for examining diverse values and perspectives in pluralistic societies. While prior research has identified productive discussion moves mainly in STEM-oriented contexts,…

人机交互 · 计算机科学 2026-01-12 Kyuwon Kim , Jeanhee Lee , Sung-Eun Kim , Hyo-Jeong So

We survey SoTA open-domain conversational AI models with the purpose of presenting the prevailing challenges that still exist to spur future research. In addition, we provide statistics on the gender of conversational AI in order to guide…

计算与语言 · 计算机科学 2022-05-03 Tosin Adewumi , Foteini Liwicki , Marcus Liwicki

Dialogue systems in the form of chatbots and personal assistants are being increasingly integrated into people's lives. Modern dialogue systems may consider adopting anthropomorphic personas, mimicking societal demographic groups to appear…

计算与语言 · 计算机科学 2021-12-16 Emily Sheng , Josh Arnold , Zhou Yu , Kai-Wei Chang , Nanyun Peng

Realistic user simulation is crucial for training and evaluating multi-turn dialogue systems, yet creating simulators that accurately replicate human behavior remains a significant challenge. An effective simulator must expose the failure…

Powered by advanced Artificial Intelligence (AI) techniques, conversational AI systems, such as ChatGPT and digital assistants like Siri, have been widely deployed in daily life. However, such systems may still produce content containing…

计算与语言 · 计算机科学 2023-05-23 Yuxuan Wan , Wenxuan Wang , Pinjia He , Jiazhen Gu , Haonan Bai , Michael Lyu

State-of-the-art model for zero-shot cross-lingual spoken language understanding performs cross-lingual unsupervised contrastive learning to achieve the label-agnostic semantic alignment between each utterance and its code-switched data.…

计算与语言 · 计算机科学 2024-05-13 Bowen Xing , Ivor W. Tsang

Artificial intelligence (AI) developers are increasingly building language models with warm and empathetic personas that millions of people now use for advice, therapy, and companionship. Here, we show how this creates a significant…

计算与语言 · 计算机科学 2025-07-31 Lujain Ibrahim , Franziska Sofia Hafner , Luc Rocher

Although pre-trained language models show good performance on various natural language processing tasks, they often rely on non-causal features and patterns to determine the outcome. For natural language inference tasks, previous results…

计算与语言 · 计算机科学 2024-10-29 Heerin Yang , Sseung-won Hwang , Jungmin So

Online discussions, panels, talk page edits, etc., often contain harmful conversational content i.e., hate speech, death threats and offensive language, especially towards certain demographic groups. For example, individuals who identify as…

计算与语言 · 计算机科学 2022-07-21 Jamell Dacon , Harry Shomer , Shaylynn Crum-Dacon , Jiliang Tang

Machine learning is being integrated into a growing number of critical systems with far-reaching impacts on society. Unexpected behaviour and unfair decision processes are coming under increasing scrutiny due to this widespread use and its…

机器学习 · 计算机科学 2020-09-02 Pieter Delobelle , Paul Temple , Gilles Perrouin , Benoît Frénay , Patrick Heymans , Bettina Berendt

Communicating in natural language is a powerful tool in multi-agent settings, as it enables independent agents to share information in partially observable settings and allows zero-shot coordination with humans. However, most prior works…

人工智能 · 计算机科学 2025-02-11 Bidipta Sarkar , Warren Xia , C. Karen Liu , Dorsa Sadigh

Legislation and public sentiment throughout the world have promoted fairness metrics, explainability, and interpretability as prescriptions for the responsible development of ethical artificial intelligence systems. Despite the importance…

人工智能 · 计算机科学 2022-03-08 Erick Galinkin

Conversational agents have come increasingly closer to human competence in open-domain dialogue settings; however, such models can reflect insensitive, hurtful, or entirely incoherent viewpoints that erode a user's trust in the moral…

计算与语言 · 计算机科学 2022-04-08 Caleb Ziems , Jane A. Yu , Yi-Chia Wang , Alon Halevy , Diyi Yang