English
Related papers

Related papers: Anticipating Safety Issues in E2E Conversational A…

200 papers

Detecting toxic language including sexism, harassment and abusive behaviour, remains a critical challenge, particularly in its subtle and context-dependent forms. Existing approaches largely focus on isolated message-level classification,…

AI-based systems have been used widely across various industries for different decisions ranging from operational decisions to tactical and strategic ones in low- and high-stakes contexts. Gradually the weaknesses and issues of these…

Human-Computer Interaction · Computer Science 2022-01-13 Morteza Saberi

Organisations generate vast amounts of information, which has resulted in a long-term research effort into knowledge access systems for enterprise settings. Recent developments in artificial intelligence, in relation to large language…

Computers and Society · Computer Science 2024-05-01 Anna Gausen , Bhaskar Mitra , Siân Lindley

Due to the remarkable capabilities and growing impact of large language models (LLMs), they have been deeply integrated into many aspects of society. Thus, ensuring their alignment with human values and intentions has emerged as a critical…

The rapid development and deployment of large language models (LLMs) have introduced a new frontier in artificial intelligence, marked by unprecedented capabilities in natural language understanding and generation. However, the increasing…

Artificial Intelligence · Computer Science 2024-12-25 Dan Shi , Tianhao Shen , Yufei Huang , Zhigen Li , Yongqi Leng , Renren Jin , Chuang Liu , Xinwei Wu , Zishan Guo , Linhao Yu , Ling Shi , Bojian Jiang , Deyi Xiong

Large Language Models (LLMs) are increasingly deployed as agentic systems that plan, memorize, and act in open-world environments. This shift brings new security problems: failures are no longer only unsafe text generation, but can become…

Cryptography and Security · Computer Science 2026-03-03 Zhihang Deng , Jiaping Gui , Weinan Zhang

With the advent of off-the-shelf intelligent home products and broader internet adoption, researchers increasingly explore smart computing applications that provide easier access to health and wellness resources. AI-based systems like…

Human-Computer Interaction · Computer Science 2021-07-29 Lu Wang , Munif Ishad Mujib , Jake Williams , George Demiris , Jina Huh-Yoo

Existing fiducial markers solutions are designed for efficient detection and decoding, however, their ability to stand out in natural environments is difficult to infer from relatively limited analysis. Furthermore, worsening performance in…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 J. Brennan Peace , Eric Psota , Yanfeng Liu , Lance C. Pérez

This paper addresses the problem of end-to-end (E2E) design of learning and communication in a task-oriented semantic communication system. In particular, we consider a multi-device cooperative edge inference system over a wireless…

Information Theory · Computer Science 2024-09-02 Chang Cai , Xiaojun Yuan , Ying-Jun Angela Zhang

Voice agents, artificial intelligence systems that conduct spoken conversations to complete tasks, are increasingly deployed across enterprise applications. However, no existing benchmark jointly addresses two core evaluation challenges:…

In recent years, large language models have been responsible for great advances in the field of artificial intelligence (AI). ChatGPT in particular, an AI chatbot developed and recently released by OpenAI, has taken the field to the next…

Cryptography and Security · Computer Science 2026-04-09 Raphaël Khoury , Anderson R. Avila , Jacob Brunelle , Baba Mamadou Camara

Advanced AI models hold the promise of tremendous benefits for humanity, but society needs to proactively manage the accompanying risks. In this paper, we focus on what we term "frontier AI" models: highly capable foundation models that…

This paper introduces v0.5 of the AI Safety Benchmark, which has been created by the MLCommons AI Safety Working Group. The AI Safety Benchmark has been designed to assess the safety risks of AI systems that use chat-tuned language models.…

Computation and Language · Computer Science 2024-05-15 Bertie Vidgen , Adarsh Agrawal , Ahmed M. Ahmed , Victor Akinwande , Namir Al-Nuaimi , Najla Alfaraj , Elie Alhajjar , Lora Aroyo , Trupti Bavalatti , Max Bartolo , Borhane Blili-Hamelin , Kurt Bollacker , Rishi Bomassani , Marisa Ferrara Boston , Siméon Campos , Kal Chakra , Canyu Chen , Cody Coleman , Zacharie Delpierre Coudert , Leon Derczynski , Debojyoti Dutta , Ian Eisenberg , James Ezick , Heather Frase , Brian Fuller , Ram Gandikota , Agasthya Gangavarapu , Ananya Gangavarapu , James Gealy , Rajat Ghosh , James Goel , Usman Gohar , Sujata Goswami , Scott A. Hale , Wiebke Hutiri , Joseph Marvin Imperial , Surgan Jandial , Nick Judd , Felix Juefei-Xu , Foutse Khomh , Bhavya Kailkhura , Hannah Rose Kirk , Kevin Klyman , Chris Knotz , Michael Kuchnik , Shachi H. Kumar , Srijan Kumar , Chris Lengerich , Bo Li , Zeyi Liao , Eileen Peters Long , Victor Lu , Sarah Luger , Yifan Mai , Priyanka Mary Mammen , Kelvin Manyeki , Sean McGregor , Virendra Mehta , Shafee Mohammed , Emanuel Moss , Lama Nachman , Dinesh Jinenhally Naganna , Amin Nikanjam , Besmira Nushi , Luis Oala , Iftach Orr , Alicia Parrish , Cigdem Patlak , William Pietri , Forough Poursabzi-Sangdeh , Eleonora Presani , Fabrizio Puletti , Paul Röttger , Saurav Sahay , Tim Santos , Nino Scherrer , Alice Schoenauer Sebag , Patrick Schramowski , Abolfazl Shahbazi , Vin Sharma , Xudong Shen , Vamsi Sistla , Leonard Tang , Davide Testuggine , Vithursan Thangarasa , Elizabeth Anne Watkins , Rebecca Weiss , Chris Welty , Tyler Wilbers , Adina Williams , Carole-Jean Wu , Poonam Yadav , Xianjun Yang , Yi Zeng , Wenhui Zhang , Fedor Zhdanov , Jiacheng Zhu , Percy Liang , Peter Mattson , Joaquin Vanschoren

The proliferation of Large Language Models (LLMs) and Intelligent Virtual Agents acting as psychotherapists presents significant opportunities for expanding mental healthcare access. However, their deployment has also been linked to serious…

Computation and Language · Computer Science 2025-09-23 Ian Steenstra , Timothy W. Bickmore

Intelligent Conversational Agent development using Artificial Intelligence or Machine Learning technique is an interesting problem in the field of Natural Language Processing. With the rise of deep learning, these models were quickly…

Computation and Language · Computer Science 2020-06-05 Abonia Sojasingarayar

As AI systems advance in capabilities, measuring their safety and alignment to human values is becoming paramount. A fast-growing field of AI research is devoted to developing such assessments. However, most current advances therein may be…

Computers and Society · Computer Science 2026-03-17 Max Hellrigel-Holderbaum , Edward James Young

Current dialogue systems are not very engaging for users, especially when trained end-to-end without relying on proactive reengaging scripted strategies. Zhang et al. (2018) showed that the engagement level of end-to-end dialogue models…

Computation and Language · Computer Science 2018-09-07 Pierre-Emmanuel Mazaré , Samuel Humeau , Martin Raison , Antoine Bordes

Despite the increasing research interest in end-to-end learning systems for speech emotion recognition, conventional systems either suffer from the overfitting due in part to the limited training data, or do not explicitly consider the…

Computation and Language · Computer Science 2019-04-01 Zixing Zhang , Bingwen Wu , Bjoern Schuller

AI safety is a rapidly growing area of research that seeks to prevent the harm and misuse of frontier AI technology, particularly with respect to generative AI (GenAI) tools that are capable of creating realistic and high-quality content…

Artificial Intelligence · Computer Science 2025-02-19 Pin-Yu Chen