中文
相关论文

相关论文: DICES Dataset: Diversity in Conversational AI Eval…

200 篇论文

State-of-the-art conversational AI systems raise concerns due to their potential risks of generating unsafe, toxic, unethical, or dangerous content. Previous works have developed datasets to teach conversational agents the appropriate…

计算与语言 · 计算机科学 2024-02-02 Souvik Das , Rohini K. Srihari

This paper introduces a conversational interface system that enables participatory design of differentially private AI systems in public sector applications. Addressing the challenge of balancing mathematical privacy guarantees with…

信息论 · 计算机科学 2025-05-28 Wenjun Yang , Eyhab Al-Masri

The amount and dissemination rate of media content accessible online is nowadays overwhelming. Recommender Systems filter this information into manageable streams or feeds, adapted to our personal needs or preferences. It is of utter…

信息检索 · 计算机科学 2023-09-08 Lorenzo Porcaro , João Vinagre , Pedro Frau , Isabelle Hupont , Emilia Gómez

Artificial Intelligence (AI) has made its way into various scientific fields, providing astonishing improvements over existing algorithms for a wide variety of tasks. In recent years, there have been severe concerns over the trustworthiness…

Current research in machine learning and artificial intelligence is largely centered on modeling and performance evaluation, less so on data collection. However, recent research demonstrated that limitations and biases in data may…

人工智能 · 计算机科学 2025-02-18 Eleonora Mancini , Ana Tanevska , Andrea Galassi , Alessio Galatolo , Federico Ruggeri , Paolo Torroni

AI-generated faces have enriched human life, such as entertainment, education, and art. However, they also pose misuse risks. Therefore, detecting AI-generated faces becomes crucial, yet current detectors show biased performance across…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Li Lin , Santosh , Mingyang Wu , Xin Wang , Shu Hu

Despite the extensive communication benefits offered by social media platforms, numerous challenges must be addressed to ensure user safety. One of the most significant risks faced by users on these platforms is targeted hate speech. Social…

计算与语言 · 计算机科学 2024-07-18 Sadar Jaf , Basel Barakat

Recent progress in generative AI, primarily through diffusion models, presents significant challenges for real-world deepfake detection. The increased realism in image details, diverse content, and widespread accessibility to the general…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Chaitali Bhattacharyya , Hanxiao Wang , Feng Zhang , Sungho Kim , Xiatian Zhu

The field of conversational information seeking, which is rapidly gaining interest in both academia and industry, is changing how we interact with search engines through natural language interactions. Existing datasets and methods are…

信息检索 · 计算机科学 2024-05-13 Chris Samarinas , Hamed Zamani

The evaluation of fairness in machine learning systems has become a central concern in high-stakes applications, including biometric recognition, healthcare decision-making, and automated risk assessment. Existing approaches typically rely…

机器学习 · 计算机科学 2026-05-21 Khalid Adnan Alsayed

Algorithms and technologies are essential tools that pervade all aspects of our daily lives. In the last decades, health care research benefited from new computer-based recruiting methods, the use of federated architectures for data…

计算机与社会 · 计算机科学 2023-01-26 Chiara Criscuolo , Tommaso Dolci , Mattia Salnitri

Instruction-tuned language models increasingly rely on large multi-turn dialogue corpora, but these datasets are often noisy and structurally inconsistent, with topic drift, repetitive chitchat, and mismatched answer formats across turns.…

计算与语言 · 计算机科学 2026-04-21 Bo Li , Shikun Zhang , Wei Ye

We aim to select data subsets for the fine-tuning of large language models to more effectively follow instructions. Prior work has emphasized the importance of diversity in dataset curation but relied on heuristics such as the number of…

机器学习 · 计算机科学 2024-02-07 Peiqi Wang , Yikang Shen , Zhen Guo , Matthew Stallone , Yoon Kim , Polina Golland , Rameswar Panda

The subject of "fairness" in artificial intelligence (AI) refers to assessing AI algorithms for potential bias based on demographic characteristics such as race and gender, and the development of algorithms to address this bias. Most…

计算机视觉与模式识别 · 计算机科学 2021-07-02 Esther Puyol-Anton , Bram Ruijsink , Stefan K. Piechnik , Stefan Neubauer , Steffen E. Petersen , Reza Razavi , Andrew P. King

Sharing ideas through communication with peers is the primary mode of human interaction. Consequently, extensive research has been conducted in the area of conversational AI, leading to an increase in the availability and diversity of…

计算与语言 · 计算机科学 2024-05-24 Shivani Kumar , Sumit Bhatia , Milan Aggarwal , Tanmoy Chakraborty

As AI becomes prevalent in high-risk domains and decision-making, it is essential to test for potential harms and biases. This urgency is reflected by the global emergence of AI regulations that emphasise fairness and adequate testing, with…

机器学习 · 计算机科学 2025-07-25 Varsha Ramineni , Hossein A. Rahmani , Emine Yilmaz , David Barber

Large Language Model (LLM) safety is inherently pluralistic, reflecting variations in moral norms, cultural expectations, and demographic contexts. Yet, existing alignment datasets such as ANTHROPIC-HH and DICES rely on demographically…

计算与语言 · 计算机科学 2026-02-10 Usman Naseem , Gautam Siddharth Kashyap , Sushant Kumar Ray , Rafiq Ali , Ebad Shabbir , Abdullah Mohammad

Deepfakes represent a growing concern across domains such as disinformation, fraud, and non-consensual media. In particular, the rise of video conference and identity-driven attacks in high-stakes scenarios--such as impostor hiring--demands…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Sarah Barrington , Maty Bohacek , Hany Farid

Powered by advanced Artificial Intelligence (AI) techniques, conversational AI systems, such as ChatGPT and digital assistants like Siri, have been widely deployed in daily life. However, such systems may still produce content containing…

计算与语言 · 计算机科学 2023-05-23 Yuxuan Wan , Wenxuan Wang , Pinjia He , Jiazhen Gu , Haonan Bai , Michael Lyu

Dataset integrity is fundamental to the safety and reliability of AI systems, especially in autonomous driving. This paper presents a structured framework for developing safe datasets aligned with ISO/PAS 8800 guidelines. Using AI-based…

人工智能 · 计算机科学 2026-04-15 Alireza Abbaspour , Tejaskumar Balgonda Patil , B Ravi Kiran , Russel Mohr , Senthil Yogamani