English
Related papers

Related papers: A Framework for Auditing Chatbots for Dialect-Base…

200 papers

In this research, we introduce BEATS, a novel framework for evaluating Bias, Ethics, Fairness, and Factuality in Large Language Models (LLMs). Building upon the BEATS framework, we present a bias benchmark for LLMs that measure performance…

Computation and Language · Computer Science 2025-04-01 Alok Abhishek , Lisa Erickson , Tushar Bandopadhyay

The increasing use of Large Language Models (LLMs) in a large variety of domains has sparked worries about how easily they can perpetuate stereotypes and contribute to the generation of biased content. With a focus on gender and…

Computation and Language · Computer Science 2025-07-28 Gioele Giachino , Marco Rondina , Antonio Vetrò , Riccardo Coppola , Juan Carlos De Martin

Large language models (LLMs) provide a new way to build chatbots by accepting natural language prompts. Yet, it is unclear how to design prompts to power chatbots to carry on naturalistic conversations while pursuing a given goal, such as…

Human-Computer Interaction · Computer Science 2024-05-08 Jing Wei , Sungdong Kim , Hyunhoon Jung , Young-Ho Kim

LLM based chatbots have become central interfaces in technical, educational, and analytical domains, supporting tasks such as code reasoning, problem solving, and information exploration. As these systems scale, sustainability concerns have…

Software Engineering · Computer Science 2025-12-17 Ronnie de Souza Santos , Cleyton Magalhães , Italo Santos

In the evolving landscape of online communication, hate speech detection remains a formidable challenge, further compounded by the diversity of digital platforms. This study investigates the effectiveness and adaptability of pre-trained and…

Computation and Language · Computer Science 2025-05-01 Ahmad Nasir , Aadish Sharma , Kokil Jaidka , Saifuddin Ahmed

As Large Language Models (LLMs) are integrated into various sectors, ensuring their reliability and safety is crucial. This necessitates rigorous probing and auditing to maintain their effectiveness and trustworthiness in practical…

Artificial Intelligence · Computer Science 2024-06-19 Maryam Amirizaniani , Elias Martin , Tanya Roosta , Aman Chadha , Chirag Shah

Efforts have been made to make machines converse like humans in the past few decades. The recent techniques of Large Language Models (LLMs) make it possible to have human-like conversations with machines, but LLM's flaws of lacking…

Logic in Computer Science · Computer Science 2025-02-14 Yankai Zeng

Recent advancements in Artificial Intelligence, particularly in Large Language Models (LLMs), have transformed natural language processing by improving generative capabilities. However, detecting biases embedded within these models remains…

Computation and Language · Computer Science 2025-03-11 Suvendu Mohanty

Patients with schizophrenia often present with cognitive impairments that may hinder their ability to learn about their condition. These individuals could benefit greatly from education platforms that leverage the adaptability of Large…

Computation and Language · Computer Science 2024-10-18 Per Niklas Waaler , Musarrat Hussain , Igor Molchanov , Lars Ailo Bongo , Brita Elvevåg

Large language models (LLMs) like ChatGPT are increasingly used in academic writing, yet issues such as incorrect or fabricated references raise ethical concerns. Moreover, current content quality evaluations often rely on subjective human…

Computation and Language · Computer Science 2025-09-15 Jing Ren , Weiqi Wang

With the rise of individual and collaborative networks of autonomous agents, AI is deployed in more key reasoning and decision-making roles. For this reason, ethics-based audits play a pivotal role in the rapidly growing fields of AI safety…

Computers and Society · Computer Science 2024-02-06 Jon Chun , Katherine Elkins

The escalating demand for personalized AI chatbot interactions, capable of dynamically adapting to user emotional states and real-time requests, has highlighted critical limitations in current development paradigms. Existing methodologies,…

Human-Computer Interaction · Computer Science 2025-10-21 Pooja Rangarajan , Jacob Boyle

The use of large language model (LLM)-powered chatbots, such as ChatGPT, has become popular across various domains, supporting a range of tasks and processes. However, due to the intrinsic complexity of LLMs, effective prompting is more…

Large Language Models (LLMs) have transformed human-computer interaction by enabling natural language-based communication with AI-powered chatbots. These models are designed to be intuitive and user-friendly, allowing users to articulate…

In the rapidly evolving landscape of education, digital technologies have repeatedly disrupted traditional pedagogical methods. This paper explores the latest of these disruptions: the potential integration of large language models (LLMs)…

Computers and Society · Computer Science 2023-12-21 Mahyar Abedi , Ibrahem Alshybani , Muhammad Rubayat Bin Shahadat , Michael S. Murillo

Large Language Models (LLMs) are rapidly entering children's lives - through parent-driven adoption, schools, and peer networks - yet current AI ethics and safety research do not adequately address content-related risks specific to minors.…

Computation and Language · Computer Science 2025-03-14 Shaun Khoo , Gabriel Chua , Rachel Shong

The integration of Large Language Models (LLMs) into chatbot-like search engines poses new challenges for governing, assessing, and scrutinizing the content output by these online entities, especially in light of the Digital Service Act…

Large Language Models (LLMs) push the bound-aries in natural language processing and generative AI, driving progress across various aspects of modern society. Unfortunately, the pervasive issue of bias in LLMs responses (i.e., predictions)…

Computation and Language · Computer Science 2025-05-20 Isabela Pereira Gregio , Ian Pons , Anna Helena Reali Costa , Artur Jordão

People experiencing severe distress increasingly use Large Language Model (LLM) chatbots as mental health support tools. Discussions on social media have described how engagements were lifesaving for some, but evidence suggests that…

Human-Computer Interaction · Computer Science 2025-05-12 Inhwa Song , Sachin R. Pendse , Neha Kumar , Munmun De Choudhury

It is known that large language models (LLMs) underperform in English dialects, and that improving them is difficult due to data scarcity. In this work we investigate how quality and availability impact the feasibility of improving LLMs in…

Computation and Language · Computer Science 2026-03-17 Wei Li , Adrian de Wynter