中文
相关论文

相关论文: Benchmarking Educational LLMs with Analytics: A Ca…

200 篇论文

In recent years, generative artificial intelligence (GenAI) systems have assumed increasingly crucial roles in selection processes, personnel recruitment and analysis of candidates' profiles. However, the employment of large language models…

人工智能 · 计算机科学 2026-03-13 Martina Ullasci , Marco Rondina , Riccardo Coppola , Antonio Vetrò

With the rapid development of large language models (LLMs), they have significantly improved efficiency across a wide range of domains. However, recent studies have revealed that LLMs often exhibit gender bias, leading to serious social…

计算与语言 · 计算机科学 2025-06-17 Xiaoqing Cheng , Hongying Zan , Lulu Kong , Jinwang Song , Min Peng

Large Language Models (LLM) have made significant advances in the recent past becoming more mainstream in Artificial Intelligence (AI) enabled human-facing applications. However, LLMs often generate stereotypical output inherited from…

计算与语言 · 计算机科学 2023-11-27 Wu Zekun , Sahan Bulathwela , Adriano Soares Koshiyama

Recent advances in Generative Artificial Intelligence (GenAI) have transformed educational content creation, particularly in developing tutor training materials. However, biases embedded in AI-generated content--such as gender, racial, or…

计算与语言 · 计算机科学 2025-05-20 Jingyang Peng , Wenyuan Shen , Jiarui Rao , Jionghao Lin

Large Language Models (LLMs) have revolutionized artificial intelligence, demonstrating remarkable computational power and linguistic capabilities. However, these models are inherently prone to various biases stemming from their training…

计算与语言 · 计算机科学 2025-02-14 Riccardo Cantini , Giada Cosenza , Alessio Orsino , Domenico Talia

The widespread integration of Large Language Models (LLMs) across various sectors has highlighted the need for empirical research to understand their biases, thought patterns, and societal implications to ensure ethical and effective use.…

计算与语言 · 计算机科学 2025-05-20 Manari Hirose , Masato Uchida

The integration of large language models (LLMs) on low-power edge devices such as Raspberry Pi, known as edge language models (ELMs), has introduced opportunities for more personalized, secure, and low-latency language intelligence that is…

机器学习 · 计算机科学 2025-02-18 Vinamra Sharma , Danilo Pietro Pau , José Cano

We present the first systematic evaluation examining format bias in performance of large language models (LLMs). Our approach distinguishes between two categories of an evaluation metric under format constraints to reliably and accurately…

计算与语言 · 计算机科学 2025-02-25 Do Xuan Long , Hai Nguyen Ngoc , Tiviatis Sim , Hieu Dao , Shafiq Joty , Kenji Kawaguchi , Nancy F. Chen , Min-Yen Kan

Masculine defaults are widely recognized as a significant type of gender bias, but they are often unseen as they are under-researched. Masculine defaults involve three key parts: (i) the cultural context, (ii) the masculine characteristics…

计算与语言 · 计算机科学 2025-04-16 Maria Teleki , Xiangjue Dong , Haoran Liu , James Caverlee

Large Language Models (LLMs) have made significant strides in Natural Language Processing but remain vulnerable to fairness-related issues, often reflecting biases inherent in their training data. These biases pose risks, particularly when…

计算与语言 · 计算机科学 2025-04-14 Harishwar Reddy , Madhusudan Srinivasan , Upulee Kanewala

The widespread deployment of Large Language Models (LLMs) has intensified concerns about subtle social biases embedded in their outputs. Existing guardrails often fail when faced with indirect or contextually complex bias-inducing prompts.…

软件工程 · 计算机科学 2025-12-02 Sina Salimian , Gias Uddin , Sumon Biswas , Henry Leung

Generative artificial intelligence (AI), particularly large language models (LLMs), is being rapidly deployed in recruitment and for candidate shortlisting. We audit several mid-sized open-source LLMs for gender bias using a dataset of…

综合经济学 · 经济学 2025-05-01 Sugat Chaturvedi , Rochana Chaturvedi

Large language models (LLMs) reflect societal norms and biases, especially about gender. While societal biases and stereotypes have been extensively researched in various NLP applications, there is a surprising gap for emotion analysis.…

计算与语言 · 计算机科学 2024-05-29 Flor Miriam Plaza-del-Arco , Amanda Cercas Curry , Alba Curry , Gavin Abercrombie , Dirk Hovy

One of the central challenges for instructors is offering meaningful individual feedback, especially in large courses. Faced with limited time and resources, educators are often forced to rely on generalized feedback, even when more…

其他统计学 · 统计学 2025-11-07 Markus Herklotz , Niklas Ippisch , Anna-Carolina Haensch

Pre-trained large language models (LLMs) have been reliably integrated with visual input for multimodal tasks. The widespread adoption of instruction-tuned image-to-text vision-language assistants (VLAs) like LLaVA and InternVL necessitates…

计算机与社会 · 计算机科学 2025-03-14 Leander Girrbach , Stephan Alaniz , Yiran Huang , Trevor Darrell , Zeynep Akata

Large language models (LLMs) have demonstrated the ability to generate formative feedback and instructional hints in English, making them increasingly relevant for AI-assisted education. However, their ability to provide effective…

计算与语言 · 计算机科学 2025-06-06 Junior Cedric Tonga , KV Aditya Srivatsa , Kaushal Kumar Maurya , Fajri Koto , Ekaterina Kochmar

Recent advances in AI have catalyzed the adoption of intelligent educational tools, yet many semantic retrieval systems remain ill-suited to the unique linguistic and structural characteristics of academic content. This study presents two…

计算与语言 · 计算机科学 2025-05-09 Ramteja Sajja , Yusuf Sermet , Ibrahim Demir

Recent work in benchmarking bias and fairness in speech large language models (SpeechLLMs) has relied heavily on multiple-choice question answering (MCQA) formats. The model is tasked to choose between stereotypical, anti-stereotypical, or…

计算与语言 · 计算机科学 2026-02-03 Shree Harsha Bokkahalli Satish , Gustav Eje Henter , Éva Székely

As Large Language Models (LLMs) advance, their potential for widespread societal impact grows simultaneously. Hence, rigorous LLM evaluations are both a technical necessity and social imperative. While numerous evaluation benchmarks have…

计算与语言 · 计算机科学 2025-04-22 Jaime Raldua Veuthey , Zainab Ali Majid , Suhas Hariharan , Jacob Haimes

Warning: This paper contains content that may be offensive or upsetting. There has been a significant increase in the usage of large language models (LLMs) in various applications, both in their original form and through fine-tuned…

计算与语言 · 计算机科学 2023-12-12 Jiaxu Zhao , Meng Fang , Shirui Pan , Wenpeng Yin , Mykola Pechenizkiy