English
Related papers

Related papers: Fooling LLM graders into giving better grades thro…

200 papers

Large Language Models (LLMs) are increasingly trusted to perform automated code review and static analysis at scale, supporting tasks such as vulnerability detection, summarization, and refactoring. In this paper, we identify and exploit a…

Machine Learning · Computer Science 2025-12-19 Shir Bernstein , David Beste , Daniel Ayzenshteyn , Lea Schonherr , Yisroel Mirsky

Large Language Models (LLMs) offer a promising approach to enhancing Explainable AI (XAI) by transforming complex machine learning outputs into easy-to-understand narratives, making model predictions more accessible to users, and helping…

Artificial Intelligence · Computer Science 2025-04-02 Ahsan Bilal , David Ebert , Beiyu Lin

The widespread deployment of Large Language Models (LLMs) has intensified concerns about subtle social biases embedded in their outputs. Existing guardrails often fail when faced with indirect or contextually complex bias-inducing prompts.…

Software Engineering · Computer Science 2025-12-02 Sina Salimian , Gias Uddin , Sumon Biswas , Henry Leung

The emergence of Large Language Models (LLMs), has opened exciting possibilities for constructing computational simulations designed to replicate human behavior accurately. Current research suggests that LLM-based agents become increasingly…

Computation and Language · Computer Science 2024-12-18 Amir Taubenfeld , Yaniv Dover , Roi Reichart , Ariel Goldstein

The landscape of education is changing rapidly, shaped by emerging pedagogical approaches, technological innovations such as artificial intelligence (AI), and evolving societal expectations, all of which demand thorough evaluation of new…

Computers and Society · Computer Science 2026-03-19 Fiammetta Caccavale , Carina L. Gargalo , Julian Kager , Magdalena Skowyra , Steen Larsen , Krist V. Gernaey , Ulrich Krühne

While natural-language explanations from large language models (LLMs) are widely adopted to improve transparency and trust, their impact on objective human-AI team performance remains poorly understood. We identify a Persuasion Paradox:…

Human-Computer Interaction · Computer Science 2026-04-07 Ruth Cohen , Lu Feng , Ayala Bloch , Sarit Kraus

We present an experimental methodology for investigating how large language models (LLMs) respond to descriptions of their own internal processing patterns. Using a paired-choice paradigm, we tested 12 LLMs on their ability to identify…

Human-Computer Interaction · Computer Science 2025-10-28 Annika Hedberg

Automatic reviewing helps handle a large volume of papers, provides early feedback and quality control, reduces bias, and allows the analysis of trends. We evaluate the alignment of automatic paper reviews with human reviews using an arena…

Generative artificial intelligence (AI) has the potential to scale up personalized tutoring through large language models (LLMs). Recent AI tutors are adapted for the tutoring task by training or prompting LLMs to follow effective…

Computation and Language · Computer Science 2025-07-30 Alexander Scarlatos , Naiming Liu , Jaewook Lee , Richard Baraniuk , Andrew Lan

While artificial intelligence (AI) technology is becoming increasingly popular, its underlying mechanisms tend to remain opaque to most people. To address this gap, the field of AI literacy aims to develop various resources to teach people…

Computers and Society · Computer Science 2026-03-31 Allison Chen , Isabella Pu

As large language models (LLMs) achieve advanced persuasive capabilities, concerns about their potential risks have grown. The EU AI Act prohibits AI systems that use manipulative or deceptive techniques to undermine informed…

Computers and Society · Computer Science 2025-05-20 Haein Kong

Artificial Intelligence (AI) has been used extensively in automatic decision making in a broad variety of scenarios, ranging from credit ratings for loans to recommendations of movies. Traditional design guidelines for AI models focus…

Artificial Intelligence · Computer Science 2018-09-27 Marisa Vasconcelos , Carlos Cardonha , Bernardo Gonçalves

Large Language Models (LLMs) are widely used in Automated Essay Scoring (AES) due to their ability to capture semantic meaning. Traditional fine-tuning approaches required technical expertise, limiting accessibility for educators with…

Computation and Language · Computer Science 2025-05-01 Kaixun Yang , Mladen Raković , Dragan Gašević , Guanliang Chen

This study investigates whether large language models (LLMs) can function as intelligent collaborators to bridge expertise gaps in cybersecurity decision-making. We examine two representative tasks-phishing email detection and intrusion…

Cryptography and Security · Computer Science 2025-05-07 Shahroz Tariq , Ronal Singh , Mohan Baruwal Chhetri , Surya Nepal , Cecile Paris

As large language models (LLMs) have been deployed in various real-world settings, concerns about the harm they may propagate have grown. Various jailbreaking techniques have been developed to expose the vulnerabilities of these models and…

Computation and Language · Computer Science 2025-02-19 Yubin Ge , Neeraja Kirtane , Hao Peng , Dilek Hakkani-Tür

As students increasingly rely on large language models, hallucinations pose a growing threat to learning. To mitigate this, AI literacy must expand beyond prompt engineering to address how students should detect and respond to LLM…

Human-Computer Interaction · Computer Science 2026-02-23 Abdulhadi Shoufan , Ahmad-Azmi-Abdelhamid Esmaeil

Large language models (LLMs) have demonstrated impressive capabilities in various tasks using the in-context learning (ICL) paradigm. However, their effectiveness is often compromised by inherent bias, leading to prompt brittleness, i.e.,…

Computation and Language · Computer Science 2024-12-13 Hanzhang Zhou , Zijian Feng , Zixiao Zhu , Junlang Qian , Kezhi Mao

Self-evaluation using large language models (LLMs) has proven valuable not only in benchmarking but also methods like reward modeling, constitutional AI, and self-refinement. But new biases are introduced due to the same LLM acting as both…

Computation and Language · Computer Science 2024-04-23 Arjun Panickssery , Samuel R. Bowman , Shi Feng

Large language models (LLMs) are increasingly integral to information retrieval (IR), powering ranking, evaluation, and AI-assisted content creation. This widespread adoption necessitates a critical examination of potential biases arising…

Information Retrieval · Computer Science 2025-07-11 Krisztian Balog , Donald Metzler , Zhen Qin

Current large language models (LLMs) provide a strong foundation for large-scale user-oriented natural language tasks. A large number of users can easily inject adversarial text or instructions through the user interface, thus causing LLMs…

Cryptography and Security · Computer Science 2024-11-12 Chong Zhang , Mingyu Jin , Qinkai Yu , Chengzhi Liu , Haochen Xue , Xiaobo Jin