English
Related papers

Related papers: Evaluating Machine Expertise: How Graduate Student…

200 papers

To improve the performance of large language models (LLMs), researchers have explored providing LLMs with textual task-solving experience via prompts. However, they rely on manual efforts to acquire and apply such experience for each task,…

Computation and Language · Computer Science 2024-07-15 Jinglong Gao , Xiao Ding , Yiming Cui , Jianbai Zhao , Hepeng Wang , Ting Liu , Bing Qin

The rapid evolution of artificial intelligence (AI), especially in the domain of Large Language Models (LLMs) and generative AI, has opened new avenues for application across various fields, yet its role in business education remains…

Computation and Language · Computer Science 2024-01-09 Vahid Ashrafimoghari , Necdet Gürkan , Jordan W. Suchow

Multi-purpose Large Language Models (LLMs), a subset of generative Artificial Intelligence (AI), have recently made significant progress. While expectations for LLMs to assist systems engineering (SE) tasks are paramount; the…

Computation and Language · Computer Science 2025-02-17 Taylan G. Topcu , Mohammed Husain , Max Ofsa , Paul Wach

Self-evaluation using large language models (LLMs) has proven valuable not only in benchmarking but also methods like reward modeling, constitutional AI, and self-refinement. But new biases are introduced due to the same LLM acting as both…

Computation and Language · Computer Science 2024-04-23 Arjun Panickssery , Samuel R. Bowman , Shi Feng

Large Language Models (LLMs) have shown impressive performance across a variety of Artificial Intelligence (AI) and natural language processing tasks, such as content creation, report generation, etc. However, unregulated malign application…

Computation and Language · Computer Science 2023-09-15 Harika Abburi , Michael Suesserman , Nirmala Pudota , Balaji Veeramani , Edward Bowen , Sanmitra Bhattacharya

The rising adoption of generative AI/ML technologies increases the need to support teens in developing AI/ML literacies. Child-computer interaction research argues that construction activities can support young people in understanding these…

Human-Computer Interaction · Computer Science 2026-04-17 Luis Morales-Navarro , Daniel J. Noh , Lucianne Servat , Carly Netting , Yasmin B. Kafai , Danaé Metaxa

Novelty is a crucial criterion in the peer review process for evaluating academic papers. Traditionally, it's judged by experts or measure by unique reference combinations. Both methods have limitations: experts have limited knowledge, and…

Computation and Language · Computer Science 2025-07-17 Wenqing Wu , Chengzhi Zhang , Yi Zhao

In the post-Turing era, evaluating large language models (LLMs) involves assessing generated text based on readers' reactions rather than merely its indistinguishability from human-produced content. This paper explores how LLM-generated…

Computational Engineering, Finance, and Science · Computer Science 2024-11-26 Takehiro Takayanagi , Hiroya Takamura , Kiyoshi Izumi , Chung-Chi Chen

Investigation of students' perceptions and opinions on the use of generative artificial intelligence (GenAI) in education is a topic gaining much interest. Studies addressing this are typically conducted with large heterogeneous groups, at…

This research prepares an automatic pipeline for generating reliable question-answer (Q&A) tests using AI chatbots. We automatically generated a GPT-4o-mini-based Q&A test for a Natural Language Processing course and evaluated its…

Computation and Language · Computer Science 2025-08-08 Anna Wróblewska , Bartosz Grabek , Jakub Świstak , Daniel Dan

This project examines the prospect of using AI-generated feedback as suggestions to expedite and enhance human instructors' feedback provision. In particular, we focus on understanding the teaching assistants' perspectives on the quality of…

Human-Computer Interaction · Computer Science 2025-05-22 Xinyi Lu , Aditya Mahesh , Zejia Shen , Mitchell Dudley , Larissa Sano , Xu Wang

Writing literature reviews is a common component of university curricula, yet it often poses challenges for students. Since generative artificial intelligence (GenAI) tools have been made publicly accessible, students have been employing…

Computers and Society · Computer Science 2025-09-09 Aminul Islam , Mukta Bansal , Lena Felix Stephanie , Poernomo Gunawan , Pui Tze Sian , Sabrina Luk , Eunice Tan , Hortense Le Ferrand

Online education platforms have experienced explosive growth over the past decade, generating massive volumes of user-generated content in the form of reviews, ratings, and behavioral logs. These heterogeneous signals provide unprecedented…

Graphics · Computer Science 2026-04-14 Arman Bekov , Azamat Nurgali

This paper presents an AI-generated review of Vision-Language-Action (VLA) models, summarizing key methodologies, findings, and future directions. The content is produced using large language models (LLMs) and is intended only for…

Numerous studies have assessed the proficiency of AI systems, particularly large language models (LLMs), in facilitating everyday tasks such as email writing, question answering, and creative content generation. However, researchers face…

Generative artificial intelligence (GAI), specifically large language models (LLMs), are increasingly used in software engineering, mainly for coding tasks. However, requirements engineering - particularly requirements validation - has seen…

Software Engineering · Computer Science 2026-02-10 Adam Trendowicz , Daniel Seifert , Andreas Jedlitschka , Marcus Ciolkowski , Anton Strahilov

The adoption of generative AI in education has accelerated dramatically in recent years, with Large Language Models (LLMs) increasingly integrated into learning environments in the hope of providing personalized support that enhances…

Computers and Society · Computer Science 2026-02-06 Johaun Hatchett , Debshila Basu Mallick , Brittany C. Bradford , Richard G. Baraniuk

The integration of generative AI (GenAI) tools, particularly large language models (LLMs), is transforming professional coaching workflows. This study explores how coaches use GenAI, the perceived benefits and limitations of these tools,…

Human-Computer Interaction · Computer Science 2025-02-21 Jennifer Haase

Artificial Intelligence (AI) / Machine Learning (ML)-based systems are widely sought-after commercial solutions that can automate and augment core business services. Intelligent systems can improve the quality of services offered and…

Machine Learning · Computer Science 2021-03-26 Akriti Chadda , Kelly Song , Raman Chandrasekar , Ian Gorton

Recent advancements in artificial intelligence (AI) are fundamentally reshaping computing, with large language models (LLMs) now effectively being able to generate and interpret source code and natural language instructions. These emergent…