English
Related papers

Related papers: Evaluating Large Language Models for automatic ana…

200 papers

Large language models (LLMs) use pretraining to predict the subsequent word; however, their expansion requires significant computing resources. Numerous big tech companies and research institutes have developed multilingual LLMs (MLLMs) to…

Large language models have increasingly been proposed as a powerful replacement for classical agent-based models (ABMs) to simulate social dynamics. By using LLMs as a proxy for human behavior, the hope of this new approach is to be able to…

Computers and Society · Computer Science 2024-12-09 Da Ju , Adina Williams , Brian Karrer , Maximilian Nickel

Active learning is designed to minimize annotation efforts by prioritizing instances that most enhance learning. However, many active learning strategies struggle with a `cold-start' problem, needing substantial initial data to be…

Computation and Language · Computer Science 2026-01-14 Markus Bayer , Justin Lutz , Christian Reuter

Language models have steadily increased in size over the past few years. They achieve a high level of performance on various natural language processing (NLP) tasks such as question answering and summarization. Large language models (LLMs)…

Computation and Language · Computer Science 2023-01-31 Jessica Huynh , Cathy Jiao , Prakhar Gupta , Shikib Mehri , Payal Bajaj , Vishrav Chaudhary , Maxine Eskenazi

Large Language Models (LLMs) are demonstrating outstanding potential for tasks such as text generation, summarization, and classification. Given that such models are trained on a humongous amount of online knowledge, we hypothesize that…

Software Engineering · Computer Science 2024-03-18 Jiahui Wu , Chengjie Lu , Aitor Arrieta , Tao Yue , Shaukat Ali

This paper investigates the performance of the Large Language Models (LLMs) ChatGPT-3.5 and GPT-4 in solving introductory programming tasks. Based on the performance, implications for didactic scenarios and assessment formats utilizing LLMs…

Software Engineering · Computer Science 2023-08-21 Natalie Kiesler , Daniel Schiffner

As Large-Scale Language Models (LLMs) continue to evolve, they demonstrate significant enhancements in performance and an expansion of functionalities, impacting various domains, including education. In this study, we conducted interviews…

Human-Computer Interaction · Computer Science 2024-07-18 He Zhang , Jingyi Xie , Chuhao Wu , Jie Cai , ChanMin Kim , John M. Carroll

Large language models (LLMs) are increasingly being used in a zero-shot fashion to assess mental health conditions, yet we have limited knowledge on what factors affect their accuracy. In this study, we utilize a clinical dataset of natural…

This study examines how Large Language Models (LLMs) perform when tackling quantitative management decision problems in a zero-shot setting. Drawing on 900 responses generated by five leading models across 20 diverse managerial scenarios,…

Computation and Language · Computer Science 2025-02-25 Jonathan Kuzmanko

Qualitative analysis of textual contents unpacks rich and valuable information by assigning labels to the data. However, this process is often labor-intensive, particularly when working with large datasets. While recent AI-based tools…

Computation and Language · Computer Science 2023-04-24 Ziang Xiao , Xingdi Yuan , Q. Vera Liao , Rania Abdelghani , Pierre-Yves Oudeyer

While Machine Learning (ML) and Deep Learning (DL) models have been widely used for diabetes prediction, the use of Large Language Models (LLMs) for structured numerical data is still not well explored. In this study, we test the…

Computation and Language · Computer Science 2025-06-19 Shadman Sakib , Oishy Fatema Akhand , Ajwad Abrar

Students in computing education increasingly use large language models (LLMs) such as ChatGPT. Yet, the role of LLMs in supporting cognitively demanding tasks, like deductive program verification, remains poorly understood. This paper…

Software Engineering · Computer Science 2025-09-09 Carolina Carreira , Álvaro Silva , Alexandre Abreu , Alexandra Mendes

Transformer models have achieved state-of-the-art results, with Large Language Models (LLMs), an evolution of first-generation transformers (1stTR), being considered the cutting edge in several NLP tasks. However, the literature has yet to…

Computation and Language · Computer Science 2024-08-20 Claudio M. V. de Andrade , Washington Cunha , Davi Reis , Adriana Silvina Pagano , Leonardo Rocha , Marcos André Gonçalves

This study investigates the application effectiveness of the Large Language Model (LLMs) ChatGLM in the automated generation of high school information technology exam questions. Through meticulously designed prompt engineering strategies,…

Computers and Society · Computer Science 2024-08-22 Yanxin Chen , Ling He

Large Language Models (LLMs) are highly vulnerable to input perturbations, as even a small prompt change may result in a substantially different output. Existing methods to enhance LLM robustness are primarily focused on perturbed data…

Computation and Language · Computer Science 2025-04-04 Aryan Agrawal , Lisa Alazraki , Shahin Honarvar , Marek Rei

We propose to utilize an instruction-tuned large language model (LLM) for guiding the text generation process in automatic speech recognition (ASR). Modern large language models (LLMs) are adept at performing various text generation tasks…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-08 Yosuke Higuchi , Tetsuji Ogawa , Tetsunori Kobayashi

We investigate the use of Large Language Models (LLMs) for zero-shot prediction of Ryff Psychological Well-Being (PWB) scores from spontaneous speech. Using a few minutes of voice recordings from 111 participants in the PsyVoiD database, we…

Computation and Language · Computer Science 2026-05-13 Erfan Loweimi , Sofia de la Fuente Garcia , Saturnino Luz

Decoder-only LLMs have shown impressive performance in MT due to their ability to learn from extensive datasets and generate high-quality translations. However, LLMs often struggle with the nuances and style required for…

Computation and Language · Computer Science 2024-09-11 Inacio Vieira , Will Allred , Séamus Lankford , Sheila Castilho , Andy Way

This study investigates the design, development, and evaluation of a Large Language Model (LLM)-based chatbot for teaching English conversations in an English as a Foreign Language (EFL) context. Employing the Design and Development…

Human-Computer Interaction · Computer Science 2024-09-10 Jaekwon Park , Jiyoung Bae , Unggi Lee , Taekyung Ahn , Sookbun Lee , Dohee Kim , Aram Choi , Yeil Jeong , Jewoong Moon , Hyeoncheol Kim

Despite the many advances of Large Language Models (LLMs) and their unprecedented rapid evolution, their impact and integration into every facet of our daily lives is limited due to various reasons. One critical factor hindering their…

Computation and Language · Computer Science 2024-08-20 Yakir Yehuda , Itzik Malkiel , Oren Barkan , Jonathan Weill , Royi Ronen , Noam Koenigstein