English
Related papers

Related papers: Systematic Evaluation of GPT-3 for Zero-Shot Perso…

200 papers

Large Language Models (LLMs) have demonstrated potential in predicting mental health outcomes from online text, yet traditional classification methods often lack interpretability and robustness. This study evaluates structured reasoning…

Computation and Language · Computer Science 2026-01-09 Avinash Patil , Amardeep Kour Gedhu

The growing demand for accessible mental health support, compounded by workforce shortages and logistical barriers, has led to increased interest in utilizing Large Language Models (LLMs) for scalable and real-time assistance. However,…

Human-Computer Interaction · Computer Science 2025-05-27 Ugur Kursuncu , Trilok Padhi , Gaurav Sinha , Abdulkadir Erol , Jaya Krishna Mandivarapu , Christopher R. Larrison

As Large Language Models (LLMs) become widely used to model and simulate human behavior, understanding their biases becomes critical. We developed an experimental framework using Big Five personality surveys and uncovered a previously…

Artificial Intelligence · Computer Science 2024-11-25 Aadesh Salecha , Molly E. Ireland , Shashanka Subrahmanya , João Sedoc , Lyle H. Ungar , Johannes C. Eichstaedt

This paper describes a rapid feasibility study of using GPT-4, a large language model (LLM), to (semi)automate data extraction in systematic reviews. Despite the recent surge of interest in LLMs there is still a lack of understanding of how…

Computation and Language · Computer Science 2025-02-14 Lena Schmidt , Kaitlyn Hair , Sergio Graziosi , Fiona Campbell , Claudia Kapp , Alireza Khanteymoori , Dawn Craig , Mark Engelbert , James Thomas

The quality of texts generated by natural language generation (NLG) systems is hard to measure automatically. Conventional reference-based metrics, such as BLEU and ROUGE, have been shown to have relatively low correlation with human…

Computation and Language · Computer Science 2023-05-25 Yang Liu , Dan Iter , Yichong Xu , Shuohang Wang , Ruochen Xu , Chenguang Zhu

In this paper, we report our experience with several LLMs for their ability to understand a process model in an interactive, conversational style, find syntactical and logical errors in it, and reason with it in depth through a natural…

Artificial Intelligence · Computer Science 2025-10-10 Akhil Kumar , Jianliang Leon Zhao , Om Dobariya

This study investigates the application of large language models (LLMs), specifically GPT-3.5 and GPT-4, with Chain-of-Though (CoT) in the automatic scoring of student-written responses to science assessments. We focused on overcoming the…

Computation and Language · Computer Science 2024-02-20 Gyeong-Geon Lee , Ehsan Latif , Xuansheng Wu , Ninghao Liu , Xiaoming Zhai

Large Language Models (LLMs) have been showing promising results for various NLP-tasks without the explicit need to be trained for these tasks by using few-shot or zero-shot prompting techniques. A common NLP-task is question-answering…

Computation and Language · Computer Science 2024-12-18 Kevin Fischer , Darren Fürst , Sebastian Steindl , Jakob Lindner , Ulrich Schäfer

As Large Language Models (LLMs) continue to gain popularity due to their human-like traits and the intimacy they offer to users, their societal impact inevitably expands. This leads to the rising necessity for comprehensive studies to fully…

Artificial Intelligence · Computer Science 2025-01-07 Bojana Bodroza , Bojana M. Dinic , Ljubisa Bojic

The recent progress in large language models (LLMs), especially the invention of chain-of-thought prompting, has made it possible to automatically answer questions by stepwise reasoning. However, when faced with more complicated problems…

Artificial Intelligence · Computer Science 2023-10-06 Ning Miao , Yee Whye Teh , Tom Rainforth

Large Language Models (LLMs) have demonstrated remarkable zero-shot generalization across various language-related tasks, including search engines. However, existing work utilizes the generative ability of LLMs for Information Retrieval…

Computation and Language · Computer Science 2024-12-31 Weiwei Sun , Lingyong Yan , Xinyu Ma , Shuaiqiang Wang , Pengjie Ren , Zhumin Chen , Dawei Yin , Zhaochun Ren

Background Large language models (LLMs) face challenges in inductive thematic analysis, a task requiring deep interpretive and domain-specific expertise. We evaluated the feasibility of using LLMs to replicate expert-driven thematic…

Artificial Intelligence · Computer Science 2025-10-16 JaMor Hairston , Ritvik Ranjan , Sahithi Lakamana , Anthony Spadaro , Selen Bozkurt , Jeanmarie Perrone , Abeed Sarker

In any system that uses structured knowledge graph (KG) data as its underlying knowledge representation, KG-to-text generation is a useful tool for turning parts of the graph data into text that can be understood by humans. Recent work has…

Computation and Language · Computer Science 2023-08-23 Agnes Axelsson , Gabriel Skantze

The strong few-shot in-context learning capability of large pre-trained language models (PLMs) such as GPT-3 is highly appealing for application domains such as biomedicine, which feature high and diverse demands of language technologies…

Computation and Language · Computer Science 2022-11-08 Bernal Jiménez Gutiérrez , Nikolas McNeal , Clay Washington , You Chen , Lang Li , Huan Sun , Yu Su

Recent advancements in Large Language Models (LLMs) harness linguistic associations in vast natural language data for practical applications. However, their ability to understand the physical world using only language data remains a…

Computation and Language · Computer Science 2023-05-10 Nigel H. Collier , Fangyu Liu , Ehsan Shareghi

Large Language Models are expressive tools that enable complex tasks of text understanding within Computational Social Science. Their versatility, while beneficial, poses a barrier for establishing standardized best practices within the…

Computers and Society · Computer Science 2024-08-05 Anders Giovanni Møller , Luca Maria Aiello

While specialized learning-based models have historically dominated image privacy prediction, the current literature increasingly favours adopting large Vision-Language Models (VLMs) designed for generic tasks. This trend risks overlooking…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Alina Elena Baia , Alessio Xompero , Andrea Cavallaro

Prompting techniques have significantly enhanced the capabilities of Large Language Models (LLMs) across various complex tasks, including reasoning, planning, and solving math word problems. However, most research has predominantly focused…

Computation and Language · Computer Science 2024-05-24 Neisarg Dave , Daniel Kifer , C. Lee Giles , Ankur Mali

The rapid development and deployment of Generative AI in social settings raise important questions about how to optimally personalize them for users while maintaining accuracy and realism. Based on a Facebook public post-comment dataset,…

Computation and Language · Computer Science 2024-10-03 Kristen M. Altenburger , Hongda Jiang , Robert E. Kraut , Yi-Chia Wang , Jane Dwivedi-Yu

With increasing scale, large language models demonstrate both quantitative improvement and new qualitative capabilities, especially as zero-shot learners, like GPT-3. However, these results rely heavily on delicate prompt design and large…

Computation and Language · Computer Science 2022-12-21 Jingjing Xu , Qingxiu Dong , Hongyi Liu , Lei Li