English
Related papers

Related papers: Large Language Model Psychometrics: A Systematic R…

200 papers

Large Language Models (LLMs) have demonstrated exceptional capabilities in solving various tasks, progressively evolving into general-purpose assistants. The increasing integration of LLMs into society has sparked interest in whether they…

Computation and Language · Computer Science 2025-10-20 Yuan Li , Yue Huang , Hongyi Wang , Ying Cheng , Xiangliang Zhang , James Zou , Lichao Sun

This paper explores the frontiers of large language models (LLMs) in psychology applications. Psychology has undergone several theoretical changes, and the current use of Artificial Intelligence (AI) and Machine Learning, particularly LLMs,…

Machine Learning · Computer Science 2025-07-15 Luoma Ke , Song Tong , Peng Cheng , Kaiping Peng

As large language models (LLMs) are increasingly used in human-centered tasks, assessing their psychological traits is crucial for understanding their social impact and ensuring trustworthy AI alignment. While existing reviews have covered…

Computers and Society · Computer Science 2025-05-02 Wenhan Dong , Yuemeng Zhao , Zhen Sun , Yule Liu , Zifan Peng , Jingyi Zheng , Zongmin Zhang , Ziyi Zhang , Jun Wu , Ruiming Wang , Shengmin Xu , Xinyi Huang , Xinlei He

Large language models (LLMs) are gaining increasing popularity in both academia and industry, owing to their unprecedented performance in various applications. As LLMs continue to play a vital role in both research and daily use, their…

Computation and Language · Computer Science 2024-01-01 Yupeng Chang , Xu Wang , Jindong Wang , Yuan Wu , Linyi Yang , Kaijie Zhu , Hao Chen , Xiaoyuan Yi , Cunxiang Wang , Yidong Wang , Wei Ye , Yue Zhang , Yi Chang , Philip S. Yu , Qiang Yang , Xing Xie

With generative artificial intelligence (AI), particularly large language models (LLMs), continuing to make inroads in healthcare, it is critical to supplement traditional automated evaluations with human evaluations. Understanding and…

As large language models (LLMs) continue to evolve, the need for robust and standardized evaluation benchmarks becomes paramount. Evaluating the performance of these models is a complex challenge that requires careful consideration of…

Artificial Intelligence · Computer Science 2024-08-01 Marco AF Pimentel , Clément Christophe , Tathagata Raha , Prateek Munjal , Praveen K Kanithi , Shadab Khan

The exponential growth of text-based data in domains such as healthcare, education, and social sciences has outpaced the capacity of traditional qualitative analysis methods, which are time-intensive and prone to subjectivity. Large…

The rapid rise in popularity of Large Language Models (LLMs) with emerging capabilities has spurred public curiosity to evaluate and compare different LLMs, leading many researchers to propose their own LLM benchmarks. Noticing preliminary…

Artificial Intelligence · Computer Science 2025-05-15 Timothy R. McIntosh , Teo Susnjak , Nalin Arachchilage , Tong Liu , Paul Watters , Malka N. Halgamuge

The era of large language models (LLM) raises questions not only about how to train models, but also about how to evaluate them. Despite numerous existing benchmarks, insufficient attention is often given to creating assessments that test…

Natural Language Processing (NLP) is witnessing a remarkable breakthrough driven by the success of Large Language Models (LLMs). LLMs have gained significant attention across academia and industry for their versatile applications in text…

Computation and Language · Computer Science 2024-04-16 Taojun Hu , Xiao-Hua Zhou

The rapid evolution of large language models (LLMs) and their capacity to simulate human cognition and behavior has given rise to LLM-based frameworks and tools that are evaluated and applied based on their ability to perform tasks…

Computation and Language · Computer Science 2024-12-03 Jing Yi Wang , Nicholas Sukiennik , Tong Li , Weikang Su , Qianyue Hao , Jingbo Xu , Zihan Huang , Fengli Xu , Yong Li

The rapid development of large language models (LLMs) has necessitated the creation of benchmarks to evaluate their performance. These benchmarks resemble human tests and surveys, as they consist of sets of questions designed to measure…

Computation and Language · Computer Science 2025-01-30 Denis Federiakin

This critical review provides an in-depth analysis of Large Language Models (LLMs), encompassing their foundational principles, diverse applications, and advanced training methodologies. We critically examine the evolution from Recurrent…

Artificial Intelligence · Computer Science 2025-09-29 Milad Moradi , Ke Yan , David Colwell , Matthias Samwald , Rhona Asgari

Recent years have witnessed remarkable progress made in large language models (LLMs). Such advancements, while garnering significant attention, have concurrently elicited various concerns. The potential of these models is undeniably vast;…

Computation and Language · Computer Science 2023-09-27 Tianhao Shen , Renren Jin , Yufei Huang , Chuang Liu , Weilong Dong , Zishan Guo , Xinwei Wu , Yan Liu , Deyi Xiong

Large Language Models (LLMs) have achieved remarkable results on a range of standardized tests originally designed to assess human cognitive and psychological traits, such as intelligence and personality. While these results are often…

Machine Learning · Computer Science 2026-05-12 Tom Sühr , Florian E. Dorner , Olawale Salaudeen , Augustin Kelava , Samira Samadi

Language is essentially a complex, intricate system of human expressions governed by grammatical rules. It poses a significant challenge to develop capable AI algorithms for comprehending and grasping a language. As a major approach,…

Large Language Models (LLMs) are transforming diverse fields and gaining increasing influence as human proxies. This development underscores the urgent need for evaluating value orientations and understanding of LLMs to ensure their…

Computation and Language · Computer Science 2024-06-07 Yuanyi Ren , Haoran Ye , Hanjun Fang , Xin Zhang , Guojie Song

The immense number of parameters and deep neural networks make large language models (LLMs) rival the complexity of human brains, which also makes them opaque ``black box'' systems that are challenging to evaluate and interpret. AI…

Artificial Intelligence · Computer Science 2026-03-16 Yibai Li , Xiaolin Lin , Zhenghui Sha , Zhiye Jin , Xiaobing Li

Large Language Models (LLMs) have recently gained significant attention due to their remarkable capabilities in performing diverse tasks across various domains. However, a thorough evaluation of these models is crucial before deploying them…

Human values and their measurement are long-standing interdisciplinary inquiry. Recent advances in AI have sparked renewed interest in this area, with large language models (LLMs) emerging as both tools and subjects of value measurement.…

Computation and Language · Computer Science 2025-03-07 Haoran Ye , Yuhang Xie , Yuanyi Ren , Hanjun Fang , Xin Zhang , Guojie Song
‹ Prev 1 2 3 10 Next ›