English
Related papers

Related papers: Evaluate What You Can't Evaluate: Unassessable Qua…

200 papers

Large language models (LLMs) can solve problems step-by-step. While this chain-of-thought (CoT) reasoning boosts LLMs' performance, it is unclear if LLMs \textit{know} when to use CoT and whether those CoT are always necessary to answer the…

Computation and Language · Computer Science 2024-03-21 Cheng-Han Chiang , Hung-yi Lee

Evaluating the output of generative large language models (LLMs) is challenging and difficult to scale. Many evaluations of LLMs focus on tasks such as single-choice question-answering or text classification. These tasks are not suitable…

Information Retrieval · Computer Science 2025-01-20 Sebastian Heineking , Jonas Probst , Daniel Steinbach , Martin Potthast , Harrisen Scells

Large Language Models (LLMs) have emerged as influential instruments within the realm of natural language processing; nevertheless, their capacity to handle multi-party conversations (MPCs) -- a scenario marked by the presence of multiple…

Computation and Language · Computer Science 2023-10-26 Chao-Hong Tan , Jia-Chen Gu , Zhen-Hua Ling

Using large language models (LLMs) to evaluate text quality has recently gained popularity. Some prior works explore the idea of using LLMs for evaluation, while they differ in some details of the evaluation process. In this paper, we…

Computation and Language · Computer Science 2023-10-10 Cheng-Han Chiang , Hung-yi Lee

Large Language Models (LLMs) have demonstrated impressive capabilities across various domains, prompting a surge in their practical applications. However, concerns have arisen regarding the trustworthiness of LLMs outputs, particularly in…

Computation and Language · Computer Science 2024-05-08 Danna Zheng , Danyang Liu , Mirella Lapata , Jeff Z. Pan

Critique ability, i.e., the capability of Large Language Models (LLMs) to identify and rectify flaws in responses, is crucial for their applications in self-improvement and scalable oversight. While numerous studies have been proposed to…

Computation and Language · Computer Science 2024-10-22 Tian Lan , Wenwei Zhang , Chen Xu , Heyan Huang , Dahua Lin , Kai Chen , Xian-ling Mao

Large Language Models (LLMs) have demonstrated remarkable zero-shot generalization across various language-related tasks, including search engines. However, existing work utilizes the generative ability of LLMs for Information Retrieval…

Computation and Language · Computer Science 2024-12-31 Weiwei Sun , Lingyong Yan , Xinyu Ma , Shuaiqiang Wang , Pengjie Ren , Zhumin Chen , Dawei Yin , Zhaochun Ren

The advent of AI driven large language models (LLMs) have stirred discussions about their role in qualitative research. Some view these as tools to enrich human understanding, while others perceive them as threats to the core values of the…

Software Engineering · Computer Science 2023-06-26 Muneera Bano , Didar Zowghi , Jon Whittle

Large language models (LLMs) can act as evaluators, a role studied by methods like LLM-as-a-Judge and fine-tuned judging LLMs. In the field of education, LLMs have been studied as assistant tools for students and teachers. Our research…

Computation and Language · Computer Science 2025-09-26 Valeria Ramirez-Garcia , David de-Fitero-Dominguez , Antonio Garcia-Cabot , Eva Garcia-Lopez

Text evaluation has historically posed significant challenges, often demanding substantial labor and time cost. With the emergence of large language models (LLMs), researchers have explored LLMs' potential as alternatives for human…

Computation and Language · Computer Science 2023-08-15 Chi-Min Chan , Weize Chen , Yusheng Su , Jianxuan Yu , Wei Xue , Shanghang Zhang , Jie Fu , Zhiyuan Liu

Large Language Models (LLMs) have been garnering significant attention of AI researchers, especially following the widespread popularity of ChatGPT. However, due to LLMs' intricate architecture and vast parameters, several concerns and…

Software Engineering · Computer Science 2023-10-10 Tinghui Ouyang , Hoang-Quoc Nguyen-Son , Huy H. Nguyen , Isao Echizen , Yoshiki Seo

Large language models (LLMs) have demonstrated notable proficiency in code generation, with numerous prior studies showing their promising capabilities in various development scenarios. However, these studies mainly provide evaluations in…

Software Engineering · Computer Science 2024-03-19 Kailun Jin , Chung-Yu Wang , Hung Viet Pham , Hadi Hemmati

Using large language models (LLMs) for automatic evaluation has become an important evaluation method in NLP research. However, it is unclear whether these LLM-based evaluators can be applied in real-world classrooms to assess student…

Computation and Language · Computer Science 2024-09-24 Cheng-Han Chiang , Wei-Chih Chen , Chun-Yi Kuan , Chienchou Yang , Hung-yi Lee

Recent advancements in large language models (LLMs) on language modeling and emergent capabilities make them a promising reference-free evaluator of natural language generation quality, and a competent alternative to human evaluation.…

Computation and Language · Computer Science 2023-09-26 Yuxuan Liu , Tianchi Yang , Shaohan Huang , Zihan Zhang , Haizhen Huang , Furu Wei , Weiwei Deng , Feng Sun , Qi Zhang

Interacting with human via high-quality multi-turn dialogues is a key feature of large language models (LLMs). However, human-based evaluation of such capability involves intensive manual labor. This report provides a preliminary evaluation…

Computation and Language · Computer Science 2023-10-23 Haodong Duan , Jueqi Wei , Chonghua Wang , Hongwei Liu , Yixiao Fang , Songyang Zhang , Dahua Lin , Kai Chen

Chatbots have shown promise as tools to scale qualitative data collection. Recent advances in Large Language Models (LLMs) could accelerate this process by allowing researchers to easily deploy sophisticated interviewing chatbots. We test…

Human-Computer Interaction · Computer Science 2024-12-05 Alejandro Cuevas , Jennifer V. Scurrell , Eva M. Brown , Jason Entenmann , Madeleine I. G. Daepp

Evaluating the open-ended text generation of large language models (LLMs) is challenging because of the lack of a clear ground truth and the high cost of human or LLM-based assessments. We propose a novel benchmark that evaluates LLMs using…

Computation and Language · Computer Science 2025-02-14 Kentaro Imajo , Masanori Hirano , Shuji Suzuki , Hiroaki Mikami

Large Language Models (LLMs) have enabled the emergence of LLM agents, systems capable of pursuing under-specified goals and adapting after deployment. Evaluating such agents is challenging because their behavior is open ended,…

Software Engineering · Computer Science 2025-11-18 Boming Xia , Qinghua Lu , Liming Zhu , Zhenchang Xing , Dehai Zhao , Hao Zhang

The performance of conversational Large Language Models (LLMs) in general, and of ChatGPT in particular, is currently being evaluated on many different tasks, from logical reasoning or maths to answering questions on a myriad of topics.…

Computation and Language · Computer Science 2024-10-22 Gonzalo Martínez , José Alberto Hernández , Javier Conde , Pedro Reviriego , Elena Merino

This study delves into the application potential of the large language models (LLMs) ChatGLM in the automatic generation of structured questions for National Teacher Certification Exams (NTCE). Through meticulously designed prompt…

Computers and Society · Computer Science 2024-08-21 Ling He , Yanxin Chen , Xiaoqiang Hu