English
Related papers

Related papers: Evaluating Large Language Models: A Comprehensive …

200 papers

The rapid advancement of large language models (LLMs) has inspired researchers to integrate them extensively into the academic workflow, potentially reshaping how research is practiced and reviewed. While previous studies highlight the…

Computation and Language · Computer Science 2025-10-15 Rui Li , Jia-Chen Gu , Po-Nien Kung , Heming Xia , Junfeng liu , Xiangwen Kong , Zhifang Sui , Nanyun Peng

This comprehensive literature review examines the emerging applications of Large Language Models (LLMs) in power system engineering. Through a systematic analysis of recent research published between 2020 and 2025, we explore how LLMs are…

Systems and Control · Electrical Eng. & Systems 2025-12-16 Muhammad Sarwar , Muhammad Rizwan , Mubushra Aziz , Abdul Rehman Sudais

In the rapidly evolving landscape of Large Language Models (LLMs), ensuring robust safety measures is paramount. To meet this crucial need, we propose \emph{SALAD-Bench}, a safety benchmark specifically designed for evaluating LLMs, attack,…

Computation and Language · Computer Science 2024-06-10 Lijun Li , Bowen Dong , Ruohui Wang , Xuhao Hu , Wangmeng Zuo , Dahua Lin , Yu Qiao , Jing Shao

Large Language Models (LLMs) are transforming education by enabling personalization, feedback, and knowledge access, while also raising concerns about risks to students and learning systems. Yet empirical evidence on these risks remains…

Computers and Society · Computer Science 2025-11-04 Iris Delikoura , Yi. R Fung , Pan Hui

The rise of large language models (LLMs) has led many researchers to consider their usage for scientific work. Some have found benefits using LLMs to augment or automate aspects of their research pipeline, while others have urged caution…

Computation and Language · Computer Science 2024-11-11 Zhehui Liao , Maria Antoniak , Inyoung Cheong , Evie Yu-Yen Cheng , Ai-Heng Lee , Kyle Lo , Joseph Chee Chang , Amy X. Zhang

Large Language Models (LLMs) have achieved significantly advanced capabilities in understanding and generating human language text, which have gained increasing popularity over recent years. Apart from their state-of-the-art natural…

Cryptography and Security · Computer Science 2025-02-11 Yihe Zhou , Tao Ni , Wei-Bin Lee , Qingchuan Zhao

The foundational capabilities established by Large Language Models (LLMs) have paved the way for Multimodal Large Language Models (MLLMs), within which Large Audio Language Models (LALMs) are essential for realizing universal auditory…

The security concerns surrounding Large Language Models (LLMs) have been extensively explored, yet the safety of Multimodal Large Language Models (MLLMs) remains understudied. In this paper, we observe that Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xin Liu , Yichen Zhu , Jindong Gu , Yunshi Lan , Chao Yang , Yu Qiao

Large language models (LLMs) represent significant breakthroughs in artificial intelligence and hold potential for applications within smart grids. However, as demonstrated in previous literature, AI technologies are susceptible to various…

Cryptography and Security · Computer Science 2025-04-22 Jiangnan Li , Yingyuan Yang , Jinyuan Sun

Online education platforms, leveraging the internet to distribute education resources, seek to provide convenient education but often fall short in real-time communication with students. They often struggle to address the diverse obstacles…

Artificial Intelligence · Computer Science 2024-04-29 Qingyao Li , Lingyue Fu , Weiming Zhang , Xianyu Chen , Jingwei Yu , Wei Xia , Weinan Zhang , Ruiming Tang , Yong Yu

The recent success of large language models (LLMs) trained on static, pre-collected, general datasets has sparked numerous research directions and applications. One such direction addresses the non-trivial challenge of integrating…

Machine Learning · Computer Science 2024-11-26 Haizhou Shi , Zihao Xu , Hengyi Wang , Weiyi Qin , Wenyuan Wang , Yibin Wang , Zifeng Wang , Sayna Ebrahimi , Hao Wang

Large language models (LLMs) have significantly advanced in various fields and intelligent agent applications. However, current LLMs that learn from human or external model supervision are costly and may face performance ceilings as task…

Computation and Language · Computer Science 2024-06-04 Zhengwei Tao , Ting-En Lin , Xiancai Chen , Hangyu Li , Yuchuan Wu , Yongbin Li , Zhi Jin , Fei Huang , Dacheng Tao , Jingren Zhou

The remarkable success of Large Language Models (LLMs) has illuminated a promising pathway toward achieving Artificial General Intelligence for both academic and industrial communities, owing to their unprecedented performance across…

Large language models (LLMs), renowned for their impressive capabilities in various tasks, have significantly advanced artificial intelligence. Yet, these advancements have raised growing concerns about privacy and security implications. To…

Artificial Intelligence · Computer Science 2024-03-28 Yuqi Yang , Xiaowen Huang , Jitao Sang

Multilingual Large Language Models (MLLMs) represent a pivotal advancement in democratizing artificial intelligence across linguistic boundaries. While theoretical foundations are well-established, practical implementation guidelines remain…

Computation and Language · Computer Science 2024-10-24 Junhua Liu , Bin Fu

The advancement of Large Language Models (LLMs) has significantly impacted various domains, including Web search, healthcare, and software development. However, as these models scale, they become more vulnerable to cybersecurity risks,…

Cryptography and Security · Computer Science 2024-10-01 Qin Liu , Wenjie Mo , Terry Tong , Jiashu Xu , Fei Wang , Chaowei Xiao , Muhao Chen

Human evaluation is indispensable and inevitable for assessing the quality of texts generated by machine learning models or written by humans. However, human evaluation is very difficult to reproduce and its quality is notoriously unstable,…

Computation and Language · Computer Science 2023-05-04 Cheng-Han Chiang , Hung-yi Lee

This paper proposes a pipeline for quantitatively evaluating interactive Large Language Models (LLMs) using publicly available datasets. We carry out an extensive technical evaluation of LLMs using Big-Vul covering four different common…

Software Engineering · Computer Science 2024-07-09 Xin Yin , Chao Ni , Shaohua Wang

With the rapid development of artificial intelligence, large language models (LLMs) have shown promising capabilities in mimicking human-level language comprehension and reasoning. This has sparked significant interest in applying LLMs to…

Computation and Language · Computer Science 2023-11-06 Mingze Yuan , Peng Bao , Jiajia Yuan , Yunhao Shen , Zifan Chen , Yi Xie , Jie Zhao , Yang Chen , Li Zhang , Lin Shen , Bin Dong

Large Language Models (LLMs) are increasingly employed for simulating human behaviors across diverse domains. However, our position is that current LLM-based human simulations remain insufficiently reliable, as evidenced by significant…

Computation and Language · Computer Science 2025-12-02 Qian Wang , Jiaying Wu , Zichen Jiang , Zhenheng Tang , Bingqiao Luo , Nuo Chen , Wei Chen , Bingsheng He