English
Related papers

Related papers: Testing and Evaluation of Large Language Models: C…

200 papers

We present the first study to investigate Large Language Models (LLMs) in answering radiation oncology physics questions. Because popular exams like AP Physics, LSAT, and GRE have large test-taker populations and ample test preparation…

Large Language Models (LLMs) have revolutionized artificial intelligence, demonstrating remarkable computational power and linguistic capabilities. However, these models are inherently prone to various biases stemming from their training…

Computation and Language · Computer Science 2025-02-14 Riccardo Cantini , Giada Cosenza , Alessio Orsino , Domenico Talia

Large language models (LLMs) have become mainstream technology with their versatile use cases and impressive performance. Despite the countless out-of-the-box applications, LLMs are still not reliable. A lot of work is being done to improve…

Computation and Language · Computer Science 2023-06-13 Aisha Khatun , Daniel G. Brown

The rapid progress in Large Language Models (LLMs) could transform many fields, but their fast development creates significant challenges for oversight, ethical creation, and building user trust. This comprehensive review looks at key trust…

Computers and Society · Computer Science 2024-07-22 Md Meftahul Ferdaus , Mahdi Abdelguerfi , Elias Ioup , Kendall N. Niles , Ken Pathak , Steven Sloan

Previous works on Large Language Models (LLMs) have mainly focused on evaluating their helpfulness or harmlessness. However, honesty, another crucial alignment criterion, has received relatively less attention. Dishonest behaviors in LLMs,…

Computation and Language · Computer Science 2024-07-10 Steffi Chern , Zhulin Hu , Yuqing Yang , Ethan Chern , Yuan Guo , Jiahe Jin , Binjie Wang , Pengfei Liu

With the rapid popularity of large language models such as ChatGPT and GPT-4, a growing amount of attention is paid to their safety concerns. These models may generate insulting and discriminatory content, reflect incorrect social values,…

Computation and Language · Computer Science 2023-04-21 Hao Sun , Zhexin Zhang , Jiawen Deng , Jiale Cheng , Minlie Huang

A Large Language Model (LLM) is an artificial intelligence system that has been trained on vast amounts of natural language data, enabling it to generate human-like responses to written or spoken language input. GPT-3.5 is an example of an…

Artificial Intelligence · Computer Science 2023-05-09 Gaurav Suri , Lily R. Slater , Ali Ziaee , Morgan Nguyen

Context: ChatGPT and other large language models (LLMs) are widely used across healthcare, business, economics, engineering, and software engineering (SE). Despite their popularity, concerns persist about their reliability, especially their…

Software Engineering · Computer Science 2025-04-29 Vahid Garousi

Large language models (LLMs) have become integral to our professional workflows and daily lives. Nevertheless, these machine companions of ours have a critical flaw: the huge amount of data which endows them with vast and diverse knowledge,…

Computation and Language · Computer Science 2024-05-21 Tinh Son Luong , Thanh-Thien Le , Linh Ngo Van , Thien Huu Nguyen

Large Language Models (LLMs) represent an advanced evolution of earlier, simpler language models. They boast enhanced abilities to handle complex language patterns and generate coherent text, images, audios, and videos. Furthermore, they…

Cryptography and Security · Computer Science 2024-03-01 Jun Huang , Jiawei Zhang , Qi Wang , Weihong Han , Yanchun Zhang

In recent years, Large Language Models (LLMs) have gained immense attention due to their notable emergent capabilities, surpassing those seen in earlier language models. A particularly intriguing application of LLMs is their role as…

Computation and Language · Computer Science 2023-11-02 Xue-Yong Fu , Md Tahmid Rahman Laskar , Cheng Chen , Shashi Bhushan TN

Large language models (LLMs) have recently become a popular topic in the field of Artificial Intelligence (AI) research, with companies such as Google, Amazon, Facebook, Amazon, Tesla, and Apple (GAFA) investing heavily in their…

Artificial Intelligence · Computer Science 2023-05-11 Frank Joublin , Antonello Ceravola , Joerg Deigmoeller , Michael Gienger , Mathias Franzius , Julian Eggert

Coverage of ChatGPT-style large language models (LLMs) in the media has focused on their eye-catching achievements, including solving advanced mathematical problems and reaching expert proficiency in medical examinations. But the gradual…

Computers and Society · Computer Science 2024-03-26 Djavan De Clercq , Elias Nehring , Harry Mayne , Adam Mahdi

Large language models (LLMs) are gaining increasing popularity in both academia and industry, owing to their unprecedented performance in various applications. As LLMs continue to play a vital role in both research and daily use, their…

Computation and Language · Computer Science 2024-01-01 Yupeng Chang , Xu Wang , Jindong Wang , Yuan Wu , Linyi Yang , Kaijie Zhu , Hao Chen , Xiaoyuan Yi , Cunxiang Wang , Yidong Wang , Wei Ye , Yue Zhang , Yi Chang , Philip S. Yu , Qiang Yang , Xing Xie

Countless terms of service (ToS) are being signed everyday by users all over the world while interacting with all kinds of apps and websites. More often than not, these online contracts spanning double-digit pages are signed blindly by…

Computation and Language · Computer Science 2024-09-09 Mirgita Frasheri , Arian Bakhtiarnia , Lukas Esterle , Alexandros Iosifidis

Large Language Model (LLMs) such as ChatGPT that exhibit generative AI capabilities are facing accelerated adoption and innovation. The increased presence of Generative AI (GAI) inevitably raises concerns about the risks and safety…

Computers and Society · Computer Science 2024-07-29 Jaymari Chua , Yun Li , Shiyi Yang , Chen Wang , Lina Yao

Large language models (LLMs) are powerful artificial intelligence (AI) tools transforming how research is conducted. However, their use in research has been met with skepticism, due to concerns about hallucinations, biases and potential…

Artificial Intelligence · Computer Science 2025-07-08 Ruian Ke , Ruy M. Ribeiro

Large Language Models (LLMs) have shown powerful performance and development prospects and are widely deployed in the real world. However, LLMs can capture social biases from unprocessed training data and propagate the biases to downstream…

Computation and Language · Computer Science 2024-02-22 Yingji Li , Mengnan Du , Rui Song , Xin Wang , Ying Wang

Logical reasoning consistently plays a fundamental and significant role in the domains of knowledge engineering and artificial intelligence. Recently, Large Language Models (LLMs) have emerged as a noteworthy innovation in natural language…

Computation and Language · Computer Science 2024-09-17 Fangzhi Xu , Qika Lin , Jiawei Han , Tianzhe Zhao , Jun Liu , Erik Cambria

Existing benchmarks for evaluating mathematical reasoning in large language models (LLMs) rely primarily on competition problems, formal proofs, or artificially challenging questions -- failing to capture the nature of mathematics…

Artificial Intelligence · Computer Science 2025-10-21 Jie Zhang , Cezara Petrui , Kristina Nikolić , Florian Tramèr