中文
相关论文

相关论文: GPT-Fathom: Benchmarking Large Language Models to …

200 篇论文

We explore the evolving efficacy of three generative pre-trained transformer (GPT) models in generating answers for multiple-choice questions (MCQ) from introductory and intermediate Python programming courses in higher education. We focus…

计算机与社会 · 计算机科学 2023-11-17 Jaromir Savelka , Arav Agarwal , Christopher Bogart , Majd Sakr

In the rapidly evolving field of natural language processing, the translation of linguistic descriptions into mathematical formulation of optimization problems presents a formidable challenge, demanding intricate understanding and…

计算与语言 · 计算机科学 2024-03-05 Tasnim Ahmed , Salimur Choudhury

Artificial intelligence is making spectacular progress, and one of the best examples is the development of large language models (LLMs) such as OpenAI's GPT series. In these lectures, written for readers with a background in mathematics or…

计算与语言 · 计算机科学 2023-10-09 Michael R. Douglas

Our research investigates the potential of Large-scale Language Models (LLMs), specifically OpenAI's GPT, in credit risk assessment-a binary classification task. Our findings suggest that LLMs, when directed by judiciously designed prompts…

计算与语言 · 计算机科学 2023-07-25 Yashar Deldjoo

OpenAI's ChatGPT initiated a wave of technical iterations in the space of Large Language Models (LLMs) by demonstrating the capability and disruptive power of LLMs. OpenAI has prompted large organizations to respond with their own…

社会与信息网络 · 计算机科学 2024-05-20 Benjamin Zi Hao Zhao , Muhammad Ikram , Mohamed Ali Kaafar

Large language models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence technology which is rapidly evolving and promises to aid in medical diagnosis. However, the correctness and the accuracy of their returns has…

计算与语言 · 计算机科学 2024-02-07 Dimitrios P. Panagoulias , Maria Virvou , George A. Tsihrintzis

Previous learning-based vulnerability detection methods relied on either medium-sized pre-trained models or smaller neural networks from scratch. Recent advancements in Large Pre-Trained Language Models (LLMs) have showcased remarkable…

软件工程 · 计算机科学 2024-01-30 Xin Zhou , Ting Zhang , David Lo

Given the rapid ascent of large language models (LLMs), we study the question: (How) can large language models help in reviewing of scientific papers or proposals? We first conduct some pilot studies where we find that (i) GPT-4 outperforms…

计算与语言 · 计算机科学 2023-06-02 Ryan Liu , Nihar B. Shah

Large Language Models (LLMs) excel in various Natural Language Processing (NLP) tasks, yet their evaluation, particularly in languages beyond the top $20$, remains inadequate due to existing benchmarks and metrics limitations. Employing…

Large language models (LLMs) have shown great potential for the automatic generation of feedback in a wide range of computing contexts. However, concerns have been voiced around the privacy and ethical implications of sending student work…

计算与语言 · 计算机科学 2024-05-09 Charles Koutcheme , Nicola Dainese , Sami Sarsa , Arto Hellas , Juho Leinonen , Paul Denny

Large Language Models (LLMs) represent a major step toward artificial general intelligence, significantly advancing our ability to interact with technology. While LLMs perform well on Natural Language Processing tasks -- such as…

计算与语言 · 计算机科学 2025-05-15 Brandon Smith , Mohamed Reda Bouadjenek , Tahsin Alamgir Kheya , Phillip Dawson , Sunil Aryal

Large language models (LLMs) show impressive abilities via few-shot prompting. Commercialized APIs such as OpenAI GPT-3 further increase their use in real-world language applications. However, the crucial problem of how to improve the…

计算与语言 · 计算机科学 2023-02-16 Chenglei Si , Zhe Gan , Zhengyuan Yang , Shuohang Wang , Jianfeng Wang , Jordan Boyd-Graber , Lijuan Wang

In the rapidly evolving field of artificial intelligence (AI), the application of large language models (LLMs) in agriculture, particularly in pest management, remains nascent. We aimed to prove the feasibility by evaluating the content of…

计算与语言 · 计算机科学 2024-03-19 Shanglong Yang , Zhipeng Yuan , Shunbao Li , Ruoling Peng , Kang Liu , Po Yang

Frontier large language models (LLMs), such as GPT-5, Claude 4.5, Gemini 3, Llama 4, and DeepSeek-R1, represent a transformative class of AI tools capable of revolutionizing various aspects of healthcare by generating human-like responses…

Purpose: To assess the alignment of GPT-4-based evaluation to human clinician experts, for the evaluation of responses to ophthalmology-related patient queries generated by fine-tuned LLM chatbots. Methods: 400 ophthalmology questions and…

Large Language Models (LLMs) such as OpenAI's GPT-4 and Meta's LLaMA offer a promising approach for scalable personality assessment from open-ended language. However, inferring personality traits remains challenging, and earlier work often…

计算与语言 · 计算机科学 2025-07-22 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman

The rapid evolution of artificial intelligence (AI), especially in the domain of Large Language Models (LLMs) and generative AI, has opened new avenues for application across various fields, yet its role in business education remains…

计算与语言 · 计算机科学 2024-01-09 Vahid Ashrafimoghari , Necdet Gürkan , Jordan W. Suchow

Purpose: The performance of three different large language models (LLMS) (GPT-3.5, GPT-4, and PaLM2) in answering ophthalmology professional questions was evaluated and compared with that of three different professional populations (medical…

计算与语言 · 计算机科学 2023-11-10 Jason Holmes , Shuyuan Ye , Yiwei Li , Shi-Nan Wu , Zhengliang Liu , Zihao Wu , Jinyu Hu , Huan Zhao , Xi Jiang , Wei Liu , Hong Wei , Jie Zou , Tianming Liu , Yi Shao

This study investigates the efficacy of large language models (LLMs) as tools for grading master-level student essays. Utilizing a sample of 60 essays in political science, the study compares the accuracy of grades suggested by the GPT-4…

综合经济学 · 经济学 2024-06-25 Magnus Lundgren

Large Language Models (LLMs) have garnered considerable interest within both academic and industrial. Yet, the application of LLMs to graph data remains under-explored. In this study, we evaluate the capabilities of four LLMs in addressing…

人工智能 · 计算机科学 2023-09-12 Chang Liu , Bo Wu