中文
相关论文

相关论文: Evaluating the Performance of Large Language Model…

200 篇论文

Large Language Models (LLMs) have shown exceptional performance across various Data-to-Text Generation (DTG) tasks. However, generating factually consistent text in DTG remains challenging for LLMs. Despite this, in-depth evaluations of LLM…

计算与语言 · 计算机科学 2024-12-02 Joy Mahapatra , Utpal Garain

Frontier Large language models (LLMs) like ChatGPT and Gemini can decipher cryptic compiler errors for novice programmers, but their computational scale, cost, and tendency to over-assist make them problematic for widespread pedagogical…

计算机与社会 · 计算机科学 2025-07-09 Lorenzo Lee Solano , Charles Koutcheme , Juho Leinonen , Alexandra Vassar , Jake Renzella

Large language models (LLMs) have achieved remarkable progress across domains and applications but face challenges such as high fine-tuning costs, inference latency, limited edge deployability, and reliability concerns. Small language…

计算与语言 · 计算机科学 2025-11-06 Fali Wang , Jihai Chen , Shuhua Yang , Ali Al-Lawati , Linli Tang , Hui Liu , Suhang Wang

Large Language Models (LLMs) are distinguished by their architecture, which dictates their parameter size and performance capabilities. Social scientists have increasingly adopted LLMs for text classification tasks, which are difficult to…

计算与语言 · 计算机科学 2024-11-05 Marcello Carammia , Stefano Maria Iacus , Giuseppe Porro

In this study, we explore the application of Large Language Models (LLMs) for generating synthetic users and simulating user conversations with a task-oriented dialogue system and present detailed results and their analysis. We propose a…

计算与语言 · 计算机科学 2025-02-19 Adnan Ahmad , Stefan Hillmann , Sebastian Möller

Background: The potential of large language models (LLMs) to automate and support pharmacoepidemiologic study design is an emerging area of interest, yet their reliability remains insufficiently characterized. General-purpose LLMs often…

Large Language Models (LLMs) have revolutionized the field of Natural Language Processing thanks to their ability to reuse knowledge acquired on massive text corpora on a wide variety of downstream tasks, with minimal (if any) tuning steps.…

计算与语言 · 计算机科学 2024-07-12 Flavio Petruzzellis , Alberto Testolin , Alessandro Sperduti

As educational systems evolve, ensuring that assessment items remain aligned with content standards is essential for maintaining fairness and instructional relevance. Traditional human alignment reviews are accurate but slow and…

人工智能 · 计算机科学 2025-11-26 Farzan Karimi-Malekabadi , Pooya Razavi , Sonya Powers

In recent years, transformer-based large language models (LLMs) have revolutionised natural language processing (NLP), with generative models opening new possibilities for tasks that require context-aware text generation. Requirements…

计算与语言 · 计算机科学 2025-04-24 Waad Alhoshan , Alessio Ferrari , Liping Zhao

Large Language Models (LLMs) are advancing at a rapid pace, with significant improvements at natural language processing and coding tasks. Yet, their ability to work with formal languages representing data, specifically within the realm of…

人工智能 · 计算机科学 2023-10-02 Johannes Frey , Lars-Peter Meyer , Natanael Arndt , Felix Brei , Kirill Bulert

In this work, we designed unbiased prompts to systematically evaluate the psychological safety of large language models (LLMs). First, we tested five different LLMs by using two personality tests: Short Dark Triad (SD-3) and Big Five…

计算与语言 · 计算机科学 2024-03-01 Xingxuan Li , Yutong Li , Lin Qiu , Shafiq Joty , Lidong Bing

Large Language Models (LLMs) have revolutionized both general natural language processing and domain-specific applications such as code synthesis, legal reasoning, and finance. However, while prior studies have explored individual model…

软件工程 · 计算机科学 2025-12-05 Gunjan Das , Paheli Bhattacharya , Rishabh Gupta

In this work, we evaluated Lithuanian and general history knowledge of multilingual Large Language Models (LLMs) on a multiple-choice question-answering task. The models were tested on a dataset of Lithuanian national and general history…

计算与语言 · 计算机科学 2025-01-17 Yevhen Kostiuk , Oxana Vitman , Łukasz Gagała , Artur Kiulian

This study investigates the potential for Large Language Models (LLMs) to scale-up Dynamic Assessment (DA). To facilitate such an investigation, we first developed DynaWrite-a modular, microservices-based grammatical tutoring application…

计算与语言 · 计算机科学 2025-09-08 Timur Jaganov , John Blake , Julián Villegas , Nicholas Carr

The deployment of autonomous robots in various domains has raised significant concerns about their trustworthiness and accountability. This study explores the potential of Large Language Models (LLMs) in analyzing ROS 2 logs generated by…

The success of Large Language Models (LLMs) has led to a parallel rise in the development of Large Multimodal Models (LMMs), which have begun to transform a variety of applications. These sophisticated multimodal models are designed to…

人工智能 · 计算机科学 2025-05-20 Fouad Trad , Ali Chehab

High-quality textual training data is essential for the success of multimodal data processing tasks, yet outputs from image captioning models like BLIP and GIT often contain errors and anomalies that are difficult to rectify using…

计算与语言 · 计算机科学 2025-02-25 Elyas Meguellati , Nardiena Pratama , Shazia Sadiq , Gianluca Demartini

Large Language Models (LLMs), such as Generative Pre-trained Transformers (GPTs) are revolutionizing the generation of human-like text, producing contextually relevant and syntactically correct content. Despite challenges like biases and…

计算与语言 · 计算机科学 2025-08-04 Alper Yaman , Jannik Schwab , Christof Nitsche , Abhirup Sinha , Marco Huber

With the growing need for efficient language models in resource-constrained environments, Small Language Models (SLMs) have emerged as compact and practical alternatives to Large Language Models (LLMs). While studies have explored noise…

计算与语言 · 计算机科学 2025-05-28 Nicy Scaria , Silvester John Joseph Kennedy , Deepak Subramani

With the advancement of Large Language Models (LLMs), their application in Software Quality Assurance (SQA) has increased. However, the current focus of these applications is predominantly on ChatGPT. There remains a gap in understanding…

软件工程 · 计算机科学 2024-09-04 Ratnadira Widyasari , David Lo , Lizi Liao