English
Related papers

Related papers: Testing Large Language Models on Driving Theory Kn…

200 papers

Large Language Models (LLMs) are able to provide assistance on a wide range of information-seeking tasks. However, model outputs may be misleading, whether unintentionally or in cases of intentional deception. We investigate the ability of…

Computation and Language · Computer Science 2024-07-17 Betty Li Hou , Kejian Shi , Jason Phang , James Aung , Steven Adler , Rosie Campbell

In a rapidly evolving digital landscape autonomous tools and robots are becoming commonplace. Recognizing the significance of this development, this paper explores the integration of Large Language Models (LLMs) like Generative pre-trained…

Human-Computer Interaction · Computer Science 2024-03-22 Younes Lakhnati , Max Pascher , Jens Gerken

Reading comprehension is a key for individual success, yet the assessment of question difficulty remains challenging due to the extensive human annotation and large-scale testing required by traditional methods such as linguistic analysis…

Computation and Language · Computer Science 2025-02-26 Yoshee Jain , John Hollander , Amber He , Sunny Tang , Liang Zhang , John Sabatini

This study investigates the capabilities of Large Language Models (LLMs), specifically GPT-4, in the context of Binary Reverse Engineering (RE). Employing a structured experimental approach, we analyzed the LLM's performance in interpreting…

Software Engineering · Computer Science 2024-06-12 Saman Pordanesh , Benjamin Tan

Large Language Models (LLMs) have emerged as promising tools to assist students while solving programming assignments. However, object-oriented programming (OOP), with its inherent complexity involving the identification of entities,…

Software Engineering · Computer Science 2024-03-12 Bruno Pereira Cipriano , Pedro Alves

Various methods have been proposed for utilizing Large Language Models (LLMs) in autonomous driving. One strategy of using LLMs for autonomous driving involves inputting surrounding objects as text prompts to the LLMs, along with their…

This work investigates the applicability of recent generative Large Language Models (LLMs), such as the GPT series and Flan-T5, to ontology alignment for identifying concept equivalence mappings across ontologies. To test the zero-shot…

Artificial Intelligence · Computer Science 2023-09-15 Yuan He , Jiaoyan Chen , Hang Dong , Ian Horrocks

In recent years, there have been significant breakthroughs in the field of natural language processing, particularly with the development of large language models (LLMs). These LLMs have showcased remarkable capabilities on various…

Computation and Language · Computer Science 2023-08-10 Sean Wu , Michael Koo , Lesley Blum , Andy Black , Liyo Kao , Fabien Scalzo , Ira Kurtz

While Large Language Models (LLMs) are increasingly envisioned as intelligent assistants for personalized learning, systematic head-to-head evaluations in authentic learning scenarios remain scarce. This study presents an empirical…

Artificial Intelligence · Computer Science 2025-10-23 Bo Yuan , Jiazi Hu

Over the last year, significant advancements have been made in the realms of large language models (LLMs) and multi-modal large language models (MLLMs), particularly in their application to autonomous driving. These models have showcased…

Robotics · Computer Science 2024-06-11 Xiangrui Kong , Thomas Braunl , Marco Fahmi , Yue Wang

Large language models (LLMs) are a special class of pretrained language models obtained by scaling model size, pretraining corpus and computation. LLMs, because of their large size and pretraining on large volumes of text data, exhibit…

Computation and Language · Computer Science 2023-10-20 Katikapalli Subramanyam Kalyan

Better understanding of Large Language Models' (LLMs) legal analysis abilities can contribute to improving the efficiency of legal services, governing artificial intelligence, and leveraging LLMs to identify inconsistencies in law. This…

Computation and Language · Computer Science 2023-06-13 John J. Nay , David Karamardian , Sarah B. Lawsky , Wenting Tao , Meghana Bhat , Raghav Jain , Aaron Travis Lee , Jonathan H. Choi , Jungo Kasai

Roadway safety and mobility remain critical challenges for modern transportation systems, demanding innovative analytical frameworks capable of addressing complex, dynamic, and heterogeneous environments. While traditional engineering…

Artificial Intelligence · Computer Science 2025-12-10 Muhammad Monjurul Karim , Yan Shi , Shucheng Zhang , Bingzhang Wang , Mehrdad Nasri , Yinhai Wang

The integration of artificial intelligence into various domains is rapidly increasing, with Large Language Models (LLMs) becoming more prevalent in numerous applications. This work is included in an overall project which aims to train an…

Computational Physics · Physics 2025-01-09 Christophe Bajan , Guillaume Lambard

The resurgence and rapid advancement of Generative Artificial Intelligence (GenAI) in 2023 has catalyzed transformative shifts across numerous industry sectors, including urban transportation and logistics. This study investigates the…

Artificial Intelligence · Computer Science 2024-09-24 Shaowei Ying , Zhenlong Li , Manzhu Yu

Matching patients to clinical trial options is critical for identifying novel treatments, especially in oncology. However, manual matching is labor-intensive and error-prone, leading to recruitment delays. Pipelines incorporating large…

Computation and Language · Computer Science 2025-09-25 Braxton A. Morrison , Madhumita Sushil , Jacob S. Young

In this study, we investigate the capabilities and inherent biases of advanced large language models (LLMs) such as GPT-3.5 and GPT-4 in the context of debate evaluation. We discover that LLM's performance exceeds humans and surpasses the…

Computation and Language · Computer Science 2024-06-05 Xinyi Liu , Pinxin Liu , Hangfeng He

$\textbf{Objectives}$: Large Language Models (LLMs) such as ChatGPT and Med-PaLM have excelled in various medical question-answering tasks. However, these English-centric models encounter challenges in non-English clinical settings,…

Computation and Language · Computer Science 2024-01-31 Jiageng Wu , Xian Wu , Zhaopeng Qiu , Minghui Li , Yingying Zhang , Yefeng Zheng , Changzheng Yuan , Jie Yang

This paper describes a rapid feasibility study of using GPT-4, a large language model (LLM), to (semi)automate data extraction in systematic reviews. Despite the recent surge of interest in LLMs there is still a lack of understanding of how…

Computation and Language · Computer Science 2025-02-14 Lena Schmidt , Kaitlyn Hair , Sergio Graziosi , Fiona Campbell , Claudia Kapp , Alireza Khanteymoori , Dawn Craig , Mark Engelbert , James Thomas

In this paper, we introduce an automated approach to domain-specific metamodel construction relying on Large Language Model (LLM). The main focus is adoption in automotive domain. As outcome, a prototype was implemented as web service using…

Software Engineering · Computer Science 2025-03-10 Nenad Petrovic , Fengjunjie Pan , Vahid Zolfaghari , Alois Knoll