中文
相关论文

相关论文: Enhancing Systematic Reviews with Large Language M…

200 篇论文

Advances in automated scoring are closely aligned with advances in machine-learning and natural-language-processing techniques. With recent progress in large language models (LLMs), the use of ChatGPT, Gemini, Claude, and other…

计算与语言 · 计算机科学 2025-09-30 Haowei Hua , Hong Jiao , Dan Song

This paper presents a comprehensive performance evaluation of Large Language Models (LLMs) in solving programming challenges from Leetcode, a widely used platform for algorithm practice and technical interviews. We began by crawling the…

软件工程 · 计算机科学 2025-03-04 Lun Wang , Chuanqi Shi , Shaoshui Du , Yiyi Tao , Yixian Shen , Hang Zheng , Yanxin Shen , Xinyu Qiu

This study examines the potential of large language models (LLMs) to augment the academic peer review process by reliably evaluating the quality of economics research without introducing systematic bias. We conduct one of the first…

计算机与社会 · 计算机科学 2025-04-04 Pat Pataranutaporn , Nattavudh Powdthavee , Chayapatr Achiwaranguprok , Pattie Maes

This paper explores the potential of large language models (LLMs) as reliable analytical tools in linguistic research, focusing on the emergence of affective meanings in temporal expressions involving manner-of-motion verbs. While LLMs like…

计算与语言 · 计算机科学 2025-07-15 Rosa Illan Castillo , Javier Valenzuela

Recent studies have used both automatic metrics and human evaluations to assess the simplification abilities of LLMs. However, the suitability of existing evaluation methodologies for LLMs remains in question. First, the suitability of…

计算与语言 · 计算机科学 2025-07-15 Xuanxin Wu , Yuki Arase

This study investigates the capabilities of Large Language Models (LLMs), specifically GPT-4, in the context of Binary Reverse Engineering (RE). Employing a structured experimental approach, we analyzed the LLM's performance in interpreting…

软件工程 · 计算机科学 2024-06-12 Saman Pordanesh , Benjamin Tan

Urban systems are managed using complex textual documentation that need coding and analysis to set requirements and evaluate built environment performance. This paper contributes to the study of applying large-language models (LLM) to…

计算与语言 · 计算机科学 2025-04-02 Joshua Rodriguez , Om Sanan , Guillermo Vizarreta-Luna , Steven A. Conrad

Prompt engineering relevance research has seen a notable surge in recent years, primarily driven by advancements in pre-trained language models and large language models. However, a critical issue has been identified within this domain: the…

计算与语言 · 计算机科学 2023-06-09 Chengguang Gan , Tatsunori Mori

Generative large language models (LLMs) can be a powerful tool for augmenting text annotation procedures, but their performance varies across annotation tasks due to prompt quality, text data idiosyncrasies, and conceptual difficulty.…

计算与语言 · 计算机科学 2023-06-02 Nicholas Pangakis , Samuel Wolken , Neil Fasching

Providing effective feedback is important for student learning in programming problem-solving. In this sense, Large Language Models (LLMs) have emerged as potential tools to automate feedback generation. However, their reliability and…

软件工程 · 计算机科学 2025-03-20 Priscylla Silva , Evandro Costa

The new polymath Large Language Models (LLMs) can speed-up greatly scientific reviews, possibly using more unbiased quantitative metrics, facilitating cross-disciplinary connections, and identifying emerging trends and research gaps by…

计算与语言 · 计算机科学 2023-12-08 Chenxi Wu , Alan John Varghese , Vivek Oommen , George Em Karniadakis

Systematic reviews are time-consuming endeavors. Historically speaking, knowledgeable humans have had to screen and extract data from studies before it can be analyzed. However, large language models (LLMs) hold promise to greatly…

人机交互 · 计算机科学 2025-01-22 Noah L. Schroeder , Chris Davis Jaldi , Shan Zhang

Recently, there has been a growing trend of utilizing Large Language Model (LLM) to evaluate the quality of other LLMs. Many studies have fine-tuned judge models based on open-source LLMs for evaluation. While the fine-tuned judge models…

计算与语言 · 计算机科学 2025-06-02 Hui Huang , Xingyuan Bu , Hongli Zhou , Yingqi Qu , Jing Liu , Muyun Yang , Bing Xu , Tiejun Zhao

Educational materials such as survey articles in specialized fields like computer science traditionally require tremendous expert inputs and are therefore expensive to create and update. Recently, Large Language Models (LLMs) have achieved…

计算与语言 · 计算机科学 2024-05-24 Fan Gao , Hang Jiang , Rui Yang , Qingcheng Zeng , Jinghui Lu , Moritz Blum , Dairui Liu , Tianwei She , Yuang Jiang , Irene Li

This paper explores the use of Large Language Models (LLMs) to automate the generation of test skeletons -- structural templates that outline unit test coverage without implementing full test logic. Test skeletons are especially important…

软件工程 · 计算机科学 2025-09-08 Subhang Boorlagadda , Nitya Naga Sai Atluri , Muhammet Mustafa Olmez , Edward F. Gehringer

This systematic literature review examines the role of large language models (LLMs) in UI/UX design, synthesizing findings from 38 peer-reviewed studies published between 2022 and 2025. We identify key LLMs in use, including GPT-4, Gemini,…

人机交互 · 计算机科学 2025-07-21 Ammar Ahmed , Ali Shariq Imran

Large language models (LLMs) are playing an increasingly important role in science and engineering. For example, their ability to parse and understand human and computer languages makes them powerful interpreters and their use in…

材料科学 · 物理学 2023-10-19 Juan C. Verduzco , Ethan Holbrook , Alejandro Strachan

The rapid advancement of Large Language Models (LLMs) in the realm of mathematical reasoning necessitates comprehensive evaluations to gauge progress and inspire future directions. Existing assessments predominantly focus on problem-solving…

计算与语言 · 计算机科学 2024-06-05 Xiaoyuan Li , Wenjie Wang , Moxin Li , Junrong Guo , Yang Zhang , Fuli Feng

Large Language Models (LLMs) hold the potential to revolutionize autoformalization. The introduction of Lean4, a mathematical programming language, presents an unprecedented opportunity to rigorously assess the autoformalization…

机器学习 · 计算机科学 2024-06-12 Aryan Gulati , Devanshu Ladsaria , Shubhra Mishra , Jasdeep Sidhu , Brando Miranda

Large language models (LLMs) have shown great potential for the automatic generation of feedback in a wide range of computing contexts. However, concerns have been voiced around the privacy and ethical implications of sending student work…

计算与语言 · 计算机科学 2024-05-09 Charles Koutcheme , Nicola Dainese , Sami Sarsa , Arto Hellas , Juho Leinonen , Paul Denny