中文
相关论文

相关论文: Assessing the Capability of LLMs in Solving POSCOM…

200 篇论文

Large language models (LLMs) have demonstrated impressive performance in various natural language processing (NLP) tasks. However, there is limited understanding of how well LLMs perform in specific domains (e.g, the intellectual property…

计算与语言 · 计算机科学 2024-02-27 Shiwen Ni , Minghuan Tan , Yuelin Bai , Fuqiang Niu , Min Yang , Bowen Zhang , Ruifeng Xu , Xiaojun Chen , Chengming Li , Xiping Hu , Ye Li , Jianping Fan

Large Language Models (LLMs) have recently showcased their remarkable capacities, not only in natural language processing tasks but also across diverse domains such as clinical medicine, legal consultation, and education. LLMs become more…

计算与语言 · 计算机科学 2024-01-23 Jen-tse Huang , Wenxuan Wang , Eric John Li , Man Ho Lam , Shujie Ren , Youliang Yuan , Wenxiang Jiao , Zhaopeng Tu , Michael R. Lyu

Evaluating reasoning ability in Large Language Models (LLMs) is important for advancing artificial intelligence, as it transcends mere linguistic task performance. It involves understanding whether these models truly understand information,…

人工智能 · 计算机科学 2025-10-29 Benjamin Grando Moreira

The advent of Large Language Models (LLMs) has revolutionized code completion, transforming it into a more intelligent and context-aware feature in modern integrated development environments. These advancements have significantly enhanced…

软件工程 · 计算机科学 2025-02-24 Hang Zhang , Yanxin Shen , Lun Wang , Chuanqi Shi , Shaoshuai Du , Yiyi Tao , Yixian Shen

Nowadays, DeepSeek, ChatGPT, and Google Gemini are the most trending and exciting Large Language Model (LLM) technologies for reasoning, multimodal capabilities, and general linguistic performance worldwide. DeepSeek employs a…

Large language models (LLMs) have been widely explored for automated scoring in low-stakes assessment to facilitate learning and instruction. Empirical evidence related to which LLM produces the most reliable scores and induces least rater…

计算与语言 · 计算机科学 2025-05-30 Hong Jiao , Dan Song , Won-Chan Lee

Large language models (LLMs) have significantly advanced various natural language processing (NLP) tasks. Recent research indicates that moderately-sized LLMs often outperform larger ones after task-specific fine-tuning. This study focuses…

计算与语言 · 计算机科学 2024-10-14 Minghao Wu , Thuy-Trang Vu , Lizhen Qu , George Foster , Gholamreza Haffari

ChatGPT has gained a huge popularity since its introduction. Its positive aspects have been reported through many media platforms, and some analyses even showed that ChatGPT achieved a decent grade in professional exams, adding extra…

计算与语言 · 计算机科学 2023-11-15 Myeongjun Erik Jang , Thomas Lukasiewicz

This paper presents a comprehensive investigation into the capability of Large Language Models (LLMs) to successfully complete a semester-long undergraduate control systems course. Through evaluation of 115 course deliverables, we assess…

计算机与社会 · 计算机科学 2025-05-19 Gokul Puthumanaillam , Timothy Bretl , Melkior Ornik

The rapid advancement of Large Language Models (LLMs) in the realm of mathematical reasoning necessitates comprehensive evaluations to gauge progress and inspire future directions. Existing assessments predominantly focus on problem-solving…

计算与语言 · 计算机科学 2024-06-05 Xiaoyuan Li , Wenjie Wang , Moxin Li , Junrong Guo , Yang Zhang , Fuli Feng

Evaluating open-ended written examination responses from students is an essential yet time-intensive task for educators, requiring a high degree of effort, consistency, and precision. Recent developments in Large Language Models (LLMs)…

计算与语言 · 计算机科学 2024-05-10 Jussi S. Jauhiainen , Agustín Garagorry Guerra

Security analysts face increasing pressure to triage large and complex vulnerability backlogs. Large Language Models (LLMs) offer a potential aid by automating parts of the interpretation process. We evaluate four models (ChatGPT, Claude,…

密码学与安全 · 计算机科学 2025-10-22 Osama Al Haddad , Muhammad Ikram , Ejaz Ahmed , Young Lee

Large Language models (LLMs), such as ChatGPT, have gained popularity in recent years with the advancement of Natural Language Processing (NLP), with use cases spanning many disciplines and daily lives as well. LLMs inherit explicit and…

计算与语言 · 计算机科学 2025-12-01 Fatima Kazi

This paper explores the efficacy of large language models (LLMs) for Persian. While ChatGPT and consequent LLMs have shown remarkable performance in English, their efficiency for more low-resource languages remains an open question. We…

Large Language Models (LLMs) have the potential to significantly enhance threat intelligence by automating the collection, preprocessing, and analysis of threat data. However, the usability of these tools is critical to ensure their…

密码学与安全 · 计算机科学 2024-09-24 Sanchana Srikanth , Mohammad Hasanuzzaman , Farah Tasnur Meem

Large Language Models (LLMs) have demonstrated promise in medical knowledge assessments, yet their practical utility in real-world clinical decision-making remains underexplored. In this study, we evaluated the performance of three…

计算与语言 · 计算机科学 2025-12-30 Mengdi Chai , Ali R. Zomorrodi

The dream of achieving a student-teacher ratio of 1:1 is closer than ever thanks to the emergence of large language models (LLMs). One potential application of these models in the educational field would be to provide feedback to students…

计算机与社会 · 计算机科学 2025-05-06 Marc Ballestero-Ribó , Daniel Ortiz-Martínez

Previous learning-based vulnerability detection methods relied on either medium-sized pre-trained models or smaller neural networks from scratch. Recent advancements in Large Pre-Trained Language Models (LLMs) have showcased remarkable…

软件工程 · 计算机科学 2024-01-30 Xin Zhou , Ting Zhang , David Lo

This paper provides an in-depth evaluation of three state-of-the-art Large Language Models (LLMs) for personalized career mentoring in the computing field, using three distinct student profiles that consider gender, race, and professional…

计算与语言 · 计算机科学 2024-12-16 Xiao Luo , Sean O'Connell , Shamima Mithun

The integration of artificial intelligence into various domains is rapidly increasing, with Large Language Models (LLMs) becoming more prevalent in numerous applications. This work is included in an overall project which aims to train an…

计算物理 · 物理学 2025-01-09 Christophe Bajan , Guillaume Lambard