中文
相关论文

相关论文: Assessing the Capability of LLMs in Solving POSCOM…

200 篇论文

Large Language Models (LLMs) have drawn a lot of attention due to their strong performance on a wide range of natural language tasks, since the release of ChatGPT in November 2022. LLMs' ability of general-purpose language understanding and…

计算与语言 · 计算机科学 2025-03-25 Shervin Minaee , Tomas Mikolov , Narjes Nikzad , Meysam Chenaghlu , Richard Socher , Xavier Amatriain , Jianfeng Gao

The disruptive technology provided by large-scale pre-trained language models (LLMs) such as ChatGPT or GPT-4 has received significant attention in several application domains, often with an emphasis on high-level opportunities and…

人机交互 · 计算机科学 2023-06-27 Philippe J. Giabbanelli

The deployment of Large Language Models (LLMs) in real-world applications presents both opportunities and challenges, particularly in multilingual and code-mixed communication settings. This research evaluates the performance of seven…

Although both Google Gemini (1.5 Flash) and ChatGPT (4o and 4o-mini) give research quality evaluation scores that correlate positively with expert scores in nearly all fields, and more strongly that citations in most, it is not known…

数字图书馆 · 计算机科学 2025-08-12 Mike Thelwall

Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation across various domains, including medicine. We present a comprehensive evaluation of GPT-4, a state-of-the-art LLM, on…

计算与语言 · 计算机科学 2023-04-13 Harsha Nori , Nicholas King , Scott Mayer McKinney , Dean Carignan , Eric Horvitz

Large language models (LLMs) have made rapid improvement on medical benchmarks, but their unreliability remains a persistent challenge for safe real-world uses. To design for the use LLMs as a category, rather than for specific models,…

计算与语言 · 计算机科学 2024-10-14 Andrew M. Bean , Karolina Korgul , Felix Krones , Robert McCraith , Adam Mahdi

The development of large language models (LLMs) such as ChatGPT has brought a lot of attention recently. However, their evaluation in the benchmark academic datasets remains under-explored due to the difficulty of evaluating the generative…

In recent years, there have been significant breakthroughs in the field of natural language processing, particularly with the development of large language models (LLMs). These LLMs have showcased remarkable capabilities on various…

计算与语言 · 计算机科学 2023-08-10 Sean Wu , Michael Koo , Lesley Blum , Andy Black , Liyo Kao , Fabien Scalzo , Ira Kurtz

Large language models (LLMs) such as ChatGPT have gained considerable interest across diverse research communities. Their notable ability for text completion and generation has inaugurated a novel paradigm for language-interfaced problem…

Although several methods were proposed to address the problem of automated essay scoring (AES) in the last 50 years, there is still much to desire in terms of effectiveness. Large Language Models (LLMs) are transformer-based models that…

计算与语言 · 计算机科学 2024-04-17 Watheq Mansour , Salam Albatarni , Sohaila Eltanbouly , Tamer Elsayed

Large Language Models (LLMs) such as ChatGPT have shown remarkable abilities in producing human-like text. However, it is unclear how accurately these models internalize concepts that shape human thought and behavior. Here, we developed a…

机器学习 · 计算机科学 2025-07-01 Hiro Taiyo Hamada , Ippei Fujisawa , Genji Kawakita , Yuki Yamada

Large Language Models (LLMs) like ChatGPT have demonstrated amazing capabilities in comprehending user intents and generate reasonable and useful responses. Beside their ability to chat, their capabilities in various natural language…

计算与语言 · 计算机科学 2026-02-12 Liz Li , Wei Zhu

Large Language Models (LLMs) have revolutionized the field of Natural Language Processing thanks to their ability to reuse knowledge acquired on massive text corpora on a wide variety of downstream tasks, with minimal (if any) tuning steps.…

计算与语言 · 计算机科学 2024-07-12 Flavio Petruzzellis , Alberto Testolin , Alessandro Sperduti

Upon its release in late 2022, ChatGPT has brought a seismic shift in the entire landscape of AI, both in research and commerce. Through instruction-tuning a large language model (LLM) with supervised fine-tuning and reinforcement learning…

计算与语言 · 计算机科学 2024-01-17 Hailin Chen , Fangkai Jiao , Xingxuan Li , Chengwei Qin , Mathieu Ravaut , Ruochen Zhao , Caiming Xiong , Shafiq Joty

Generative AI including large language models (LLMs) has recently gained significant interest in the geo-science community through its versatile task-solving capabilities including programming, arithmetic reasoning, generation of sample…

计算机与社会 · 计算机科学 2024-08-14 Hartwig H. Hochmair , Levente Juhasz , Takoda Kemp

As educational systems evolve, ensuring that assessment items remain aligned with content standards is essential for maintaining fairness and instructional relevance. Traditional human alignment reviews are accurate but slow and…

人工智能 · 计算机科学 2025-11-26 Farzan Karimi-Malekabadi , Pooya Razavi , Sonya Powers

The present study aims to explore the capabilities of Language Models (LMs) in tackling high-stakes multiple-choice tests, represented here by the Exame Nacional do Ensino M\'edio (ENEM), a multidisciplinary entrance examination widely…

计算与语言 · 计算机科学 2023-03-31 Desnes Nunes , Ricardo Primi , Ramon Pires , Roberto Lotufo , Rodrigo Nogueira

Large Language Models (LLMs) have demonstrated remarkable zero-shot generalization across various language-related tasks, including search engines. However, existing work utilizes the generative ability of LLMs for Information Retrieval…

计算与语言 · 计算机科学 2024-12-31 Weiwei Sun , Lingyong Yan , Xinyu Ma , Shuaiqiang Wang , Pengjie Ren , Zhumin Chen , Dawei Yin , Zhaochun Ren

The ChatGPT, a lite and conversational variant of Generative Pretrained Transformer 4 (GPT-4) developed by OpenAI, is one of the milestone Large Language Models (LLMs) with billions of parameters. LLMs have stirred up much interest among…

计算与语言 · 计算机科学 2023-08-01 Hanyao Huang , Ou Zheng , Dongdong Wang , Jiayi Yin , Zijin Wang , Shengxuan Ding , Heng Yin , Chuan Xu , Renjie Yang , Qian Zheng , Bing Shi

We introduce ChatGLM, an evolving family of large language models that we have been developing over time. This report primarily focuses on the GLM-4 language series, which includes GLM-4, GLM-4-Air, and GLM-4-9B. They represent our most…