中文
相关论文

相关论文: Evaluating the Performance of LLMs on Technical La…

200 篇论文

Recent work utilizes Large Language Models (LLMs) for topic modeling, generating comprehensible topic labels for given documents. However, their performance has mainly been evaluated qualitatively, and there remains room for quantitative…

计算与语言 · 计算机科学 2024-06-26 Tomoki Doi , Masaru Isonuma , Hitomi Yanaka

The use of large language models (LLMs) such as OpenAI's GPT-4 in technical customer support (TCS) has the potential to revolutionize this area. This study examines automated text correction, summarization of customer inquiries and question…

综合经济学 · 经济学 2024-06-04 Jochen Wulf , Jürg Meierhofer

This paper investigates the ability of large language models (LLMs) to solve statistical tasks, as well as their capacity to assess the quality of reasoning. While state-of-the-art LLMs have demonstrated remarkable performance in a range of…

计算与语言 · 计算机科学 2026-01-22 Crish Nagarkar , Leonid Bogachev , Serge Sharoff

Interacting with the legal system and the government requires the assembly and analysis of various pieces of information that can be spread across different (paper) documents, such as forms, certificates and contracts (e.g. leases). This…

计算与语言 · 计算机科学 2024-12-23 Hannes Westermann , Jaromir Savelka

Text normalization - the conversion of text from written to spoken form - is traditionally assumed to be an ill-formed task for language models. In this work, we argue otherwise. We empirically show the capacity of Large-Language Models…

Large Language Models (LLMs) continue to advance natural language processing with their ability to generate human-like text across a range of tasks. Despite the remarkable success of LLMs in Natural Language Processing (NLP), their…

计算与语言 · 计算机科学 2025-07-08 Walid Mohamed Aly , Taysir Hassan A. Soliman , Amr Mohamed AbdelAziz

Modern Artificial Intelligence applications show great potential for language-related tasks that rely on next-word prediction. The current generation of Large Language Models (LLMs) have been linked to claims about human-like linguistic…

计算与语言 · 计算机科学 2024-09-05 Evelina Leivada , Gary Marcus , Fritz Günther , Elliot Murphy

Despite outstanding processes in many tasks, Large Language Models (LLMs) still lack accuracy when dealing with highly technical domains. Especially, telecommunications (telco) is a particularly challenging domain due the large amount of…

计算与语言 · 计算机科学 2024-12-23 Camille Barboule , Viet-Phi Huynh , Adrien Bufort , Yoan Chabot , Géraldine Damnati , Gwénolé Lecorvé

Developers deal with code-change-related tasks daily, e.g., reviewing code. Pre-trained code and code-change-oriented models have been adapted to help developers with such tasks. Recently, large language models (LLMs) have shown their…

软件工程 · 计算机科学 2024-07-04 Lishui Fan , Jiakun Liu , Zhongxin Liu , David Lo , Xin Xia , Shanping Li

Text summarization plays a crucial role in natural language processing by condensing large volumes of text into concise and coherent summaries. As digital content continues to grow rapidly and the demand for effective information retrieval…

Text simplification (TS) refers to the process of reducing the complexity of a text while retaining its original meaning and key information. Existing work only shows that large language models (LLMs) have outperformed supervised…

计算与语言 · 计算机科学 2025-02-13 Jipeng Qiang , Minjiang Huang , Yi Zhu , Yunhao Yuan , Chaowei Zhang , Kui Yu

Large language models (LLMs) have significantly improved their ability to perform tasks in the field of code generation. However, there is still a gap between LLMs being capable coders and being top-tier software engineers. Based on the…

软件工程 · 计算机科学 2025-01-29 Jie JW Wu , Fatemeh H Fard

Large Language Models (LLMs) as chatbots have drawn remarkable attention thanks to their versatile capability in natural language processing as well as in a wide range of tasks. While there has been great enthusiasm towards adopting such…

系统与控制 · 电气工程与系统科学 2024-06-24 Subir Majumder , Lin Dong , Fatemeh Doudi , Yuting Cai , Chao Tian , Dileep Kalathi , Kevin Ding , Anupam A. Thatte , Na Li , Le Xie

The rise of Multimodal Large Language Models (MLLMs) has become a transformative force in the field of artificial intelligence, enabling machines to process and generate content across multiple modalities, such as text, images, audio, and…

A prominent achievement of natural language processing (NLP) is its ability to understand and generate meaningful human language. This capability relies on complex feedforward transformer block architectures pre-trained on large language…

计算与语言 · 计算机科学 2025-11-11 Ronit D. Gross , Yarden Tzach , Tal Halevi , Ella Koresh , Ido Kanter

Large language models (LLMs) show promise in drafting responses to patient portal messages, yet their integration into clinical workflows raises various concerns, including whether they would actually save clinicians time and effort in…

Recently, Large Language Models (LLMs) have drawn significant attention due to their outstanding reasoning capabilities and extensive knowledge repository, positioning them as superior in handling various natural language processing tasks…

计算与语言 · 计算机科学 2023-11-30 Han Cao , Lingwei Wei , Mengyang Chen , Wei Zhou , Songlin Hu

Large Language Models (LLMs) have revolutionized Natural Language Processing but exhibit limitations, particularly in autonomously addressing novel challenges such as reasoning and problem-solving. Traditional techniques like…

多智能体系统 · 计算机科学 2024-01-03 Sumedh Rasal

Large language model (LLM) agents have demonstrated remarkable potential in advancing scientific discovery. However, their capability in the fundamental yet crucial task of reproducing code from research papers, especially in the NLP…

Reasoning Large Language Models (LLMs) have shown promising results when tasked with solving complex problems. In this paper, we propose and evaluate a multi-stage workflow that leverages the capabilities of fine-tuned reasoning LLMs to…

计算与语言 · 计算机科学 2026-01-13 Alberto Purpura , Emily Chen , Swapnil Shinde