中文
相关论文

相关论文: Three Ways of Using Large Language Models to Evalu…

200 篇论文

Large Language Models (LLMs) such as ChatGPT demonstrated the potential to replicate human language abilities through technology, ranging from text generation to engaging in conversations. However, it remains controversial to what extent…

计算与语言 · 计算机科学 2025-07-09 Martin Schuele

Large Language Models (LLMs) have made significant progress in reasoning, demonstrating their capability to generate human-like responses. This study analyzes the problem-solving capabilities of LLMs in the domain of thermodynamics. A…

计算工程、金融与科学 · 计算机科学 2025-12-18 Rebecca Loubet , Pascal Zittlau , Luisa Vollmer , Marco Hoffmann , Sophie Fellenz , Fabian Jirasek , Heike Leitte , Hans Hasse

Digital Simulations (DS) provide safe environments where users interact with an agent through conversational prompts, providing engaging learning experiences that can be used to train teacher candidates in realistic classroom scenarios.…

Automated sentiment analysis using Large Language Model (LLM)-based models like ChatGPT, Gemini or LLaMA2 is becoming widespread, both in academic research and in industrial applications. However, assessment and validation of their…

计算与语言 · 计算机科学 2024-02-06 Alessio Buscemi , Daniele Proverbio

The introduction of ChatGPT has led to a significant increase in the utilization of Large Language Models (LLMs) for addressing downstream tasks. There's an increasing focus on cost-efficient training and deployment within this context.…

This work introduces approaches to assessing phrase breaks in ESL learners' speech using pre-trained language models (PLMs) and large language models (LLMs). There are two tasks: overall assessment of phrase break for a speech clip and…

计算与语言 · 计算机科学 2023-06-09 Zhiyi Wang , Shaoguang Mao , Wenshan Wu , Yan Xia , Yan Deng , Jonathan Tien

Chatbots based on large language models offer cheap conversation practice opportunities for language learners. However, they are hard to control for linguistic forms that correspond to learners' current needs, such as grammar. We control…

计算与语言 · 计算机科学 2025-02-12 Dominik Glandorf , Peng Cui , Detmar Meurers , Mrinmaya Sachan

The landscape for building conversational interfaces (chatbots) has witnessed a paradigm shift with recent developments in generative Artificial Intelligence (AI) based Large Language Models (LLMs), such as ChatGPT by OpenAI (GPT3.5 and…

人机交互 · 计算机科学 2024-07-23 Sumit Soman , Ranjani H G

Large Language Models (LLMs), such as ChatGPT, have become widely popular and widely used in various software engineering tasks such as refactoring, testing, code review, and program comprehension. Although recent studies have examined the…

Large language models (LLMs) like ChatGPT have exhibited remarkable abilities on a wide range of natural language processing~(NLP) tasks, including various machine translation abilities accomplished during chat. However, these models are…

计算与语言 · 计算机科学 2023-11-03 Wenxiang Jiao , Jen-tse Huang , Wenxuan Wang , Zhiwei He , Tian Liang , Xing Wang , Shuming Shi , Zhaopeng Tu

This paper presents a comprehensive performance evaluation of Large Language Models (LLMs) in solving programming challenges from Leetcode, a widely used platform for algorithm practice and technical interviews. We began by crawling the…

软件工程 · 计算机科学 2025-03-04 Lun Wang , Chuanqi Shi , Shaoshui Du , Yiyi Tao , Yixian Shen , Hang Zheng , Yanxin Shen , Xinyu Qiu

Chatbots via large language models (LLMs) generate fluent responses but often struggle with when to speak, especially for brief, timely listener reactions during ongoing dialogue. We present a multimodal strategy for LLMs, which leverages…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Zikai Liao , Yi Ouyang , Yi-Lun Lee , Chen-Ping Yu , Yi-Hsuan Tsai , Zhaozheng Yin

Large Language Models (LLMs) are trained on massive amounts of data, enabling their application across diverse domains and tasks. Despite their remarkable performance, most LLMs are developed and evaluated primarily in English. Recently, a…

计算与语言 · 计算机科学 2024-10-18 Krishno Dey , Prerona Tarannum , Md. Arid Hasan , Imran Razzak , Usman Naseem

In recent years, generative AI has undergone major advancements, demonstrating significant promise in augmenting human productivity. Notably, large language models (LLM), with ChatGPT-4 as an example, have drawn considerable attention.…

人机交互 · 计算机科学 2024-01-23 Sida Peng , Wojciech Swiatek , Allen Gao , Paul Cullivan , Haoge Chang

Large Language Models (LLMs) pre-trained on multilingual data have revolutionized natural language processing research, by transitioning from languages and task specific model pipelines to a single model adapted on a variety of tasks.…

计算与语言 · 计算机科学 2025-01-31 Munief Hassan Tahir , Sana Shams , Layba Fiaz , Farah Adeeba , Sarmad Hussain

Purpose: To assess the alignment of GPT-4-based evaluation to human clinician experts, for the evaluation of responses to ophthalmology-related patient queries generated by fine-tuned LLM chatbots. Methods: 400 ophthalmology questions and…

OpenAI's ChatGPT (GPT-4 and GPT-4o) and other Large Language Models (LLMs) like Microsoft's Copilot, Google's Gemini 1.5 Pro, and Antrophic's Claude 3.5 Sonnet can be effectively used in various phases of scientific research. Their…

人工智能 · 计算机科学 2024-09-24 Goran Bubaš

This paper explores the potential of leveraging Large Language Models (LLMs) for data augmentation in multilingual commonsense reasoning datasets where the available training data is extremely limited. To achieve this, we utilise several…

计算与语言 · 计算机科学 2023-10-24 Chenxi Whitehouse , Monojit Choudhury , Alham Fikri Aji

Interest in Large Language Models (LLMs) has increased drastically since the emergence of ChatGPT and the outstanding positive societal response to the ease with which it performs tasks in Natural Language Processing (NLP). The triumph of…

计算与语言 · 计算机科学 2023-04-06 Oluwatosin Ogundare , Gustavo Quiros Araya

In the rapidly evolving landscape of education, digital technologies have repeatedly disrupted traditional pedagogical methods. This paper explores the latest of these disruptions: the potential integration of large language models (LLMs)…

计算机与社会 · 计算机科学 2023-12-21 Mahyar Abedi , Ibrahem Alshybani , Muhammad Rubayat Bin Shahadat , Michael S. Murillo