English
Related papers

Related papers: Can ChatGPT Detect Intent? Evaluating Large Langua…

200 papers

Intent detection and slot filling are two main tasks for building a spoken language understanding(SLU) system. Multiple deep learning based models have demonstrated good results on these tasks . The most effective algorithms are based on…

Computation and Language · Computer Science 2018-12-27 Yu Wang , Yilin Shen , Hongxia Jin

Previous work has shown that there exists a scaling law between the size of Language Models (LMs) and their zero-shot performance on different downstream NLP tasks. In this work, we show that this phenomenon does not hold when evaluating…

Computation and Language · Computer Science 2022-09-27 Joel Jang , Seonghyeon Ye , Minjoon Seo

Large language models (LLMs) such as ChatGPT and GPT-4 have demonstrated impressive capabilities in various generative tasks. However, their performance is often hampered by limitations in accessing and leveraging long-term memory, leading…

Artificial Intelligence · Computer Science 2024-07-16 Zhongsheng Wang , Jiamou Liu , Qiming Bao , Hongfei Rong , Jingfeng Zhang

Multi-modal large language models are regarded as a crucial step towards Artificial General Intelligence (AGI) and have garnered significant interest with the emergence of ChatGPT. However, current speech-language models typically adopt the…

Computation and Language · Computer Science 2023-05-22 Dong Zhang , Shimin Li , Xin Zhang , Jun Zhan , Pengyu Wang , Yaqian Zhou , Xipeng Qiu

Intent modelling has become an important part of modern dialogue systems. With the rapid expansion of practical dialogue systems and virtual assistants, such as Amazon Alexa, Apple Siri, and Google Assistant, the interest has only…

Computation and Language · Computer Science 2021-05-11 Sindre André Jacobsen , Anton Ragni

Large language models (LLMs) have demonstrated notable proficiency in code generation, with numerous prior studies showing their promising capabilities in various development scenarios. However, these studies mainly provide evaluations in…

Software Engineering · Computer Science 2024-03-19 Kailun Jin , Chung-Yu Wang , Hung Viet Pham , Hadi Hemmati

Spoken Language Understanding (SLU) consists of two sub-tasks: intent detection (ID) and slot filling (SF). Given its broad range of real-world applications, enhancing SLU for practical deployment is increasingly critical. Profile-based SLU…

Artificial Intelligence · Computer Science 2025-11-25 Di Wu , Liting Jiang , Ruiyu Fang , Bianjing , Hongyan Xie , Haoxiang Su , Hao Huang , Zhongjiang He , Shuangyong Song , Xuelong Li

Joint intent detection and slot filling, which is also termed as joint NLU (Natural Language Understanding) is invaluable for smart voice assistants. Recent advancements in this area have been heavily focusing on improving accuracy using…

Machine Learning · Computer Science 2023-09-27 Kalpa Gunaratna , Vijay Srinivasan , Hongxia Jin

Large language models (LLMs) implicitly learn to perform a range of language tasks, including machine translation (MT). Previous studies explore aspects of LLMs' MT capabilities. However, there exist a wide variety of languages for which…

Computation and Language · Computer Science 2023-09-15 Nathaniel R. Robinson , Perez Ogayo , David R. Mortensen , Graham Neubig

Artificial Intelligence (AI) advancements have enabled the development of Large Language Models (LLMs) that can perform a variety of tasks with remarkable semantic understanding and accuracy. ChatGPT is one such LLM that has gained…

Software Engineering · Computer Science 2024-08-02 M. Mehdi Kholoosi , M. Ali Babar , Roland Croft

Large Language Models (LLMs) have emerged as transformative tools for natural language understanding and user intent resolution, enabling tasks such as translation, summarization, and, increasingly, the orchestration of complex workflows.…

Software Engineering · Computer Science 2025-11-12 Justus Flerlage , Alexander Acker , Odej Kao

As Large-Scale Language Models (LLMs) continue to evolve, they demonstrate significant enhancements in performance and an expansion of functionalities, impacting various domains, including education. In this study, we conducted interviews…

Human-Computer Interaction · Computer Science 2024-07-18 He Zhang , Jingyi Xie , Chuhao Wu , Jie Cai , ChanMin Kim , John M. Carroll

Scientific workflow systems are increasingly popular for expressing and executing complex data analysis pipelines over large datasets, as they offer reproducibility, dependability, and scalability of analyses by automatic parallelization on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-09 Mario Sänger , Ninon De Mecquenem , Katarzyna Ewa Lewińska , Vasilis Bountris , Fabian Lehmann , Ulf Leser , Thomas Kosch

Recently, various illustrative examples have shown the impressive ability of generative large language models (LLMs) to perform NLP related tasks. ChatGPT undoubtedly is the most representative model. We empirically evaluate ChatGPT's…

Software Engineering · Computer Science 2023-07-20 Jianzhang Zhang , Yiyang Chen , Nan Niu , Yinglin Wang , Chuang Liu

When asked, large language models (LLMs) like ChatGPT claim that they can assist with relevance judgments but it is not clear whether automated judgments can reliably be used in evaluations of retrieval systems. In this perspectives paper,…

Large language models (LLMs) like ChatGPT have exhibited remarkable abilities on a wide range of natural language processing~(NLP) tasks, including various machine translation abilities accomplished during chat. However, these models are…

Computation and Language · Computer Science 2023-11-03 Wenxiang Jiao , Jen-tse Huang , Wenxuan Wang , Zhiwei He , Tian Liang , Xing Wang , Shuming Shi , Zhaopeng Tu

ChatGPT, the first large language model (LLM) with mass adoption, has demonstrated remarkable performance in numerous natural language tasks. Despite its evident usefulness, evaluating ChatGPT's performance in diverse problem domains…

Computation and Language · Computer Science 2024-08-23 Rachith Aiyappa , Jisun An , Haewoon Kwak , Yong-Yeol Ahn

Dialogue State Tracking (DST) is of paramount importance in ensuring accurate tracking of user goals and system actions within task-oriented dialogue systems. The emergence of large language models (LLMs) such as GPT3 and ChatGPT has…

Computation and Language · Computer Science 2023-10-24 Yujie Feng , Zexin Lu , Bo Liu , Liming Zhan , Xiao-Ming Wu

Pretrained Large Language Models (LLMs) have achieved remarkable success across diverse domains, with education and research emerging as particularly impactful areas. Among current state-of-the-art LLMs, ChatGPT and DeepSeek exhibit strong…

Artificial Intelligence · Computer Science 2025-12-10 Md Mostafizer Rahman , Ariful Islam Shiplu , Md Faizul Ibne Amin , Yutaka Watanobe , Lu Peng

The increased presence of large language models (LLMs) in educational settings has ignited debates concerning negative repercussions, including overreliance and inadequate task reflection. Our work advocates moderated usage of such models,…