English
Related papers

Related papers: DIALIGHT: Lightweight Multilingual Development and…

200 papers

Large language models (LLMs) have demonstrated remarkable performance in zero-shot dialogue state tracking (DST), reducing the need for task-specific training. However, conventional DST benchmarks primarily focus on structured user-agent…

Computation and Language · Computer Science 2025-06-13 Sangmin Song , Juhwan Choi , JungMin Yun , YoungBin Kim

In task-oriented conversational AI evaluation, unsupervised methods poorly correlate with human judgments, and supervised approaches lack generalization. Recent advances in large language models (LLMs) show robust zeroshot and few-shot…

Computation and Language · Computer Science 2024-06-26 Jinghan Jia , Abi Komma , Timothy Leffel , Xujun Peng , Ajay Nagesh , Tamer Soliman , Aram Galstyan , Anoop Kumar

Achieving robust language technologies that can perform well across the world's many languages is a central goal of multilingual NLP. In this work, we take stock of and empirically analyse task performance disparities that exist between…

Computation and Language · Computer Science 2023-10-20 Songbo Hu , Han Zhou , Moy Yuan , Milan Gritta , Guchun Zhang , Ignacio Iacobacci , Anna Korhonen , Ivan Vulić

Large language models (LLMs) gained immense popularity due to their impressive capabilities in unstructured conversations. Empowering LLMs with advanced prompting strategies such as reasoning and acting (ReAct) (Yao et al., 2022) has shown…

Computation and Language · Computer Science 2025-03-18 Michelle Elizabeth , Morgan Veyret , Miguel Couceiro , Ondrej Dusek , Lina M. Rojas-Barahona

Language models have steadily increased in size over the past few years. They achieve a high level of performance on various natural language processing (NLP) tasks such as question answering and summarization. Large language models (LLMs)…

Computation and Language · Computer Science 2023-01-31 Jessica Huynh , Cathy Jiao , Prakhar Gupta , Shikib Mehri , Payal Bajaj , Vishrav Chaudhary , Maxine Eskenazi

Task-oriented dialogue (ToD) benchmarks provide an important avenue to measure progress and develop better conversational agents. However, existing datasets for end-to-end ToD modeling are limited to a single language, hindering the…

Computation and Language · Computer Science 2021-06-08 Zhaojiang Lin , Andrea Madotto , Genta Indra Winata , Peng Xu , Feijun Jiang , Yuxiang Hu , Chen Shi , Pascale Fung

In task-oriented dialogue (ToD), a user holds a conversation with an artificial agent to complete a concrete task. Although this technology represents one of the central objectives of AI and has been the focus of ever more intense research…

Computation and Language · Computer Science 2022-05-27 Evgeniia Razumovskaia , Goran Glavaš , Olga Majewska , Edoardo M. Ponti , Anna Korhonen , Ivan Vulić

Task-oriented Dialogue Systems (TODS) often face the challenge of encountering new intents. New Intent Discovery (NID) is a crucial task that aims to identify these novel intents while maintaining the capability to recognize existing ones.…

Computation and Language · Computer Science 2025-04-01 Lu Fan , Jiashu Pu , Rongsheng Zhang , Xiao-Ming Wu

This paper explores SynTOD, a new synthetic data generation approach for developing end-to-end Task-Oriented Dialogue (TOD) Systems capable of handling complex tasks such as intent classification, slot filling, conversational…

Computation and Language · Computer Science 2024-04-24 Chris Samarinas , Pracha Promthaw , Atharva Nijasure , Hansi Zeng , Julian Killingback , Hamed Zamani

Tool-augmented large language models (LLMs) are increasingly employed in real-world applications, but tool usage errors still hinder their reliability. We introduce ToolCritic, a diagnostic framework that evaluates and improves LLM behavior…

Artificial Intelligence · Computer Science 2025-10-21 Hassan Hamad , Yingru Xu , Liang Zhao , Wenbo Yan , Narendra Gyanchandani

Large language models (LLMs) have been widely applied in various practical applications, typically comprising billions of parameters, with inference processes requiring substantial energy and computational resources. In contrast, the human…

Software Engineering · Computer Science 2024-12-23 Xin Du , Shifan Ye , Qian Zheng , Yangfan Hu , Rui Yan , Shunyu Qi , Shuyang Chen , Huajin Tang , Gang Pan , Shuiguang Deng

Large language models (LLMs) have displayed massive improvements in reasoning and decision-making skills and can hold natural conversations with users. Many recent works seek to augment LLM-based assistants with external tools so they can…

Computation and Language · Computer Science 2023-11-21 Nicholas Farn , Richard Shin

The reasoning capability of large language models (LLMs), defined as their ability to analyze, infer, and make decisions based on input information, is essential for building intelligent task-oriented dialogue systems. However, existing…

Computation and Language · Computer Science 2026-03-02 Yu Zhu , Kai Yang

Conversational systems based on Large Language Models (LLMs), such as ChatGPT, show exceptional proficiency in context understanding and response generation. However, despite their impressive capabilities, they still possess limitations,…

Computation and Language · Computer Science 2023-10-17 Yang Deng , Lizi Liao , Liang Chen , Hongru Wang , Wenqiang Lei , Tat-Seng Chua

Large language models (LLMs) demonstrate remarkable text comprehension and generation capabilities but often lack the ability to utilize up-to-date or domain-specific knowledge not included in their training data. To address this gap, we…

Computation and Language · Computer Science 2025-09-26 Bo Zhang , Hui Ma , Dailin Li , Jian Ding , Jian Wang , Bo Xu , HongFei Lin

In current text-based task-oriented dialogue (TOD) systems, user emotion detection (ED) is often overlooked or is typically treated as a separate and independent task, requiring additional training. In contrast, our work demonstrates that…

Computation and Language · Computer Science 2024-07-01 Armand Stricker , Patrick Paroubek

In second language learning, scenario-based conversation practice is important for language learners to achieve fluency in speaking, but students often lack sufficient opportunities to practice their conversational skills with qualified…

Computation and Language · Computer Science 2024-04-01 Shuyao Xu , Long Qin , Tianyang Chen , Zhenzhou Zha , Bingxue Qiu , Weizhi Wang

Pretrained language models (PLMs) trained on large-scale unlabeled corpus are typically fine-tuned on task-specific downstream datasets, which have produced state-of-the-art results on various NLP tasks. However, the data discrepancy issue…

Computation and Language · Computer Science 2022-03-23 Jiali Zeng , Yufan Jiang , Shuangzhi Wu , Yongjing Yin , Mu Li

The advent of Large Language Models (LLMs) has drastically enhanced dialogue systems. However, comprehensively evaluating the dialogue abilities of LLMs remains a challenge. Previous benchmarks have primarily focused on single-turn…

Computation and Language · Computer Science 2024-11-06 Ge Bai , Jie Liu , Xingyuan Bu , Yancheng He , Jiaheng Liu , Zhanhui Zhou , Zhuoran Lin , Wenbo Su , Tiezheng Ge , Bo Zheng , Wanli Ouyang

Multimodal large language models (MLLMs), built on large-scale pre-trained vision towers and language models, have shown great capabilities in multimodal understanding. However, most existing MLLMs are trained on single-turn vision…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jiazheng Liu , Sipeng Zheng , Börje F. Karlsson , Zongqing Lu