English
Related papers

Related papers: Improving Multi-turn Task Completion in Task-Orien…

200 papers

To make robots accessible to a broad audience, it is critical to endow them with the ability to take universal modes of communication, like commands given in natural language, and extract a concrete desired task specification, defined using…

Computation and Language · Computer Science 2023-03-22 Jiayi Pan , Glen Chou , Dmitry Berenson

Recent research in dialogue systems and corpora has focused on two main categories: task-oriented (TOD) and open-domain (chit-chat) dialogues. TOD systems help users accomplish specific tasks, while open-domain systems aim to create…

Computation and Language · Computer Science 2024-04-30 Wen-Yu Chang , Yun-Nung Chen

Large language models (LLMs) have shown surprisingly good performance in multilingual neural machine translation (MNMT) even when trained without parallel data. Yet, despite the fact that the amount of training data is gigantic, they still…

Computation and Language · Computer Science 2024-08-20 Hongyuan Lu , Haoran Yang , Haoyang Huang , Dongdong Zhang , Wai Lam , Furu Wei

Pre-trained conversation models (PCMs) have demonstrated remarkable results in task-oriented dialogue (TOD) systems. Many PCMs focus predominantly on dialogue management tasks like dialogue state tracking, dialogue generation tasks like…

Computation and Language · Computer Science 2023-12-29 Mingtao Yang , See-Kiong Ng , Jinlan Fu

Language models are aligned to emulate the collective voice of many, resulting in outputs that align with no one in particular. Steering LLMs away from generic output is possible through supervised finetuning or RLHF, but requires…

Computation and Language · Computer Science 2025-04-22 Omar Shaikh , Michelle S. Lam , Joey Hejna , Yijia Shao , Hyundong Cho , Michael S. Bernstein , Diyi Yang

Large language models (LLMs) have demonstrated remarkable performance in zero-shot dialogue state tracking (DST), reducing the need for task-specific training. However, conventional DST benchmarks primarily focus on structured user-agent…

Computation and Language · Computer Science 2025-06-13 Sangmin Song , Juhwan Choi , JungMin Yun , YoungBin Kim

Multilingual task-oriented dialogue (ToD) facilitates access to services and information for many (communities of) speakers. Nevertheless, the potential of this technology is not fully realised, as current datasets for multilingual ToD -…

Computation and Language · Computer Science 2023-05-24 Olga Majewska , Evgeniia Razumovskaia , Edoardo Maria Ponti , Ivan Vulić , Anna Korhonen

Pretrained language models (PLMs) trained on large-scale unlabeled corpus are typically fine-tuned on task-specific downstream datasets, which have produced state-of-the-art results on various NLP tasks. However, the data discrepancy issue…

Computation and Language · Computer Science 2022-03-23 Jiali Zeng , Yufan Jiang , Shuangzhi Wu , Yongjing Yin , Mu Li

While the English virtual assistants have achieved exciting performance with an enormous amount of training resources, the needs of non-English-speakers have not been satisfied well. Up to Dec 2021, Alexa, one of the most popular smart…

Computation and Language · Computer Science 2021-12-24 Michael Sun , Kaili Huang , Mehrad Moradshahi

Large language models (LLMs) are powerful dialogue agents, but specializing them towards fulfilling a specific function can be challenging. Instructing tuning, i.e. tuning models on instruction and sample responses generated by humans…

Computation and Language · Computer Science 2024-01-11 Dennis Ulmer , Elman Mansimov , Kaixiang Lin , Justin Sun , Xibin Gao , Yi Zhang

Large language models (LLMs) have rapidly advanced and demonstrated impressive capabilities. In-Context Learning (ICL) and Parameter-Efficient Fine-Tuning (PEFT) are currently two mainstream methods for augmenting LLMs to downstream tasks.…

Computation and Language · Computer Science 2024-11-21 Luohe Shi , Yao Yao , Zuchao Li , Lefei Zhang , Hai Zhao

Tool-Augmented Larage Language Models (TA-LLMs) have shown promise in real-world applications, but face challenges in handling incomplete queries and out-of-scope requests. While existing approaches rely mainly on Supervised Fine-Tuning…

Computation and Language · Computer Science 2025-07-15 Sunghee Jung , Donghun Lee , Shinbok Lee , Gaeun Seo , Daniel Lee , Byeongil Ko , Junrae Cho , Kihyun Kim , Eunggyun Kim , Myeongcheol Shin

Task-oriented dialogue (TOD) systems have been widely deployed in many industries as they deliver more efficient customer support. These systems are typically constructed for a single domain or language and do not generalise well beyond…

Computation and Language · Computer Science 2023-06-21 Nikita Moghe , Evgeniia Razumovskaia , Liane Guillou , Ivan Vulić , Anna Korhonen , Alexandra Birch

Large Language Models (LLMs) are increasingly employed as AI tutors due to their scalability and potential for personalized instruction. However, off-the-shelf LLMs often underperform in educational settings: they frequently reveal answers…

Computation and Language · Computer Science 2025-08-13 Shuzhou Yuan , William LaCroix , Hardik Ghoshal , Ercong Nie , Michael Färber

Although pre-trained language models encode generic knowledge beneficial for planning and control, they may fail to generate appropriate control policies for domain-specific tasks. Existing fine-tuning methods use human feedback to address…

Artificial Intelligence · Computer Science 2024-04-02 Yunhao Yang , Neel P. Bhatt , Tyler Ingebrand , William Ward , Steven Carr , Zhangyang Wang , Ufuk Topcu

The advent of Large Language Models (LLMs) has drastically enhanced dialogue systems. However, comprehensively evaluating the dialogue abilities of LLMs remains a challenge. Previous benchmarks have primarily focused on single-turn…

Computation and Language · Computer Science 2024-11-06 Ge Bai , Jie Liu , Xingyuan Bu , Yancheng He , Jiaheng Liu , Zhanhui Zhou , Zhuoran Lin , Wenbo Su , Tiezheng Ge , Bo Zheng , Wanli Ouyang

Task-oriented Dialogue Systems (TODS) often face the challenge of encountering new intents. New Intent Discovery (NID) is a crucial task that aims to identify these novel intents while maintaining the capability to recognize existing ones.…

Computation and Language · Computer Science 2025-04-01 Lu Fan , Jiashu Pu , Rongsheng Zhang , Xiao-Ming Wu

Large Language Models (LLMs) have the unique capability to understand and generate human-like text from input queries. When fine-tuned, these models show enhanced performance on domain-specific queries. OpenAI highlights the process of…

Computation and Language · Computer Science 2024-07-02 Scott Barnett , Zac Brannelly , Stefanus Kurniawan , Sheng Wong

Recently, advanced large language models (LLMs) have emerged at an increasingly rapid pace. However, when faced with complex problems, most users are often unable to provide accurate and effective prompts to interact with LLMs, thus…

Computation and Language · Computer Science 2026-04-17 Wenjin Liu , Haoran Luo , Xueyuan Lin , Haoming Liu , Tiesunlong Shen , Jiapu Wang , Rui Mao , Erik Cambria

Large language models (LLMs), such as GPT series and Llama series have demonstrated strong capabilities in natural language processing, contextual understanding, and text generation. In recent years, researchers are trying to enhance the…

Computation and Language · Computer Science 2024-10-08 Ziyang Chen , Stylios Moscholios