中文
相关论文

相关论文: Towards Joint Modeling of Dialogue Response and Sp…

200 篇论文

We describe a system for building task-oriented dialogue systems combining the in-context learning abilities of large language models (LLMs) with the deterministic execution of business logic. LLMs are used to translate between the surface…

计算与语言 · 计算机科学 2024-02-20 Tom Bocklisch , Thomas Werkmeister , Daksh Varshneya , Alan Nichol

This study introduces a groundbreaking approach to simultaneous interpretation by directly leveraging the predictive capabilities of Large Language Models (LLMs). We present a novel algorithm that generates real-time translations by…

计算与语言 · 计算机科学 2024-07-22 Kurando Iida , Kenjiro Mimura , Nobuo Ito

Voice-based conversational AI systems increasingly rely on cascaded architectures that combine speech-to-text (STT), large language models (LLMs), and text-to-speech (TTS) components. We present a large-scale empirical comparison of STT x…

音频与语音处理 · 电气工程与系统科学 2025-08-25 Rumi Allbert , Nima Yazdani , Ali Ansari , Aruj Mahajan , Amirhossein Afsharrad , Seyed Shahabeddin Mousavi

Automatic evaluation is an integral aspect of dialogue system research. The traditional reference-based NLG metrics are generally found to be unsuitable for dialogue assessment. Consequently, recent studies have suggested various unique,…

计算与语言 · 计算机科学 2024-01-23 Chen Zhang , Luis Fernando D'Haro , Yiming Chen , Malu Zhang , Haizhou Li

This study investigates the design, development, and evaluation of a Large Language Model (LLM)-based chatbot for teaching English conversations in an English as a Foreign Language (EFL) context. Employing the Design and Development…

Turn-taking is a fundamental mechanism in human communication that ensures smooth and coherent verbal interactions. Recent advances in Large Language Models (LLMs) have motivated their use in improving the turn-taking capabilities of Spoken…

计算与语言 · 计算机科学 2024-10-22 Muhammad Umair , Vasanth Sarathy , JP de Ruiter

The advent of large language models (LLMs) has made it possible to generate natural written dialogues between two agents. However, generating human-like spoken dialogues from these written dialogues remains challenging. Spoken dialogues…

计算与语言 · 计算机科学 2023-10-03 Kentaro Mitsui , Yukiya Hono , Kei Sawada

Recently, large language models (LLMs), such as GPT-4, stand out remarkable conversational abilities, enabling them to engage in dynamic and contextually relevant dialogues across a wide range of topics. However, given a long conversation,…

计算与语言 · 计算机科学 2025-08-26 Qingyue Wang , Yanhe Fu , Yanan Cao , Shuai Wang , Zhiliang Tian , Liang Ding

People have long hoped for a conversational system that can assist in real-life situations, and recent progress on large language models (LLMs) is bringing this idea closer to reality. While LLMs are often impressive in performance, their…

计算与语言 · 计算机科学 2025-02-06 Linkai Peng , Baorian Nuchged , Yingming Gao

We investigate the use of Large Language Models (LLMs) to equip neural robotic agents with human-like social and cognitive competencies, for the purpose of open-ended human-robot conversation and collaboration. We introduce a modular and…

机器人学 · 计算机科学 2024-09-30 Philipp Allgeuer , Hassan Ali , Stefan Wermter

Speech understanding is essential for interpreting the diverse forms of information embedded in spoken language, including linguistic, paralinguistic, and non-linguistic cues that are vital for effective human-computer interaction. The…

音频与语音处理 · 电气工程与系统科学 2025-12-08 Jing Peng , Yucheng Wang , Bohan Li , Yiwei Guo , Hankun Wang , Yangui Fang , Yu Xi , Haoyu Li , Xu Li , Ke Zhang , Shuai Wang , Kai Yu

The fusion of human-centric design and artificial intelligence (AI) capabilities has opened up new possibilities for next-generation autonomous vehicles that go beyond transportation. These vehicles can dynamically interact with passengers…

人机交互 · 计算机科学 2023-10-13 Can Cui , Yunsheng Ma , Xu Cao , Wenqian Ye , Ziran Wang

The emergence of instruction-tuned large language models (LLMs) has advanced the field of dialogue systems, enabling both realistic user simulations and robust multi-turn conversational agents. However, existing research often evaluates…

计算与语言 · 计算机科学 2025-07-22 Chalamalasetti Kranti , Sherzod Hakimov , David Schlangen

In recent years, large language models (LLMs) have rapidly proliferated and have been utilized in various tasks, including research in dialogue systems. We aimed to construct a system that not only leverages the flexible conversational…

计算与语言 · 计算机科学 2023-12-25 Katsumasa Yoshikawa , Takato Yamazaki , Masaya Ohagi , Tomoya Mizumoto , Keiya Sato

One of the major impediments to the development of new task-oriented dialogue (TOD) systems is the need for human evaluation at multiple stages and iterations of the development process. In an effort to move toward automated evaluation of…

计算与语言 · 计算机科学 2023-09-26 Sam Davidson , Salvatore Romeo , Raphael Shu , James Gung , Arshit Gupta , Saab Mansour , Yi Zhang

We have reached a practical and realistic phase in human-support dialogue agents by developing a large language model (LLM). However, when requiring expert knowledge or anticipating the utterance content using the massive size of the…

人机交互 · 计算机科学 2023-12-22 Naoki Yoshimaru , Motoharu Okuma , Takamasa Iio , Kenji Hatano

Large language models (LLMs), due to their advanced natural language capabilities, have seen significant success in applications where the user interface is usually a conversational artificial intelligence (AI) agent and engages the user…

计算与语言 · 计算机科学 2025-03-10 Fei Wei , Yaliang Li , Bolin Ding

As large language models (LLMs) increasingly permeate daily lives, there is a growing demand for real-time interactions that mirror human conversations. Traditional turn-based chat systems driven by LLMs prevent users from verbally…

计算与语言 · 计算机科学 2026-01-14 Xinrong Zhang , Yingfa Chen , Shengding Hu , Xu Han , Zihang Xu , Yuanwei Xu , Weilin Zhao , Maosong Sun , Zhiyuan Liu

Large Language Models (LLMs) have showcased remarkable capabilities in various Natural Language Processing tasks. For automatic open-domain dialogue evaluation in particular, LLMs have been seamlessly integrated into evaluation frameworks,…

计算与语言 · 计算机科学 2024-07-08 John Mendonça , Alon Lavie , Isabel Trancoso

In this paper, we introduce ConversaSynth, a framework designed to generate synthetic conversation audio using large language models (LLMs) with multiple persona settings. The framework first creates diverse and coherent text-based…

声音 · 计算机科学 2025-07-08 Kaung Myat Kyaw , Jonathan Hoyin Chan