English
Related papers

Related papers: DialogueAgents: A Hybrid Agent-Based Speech Synthe…

200 papers

Building dialogue systems requires a large corpus of annotated dialogues. Such datasets are usually created via crowdsourcing, which is expensive and time-consuming. In this paper, we propose \textsc{Dialogic}, a novel dialogue simulation…

Computation and Language · Computer Science 2023-06-07 Zekun Li , Wenhu Chen , Shiyang Li , Hong Wang , Jing Qian , Xifeng Yan

This paper focuses on enhancing human-agent communication by integrating spatial context into virtual agents' non-verbal behaviors, specifically gestures. Recent advances in co-speech gesture generation have primarily utilized data-driven…

Human-Computer Interaction · Computer Science 2024-08-09 Anna Deichler , Simon Alexanderson , Jonas Beskow

We introduce DriveAgent, a novel multi-agent autonomous driving framework that leverages large language model (LLM) reasoning combined with multimodal sensor fusion to enhance situational understanding and decision-making. DriveAgent…

Robotics · Computer Science 2025-05-06 Xinmeng Hou , Wuqi Wang , Long Yang , Hao Lin , Jinglun Feng , Haigen Min , Xiangmo Zhao

Recent advancements in Large Language Models (LLMs) have significantly enhanced conversational agents, making them applicable to various fields (e.g., education, entertainment). Despite their progress, the evaluation of the agents often…

Computation and Language · Computer Science 2025-09-29 Jiho Kim , Woosog Chay , Hyeonji Hwang , Daeun Kyung , Hyunseung Chung , Eunbyeol Cho , Yeonsu Kwon , Yohan Jo , Edward Choi

Synthetic data has become increasingly important for training large language models, especially when real data is scarce, expensive, or privacy-sensitive. Many such generation tasks require coordinated multi-agent workflows, where…

We propose Teamwork Synthesis, a version of the distributed synthesis problem with application to teamwork multi-agent systems. We reformulate the distributed synthesis question by dropping the fixed interaction architecture among agents as…

Logic in Computer Science · Computer Science 2023-05-15 Yehia Abd Alrahman , Nir Piterman

Data scarcity and unreliable self-reporting -- such as concealment or exaggeration -- pose fundamental challenges to psychiatric intake and assessment. We propose a multi-agent synthesis framework that explicitly models patient deception to…

Databases · Computer Science 2026-01-15 Xinyuan Zhang , Zijian Wang , Chang Dao , Juexiao Zhou

The automation of scientific discovery represents a critical milestone in Artificial Intelligence (AI) research. However, existing agentic systems for science suffer from two fundamental limitations: rigid, pre-programmed workflows that…

Artificial Intelligence · Computer Science 2025-10-20 Ed Li , Junyu Ren , Xintian Pan , Cat Yan , Chuanhao Li , Dirk Bergemann , Zhuoran Yang

The complex interaction between social behaviors and climate change requires more than traditional data-driven prediction; it demands interpretable and adaptive analytical frameworks capable of integrating heterogeneous sources of…

Multiagent Systems · Computer Science 2026-03-17 Shan Shan

Full-duplex voice interaction is crucial for natural human computer interaction. We present a framework that decomposes complex dialogue into minimal conversational units, enabling the system to process each unit independently and predict…

Computation and Language · Computer Science 2026-01-30 Haoyuan Yu , Yuxuan Chen , Minjie Cai

The scarcity of data depicting dangerous situations presents a major obstacle to training AI systems for safety-critical applications, such as construction safety, where ethical and logistical barriers hinder real-world data collection.…

Artificial Intelligence · Computer Science 2025-05-21 Vu Dinh Xuan , Hao Vo , David Murphy , Hoang D. Nguyen

In today's data-driven era, fully automated end-to-end data analytics, particularly insight discovery, is critical for discovering actionable insights that assist organizations in making effective decisions. With the rapid advancement of…

Artificial Intelligence · Computer Science 2025-11-25 Xiaochuan Liu , Yuanfeng Song , Xiaoming Yin , Xing Chen

Every individual carries a unique and personal life story shaped by their memories and experiences. However, these memories are often scattered and difficult to organize into a coherent narrative, a challenge that defines the task of…

Human-Computer Interaction · Computer Science 2025-09-30 Shayan Talaei , Meijin Li , Kanu Grover , James Kent Hippler , Diyi Yang , Amin Saberi

The prevailing paradigm in the domain of Open-Domain Dialogue agents predominantly focuses on the English language, encompassing both models and datasets. Furthermore, the financial and temporal investments required for crowdsourcing such…

Computation and Language · Computer Science 2025-03-06 Ahmed Njifenjou , Virgile Sucal , Bassam Jabaian , Fabrice Lefèvre

To build open-domain chatbots that are able to use diverse communicative skills, we propose a novel framework BotsTalk, where multiple agents grounded to the specific target skills participate in a conversation to automatically annotate…

Computation and Language · Computer Science 2022-10-25 Minju Kim , Chaehyeong Kim , Yongho Song , Seung-won Hwang , Jinyoung Yeo

In this paper, we propose a novel text-based talking-head video generation framework that synthesizes high-fidelity facial expressions and head motions in accordance with contextual sentiments as well as speech rhythm and pauses. To be…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Lincheng Li , Suzhen Wang , Zhimeng Zhang , Yu Ding , Yixing Zheng , Xin Yu , Changjie Fan

We introduce a new conversation head generation benchmark for synthesizing behaviors of a single interlocutor in a face-to-face conversation. The capability to automatically synthesize interlocutors which can participate in long and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Mohan Zhou , Yalong Bai , Wei Zhang , Ting Yao , Tiejun Zhao

Existing text-to-SQL synthesis pipelines still conflate executability with semantic validity: syntactic checks and execution-based validation can retain queries that execute successfully while violating database semantics. To address these…

Artificial Intelligence · Computer Science 2026-04-24 Qiang Gao , Zhenping Li , Anqi Zhuo , Yingxiao Zhao , Weibo Geng , Xiaosong Li

Digital storytelling, essential in entertainment, education, and marketing, faces challenges in production scalability and flexibility. The StoryAgent framework, introduced in this paper, utilizes Large Language Models and generative tools…

Computation and Language · Computer Science 2024-06-24 Samuel S. Sohn , Danrui Li , Sen Zhang , Che-Jui Chang , Mubbasir Kapadia

Existing text-to-speech systems predominantly focus on single-sentence synthesis and lack adequate contextual modeling as well as fine-grained performance control capabilities for generating coherent multicast audiobooks. To address these…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-23 Min Liu , JingJing Yin , Xiang Zhang , Siyu Hao , Yanni Hu , Bin Lin , Yuan Feng , Hongbin Zhou , Jianhao Ye