English
Related papers

Related papers: TalkPlayData 2: An Agentic Synthetic Data Pipeline…

200 papers

Real-time, intelligent, and natural speech interaction is an essential part of the next-generation human-computer interaction. Recent advancements have showcased the potential of building intelligent spoken chatbots based on large language…

Computation and Language · Computer Science 2025-05-06 Qingkai Fang , Yan Zhou , Shoutao Guo , Shaolei Zhang , Yang Feng

The growing availability of music on streaming platforms has led to information overload for users. To address this issue and enhance the user experience, increasingly sophisticated recommendation systems have been proposed. This work…

Information Retrieval · Computer Science 2025-08-19 Ronald Carvalho Boadana , Ademir Guimarães da Costa Junior , Ricardo Rios , Fábio Santos da Silva

Tool-calling agents are increasingly deployed in real-world customer-facing workflows. Yet most studies on tool-calling agents focus on idealized settings with general, fixed, and well-specified tasks. In real-world applications, user…

Computation and Language · Computer Science 2026-04-23 Ziyi Wang , Yuxuan Lu , Yimeng Zhang , Pei Chen , Ziwei Dong , Jing Huang , Jiri Gesi , Xianfeng Tang , Chen Luo , Qun Liu , Yisi Sang , Hanqing Lu , Manling Li , Jin Lai , Dakuo Wang

Human communication is a complex and diverse process that not only involves multiple factors such as language, commonsense, and cultural backgrounds but also requires the participation of multimodal information, such as speech. Large…

Computation and Language · Computer Science 2024-01-09 Dong Zhang , Zhaowei Li , Pengyu Wang , Xin Zhang , Yaqian Zhou , Xipeng Qiu

The era of Large Language Models (LLMs) presents a new opportunity for interpretability--agentic interpretability: a multi-turn conversation with an LLM wherein the LLM proactively assists human understanding by developing and leveraging a…

Artificial Intelligence · Computer Science 2025-06-17 Been Kim , John Hewitt , Neel Nanda , Noah Fiedel , Oyvind Tafjord

Interactive conversational recommender systems have gained significant attention for their ability to capture user preferences through natural language interactions. However, existing approaches face substantial challenges in handling…

Artificial Intelligence · Computer Science 2025-10-03 Bo Ma , Hang Li , ZeHua Hu , XiaoFan Gui , LuYao Liu , Simon Lau

Young people's mental well-being is a global concern, with peer support playing a key role in daily emotional regulation. Conversational agents are increasingly viewed as promising tools for delivering accessible, personalised peer support,…

Human-Computer Interaction · Computer Science 2025-12-01 Ruoyu Wen , Xiaoli Wu , Kunal Gupta , Simon Hoermann , Mark Billinghurst , Alaeddin Nassani , Dwain Allan , Thammathip Piumsomboon

Creating effective dialogue systems for mental health support requires high-quality multi-turn counseling dialogue data, yet collecting real counselor-client conversations presents significant challenges, including privacy concerns, high…

Computation and Language · Computer Science 2026-05-27 Huachuan Qiu , Zhenzhong Lan

LLM-based agents have emerged as transformative tools capable of executing complex tasks through iterative planning and action, achieving significant advancements in understanding and addressing user needs. Yet, their effectiveness remains…

Human-Computer Interaction · Computer Science 2025-08-26 Mithat Can Ozgun , Jiahuan Pei , Koen Hindriks , Lucia Donatelli , Qingzhi Liu , Junxiao Wang

Developing expressive and responsive conversational digital humans is a cornerstone of next-generation human-computer interaction. While large language models (LLMs) have significantly enhanced dialogue capabilities, most current systems…

Machine Learning · Computer Science 2026-02-06 Xiaolin Hu , Hang Yuan , Xinzhu Sang , Binbin Yan , Zhou Yu , Cong Huang , Kai Chen

Training effective AI agents for multi-turn interactions requires high-quality data that captures realistic human-agent dynamics, yet such data is scarce and expensive to collect manually. We introduce APIGen-MT, a two-phase framework that…

Chatbots via large language models (LLMs) generate fluent responses but often struggle with when to speak, especially for brief, timely listener reactions during ongoing dialogue. We present a multimodal strategy for LLMs, which leverages…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Zikai Liao , Yi Ouyang , Yi-Lun Lee , Chen-Ping Yu , Yi-Hsuan Tsai , Zhaozheng Yin

Recent breakthroughs in Large Language Models (LLMs) have led to the emergence of agentic AI systems that extend beyond the capabilities of standalone models. By empowering LLMs to perceive external environments, integrate multimodal…

Artificial Intelligence · Computer Science 2025-03-24 Chengkai Huang , Junda Wu , Yu Xia , Zixu Yu , Ruhan Wang , Tong Yu , Ruiyi Zhang , Ryan A. Rossi , Branislav Kveton , Dongruo Zhou , Julian McAuley , Lina Yao

This paper introduces Agentics, a functional agentic AI framework for building LLM-based structured data workflow pipelines. Designed for both research and practical applications, Agentics offers a new data-centric paradigm in which agents…

LLM agents are rapidly becoming the practical interface for task automation, yet the ecosystem lacks a principled way to choose among an exploding space of deployable configurations. Existing LLM leaderboards and tool/agent benchmarks…

Artificial Intelligence · Computer Science 2026-03-05 Yunxiao Shi , Wujiang Xu , Tingwei Chen , Haoning Shang , Ling Yang , Yunfeng Wan , Zhuo Cao , Xing Zi , Dimitris N. Metaxas , Min Xu

Current audio generation conditioned by text or video focuses on aligning audio with text/video modalities. Despite excellent alignment results, these multimodal frameworks still cannot be directly applied to compelling movie storytelling…

Sound · Computer Science 2025-06-03 Zixuan Wang , Chi-Keung Tang , Yu-Wing Tai

Audio large language models (AudioLLMs) enable instruction-following over speech and general audio, but progress is increasingly limited by the lack of diverse, conversational, instruction-aligned speech-text data. This bottleneck is…

Data preparation, which aims to transform heterogeneous and noisy raw tables into analysis-ready data, remains a major bottleneck in data science. Recent approaches leverage large language models (LLMs) to automate data preparation from…

Databases · Computer Science 2026-02-10 Meihao Fan , Ju Fan , Yuxin Zhang , Shaolei Zhang , Xiaoyong Du , Jie Song , Peng Li , Fuxin Jiang , Tieying Zhang , Jianjun Chen

Tool-augmented LLMs are a promising approach to create AI agents that can have realistic conversations, follow procedures, and call appropriate functions. However, evaluating them is challenging due to the diversity of possible…

Computation and Language · Computer Science 2024-10-11 Samuel Arcadinho , David Aparicio , Mariana Almeida

Conversational diagnosis prediction requires models to track evolving evidence in streaming clinical conversations and decide when to commit to a diagnosis. Existing medical dialogue corpora are largely dyadic or lack the multi-party…

Computation and Language · Computer Science 2026-04-21 Xueren Ge , Sahil Murtaza , Anthony Cortez , Homa Alemzadeh