English
Related papers

Related papers: A Multimodal Conversational Agent for Tabular Data…

200 papers

In spoken Task-Oriented Dialogue (TOD) systems, the choice of the semantic representation describing the users' requests is key to a smooth interaction. Indeed, the system uses this representation to reason over a database and its domain…

Artificial Intelligence · Computer Science 2024-06-21 Lucas Druart , Valentin Vielzeuf , Yannick Estève

The rise of big data has amplified the need for efficient, user-friendly automated machine learning (AutoML) tools. However, the intricacy of understanding domain-specific data and defining prediction tasks necessitates human intervention…

Computation and Language · Computer Science 2023-05-24 Md Mahadi Hassan , Alex Knipper , Shubhra Kanti Karmaker Santu

Large Language Models (LLMs) with API-calling capabilities enabled building effective Language Agents (LA), while also revolutionizing the conventional task-oriented dialogue (TOD) paradigm. However, current approaches face a critical…

Human conversation involves language, speech, and visual cues, with each medium providing complementary information. For instance, speech conveys a vibe or tone not fully captured by text alone. While multimodal LLMs focus on generating…

Human-Computer Interaction · Computer Science 2025-09-19 Taesoo Kim , Yongsik Jo , Hyunmin Song , Taehwan Kim

Open-domain dialogue systems have seen remarkable advancements with the development of large language models (LLMs). Nonetheless, most existing dialogue systems predominantly focus on brief single-session interactions, neglecting the…

Computation and Language · Computer Science 2025-02-14 Hao Li , Chenghao Yang , An Zhang , Yang Deng , Xiang Wang , Tat-Seng Chua

This paper presents a Large Language Model (LLM) based conversational agent system designed to enhance human-machine collaboration in Machine Learning Operations (MLOps). We introduce the Swarm Agent, an extensible architecture that…

Artificial Intelligence · Computer Science 2025-11-11 George Fatouros , Georgios Makridis , George Kousiouris , John Soldatos , Anargyros Tsadimas , Dimosthenis Kyriazis

Recent advances in Large Language Models (LLMs) have significantly improved table understanding tasks such as Table Question Answering (TableQA), yet challenges remain in ensuring reliability, scalability, and efficiency, especially in…

Computation and Language · Computer Science 2026-04-22 Sieun Hyeon , Jusang Oh , Sunghwan Steve Cho , Jaeyoung Do

Large Language Models (LLMs) have demonstrated remarkable performance across various disciplines and tasks. However, benchmarking their capabilities with multilingual spoken queries remains largely unexplored. In this study, we introduce…

Computation and Language · Computer Science 2025-05-27 Firoj Alam , Md Arid Hasan , Shammur Absar Chowdhury

Large Language Models (LLMs) have emerged as powerful tools for automating and executing complex data tasks. However, their integration into more complex data workflows introduces significant management challenges. In response, we present…

Databases · Computer Science 2025-06-24 Jinjin Zhao , Sanjay Krishnan

This paper presents a novel application of large language models (LLMs) to enhance user comprehension of privacy policies through an interactive dialogue agent. We demonstrate that LLMs significantly outperform traditional models in tasks…

Human-Computer Interaction · Computer Science 2024-10-17 Bolun Sun , Yifan Zhou , Haiyun Jiang

Conversational agents have made significant progress since ELIZA, expanding their role across various domains, including healthcare, education, and customer service. As these agents become increasingly integrated into daily human…

Human-Computer Interaction · Computer Science 2025-07-04 Paulo Ricardo Knob , Leonardo Scholler , Juliano Rigatti , Soraia Raupp Musse

Large language models (LLMs) have achieved superior performance in powering text-based AI agents, endowing them with decision-making and reasoning abilities akin to humans. Concurrently, there is an emerging research trend focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Junlin Xie , Zhihong Chen , Ruifei Zhang , Xiang Wan , Guanbin Li

The advancement of large language models (LLMs) prompts the development of multi-modal agents, which are used as a controller to call external tools, providing a feasible way to solve practical tasks. In this paper, we propose a multi-modal…

Artificial Intelligence · Computer Science 2025-02-04 Zhi Gao , Bofei Zhang , Pengxiang Li , Xiaojian Ma , Tao Yuan , Yue Fan , Yuwei Wu , Yunde Jia , Song-Chun Zhu , Qing Li

The evolution of Large Language Models (LLMs) has showcased remarkable capacities for logical reasoning and natural language comprehension. These capabilities can be leveraged in solutions that semantically and textually model complex…

Human-Computer Interaction · Computer Science 2024-04-17 Syed Mekael Wasti , Ken Q. Pu , Ali Neshati

Conversational agents show the promise to allow users to interact with mobile devices using language. However, to perform diverse UI tasks with natural language, developers typically need to create separate datasets and models for each…

Human-Computer Interaction · Computer Science 2023-02-21 Bryan Wang , Gang Li , Yang Li

Developing expressive and responsive conversational digital humans is a cornerstone of next-generation human-computer interaction. While large language models (LLMs) have significantly enhanced dialogue capabilities, most current systems…

Machine Learning · Computer Science 2026-02-06 Xiaolin Hu , Hang Yuan , Xinzhu Sang , Binbin Yan , Zhou Yu , Cong Huang , Kai Chen

Access to humanities research databases is often hindered by the limitations of traditional interaction formats, particularly in the methods of searching and response generation. This study introduces an LLM-based smart assistant designed…

Computation and Language · Computer Science 2025-06-03 Alexander Sergeev , Valeriya Goloviznina , Mikhail Melnichenko , Evgeny Kotelnikov

Recent advancements in large language models (LLMs) have revolutionized various domains, bringing significant progress and new opportunities. Despite progress in speech-related tasks, LLMs have not been sufficiently explored in multi-talker…

Computation and Language · Computer Science 2025-04-03 Lingwei Meng , Shujie Hu , Jiawen Kang , Zhaoqing Li , Yuejiao Wang , Wenxuan Wu , Xixin Wu , Xunying Liu , Helen Meng

Translating natural language queries into SQL queries (NL2SQL or Text-to-SQL) has recently been empowered by large language models (LLMs). Using LLMs to perform NL2SQL methods on a large collection of SQL databases necessitates processing…

Artificial Intelligence · Computer Science 2025-10-17 Dominik Jehle , Lennart Purucker , Frank Hutter

Large Language Model (LLM) agents have developed rapidly in recent years to solve complex real-world problems using external tools. However, the scarcity of high-quality trajectories still hinders the development of stronger LLM agents.…

Artificial Intelligence · Computer Science 2025-12-08 Chen Yang , Ran Le , Yun Xing , Zhenwei An , Zongchao Chen , Wayne Xin Zhao , Yang Song , Tao Zhang