English
Related papers

Related papers: Mind the Goal: Data-Efficient Goal-Oriented Evalua…

200 papers

Existing benchmarks that assess Language Models (LMs) as Language Agents (LAs) for tool use primarily focus on stateless, single-turn interactions or partial evaluations, such as tool selection in a single turn, overlooking the inherent…

Computation and Language · Computer Science 2025-05-20 Hongru Wang , Wenyu Huang , Yufei Wang , Yuanhao Xi , Jianqiao Lu , Huan Zhang , Nan Hu , Zeming Liu , Jeff Z. Pan , Kam-Fai Wong

The rise of Multi-Agent Systems (MAS) in Artificial Intelligence (AI), especially integrated with Large Language Models (LLMs), has greatly facilitated the resolution of complex tasks. However, current systems are still facing challenges of…

Information Retrieval · Computer Science 2025-09-23 Callie C. Liao , Duoduo Liao , Sai Surya Gadiraju

The growing capabilities of large language models (LLMs) in instruction-following and context-understanding lead to the era of agents with numerous applications. Among these, task planning agents have become especially prominent in…

Product concept evaluation is a critical stage that determines strategic resource allocation and project success in enterprises. However, traditional expert-led approaches face limitations such as subjective bias and high time and cost…

Artificial Intelligence · Computer Science 2026-03-09 Bin Xuan , Ruo Ai , Hakyeon Lee

In an era where single large language models have dominated the landscape of artificial intelligence for years, multi-agent systems arise as new protagonists in conversational task-solving. While previous studies have showcased their…

Computation and Language · Computer Science 2024-11-04 Jonas Becker

Reasoning and planning for mobile robots is a challenging problem, as the world evolves over time and thus the robot's goals may change. One technique to tackle this problem is goal reasoning, where the agent not only reasons about its…

Artificial Intelligence · Computer Science 2022-06-22 Daniel Swoboda , Till Hofmann , Tarik Viehmann , Gerhard Lakemeyer

Task-oriented dialogue (TOD) systems have been widely used by mobile phone intelligent assistants to accomplish tasks such as calendar scheduling or hotel reservation. Current TOD systems usually focus on multi-turn text/speech interaction,…

Computation and Language · Computer Science 2024-03-04 Liangtai Sun , Xingyu Chen , Lu Chen , Tianle Dai , Zichen Zhu , Kai Yu

As multi-turn dialogues with large language models (LLMs) grow longer and more complex, how can users better evaluate and review progress on their conversational goals? We present OnGoal, an LLM chat interface that helps users better manage…

Human-Computer Interaction · Computer Science 2025-08-29 Adam Coscia , Shunan Guo , Eunyee Koh , Alex Endert

Task-oriented dialogue (TOD) system is designed to accomplish user-defined tasks through dialogues. The TOD system has progressed towards end-to-end modeling by leveraging pre-trained large language models. Fine-tuning the pre-trained…

Computation and Language · Computer Science 2024-11-11 Dharmendra Prajapat , Durga Toshniwal

Optimization is as much about modeling the right problem as solving it. Identifying the right objectives, constraints, and trade-offs demands extensive interaction between researchers and stakeholders. Large language models can empower…

Artificial Intelligence · Computer Science 2026-04-06 Joshua Drossman , Alexandre Jacquillat , Sébastien Martin

Current approaches rely on zero-shot evaluation due to the absence of training data; while proprietary models such as GPT-4 exhibit strong reasoning capabilities, smaller open-source models remain ineffective at complex tool use. To address…

Artificial Intelligence · Computer Science 2026-05-05 Hyunji Min , Sangwon Jung , Junyoung Sung , Dosung Lee , Leekyeung Han , Paul Hongsuck Seo

Effective group decision-making is critical in Multi-Agent Systems (MAS). Yet, how different mechanisms for reaching consensus impact collaboration quality and efficiency remains understudied. We conduct a systematic study on group…

Multiagent Systems · Computer Science 2025-06-05 Young-Min Cho , Raphael Shu , Nilaksh Das , Tamer Alkhouli , Yi-An Lai , Jason Cai , Monica Sunkara , Yi Zhang , Dan Roth

Task-oriented dialog(TOD) aims to assist users in achieving specific goals through multi-turn conversation. Recently, good results have been obtained based on large pre-trained models. However, the labeled-data scarcity hinders the…

Computation and Language · Computer Science 2022-12-26 Zhitong Yang , Xing Ma , Anqi Liu , Zheyu Zhang

Intent-based management will play a critical role in achieving customers' expectations in the next-generation mobile networks. Traditional methods cannot perform efficient resource management since they tend to handle each expectation…

Artificial Intelligence · Computer Science 2023-10-27 Kaushik Dey , Satheesh K. Perepu , Abir Das

The integration of experimental technologies with large language models (LLMs) is transforming scientific research. It positions AI as a versatile research assistant rather than a mere problem-solving tool. In the field of power systems,…

Computation and Language · Computer Science 2025-05-20 Mengshuo Jia , Zeyu Cui , Gabriela Hug

Multi-turn Text-to-SQL aims to translate a user's conversational utterances into executable SQL while preserving dialogue coherence and grounding to the target schema. However, most existing systems only regard this task as a simple text…

Computation and Language · Computer Science 2026-04-21 Taicheng Guo , Hai Wang , ChaoChun Liu , Mohsen Golalikhani , Xin Chen , Xiangliang Zhang , Chandan K. Reddy

Large language model-based multi-agent systems have recently gained significant attention due to their potential for complex, collaborative, and intelligent problem-solving capabilities. Existing surveys typically categorize LLM-based…

Multiagent Systems · Computer Science 2026-05-27 Bingyu Yan , Zhibo Zhou , Litian Zhang , Lian Zhang , Ziyi Zhou , Dezhuang Miao , Zhoujun Li , Chaozhuo Li , Xiaoming Zhang

Multi-turn intent classification is notably challenging due to the complexity and evolving nature of conversational contexts. This paper introduces LARA, a Linguistic-Adaptive Retrieval-Augmentation framework to enhance accuracy in…

Computation and Language · Computer Science 2024-10-15 Junhua Liu , Yong Keat Tan , Bin Fu , Kwan Hui Lim

Automating radiology report generation poses a dual challenge: building clinically reliable systems and designing rigorous evaluation protocols. We introduce a multi-agent reinforcement learning framework that serves as both a benchmark and…

Artificial Intelligence · Computer Science 2025-09-23 Ahmed T. Elboardy , Ghada Khoriba , Essam A. Rashed

Goal-oriented conversational interfaces are designed to accomplish specific tasks and typically have interactions that tend to span multiple turns adhering to a pre-defined structure and a goal. However, conventional neural language models…

Computation and Language · Computer Science 2021-06-08 Ashish Shenoy , Sravan Bodapati , Katrin Kirchhoff