中文
相关论文

相关论文: BIRD-INTERACT: Re-imagining Text-to-SQL Evaluation…

200 篇论文

Large Language Models (LLMs) with API-calling capabilities enabled building effective Language Agents (LA), while also revolutionizing the conventional task-oriented dialogue (TOD) paradigm. However, current approaches face a critical…

The potential for improvements brought by Large Language Models (LLMs) in Text-to-SQL systems is mostly assessed on monolingual English datasets. However, LLMs' performance for other languages remains vastly unexplored. In this work, we…

Large Language Models (LLMs) have demonstrated exceptional performance in code generation tasks and have become indispensable programming assistants for developers. However, existing code generation benchmarks primarily assess the…

软件工程 · 计算机科学 2025-11-25 Peiding Wang , Li Zhang , Fang Liu , Lin Shi , Minxiao Li , Bo Shen , An Fu

Large Language Models (LLMs) have revolutionized code generation, evolving from static tools into dynamic conversational interfaces that facilitate complex, multi-turn collaborative programming. While LLMs exhibit remarkable proficiency in…

软件工程 · 计算机科学 2026-03-31 Binquan Zhang , Li Zhang , Lin Shi , Song Wang , Yuwei Qian , Linhui Zhao , Fang Liu , An Fu , Yida Ye

Large Language Models (LLMs) have demonstrated strong performance on various tasks. To unleash their power on the Text-to-SQL task, we propose $R^3$ (Review-Rebuttal-Revision), a consensus-based multi-agent system for Text-to-SQL tasks.…

计算与语言 · 计算机科学 2024-07-12 Hanchen Xia , Feng Jiang , Naihao Deng , Cunxiang Wang , Guojiang Zhao , Rada Mihalcea , Yue Zhang

Large-language models (LLMs) hold significant promise in improving human-robot interaction, offering advanced conversational skills and versatility in managing diverse, open-ended user requests in various tasks and domains. Despite the…

机器人学 · 计算机科学 2024-01-09 Callie Y. Kim , Christine P. Lee , Bilge Mutlu

Spoken Dialogue Models (SDMs) have recently attracted significant attention for their ability to generate voice responses directly to users' spoken queries. Despite their increasing popularity, there exists a gap in research focused on…

计算与语言 · 计算机科学 2025-10-07 Chengqian Ma , Wei Tao , Yiwen Guo

The effectiveness of large language models (LLMs) in conversational AI is hindered by their reliance on single-turn supervised fine-tuning (SFT) data, which limits contextual coherence in multi-turn dialogues. Existing methods for…

计算与语言 · 计算机科学 2025-07-08 Jiangxu Wu , Cong Wang , TianHuang Su , Jun Yang , Haozhi Lin , Chao Zhang , Ming Peng , Kai Shi , SongPan Yang , BinQing Pan , ZiXian Li , Ni Yang , ZhenYu Yang

Recently, instruction-following audio-language models have received broad attention for human-audio interaction. However, the absence of benchmarks capable of evaluating audio-centric interaction capabilities has impeded advancements in…

音频与语音处理 · 电气工程与系统科学 2024-07-29 Qian Yang , Jin Xu , Wenrui Liu , Yunfei Chu , Ziyue Jiang , Xiaohuan Zhou , Yichong Leng , Yuanjun Lv , Zhou Zhao , Chang Zhou , Jingren Zhou

This study explores the potential of Large Language Models (LLMs), specifically GPT-4, to enhance objectivity in organizational task performance evaluations. Through comparative analyses across two studies, including various task…

计算与语言 · 计算机科学 2024-08-13 Ning Li , Huaikang Zhou , Mingze Xu

Many recent studies have shown the ability of large language models (LLMs) to achieve state-of-the-art performance on many NLP tasks, such as question answering, text summarization, coding, and translation. In some cases, the results…

Large Language Models (LLMs) exhibit impressive problem-solving skills across many tasks, but they still underperform compared to humans in various downstream applications, such as text-to-SQL. On the BIRD benchmark leaderboard, human…

计算与语言 · 计算机科学 2024-11-21 Zhibo Chu , Zichong Wang , Qitao Qin

Spurred by recent advances in Large Language Models (LLMs), virtual assistants are poised to take a leap forward in terms of their dialogue capabilities. Yet a major bottleneck to achieving genuinely transformative task-oriented dialogue…

计算与语言 · 计算机科学 2024-05-06 Joe Stacey , Jianpeng Cheng , John Torr , Tristan Guigue , Joris Driesen , Alexandru Coca , Mark Gaynor , Anders Johannsen

Despite significant advancements in Large Language Models (LLMs) and Large Vision-Language Models (LVLMs), current models still face substantial challenges in handling complex, multi-turn, and visually-grounded tasks that demand deep…

计算与语言 · 计算机科学 2025-08-22 Seungmin Han , Haeun Kwon , Ji-jun Park , Taeyang Yoon

Research on Large Language Models (LLMs) has recently witnessed an increasing interest in extending the models' context size to better capture dependencies within long documents. While benchmarks have been proposed to assess long-range…

计算与语言 · 计算机科学 2025-01-20 Thibaut Thonet , Jos Rozen , Laurent Besacier

As organizations increasingly seek to leverage machine learning (ML) capabilities, the technical complexity of implementing ML solutions creates significant barriers to adoption and impacts operational efficiency. This research examines how…

人机交互 · 计算机科学 2025-07-09 Jiapeng Yao , Lantian Zhang , Jiping Huang

Large language models (LLMs) and their variants have shown extraordinary efficacy across numerous downstream natural language processing (NLP) tasks, which has presented a new vision for the development of NLP. Despite their remarkable…

计算与语言 · 计算机科学 2024-01-18 Yazhou Zhang , Mengyao Wang , Youxi Wu , Prayag Tiwari , Qiuchi Li , Benyou Wang , Jing Qin

Research demonstrates that the proactivity of in-vehicle conversational assistants (IVCAs) can help to reduce distractions and enhance driving safety, better meeting users' cognitive needs. However, existing IVCAs struggle with user intent…

人机交互 · 计算机科学 2024-03-15 Huifang Du , Xuejing Feng , Jun Ma , Meng Wang , Shiyu Tao , Yijie Zhong , Yuan-Fang Li , Haofen Wang

Tabular data is prevalent across various industries, necessitating significant time and effort for users to understand and manipulate for their information-seeking purposes. The advancements in large language models (LLMs) have shown…

计算与语言 · 计算机科学 2023-11-01 Yilun Zhao , Haowei Zhang , Shengyun Si , Linyong Nan , Xiangru Tang , Arman Cohan

Fine-tuning large language models (LLMs) for specific domain tasks has achieved great success in Text-to-SQL tasks. However, these fine-tuned models often face challenges with multi-turn Text-to-SQL tasks caused by ambiguous or unanswerable…

人工智能 · 计算机科学 2024-11-12 Yinggang Sun , Ziming Guo , Haining Yu , Chuanyi Liu , Xiang Li , Bingxuan Wang , Xiangzhan Yu , Tiancheng Zhao