English
Related papers

Related papers: Memory Architectures for Multi-Turn Text-to-SQL: A…

200 papers

This work reframes the Text-to-SQL task as a pathway for teaching large language models (LLMs) to reason over and manipulate tabular data--moving beyond the traditional focus on query generation. We propose a two-stage framework that…

Computation and Language · Computer Science 2025-05-05 Josefa Lia Stoisser , Marc Boubnovski Martell , Julien Fauqueur

In this paper, we present a benchmark to pressure-test today's frontier models' multimodal decision-making capabilities in the very long-context regime (up to one million tokens) and investigate whether these models can learn from large…

Artificial Intelligence · Computer Science 2025-05-26 Anian Ruoss , Fabio Pardo , Harris Chan , Bonnie Li , Volodymyr Mnih , Tim Genewein

This paper presents a novel framework for enhancing reasoning capabilities in large language models (LLMs) by leveraging iterative reasoning and feedback-driven methodologies. Building on the limitations identified in the SimpleBench…

Computation and Language · Computer Science 2024-12-18 Soham Sane , Angus McLean

Recent text-to-SQL models have achieved strong performance, but their effectiveness remains largely confined to SQLite due to dataset limitations. However, real-world applications require SQL generation across multiple dialects with varying…

Computation and Language · Computer Science 2025-05-26 Jipeng Zhang , Haolin Yang , Kehao Miao , Ruiyuan Zhang , Renjie Pi , Jiahui Gao , Xiaofang Zhou

Tool-integrated Text-to-SQL parsing has emerged as a promising paradigm, framing SQL generation as a sequential decision-making process interleaved with tool execution. However, existing reinforcement learning approaches mainly rely on…

Computation and Language · Computer Science 2026-05-08 Yaxun Dai , Baolin Sun , Junying Wang , Pengfei Wang , Yingqi Gao , Xuemei Dong , Mengdie Chu , Xiang Qi , Pingfu Chao

Despite recent advances in understanding and leveraging long-range conversational memory, existing benchmarks still lack systematic evaluation of large language models(LLMs) across diverse memory dimensions, particularly in multi-session…

Computation and Language · Computer Science 2026-01-08 Ye Shen , Dun Pei , Yiqiu Guo , Junying Wang , Yijin Guo , Zicheng Zhang , Qi Jia , Jun Zhou , Guangtao Zhai

In this work, we explore multiple neural architectures adapted for the task of automatic post-editing of machine translation output. We focus on neural end-to-end models that combine both inputs $mt$ (raw MT output) and $src$ (source…

Computation and Language · Computer Science 2017-10-03 Marcin Junczys-Dowmunt , Roman Grundkiewicz

Long-term memory is a critical capability for multimodal large language model (MLLM) agents, particularly in conversational settings where information accumulates and evolves over time. However, existing benchmarks either evaluate…

Computation and Language · Computer Science 2026-01-08 Yuanchen Bei , Tianxin Wei , Xuying Ning , Yanjun Zhao , Zhining Liu , Xiao Lin , Yada Zhu , Hendrik Hamann , Jingrui He , Hanghang Tong

Instruction-tuned language models increasingly rely on large multi-turn dialogue corpora, but these datasets are often noisy and structurally inconsistent, with topic drift, repetitive chitchat, and mismatched answer formats across turns.…

Computation and Language · Computer Science 2026-04-21 Bo Li , Shikun Zhang , Wei Ye

Text-to-SQL generation enables non-experts to interact with databases via natural language. Recent advances rely on large closed-source models like GPT-4 that present challenges in accessibility, privacy, and latency. To address these…

Computation and Language · Computer Science 2025-02-18 Satya Krishna Gorti , Ilan Gofman , Zhaoyan Liu , Jiapeng Wu , Noël Vouitsis , Guangwei Yu , Jesse C. Cresswell , Rasa Hosseinzadeh

Recently, Large Language Models (LLMs) have been demonstrated to possess impressive capabilities in a variety of domains and tasks. We investigate the issue of prompt design in the multi-turn text-to-SQL task and attempt to enhance the…

Computation and Language · Computer Science 2024-05-07 Hanchong Zhang , Ruisheng Cao , Hongshen Xu , Lu Chen , Kai Yu

Autonomous coding agents can produce strong tabular baselines quickly on Kaggle-style tasks. Practical value depends on end-to-end correctness and reliability under time limits. This paper introduces TML-Bench, a tabular benchmark for data…

Machine Learning · Computer Science 2026-03-09 Mykola Pinchuk

Embedding models group text by semantic content, what text is about. We show that temporal co-occurrence within texts discovers a different kind of structure: recurrent transition-structure concepts or what text does. We train a…

Artificial Intelligence · Computer Science 2026-03-20 Jason Dury

Current Text-to-SQL methods are evaluated and only focused on executable queries, overlooking the semantic alignment challenge -- both in terms of the semantic meaning of the query and the correctness of the execution results. Even…

Computation and Language · Computer Science 2025-11-24 Ashish Kattamuri , Ishita Prasad , Meetu Malhotra , Arpita Vats , Rahul Raja , Albert Lie

Existing text-to-SQL semantic parsers are typically designed for particular settings such as handling queries that span multiple tables, domains or turns which makes them ineffective when applied to different settings. We present UniSAr…

Computation and Language · Computer Science 2022-04-14 Longxu Dou , Yan Gao , Mingyang Pan , Dingzirui Wang , Wanxiang Che , Dechen Zhan , Jian-Guang Lou

Multi-turn interactions with language models (LMs) pose critical safety risks, as harmful intent can be strategically spread across exchanges. Yet, the vast majority of prior work has focused on single-turn safety, while adaptability and…

Cryptography and Security · Computer Science 2025-08-26 Salman Rahman , Liwei Jiang , James Shiffer , Genglin Liu , Sheriff Issaka , Md Rizwan Parvez , Hamid Palangi , Kai-Wei Chang , Yejin Choi , Saadia Gabriel

Text-to-SQL enables natural access to databases, yet most benchmarks are English-only, limiting multilingual progress. We introduce MultiSpider 2.0, extending Spider 2.0 to eight languages (English, German, French, Spanish, Portuguese,…

Computation and Language · Computer Science 2025-09-30 Khanh Trinh Pham , Thu Huong Nguyen , Jun Jo , Quoc Viet Hung Nguyen , Thanh Tam Nguyen

Prompt Tuning is emerging as a scalable and cost-effective method to fine-tune Pretrained Language Models (PLMs), which are often referred to as Large Language Models (LLMs). This study benchmarks the performance and computational…

Computation and Language · Computer Science 2024-04-15 Valentin Leonhard Buchner , Lele Cao , Jan-Christoph Kalo , Vilhelm von Ehrenheim

Generating step-by-step "chain-of-thought" rationales has proven effective for improving the performance of large language models on complex reasoning tasks. However, applying such techniques to structured tasks, such as text-to-SQL,…

Computation and Language · Computer Science 2025-02-20 Mingqian He , Yongliang Shen , Wenqi Zhang , Qiuying Peng , Jun Wang , Weiming Lu

While Multimodal Large Language Models (MLLMs) perform strongly on single-turn chart generation, their ability to support real-world exploratory data analysis remains underexplored. In practice, users iteratively refine visualizations…

Computation and Language · Computer Science 2026-02-18 Manav Nitin Kapadnis , Lawanya Baghel , Atharva Naik , Carolyn Rosé