English
Related papers

Related papers: SpotIt+: Verification-based Text-to-SQL Evaluation…

200 papers

Text-to-SQL enables users to interact with databases through natural language, simplifying access to structured data. Although highly capable large language models (LLMs) achieve strong accuracy for complex queries, they incur unnecessary…

Databases · Computer Science 2024-11-08 Mohammadhossein Malekpour , Nour Shaheen , Foutse Khomh , Amine Mhedhbi

In the context-dependent Text-to-SQL task, the generated SQL statements are refined iteratively based on the user input utterance from each interaction. The input text from each interaction can be viewed as component modifications to the…

Computation and Language · Computer Science 2023-08-15 Aiwei Liu , Wei Liu , Xuming Hu , Shuang Li , Fukun Ma , Yawen Yang , Lijie Wen

In the era of large language models, Text-to-SQL, as a natural language interface for databases, is playing an increasingly important role. The sota Text-to-SQL models have achieved impressive accuracy, but their performance critically…

Databases · Computer Science 2026-02-13 Yafeng Nan , Haifeng Sun , Zirui Zhuang , Qi Qi , Guojun Chu , Jianxin Liao , Dan Pei , Jingyu Wang

Most previous scene text spotting methods rely on high-quality manual annotations to achieve promising performance. To reduce their expensive costs, we study semi-supervised text spotting (SSTS) to exploit useful information from unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Dongliang Luo , Hanshen Zhu , Ziyang Zhang , Dingkang Liang , Xudong Xie , Yuliang Liu , Xiang Bai

We present a novel evaluation paradigm for AI text detectors that prioritizes real-world and equitable assessment. Current approaches predominantly report conventional metrics like AUROC, overlooking that even modest false positive rates…

Computation and Language · Computer Science 2025-07-22 Navid Ayoobi , Sadat Shahriar , Arjun Mukherjee

Modularity plays a crucial role in the development and maintenance of complex systems. While end-to-end text spotting efficiently mitigates the issues of error accumulation and sub-optimal performance seen in traditional two-step…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Mingxin Huang , Hongliang Li , Yuliang Liu , Xiang Bai , Lianwen Jin

Due to the ever increasing importance of the internet, interoperability of heterogeneous data sources is as well of ever increasing importance. Interoperability can be achieved e.g. through data integration and data exchange. Common to both…

Databases · Computer Science 2013-04-04 Gosta Grahne , Adrian Onet , Nihat Tartal

The semi-supervised learning (SSL) strategy in lightweight models requires reducing annotated samples and facilitating cost-effective inference. However, the constraint on model parameters, imposed by the scarcity of training labels, limits…

Computation and Language · Computer Science 2024-12-03 Qianren Mao , Weifeng Jiang , Junnan Liu , Chenghua Lin , Qian Li , Xianqing Wen , Jianxin Li , Jinhu Lu

The BERTScore metric is commonly used to evaluate automatic text simplification systems. However, current implementations of the metric fail to provide complete visibility into all information the metric can produce. Notably, the specific…

Computation and Language · Computer Science 2024-09-27 Sebastian Jaskowski , Sahasra Chava , Agam Shah

Text-to-SQL translates natural language questions into executable SQL queries, enabling intuitive database access for non-experts. While large language models achieve strong performance on Text-to-SQL with prompting, they still struggle…

Computation and Language · Computer Science 2026-05-12 Zhao Tan , Xiping Liu , Qing Shu , Qizhi Wan , Dexi Liu , Changxuan Wan

In this paper, we address the problem of searching for semantically similar images from a large database. We present a compact coding approach, supervised quantization. Our approach simultaneously learns feature selection that linearly…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Xiaojuan Wang , Ting Zhang , Guo-Jun Q , Jinhui Tang , Jingdong Wang

The application of Large Language Models (LLMs) to text-to-SQL tasks promises to democratize data access, particularly in critical industries like aviation Maintenance, Repair, and Operation (MRO). However, progress is hindered by two key…

Databases · Computer Science 2025-06-18 Patrick Sutanto , Jonathan Kenrick , Max Lorenz , Joan Santoso

Text-to-SQL models can generate a list of candidate SQL queries, and the best query is often in the candidate list, but not at the top of the list. An effective re-rank method can select the right SQL query from the candidate list and…

Computation and Language · Computer Science 2024-01-05 Zhenwen Li , Tao Xie

Recent advancements in Text-to-SQL have pushed database management systems towards greater democratization of data access. Today's language models are at the core of these advancements. They enable impressive Text-to-SQL generation as…

Computation and Language · Computer Science 2024-06-19 Karime Maamari , Amine Mhedhbi

Text-to-SQL allows experts to use databases without in-depth knowledge of them. However, real-world tasks have both query and data ambiguities. Most works on Text-to-SQL focused on query ambiguities and designed chat interfaces for experts…

Databases · Computer Science 2023-10-31 Zezhou Huang , Pavan Kalyan Damalapati , Eugene Wu

Mining suggestion expressing sentences from a given text is a less investigated sentence classification task, and therefore lacks hand labeled benchmark datasets. In this work, we propose and evaluate two approaches for distant supervision…

Computation and Language · Computer Science 2017-12-06 Sapna Negi , Paul Buitelaar

In this paper we show how prescritive type checking and constraint solving can be combined to increase automation during software verification. We do so by defining a type system and implementing a typechecker for {log} (read `setlog'), a…

Logic in Computer Science · Computer Science 2025-01-22 Maximiliano Cristiá , Gianfranco Rossi

Recently, deep learning-based language models have significantly enhanced text-to-SQL tasks, with promising applications in retrieving patient records within the medical domain. One notable challenge in such applications is discerning…

Computation and Language · Computer Science 2024-04-26 Sangryul Kim , Donghee Han , Sehyun Kim

We introduce MathConstraint, a hard, adaptive benchmark for evaluating the combinatorial reasoning capabilities of LLMs. We combine constraint satisfaction problems with rigorous solver-based verification and design an adaptive generator to…

Machine Learning · Computer Science 2026-05-12 Viresh Pati , Zhengyu Li , Piyush Jha , Rahul Garg , Yatharth Sejpal , Vijay Ganesh

We introduce SQL-Exchange, a framework for mapping SQL queries across different database schemas by preserving the source query structure while adapting domain-specific elements to align with the target schema. We investigate the conditions…

Databases · Computer Science 2026-02-24 Mohammadreza Daviran , Brian Lin , Davood Rafiei