English
Related papers

Related papers: The Interpretability Analysis of the Model Can Bri…

200 papers

Text-to-SQL systems translate natural language (NL) questions into SQL queries, enabling non-technical users to interact with structured data. While large language models (LLMs) have shown promising results on the text-to-SQL task, they…

Computation and Language · Computer Science 2025-06-06 Yue Gong , Chuan Lei , Xiao Qin , Kapil Vaidya , Balakrishnan Narayanaswamy , Tim Kraska

Current machine learning models are evaluated through behavioral snapshots, with benchmark accuracies, win rates and outcome-based metrics. Model explanations and evaluations, however, are fundamentally intertwined: understanding why a…

Computers and Society · Computer Science 2026-05-08 Isabelle Lee , Emmy Liu , Cathy Jiao , Brihi Joshi , Dani Yogatama , Fazl Barez , Michael Saxon

Speech-to-SQL (S2SQL) aims to convert spoken questions into SQL queries given relational databases, which has been traditionally implemented in a cascaded manner while facing the following challenges: 1) model training is faced with the…

Computation and Language · Computer Science 2023-05-23 Huadai Liu , Rongjie Huang , Jinzheng He , Gang Sun , Ran Shen , Xize Cheng , Zhou Zhao

Assisted text input techniques can save time and effort and improve text quality. In this paper, we investigate how grounded and conditional extensions to standard neural language models can bring improvements in the tasks of word…

Computation and Language · Computer Science 2016-10-21 Georgios P. Spithourakis , Steffen E. Petersen , Sebastian Riedel

Interpretable machine learning offers insights into what factors drive a certain prediction of a black-box system. A large number of interpreting methods focus on identifying explanatory input features, which generally fall into two main…

Machine Learning · Computer Science 2023-06-02 Vy Vo , Van Nguyen , Trung Le , Quan Hung Tran , Gholamreza Haffari , Seyit Camtepe , Dinh Phung

Conventional meta analysis of model performance conducted using datasources from different underlying populations often result in estimates that cannot be interpreted in the context of a well defined target population. In this manuscript we…

Methodology · Statistics 2024-09-23 Jon A. Steingrimsson , Lan Wen , Sarah Voter , Issa J. Dahabreh

Text-to-SQL generation enables non-experts to interact with databases via natural language. Recent advances rely on large closed-source models like GPT-4 that present challenges in accessibility, privacy, and latency. To address these…

Computation and Language · Computer Science 2025-02-18 Satya Krishna Gorti , Ilan Gofman , Zhaoyan Liu , Jiapeng Wu , Noël Vouitsis , Guangwei Yu , Jesse C. Cresswell , Rasa Hosseinzadeh

Generative AI models offer powerful capabilities but often lack transparency, making it difficult to interpret their output. This is critical in cases involving artistic or copyrighted content. This work introduces a search-inspired…

Artificial Intelligence · Computer Science 2025-04-03 Theodoros Aivalis , Iraklis A. Klampanos , Antonis Troumpoukis , Joemon M. Jose

Interpretability in Table Question Answering (Table QA) is critical, especially in high-stakes domains like finance and healthcare. While recent Table QA approaches based on Large Language Models (LLMs) achieve high accuracy, they often…

Computation and Language · Computer Science 2025-07-01 Giang Nguyen , Ivan Brugere , Shubham Sharma , Sanjay Kariyappa , Anh Totti Nguyen , Freddy Lecue

We consider machine learning models, learned from data, to be an important, intensional, kind of data in themselves. As such, various analysis tasks on models can be thought of as queries over this intensional data, often combined with…

Databases · Computer Science 2025-02-21 Mark Gerarts , Juno Steegmans , Jan Van den Bussche

We introduce instancewise feature selection as a methodology for model interpretation. Our method is based on learning a function to extract a subset of features that are most informative for each given example. This feature selector is…

Machine Learning · Computer Science 2018-06-15 Jianbo Chen , Le Song , Martin J. Wainwright , Michael I. Jordan

In-context learning (ICL) has emerged as a new approach to various natural language processing tasks, utilizing large language models (LLMs) to make predictions based on context that has been supplemented with a few examples or…

Computation and Language · Computer Science 2023-05-23 Linyong Nan , Yilun Zhao , Weijin Zou , Narutatsu Ri , Jaesung Tae , Ellen Zhang , Arman Cohan , Dragomir Radev

With the future striving toward data-centric decision-making, seamless access to databases is of utmost importance. There is extensive research on creating an efficient text-to-sql (TEXT2SQL) model to access data from the database. Using a…

Computation and Language · Computer Science 2022-08-10 Ayush Kumar , Parth Nagarkar , Prabhav Nalhe , Sanjeev Vijayakumar

Most of the work on interpretable machine learning has focused on designing either inherently interpretable models, which typically trade-off accuracy for interpretability, or post-hoc explanation systems, which lack guarantees about their…

Machine Learning · Computer Science 2019-06-05 Gregory Plumb , Maruan Al-Shedivat , Eric Xing , Ameet Talwalkar

This paper presents the development process of a natural language to SQL model using the T5 model as the basis. The models, developed in August 2022 for an online transaction processing system and a data warehouse, have a 73\% and 84\%…

Several researchers have argued that a machine learning system's interpretability should be defined in relation to a specific agent or task: we should not ask if the system is interpretable, but to whom is it interpretable. We describe a…

Artificial Intelligence · Computer Science 2018-06-21 Richard Tomsett , Dave Braines , Dan Harborne , Alun Preece , Supriyo Chakraborty

Context-dependent Text-to-SQL aims to translate multi-turn natural language questions into SQL queries. Despite various methods have exploited context-dependence information implicitly for contextual SQL parsing, there are few attempts to…

Computation and Language · Computer Science 2023-05-17 Linzheng Chai , Dongling Xiao , Jian Yang , Liqun Yang , Qian-Wen Zhang , Yunbo Cao , Zhoujun Li , Zhao Yan

Translating Natural Language Queries into Structured Query Language (Text-to-SQL or NLQ-to-SQL) is a critical task extensively studied by both the natural language processing and database communities, aimed at providing a natural language…

Computation and Language · Computer Science 2025-01-29 Hasan Alp Caferoğlu , Özgür Ulusoy

Converting natural language questions into SQL queries enables non-expert users to interact with relational databases and has long been a central task for natural language interfaces to data. While the WikiSQL dataset played a key role in…

Computation and Language · Computer Science 2025-12-10 Dzmitry Pihulski , Karol Charchut , Viktoria Novogrodskaia , Jan Kocoń

Context-dependent text-to-SQL task has drawn much attention in recent years. Previous models on context-dependent text-to-SQL task only concentrate on utilizing historical user inputs. In this work, in addition to using encoders to capture…

Computation and Language · Computer Science 2020-11-12 Yitao Cai , Xiaojun Wan