English
Related papers

Related papers: IndicDB -- Benchmarking Multilingual Text-to-SQL C…

200 papers

Text-to-SQL, the process of translating natural language into Structured Query Language (SQL), represents a transformative application of large language models (LLMs), potentially revolutionizing how humans interact with data. This paper…

Most existing medical dialogue systems operate in a single-turn question--answering paradigm or rely on template-based datasets, limiting conversational realism and multilingual applicability. We introduce IndicMedDialog, a parallel…

Computation and Language · Computer Science 2026-05-14 Shubham Kumar Nigam , Suparnojit Sarkar , Piyush Patel

Text-to-SQL, which translates a natural language question into an SQL query, has advanced with in-context learning of Large Language Models (LLMs). However, existing methods show little improvement in performance compared to randomly chosen…

Artificial Intelligence · Computer Science 2025-07-23 Jihyung Lee , Jin-Seop Lee , Jaehoon Lee , YunSeok Choi , Jee-Hyong Lee

Generating accurate SQL from users' natural language questions (text-to-SQL) remains a long-standing challenge due to the complexities involved in user question understanding, database schema comprehension, and SQL generation. Traditional…

Computation and Language · Computer Science 2025-11-25 Zijin Hong , Zheng Yuan , Qinggang Zhang , Hao Chen , Junnan Dong , Feiran Huang , Xiao Huang

Text-to-SQL, the task of translating natural language questions into SQL queries, plays a crucial role in enabling non-experts to interact with databases. While recent advancements in large language models (LLMs) have significantly enhanced…

Computation and Language · Computer Science 2025-07-15 Haoyang Li , Shang Wu , Xiaokang Zhang , Xinmei Huang , Jing Zhang , Fuxin Jiang , Shuai Wang , Tieying Zhang , Jianjun Chen , Rui Shi , Hong Chen , Cuiping Li

We present iNLTK, an open-source NLP library consisting of pre-trained language models and out-of-the-box support for Data Augmentation, Textual Similarity, Sentence Embeddings, Word Embeddings, Tokenization and Text Generation in 13 Indic…

Computation and Language · Computer Science 2021-02-15 Gaurav Arora

Text-to-SQL, which provides zero-code interface for operating relational databases, has gained much attention in financial analysis; because, financial professionals may not well-skilled in SQL programming. However, until now, there is no…

Computation and Language · Computer Science 2024-01-22 Chao Zhang , Yuren Mao , Yijiang Fan , Yu Mi , Yunjun Gao , Lu Chen , Dongfang Lou , Jinshu Lin

Evaluating text-to-SQL systems remains largely fragile: correctness is typically judged by executing predicted and gold SQL queries on a single static database, even though the same queries may behave differently under alternative database…

Databases · Computer Science 2026-05-01 Mohammadamin Habibollah , Davood Rafiei

Converting natural language (NL) questions into SQL queries, referred to as Text-to-SQL, has emerged as a pivotal technology for facilitating access to relational databases, especially for users without SQL knowledge. Recent progress in…

Computation and Language · Computer Science 2025-06-02 Yiming Huang , Jiyu Guo , Wenxin Mao , Cuiyun Gao , Peiyi Han , Chuanyi Liu , Qing Ling

A cornerstone in AI research has been the creation and adoption of standardized training and test datasets to earmark the progress of state-of-the-art models. A particularly successful example is the GLUE dataset for training and evaluating…

Computation and Language · Computer Science 2022-12-16 Tahir Javed , Kaushal Santosh Bhogale , Abhigyan Raman , Anoop Kunchukuttan , Pratyush Kumar , Mitesh M. Khapra

We present a novel approach to data preparation for developing multilingual Indic large language model. Our meticulous data acquisition spans open-source and proprietary sources, including Common Crawl, Indic books, news articles, and…

The diversity of human language, shaped by social, cultural, and regional influences, presents significant challenges for natural language processing (NLP) systems. Existing benchmarks often overlook intra-language variations, leaving…

Computation and Language · Computer Science 2025-04-11 Abhay Gupta , Jacob Cheung , Philip Meng , Shayan Sayyed , Austen Liao , Kevin Zhu , Sean O'Brien

The pervasive influence of social biases in language data has sparked the need for benchmark datasets that capture and evaluate these biases in Large Language Models (LLMs). Existing efforts predominantly focus on English language and the…

Computation and Language · Computer Science 2024-04-04 Nihar Ranjan Sahoo , Pranamya Prashant Kulkarni , Narjis Asad , Arif Ahmad , Tanu Goyal , Aparna Garimella , Pushpak Bhattacharyya

This review paper provides a comprehensive overview of large language model (LLM) research directions within Indic languages. Indic languages are those spoken in the Indian subcontinent, including India, Pakistan, Bangladesh, Sri Lanka,…

Computation and Language · Computer Science 2024-06-17 Sankalp KJ , Vinija Jain , Sreyoshi Bhaduri , Tamoghna Roy , Aman Chadha

Language models based on the Transformer architecture have achieved state-of-the-art performance on a wide range of NLP tasks such as text classification, question-answering, and token classification. However, this performance is usually…

Computation and Language · Computer Science 2020-11-05 Kushal Jain , Adwait Deshpande , Kumar Shridhar , Felix Laumann , Ayushman Dash

Generative language models have shown significant potential in single-turn Text-to-SQL. However, their performance does not extend equivalently to multi-turn Text-to-SQL. This is primarily due to generative language models' inadequacy in…

Computation and Language · Computer Science 2026-03-09 Bingfeng Chen , Shaobin Shi , Yongqi Luo , Boyan Xu , Ruichu Cai , Zhifeng Hao

Text-to-Table aims to generate structured tables to convey the key information from unstructured documents. Existing text-to-table datasets are typically oriented English, limiting the research in non-English languages. Meanwhile, the…

Computation and Language · Computer Science 2024-05-21 Haoxiang Shi , Jiaan Wang , Jiarong Xu , Cen Wang , Tetsuya Sakai

The text-to-SQL problem aims to translate natural language questions into SQL statements to ease the interaction between database systems and end users. Recently, Large Language Models (LLMs) have exhibited impressive capabilities in a…

Databases · Computer Science 2025-04-04 Chen Shen , Jin Wang , Sajjadur Rahman , Eser Kandogan

The rapid progress in question-answering (QA) systems has predominantly benefited high-resource languages, leaving Indic languages largely underrepresented despite their vast native speaker base. In this paper, we present IndicSQuAD, a…

Computation and Language · Computer Science 2025-05-14 Sharvi Endait , Ruturaj Ghatage , Aditya Kulkarni , Rajlaxmi Patil , Raviraj Joshi

The potential for improvements brought by Large Language Models (LLMs) in Text-to-SQL systems is mostly assessed on monolingual English datasets. However, LLMs' performance for other languages remains vastly unexplored. In this work, we…

Computation and Language · Computer Science 2024-06-07 Farhad Nooralahzadeh , Yi Zhang , Ellery Smith , Sabine Maennel , Cyril Matthey-Doret , Raphaël de Fondville , Kurt Stockinger