中文
相关论文

相关论文: GradeSQL: Test-Time Inference with Outcome Reward …

200 篇论文

Large Language Models (LLMs) have great success in natural language processing tasks such as response generation. However, their use in tabular data has been limited due to their inferior performance compared to traditional machine learning…

计算与语言 · 计算机科学 2024-08-27 Kangjun Noh , Baekryun Seong , Hoyoon Byun , Youngjun Choi , Sungjin Song , Kyungwoo Song

Safe deployment of large language models (LLMs) may benefit from a reliable method for assessing their generated content to determine when to abstain or to selectively generate. While likelihood-based metrics such as perplexity are widely…

计算与语言 · 计算机科学 2023-12-18 Jie Ren , Yao Zhao , Tu Vu , Peter J. Liu , Balaji Lakshminarayanan

Evaluating text-to-SQL systems remains largely fragile: correctness is typically judged by executing predicted and gold SQL queries on a single static database, even though the same queries may behave differently under alternative database…

数据库 · 计算机科学 2026-05-01 Mohammadamin Habibollah , Davood Rafiei

Large Language Models (LLMs) have shown promising performance in text-to-SQL, which involves translating natural language questions into SQL queries. However, current text-to-SQL LLMs are computationally expensive and challenging to deploy…

计算与语言 · 计算机科学 2024-10-16 Qihuang Zhong , Kunfeng Chen , Liang Ding , Juhua Liu , Bo Du , Dacheng Tao

Reward models play a critical role in guiding large language models toward outputs that align with human expectations. However, an open challenge remains in effectively utilizing test-time compute to enhance reward model performance. In…

计算与语言 · 计算机科学 2025-05-21 Jiaxin Guo , Zewen Chi , Li Dong , Qingxiu Dong , Xun Wu , Shaohan Huang , Furu Wei

As large language models (LLMs) increasingly interact with external tools, reward modeling for tool use has emerged as a critical yet underexplored area of research. Existing reward models, trained primarily on natural language outputs,…

计算与语言 · 计算机科学 2026-01-08 Mayank Agarwal , Ibrahim Abdelaziz , Kinjal Basu , Merve Unuvar , Luis A. Lastras , Yara Rizk , Pavan Kapanipathi

Natural Language to SQL (NL2SQL) technology empowers non-expert users to query relational databases without requiring SQL expertise. While large language models (LLMs) have greatly improved NL2SQL algorithms, their rapid development…

数据库 · 计算机科学 2026-04-21 Shizheng Hou , Wenqi Pei , Nuo Chen , Quang-Trung Ta , Peng Lu , Beng Chin Ooi

Text-to-SQL, which maps natural language to SQL queries, has benefited greatly from recent advances in Large Language Models (LLMs). While LLMs offer various paradigms for this task, including prompting and supervised fine-tuning (SFT), SFT…

计算与语言 · 计算机科学 2025-09-24 Jinwang Song , Hongying Zan , Kunli Zhang , Lingling Mu , Yingjie Han , Haobo Hua , Min Peng

Reinforcement Learning (RL) suffers from sample inefficiency in sparse reward domains, and the problem is further pronounced in case of stochastic transitions. To improve the sample efficiency, reward shaping is a well-studied approach to…

机器学习 · 计算机科学 2024-10-10 Siddhant Bhambri , Amrita Bhattacharjee , Durgesh Kalwar , Lin Guan , Huan Liu , Subbarao Kambhampati

Text-to-SQL is a pivotal task that bridges natural language understanding and structured data access, yet it remains fundamentally challenging due to semantic ambiguity and complex compositional reasoning. While large language models (LLMs)…

人工智能 · 计算机科学 2025-10-20 Jiayuan Bai , Xuan-guang Pan , Chongyang Tao , Shuai Ma

In recent years,Text-to-SQL, the problem of automatically converting questions posed in natural language to formal SQL queries, has emerged as an important problem at the intersection of natural language processing and data management…

计算与语言 · 计算机科学 2024-09-17 Ke Shen , Mayank Kejriwal

Query optimization, which finds the optimized execution plan for a given query, is a complex planning and decision-making problem within the exponentially growing plan space in database management systems (DBMS). Traditional optimizers…

数据库 · 计算机科学 2025-02-11 Jie Tan , Kangfei Zhao , Rui Li , Jeffrey Xu Yu , Chengzhi Piao , Hong Cheng , Helen Meng , Deli Zhao , Yu Rong

Large Language Models (LLMs) have already been widely adopted for automated algorithm design, demonstrating strong abilities in generating and evolving algorithms across various fields. Existing work has largely focused on examining their…

机器学习 · 计算机科学 2026-03-04 Qi Huang , Furong Ye , Ananta Shahane , Thomas Bäck , Niki van Stein

While large language models (LLMs) have significantly advanced mathematical reasoning, Process Reward Models (PRMs) have been developed to evaluate the logical validity of reasoning steps. However, PRMs still struggle with…

人工智能 · 计算机科学 2025-02-21 Jiachen Zhu , Congmin Zheng , Jianghao Lin , Kounianhua Du , Ying Wen , Yong Yu , Jun Wang , Weinan Zhang

The conversion of natural language queries into SQL queries, known as Text-to-SQL, is a critical yet challenging task. This paper introduces EPI-SQL, a novel methodological framework leveraging Large Language Models (LLMs) to enhance the…

计算与语言 · 计算机科学 2024-04-24 Xiping Liu , Zhao Tan

Large language models (LLMs) excel in complex tasks through advanced prompting techniques like Chain-of-Thought (CoT) and Tree-of-Thought (ToT), but their reliance on manually crafted, task-specific prompts limits adaptability and…

计算与语言 · 计算机科学 2025-07-04 Tao Xiong , Xavier Hu , Wenyan Fan , Shengyu Zhang

While recent Large Language Models (LLMs) have proven useful in answering user queries, they are prone to hallucination, and their responses often lack credibility due to missing references to reliable sources. An intuitive solution to…

计算与语言 · 计算机科学 2024-09-04 Chengyu Huang , Zeqiu Wu , Yushi Hu , Wenya Wang

Large Language Models (LLMs) exhibit strong capabilities in text processing, and recent research has augmented SQL and DataFrame with LLM-powered semantic operators for data analysis. However, LLM-based data processing is hindered by slower…

数据库 · 计算机科学 2026-03-10 Chao Hui , Weizheng Lu , Yanjie Gao , Lingfeng Xiong , Yunhai Wang , Yueguo Chen

Text-to-image models are powerful for producing high-quality images based on given text prompts, but crafting these prompts often requires specialized vocabulary. To address this, existing methods train rewriting models with supervision…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Hongji Yang , Yucheng Zhou , Wencheng Han , Jianbing Shen

In the field of software operations, Large Language Models (LLMs) have attracted increasing attention. However, existing research has not yet achieved efficient and effective end-to-end intelligent operations due to low-quality data,…

机器学习 · 计算机科学 2026-05-13 Jingkai He , Pengfei Chen , Chenghui Wu , Shuang Liang , Ye Li , Gou Tan , Xiadao Wen , Chuanfu Zhang