English
Related papers

Related papers: Q-NL Verifier: Leveraging Synthetic Data for Robus…

200 papers

Large Language Models (LLMs) have democratized synthetic data generation, which in turn has the potential to simplify and broaden a wide gamut of NLP tasks. Here, we tackle a pervasive problem in synthetic data generation: its generative…

Computation and Language · Computer Science 2023-05-25 Veniamin Veselovsky , Manoel Horta Ribeiro , Akhil Arora , Martin Josifoski , Ashton Anderson , Robert West

Large Language Models (LLMs) have recently emerged as powerful tools for autoformalization. Despite their impressive performance, these models can still struggle to produce grounded and verifiable formalizations. Recent work in text-to-SQL,…

Computation and Language · Computer Science 2025-12-05 Hayden Moore , Asfahan Shah

Verifiable generation aims to let the large language model (LLM) generate text with supporting documents, which enables the user to flexibly verify the answer and makes the LLM's output more reliable. Retrieval plays a crucial role in…

Computation and Language · Computer Science 2024-03-28 Xiaonan Li , Changtai Zhu , Linyang Li , Zhangyue Yin , Tianxiang Sun , Xipeng Qiu

The demand for synthetic data in mathematical reasoning has increased due to its potential to enhance the mathematical capabilities of large language models (LLMs). However, ensuring the validity of intermediate reasoning steps remains a…

Artificial Intelligence · Computer Science 2026-01-19 Joshua Ong Jun Leang , Giwon Hong , Wenda Li , Shay B. Cohen

Recently proposed long-form question answering (QA) systems, supported by large language models (LLMs), have shown promising capabilities. Yet, attributing and verifying their generated abstractive answers can be difficult, and…

Computation and Language · Computer Science 2024-07-02 Tal Schuster , Adam D. Lelkes , Haitian Sun , Jai Gupta , Jonathan Berant , William W. Cohen , Donald Metzler

Deep learning approaches to semantic parsing require a large amount of labeled data, but annotating complex logical forms is costly. Here, we propose Syntactic Question Abstraction and Retrieval (SQAR), a method to build a neural semantic…

Computation and Language · Computer Science 2020-05-05 Wonseok Hwang , Jinyeong Yim , Seunghyun Park , Minjoon Seo

Enabling farmers to access accurate agriculture-related information in their native languages in a timely manner is crucial for the success of the agriculture field. Publicly available general-purpose Large Language Models (LLMs) typically…

The financial domain frequently deals with large numbers of long documents that are essential for daily operations. Significant effort is put towards automating financial data analysis. However, a persistent challenge, not limited to the…

Computation and Language · Computer Science 2024-06-21 Viet Dac Lai , Michael Krumdick , Charles Lovering , Varshini Reddy , Craig Schmidt , Chris Tanner

Multiple lines of research have developed Natural Language (NL) interfaces for formulating database queries. We build upon this work, but focus on presenting a highly detailed form of the answers in NL. The answers that we present are…

Databases · Computer Science 2020-07-10 Daniel Deutch , Nave Frost , Amir Gilad

This paper presents a question answering system that operates exclusively on a knowledge graph retrieval without relying on retrieval augmented generation (RAG) with large language models (LLMs). Instead, a small paraphraser model is used…

Computation and Language · Computer Science 2025-10-23 Kartikeya Aneja , Manasvi Srivastava , Subhayan Das , Nagender Aneja

Natural question generation (QG) aims to generate questions from a passage and an answer. In this paper, we propose a novel reinforcement learning (RL) based graph-to-sequence (Graph2Seq) model for QG. Our model consists of a Graph2Seq…

Computation and Language · Computer Science 2020-02-17 Yu Chen , Lingfei Wu , Mohammed J. Zaki

Given varying prompts regarding a factoid question, can a large language model (LLM) reliably generate factually correct answers? Existing LLMs may generate distinct responses for different prompts. In this paper, we study the problem of…

Computation and Language · Computer Science 2023-10-31 Qingxiu Dong , Jingjing Xu , Lingpeng Kong , Zhifang Sui , Lei Li

Question answering (QA) aims to understand questions and find appropriate answers. In real-world QA systems, Frequently Asked Question (FAQ) based QA is usually a practical and effective solution, especially for some complicated questions…

Computation and Language · Computer Science 2020-10-23 Ruobing Xie , Yanan Lu , Fen Lin , Leyu Lin

Large Language Models (LLMs) with chain-of-thought generation have demonstrated great potential for solving complex reasoning and planning tasks. However, the output of current LLMs is not fully reliable and needs careful verification. Even…

Machine Learning · Computer Science 2026-05-19 Maria-Florina Balcan , Avrim Blum , Kiriaki Fragkia , Zhiyuan Li , Dravyansh Sharma

Knowledge graph (KG) is known to be helpful for the task of question answering (QA), since it provides well-structured relational information between entities, and allows one to further infer indirect facts. However, it is challenging to…

Machine Learning · Computer Science 2017-11-29 Yuyu Zhang , Hanjun Dai , Zornitsa Kozareva , Alexander J. Smola , Le Song

We introduce VL2NL, a Large Language Model (LLM) framework that generates rich and diverse NL datasets using only Vega-Lite specifications as input, thereby streamlining the development of Natural Language Interfaces (NLIs) for data…

Human-Computer Interaction · Computer Science 2024-01-23 Hyung-Kwon Ko , Hyeon Jeon , Gwanmo Park , Dae Hyun Kim , Nam Wook Kim , Juho Kim , Jinwook Seo

Query-focused summarization (QFS) aims to provide a summary of a document that satisfies information need of a given query and is useful in various IR applications, such as abstractive snippet generation. Current QFS approaches typically…

Information Retrieval · Computer Science 2023-04-25 Zhichao Xu , Daniel Cohen

Natural language explanations represent a proxy for evaluating explanation-based and multi-step Natural Language Inference (NLI) models. However, assessing the validity of explanations for NLI is challenging as it typically involves the…

Computation and Language · Computer Science 2024-10-14 Xin Quan , Marco Valentino , Louise A. Dennis , André Freitas

Large Language Models (LLMs) have demonstrated strong performance in question answering (QA) tasks. However, Multi-Answer Question Answering (MAQA), where a question may have several valid answers, remains challenging. Traditional QA…

Computation and Language · Computer Science 2025-08-19 Eviatar Nachshoni , Arie Cattan , Shmuel Amar , Ori Shapira , Ido Dagan

Decomposing sentences into fine-grained meaning units is increasingly used to model semantic alignment. While QA-based semantic approaches have shown effectiveness for representing predicate-argument relations, they have so far left…

Computation and Language · Computer Science 2025-11-18 Maria Tseytlin , Paul Roit , Omri Abend , Ido Dagan , Ayal Klein