English
Related papers

Related papers: Putting the Horse Before the Cart:A Generator-Eval…

200 papers

Existing Computerized Adaptive Testing (CAT) frameworks typically select questions based on the predicted likelihood that the student will answer correctly. This design ignores information contained in students' open-ended responses,…

Computation and Language · Computer Science 2026-05-28 Wanyong Feng , Alexander Scarlatos , Ruochen Sun , Andrew Lan

Retrieval-Augmented Generation (RAG), by incorporating external knowledge with parametric memory of language models, has become the state-of-the-art architecture for open-domain QA tasks. However, common knowledge bases are inherently…

Computation and Language · Computer Science 2023-12-01 Zhebin Zhang , Xinyu Zhang , Yuanhang Ren , Saijiang Shi , Meng Han , Yongkang Wu , Ruofei Lai , Zhao Cao

Narrative generation is an open-ended NLP task in which a model generates a story given a prompt. The task is similar to neural response generation for chatbots; however, innovations in response generation are often not applied to narrative…

Computation and Language · Computer Science 2021-07-09 Alexandra DeLucia , Aaron Mueller , Xiang Lisa Li , João Sedoc

Learning distributed sentence representations remains an interesting problem in the field of Natural Language Processing (NLP). We want to learn a model that approximates the conditional latent space over the representations of a logical…

Computation and Language · Computer Science 2018-03-08 Yikang Shen , Shawn Tan , Chin-Wei Huang , Aaron Courville

Natural Language Processing (NLP) has witnessed a transformative leap with the advent of transformer-based architectures, which have significantly enhanced the ability of machines to understand and generate human-like text. This paper…

Computation and Language · Computer Science 2025-03-27 Tianhao Wu , Yu Wang , Ngoc Quach

Quantum natural language processing (QNLP) offers a novel approach to semantic modeling by embedding compositional structure directly into quantum circuits. This paper investigates the application of QNLP models to the task of Natural…

Computation and Language · Computer Science 2025-10-21 Ling Sun , Peter Sullivan , Michael Martin , Yun Zhou

New systems employ Machine Learning to sift through large knowledge sources, creating flexible Large Language Models. These models discern context and predict sequential information in various communication forms. Generative AI, leveraging…

Artificial Intelligence · Computer Science 2023-07-19 Ted Selker

Neural conversational models learn to generate responses by taking into account the dialog history. These models are typically optimized over the query-response pairs with a maximum likelihood estimation objective. However, the…

Computation and Language · Computer Science 2020-03-05 Shaoxiong Feng , Hongshen Chen , Kan Li , Dawei Yin

This paper proposes an approach for applying GANs to NMT. We build a conditional sequence generative adversarial net which comprises of two adversarial sub models, a generator and a discriminator. The generator aims to generate sentences…

Computation and Language · Computer Science 2018-04-10 Zhen Yang , Wei Chen , Feng Wang , Bo Xu

Evaluation of long-form, citation-backed reports has lately received significant attention due to the wide-scale adoption of retrieval-augmented generation (RAG) systems. Core to many evaluation frameworks is the use of atomic facts, or…

Computation and Language · Computer Science 2026-05-07 Bryan Li , William Walden , Yu Hou , Gabrielle Kaili-May Liu , Dawn Lawrie , Jame Mayfield , Eugene Yang , Chris Callison-Burch , Laura Dietz

We study the task of predicting a set of salient questions from a given paragraph without any prior knowledge of the precise answer. We make two main contributions. First, we propose a new method to evaluate a set of predicted questions…

Computation and Language · Computer Science 2022-03-14 Jishnu Ray Chowdhury , Debanjan Mahata , Cornelia Caragea

Natural language explanation (NLE) models aim at explaining the decision-making process of a black box system via generating natural language sentences which are human-friendly, high-level and fine-grained. Current NLE models explain the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Fawaz Sammani , Tanmoy Mukherjee , Nikos Deligiannis

This paper presents Loops On Retrieval Augmented Generation (LoRAG), a new framework designed to enhance the quality of retrieval-augmented text generation through the incorporation of an iterative loop mechanism. The architecture…

Computation and Language · Computer Science 2024-03-26 Ayush Thakur , Rashmi Vashisth

Scene Graph Generation (SGG) structures visual scenes as graphs of objects and their relations. While Multimodal Large Language Models (MLLMs) have advanced end-to-end SGG, current methods are hindered by both a lack of task-specific…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Jiaye Feng , Qixiang Yin , Yuankun Liu , Tong Mo , Weiping Li

Automatic question generation according to an answer within the given passage is useful for many applications, such as question answering system, dialogue system, etc. Current neural-based methods mostly take two steps which extract several…

Computation and Language · Computer Science 2019-07-02 Yutong Wang , Jiyuan Zheng , Qijiong Liu , Zhou Zhao , Jun Xiao , Yueting Zhuang

While large language models (LLMs) such as ChatGPT and PaLM have demonstrated remarkable performance in various language understanding and generation tasks, their capabilities in complex reasoning and intricate knowledge utilization still…

Computation and Language · Computer Science 2023-10-11 Haodi Zhang , Min Cai , Xinhe Zhang , Chen Jason Zhang , Rui Mao , Kaishun Wu

Verifiers or reward models are often used to enhance the reasoning performance of large language models (LLMs). A common approach is the Best-of-N method, where N candidate solutions generated by the LLM are ranked by a verifier, and the…

Machine Learning · Computer Science 2025-02-25 Lunjun Zhang , Arian Hosseini , Hritik Bansal , Mehran Kazemi , Aviral Kumar , Rishabh Agarwal

Conventional automatic evaluation metrics, such as BLEU and ROUGE, developed for natural language generation (NLG) tasks, are based on measuring the n-gram overlap between the generated and reference text. These simple metrics may be…

Computation and Language · Computer Science 2024-02-27 Zifan Wang , Kotaro Funakoshi , Manabu Okumura

Generating multiple-choice questions (MCQs) with difficulty estimation remains challenging in automated MCQ-generation systems used in adaptive, AI-assisted education. This study proposes a novel methodology for generating MCQs with…

Computation and Language · Computer Science 2026-04-14 Mehmet Can Şakiroğlu , H. Altay Güvenir , Kamer Kaya

AI generated content (AIGC) presents considerable challenge to educators around the world. Instructors need to be able to detect such text generated by large language models, either with the naked eye or with the help of some tools. There…

Computation and Language · Computer Science 2023-09-26 Yikang Liu , Ziyin Zhang , Wanyang Zhang , Shisen Yue , Xiaojing Zhao , Xinyuan Cheng , Yiwen Zhang , Hai Hu