English
Related papers

Related papers: Exploring Question-Specific Rewards for Generating…

200 papers

Reinforcement Learning from Human Feedback significantly enhances Natural Language Processing by aligning language models with human expectations. A critical factor in this alignment is the strength of reward models used during training.…

Computation and Language · Computer Science 2024-10-17 Yanjun Chen , Dawei Zhu , Yirong Sun , Xinghao Chen , Wei Zhang , Xiaoyu Shen

Retrieval-augmented generation (RAG) enhances the question-answering (QA) abilities of large language models (LLMs) by integrating external knowledge. However, adapting general-purpose RAG systems to specialized fields such as science and…

Computation and Language · Computer Science 2025-01-28 Ran Xu , Hui Liu , Sreyashi Nag , Zhenwei Dai , Yaochen Xie , Xianfeng Tang , Chen Luo , Yang Li , Joyce C. Ho , Carl Yang , Qi He

Reinforcement learning (RL) is an effective approach to learn an optimal dialog policy for task-oriented visual dialog systems. A common practice is to apply RL on a neural sequence-to-sequence (seq2seq) framework with the action space…

Computation and Language · Computer Science 2019-10-30 Mingyang Zhou , Josh Arnold , Zhou Yu

The ability to ask questions is important in both human and machine intelligence. Learning to ask questions helps knowledge acquisition, improves question-answering and machine reading comprehension tasks, and helps a chatbot to keep the…

Computation and Language · Computer Science 2020-03-06 Bang Liu , Haojie Wei , Di Niu , Haolan Chen , Yancheng He

Knowledge graph (KG) question generation (QG) aims to generate natural language questions from KGs and target answers. Previous works mostly focus on a simple setting which is to generate questions from a single KG triple. In this work, we…

Computation and Language · Computer Science 2023-05-02 Yu Chen , Lingfei Wu , Mohammed J. Zaki

Despite recent advances, goal-directed generation of structured discrete data remains challenging. For problems such as program synthesis (generating source code) and materials design (generating molecules), finding examples which satisfy…

Machine Learning · Computer Science 2020-10-26 Amina Mollaysa , Brooks Paige , Alexandros Kalousis

Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks. However, their ability to access and precisely manipulate…

The rise of personal assistants has made conversational question answering (ConvQA) a very popular mechanism for user-system interaction. State-of-the-art methods for ConvQA over knowledge graphs (KGs) can only learn from crisp…

Information Retrieval · Computer Science 2021-08-23 Magdalena Kaiser , Rishiraj Saha Roy , Gerhard Weikum

Developing questions that are pedagogically sound, relevant, and promote learning is a challenging and time-consuming task for educators. Modern-day large language models (LLMs) generate high-quality content across multiple domains,…

Computation and Language · Computer Science 2024-08-23 Nicy Scaria , Suma Dharani Chenna , Deepak Subramani

While the Question Generation (QG) task has been increasingly adopted in educational assessments, its evaluation remains limited by approaches that lack a clear connection to the educational values of test items. In this work, we introduce…

Computation and Language · Computer Science 2025-06-23 Bang Nguyen , Tingting Du , Mengxia Yu , Lawrence Angrave , Meng Jiang

We present an approach for generating clarification questions with the goal of eliciting new information that would make the given textual context more complete. We propose that modeling hypothetical answers (to clarification questions) as…

Computation and Language · Computer Science 2019-04-05 Sudha Rao , Hal Daumé

A safe and trustworthy use of Large Language Models (LLMs) requires an accurate expression of confidence in their answers. We propose a novel Reinforcement Learning approach that allows to directly fine-tune LLMs to express calibrated…

Computation and Language · Computer Science 2026-03-03 David Bani-Harouni , Chantal Pellegrini , Paul Stangel , Ege Özsoy , Kamilia Zaripova , Nassir Navab , Matthias Keicher

We investigate a new training paradigm for extractive summarization. Traditionally, human abstracts are used to derive goldstandard labels for extraction units. However, the labels are often inaccurate, because human abstracts and source…

Computation and Language · Computer Science 2018-06-22 Kristjan Arumae , Fei Liu

We propose an approach towards natural language generation using a bidirectional encoder-decoder which incorporates external rewards through reinforcement learning (RL). We use attention mechanism and maximum mutual information as an…

Computation and Language · Computer Science 2019-11-27 Vidhushini Srinivasan , Sashank Santhanam , Samira Shaikh

Quizzes play a crucial role in education by reinforcing students' understanding of key concepts and encouraging self-directed exploration. However, compiling high-quality quizzes can be challenging and require deep expertise and insight…

Computation and Language · Computer Science 2025-03-20 Yicheng Fu , Zikui Wang , Liuxin Yang , Meiqing Huo , Zhongdongming Dai

Sequential recommendation aims to predict a user's next action in large-scale recommender systems. While traditional methods often suffer from insufficient information interaction, recent generative recommendation models partially address…

Information Retrieval · Computer Science 2026-02-10 Haibo Xing , Hao Deng , Yucheng Mao , Lingyu Mu , Jinxin Hu , Yi Xu , Hao Zhang , Jiahao Wang , Shizhun Wang , Yu Zhang , Xiaoyi Zeng , Jing Zhang

This paper explores the task of Difficulty-Controllable Question Generation (DCQG), which aims at generating questions with required difficulty levels. Previous research on this task mainly defines the difficulty of a question as whether it…

Computation and Language · Computer Science 2021-05-26 Yi Cheng , Siyao Li , Bang Liu , Ruihui Zhao , Sujian Li , Chenghua Lin , Yefeng Zheng

Query-focused Summarization (QfS) deals with systems that generate summaries from document(s) based on a query. Motivated by the insight that Reinforcement Learning (RL) provides a generalization to Supervised Learning (SL) for Natural…

Computation and Language · Computer Science 2023-11-30 Swaroop Nath , Harshad Khadilkar , Pushpak Bhattacharyya

Models for conversational question answering (ConvQA) over knowledge graphs (KGs) are usually trained and tested on benchmarks of gold QA pairs. This implies that training is limited to surface forms seen in the respective datasets, and…

Computation and Language · Computer Science 2024-02-20 Magdalena Kaiser , Rishiraj Saha Roy , Gerhard Weikum

In conversational question answering (CQA), the task of question rewriting~(QR) in context aims to rewrite a context-dependent question into an equivalent self-contained question that gives the same answer. In this paper, we are interested…

Computation and Language · Computer Science 2023-11-14 Hai Ye , Hwee Tou Ng , Wenjuan Han