English
Related papers

Related papers: Learning to Automatically Generate Fill-In-The-Bla…

200 papers

Large Language Models (LLMs) can perform various natural language processing tasks with suitable instruction prompts. However, designing effective prompts manually is challenging and time-consuming. Existing methods for automatic prompt…

Computation and Language · Computer Science 2024-04-04 Viet-Tung Do , Van-Khanh Hoang , Duy-Hung Nguyen , Shahab Sabahi , Jeff Yang , Hajime Hotta , Minh-Tien Nguyen , Hung Le

Automatic question generation is an important technique that can improve the training of question answering, help chatbots to start or continue a conversation with humans, and provide assessment materials for educational purposes. Existing…

Computation and Language · Computer Science 2019-02-28 Bang Liu , Mingjun Zhao , Di Niu , Kunfeng Lai , Yancheng He , Haojie Wei , Yu Xu

Large language models (LLMs) can perform a wide range of tasks by following natural language instructions, without the necessity of task-specific fine-tuning. Unfortunately, the performance of LLMs is greatly influenced by the quality of…

Computation and Language · Computer Science 2023-10-23 Zhihan Zhang , Shuohang Wang , Wenhao Yu , Yichong Xu , Dan Iter , Qingkai Zeng , Yang Liu , Chenguang Zhu , Meng Jiang

Large language models (LLMs) often fabricate a hallucinatory text. Several methods have been developed to detect such text by semantically comparing it with the multiple versions probabilistically regenerated. However, a significant issue…

Computation and Language · Computer Science 2024-09-27 Satoshi Munakata , Taku Fukui , Takao Mohri

Missing sentence generation (or sentence infilling) fosters a wide range of applications in natural language generation, such as document auto-completion and meeting note expansion. This task asks the model to generate intermediate missing…

Computation and Language · Computer Science 2020-08-04 Yichen Huang , Yizhe Zhang , Oussama Elachqar , Yu Cheng

This paper explores the utility of a Large Language Model (LLM) to automatically generate queries and query variants from a description of an information need. Given a set of information needs described as backstories, we explore how…

Information Retrieval · Computer Science 2025-01-31 Marwah Alaofi , Luke Gallagher , Mark Sanderson , Falk Scholer , Paul Thomas

We consider the fundamental problem of how to automatically construct summary statistics for implicit generative models where the evaluation of the likelihood function is intractable, but sampling data from the model is possible. The idea…

Machine Learning · Statistics 2021-03-31 Yanzhi Chen , Dinghuai Zhang , Michael Gutmann , Aaron Courville , Zhanxing Zhu

Emerging research in Neural Question Generation (NQG) has started to integrate a larger variety of inputs, and generating questions requiring higher levels of cognition. These trends point to NQG as a bellwether for NLP, about how human…

Computation and Language · Computer Science 2019-06-05 Liangming Pan , Wenqiang Lei , Tat-Seng Chua , Min-Yen Kan

Generating high quality question-answer pairs is a hard but meaningful task. Although previous works have achieved great results on answer-aware question generation, it is difficult to apply them into practical application in the education…

Computation and Language · Computer Science 2021-09-20 Fanyi Qu , Xin Jia , Yunfang Wu

Much algorithmic research in NLP aims to efficiently manipulate rich formal structures. An algorithm designer typically seeks to provide guarantees about their proposed algorithm -- for example, that its running time or space complexity is…

Programming Languages · Computer Science 2025-12-30 Tim Vieira , Ryan Cotterell , Jason Eisner

While computer and communication technologies have provided effective means to scale up many aspects of education, the submission and grading of assessments such as homework assignments and tests remains a weak link. In this paper, we study…

Machine Learning · Statistics 2015-01-20 Andrew S. Lan , Divyanshu Vats , Andrew E. Waters , Richard G. Baraniuk

Developing questions that are pedagogically sound, relevant, and promote learning is a challenging and time-consuming task for educators. Modern-day large language models (LLMs) generate high-quality content across multiple domains,…

Computation and Language · Computer Science 2024-08-23 Nicy Scaria , Suma Dharani Chenna , Deepak Subramani

Crafting quizzes from educational content is a pivotal activity that benefits both teachers and students by reinforcing learning and evaluating understanding. In this study, we introduce a novel approach to generate quizzes from Turkish…

Computation and Language · Computer Science 2024-06-06 Kamyar Zeinalipour , Yusuf Gökberk Keptiğ , Marco Maggini , Marco Gori

There have been various types of pretraining architectures including autoencoding models (e.g., BERT), autoregressive models (e.g., GPT), and encoder-decoder models (e.g., T5). However, none of the pretraining frameworks performs the best…

Computation and Language · Computer Science 2022-03-18 Zhengxiao Du , Yujie Qian , Xiao Liu , Ming Ding , Jiezhong Qiu , Zhilin Yang , Jie Tang

Automated insight generation is a common tactic for helping knowledge workers, such as data scientists, to quickly understand the potential value of new and unfamiliar data. Unfortunately, automated insights produced by large-language…

Software Engineering · Computer Science 2024-05-06 Ananya Singha , Bhavya Chopra , Anirudh Khatry , Sumit Gulwani , Austin Z. Henley , Vu Le , Chris Parnin , Mukul Singh , Gust Verbruggen

Ensuring data quality in large tabular datasets is a critical challenge, typically addressed through data wrangling tasks. Traditional statistical methods, though efficient, cannot often understand the semantic context and deep learning…

Machine Learning · Computer Science 2025-02-25 Ashlesha Akella , Krishnasuri Narayanam

When learning to program, students are usually assessed based on the code they wrote. However, the mere completion of a programming task does not guarantee actual comprehension of the underlying concepts. Asking learners questions about the…

Software Engineering · Computer Science 2025-10-14 Florian Obermüller , Gordon Fraser

Recent advances in neural network-based generative modeling have reignited the hopes in having computer systems capable of seamlessly conversing with humans and able to understand natural language. Neural architectures have been employed to…

Computation and Language · Computer Science 2020-08-03 Cristina Garbacea , Qiaozhu Mei

Herein, we generate pseudo-features based on the multivariate probability distributions obtained from the feature maps in layers of trained deep neural networks. Further, we augment the minor-class data based on these generated…

Machine Learning · Computer Science 2019-10-15 Tomohiko Konno , Michiaki Iwazume

Large Language Models (LLMs) excel in various natural language tasks but often struggle with long-horizon planning problems requiring structured reasoning. This limitation has drawn interest in integrating neuro-symbolic approaches within…

Artificial Intelligence · Computer Science 2025-10-28 Marcus Tantakoun , Xiaodan Zhu , Christian Muise