English
Related papers

Related papers: Towards Property-Based Tests in Natural Language

200 papers

This paper proposes a simple test for compositionality (i.e., literal usage) of a word or phrase in a context-specific way. The test is computationally simple, relying on no external resources and only uses a set of trained word vectors.…

Computation and Language · Computer Science 2016-11-30 Hongyu Gong , Suma Bhat , Pramod Viswanath

Human languages use a wide range of grammatical categories to constrain which words or phrases can fill certain slots in grammatical patterns and to express additional meanings, such as tense or aspect, through morpho-syntactic means. These…

Computation and Language · Computer Science 2022-04-22 Luc Steels , Paul Van Eecke , Katrien Beuls

Property-based testing (PBT) is a popular technique for establishing confidence in software, where users write properties -- i.e., executable specifications -- that can be checked many times in a loop by a testing framework. In modern PBT…

Software Engineering · Computer Science 2026-02-24 Alperen Keles , Justine Frank , Ceren Mert , Harrison Goldstein , Leonidas Lampropoulos

Automated question generation is an important approach to enable personalisation of English comprehension assessment. Recently, transformer-based pretrained language models have demonstrated the ability to produce appropriate questions from…

Computation and Language · Computer Science 2022-09-27 Vatsal Raina , Mark Gales

Generic generation and manipulation of text is challenging and has limited success compared to recent deep generative modeling in visual domain. This paper aims at generating plausible natural language sentences, whose attributes are…

Machine Learning · Computer Science 2018-09-14 Zhiting Hu , Zichao Yang , Xiaodan Liang , Ruslan Salakhutdinov , Eric P. Xing

This article presents a stochastic corpus-based model for generating natural language text. Our model first encodes dependency relations from training data through a feature set, then concatenates these features to produce a new dependency…

Computation and Language · Computer Science 2020-01-14 Elham Seifossadat , Hossein Sameti

Large language models are becoming increasingly practical for translating code across programming languages, a process known as $transpiling$. Even though automated transpilation significantly boosts developer productivity, a key concern is…

Software Engineering · Computer Science 2024-01-31 Hasan Ferit Eniser , Valentin Wüstholz , Maria Christakis

Grammar-based sentence generation has been thoroughly explored for Context-Free Grammars (CFGs), but remains unsolved for recognition-based approaches such as Parsing Expression Grammars (PEGs). Lacking tool support, language designers…

Programming Languages · Computer Science 2018-02-01 Tony Garnock-Jones , Mahdi Eslamimehr , Alessandro Warth

Property-based testing is a powerful method to validate program correctness. It is, however, not widely use in industry as the barrier of entry can be very high. One of the hindrances is to write the generators that are needed to generate…

Programming Languages · Computer Science 2023-09-13 Triera Gashi , Sophie Adeline Solheim Bosio , Joachim Tilsted Kristensen , Michael Kirkedal Thomsen

We propose a recurrent neural model that generates natural-language questions from documents, conditioned on answers. We show how to train the model using a combination of supervised and reinforcement learning. After teacher forcing for…

Computation and Language · Computer Science 2017-05-16 Xingdi Yuan , Tong Wang , Caglar Gulcehre , Alessandro Sordoni , Philip Bachman , Sandeep Subramanian , Saizheng Zhang , Adam Trischler

We study a new application for text generation -- idiomatic sentence generation -- which aims to transfer literal phrases in sentences into their idiomatic counterparts. Inspired by psycholinguistic theories of idiom use in one's native…

Computation and Language · Computer Science 2021-05-12 Jianing Zhou , Hongyu Gong , Srihari Nanniyur , Suma Bhat

Understanding and creating mathematics using natural mathematical language - the mixture of symbolic and natural language used by humans - is a challenging and important problem for driving progress in machine learning. As a step in this…

Information Retrieval · Computer Science 2021-06-09 Sean Welleck , Jiacheng Liu , Ronan Le Bras , Hannaneh Hajishirzi , Yejin Choi , Kyunghyun Cho

We continue the research on the generative capacity of contextual grammars where contexts are adjoined around whole words (externally) or around subwords (internally) which belong to special regular selection languages. All languages…

Formal Languages and Automata Theory · Computer Science 2022-09-01 Jürgen Dassow , Bianca Truthe

The web-scale of pretraining data has created an important evaluation challenge: to disentangle linguistic competence on cases well-represented in pretraining data from generalization to out-of-domain language, specifically the dynamic,…

Computation and Language · Computer Science 2025-08-14 Wesley Scivetti , Melissa Torgbi , Austin Blodgett , Mollie Shichman , Taylor Hudson , Claire Bonial , Harish Tayyar Madabushi

This paper explores the task of translating natural language queries into regular expressions which embody their meaning. In contrast to prior work, the proposed neural model does not utilize domain-specific crafting, learning to translate…

Computation and Language · Computer Science 2016-08-11 Nicholas Locascio , Karthik Narasimhan , Eduardo DeLeon , Nate Kushman , Regina Barzilay

Automated Test Case Generation (ATCG) is crucial for evaluating software reliability, particularly in competitive programming where robust algorithm assessments depend on diverse and accurate test cases. However, existing ATCG methods often…

Software Engineering · Computer Science 2025-05-22 Sicheol Sung , Aditi , Dogyu kim , Yo-Sub Han , Sang-Ki Ko

After the launch of ChatGPT v.4 there has been a global vivid discussion on the ability of this artificial intelligence powered platform and some other similar ones for the automatic production of all kinds of texts, including scientific…

Computation and Language · Computer Science 2024-04-16 Javier J. Sanchez-Medina

Question generation (QG) is a natural language processing task with an abundance of potential benefits and use cases in the educational domain. In order for this potential to be realized, QG systems must be designed and validated with…

Computation and Language · Computer Science 2025-11-05 Sabina Elkins , Ekaterina Kochmar , Jackie C. K. Cheung , Iulian Serban

Existing work on controlled text generation (CTG) assumes a control interface of categorical attributes. In this work, we propose a natural language (NL) interface, where we craft a PCFG to embed the control attributes into natural language…

Computation and Language · Computer Science 2022-10-17 Jingyu Zhang , James Glass , Tianxing He

Categorical compositional distributional semantics is a model of natural language; it combines the statistical vector space models of words with the compositional models of grammar. We formalise in this model the generalised quantifier…

Computation and Language · Computer Science 2019-11-12 Jules Hedges , Mehrnoosh Sadrzadeh