English
Related papers

Related papers: Error as a Lens: Probing LLM Reasoning through Syn…

200 papers

This paper studies the use of language models as a source of synthetic unlabeled text for NLP. We formulate a general framework called ``generate, annotate, and learn (GAL)'' to take advantage of synthetic text within knowledge…

Machine Learning · Computer Science 2022-06-01 Xuanli He , Islam Nassar , Jamie Kiros , Gholamreza Haffari , Mohammad Norouzi

Practicing conversations with large language models (LLMs) presents a promising alternative to traditional in-person language learning. However, most LLMs generate text at a near-native level of complexity, making them ill-suited for first…

Computation and Language · Computer Science 2026-02-19 Meiqing Jin , Liam Dugan , Chris Callison-Burch

In this study, we explore the growing potential of AI and deep learning technologies, particularly Generative Adversarial Networks (GANs) and Large Language Models (LLMs), for generating synthetic tabular data. Access to quality students…

Machine Learning · Computer Science 2026-05-21 Mohammad Khalil , Sam Urmian , Ronas Shakya , Qinyi Liu

Modern Large Language Model (LLM)-based programming agents often rely on test execution feedback to refine their generated code. These tests are synthetically generated by LLMs. However, LLMs may produce invalid or hallucinated test cases,…

Software Engineering · Computer Science 2026-02-27 Hamed Taherkhani , Jiho Shin , Muhammad Ammar Tahir , Md Rakib Hossain Misu , Vineet Sunil Gattani , Hadi Hemmati

Although many AI applications of interest require specialized multi-modal models, relevant data to train such models is inherently scarce or inaccessible. Filling these gaps with human annotators is prohibitively expensive, error-prone, and…

Artificial Intelligence · Computer Science 2026-04-01 Tim R. Davidson , Benoit Seguin , Enrico Bacis , Cesar Ilharco , Hamza Harkous

Large Language Models (LLMs), when used for conditional text generation, often produce hallucinations, i.e., information that is unfaithful or not grounded in the input context. This issue arises in typical conditional text generation…

Computation and Language · Computer Science 2025-02-20 Song Duong , Florian Le Bronnec , Alexandre Allauzen , Vincent Guigue , Alberto Lumbreras , Laure Soulier , Patrick Gallinari

With recent advances in large language models (LLMs), the concept of automatically generating children's educational materials has become increasingly realistic. Working toward the goal of age-appropriate simplicity in generated educational…

Computation and Language · Computer Science 2023-10-31 Maria Valentini , Jennifer Weber , Jesus Salcido , Téa Wright , Eliana Colunga , Katharina Kann

Gene regulatory networks (GRNs) represent the causal relationships between transcription factors (TFs) and target genes in single-cell RNA sequencing (scRNA-seq) data. Understanding these networks is crucial for uncovering disease…

Artificial Intelligence · Computer Science 2024-10-22 Tejumade Afonja , Ivaxi Sheth , Ruta Binkyte , Waqar Hanif , Thomas Ulas , Matthias Becker , Mario Fritz

Making errors is part of the programming process -- even for the most seasoned professionals. Novices in particular are bound to make many errors while learning. It is well known that traditional (compiler/interpreter) programming error…

Software Engineering · Computer Science 2025-01-13 Audrey Salmon , Katie Hammer , Eddie Antonio Santos , Brett A. Becker

Test collections are crucial for evaluating Information Retrieval (IR) systems. Creating a diverse set of user queries for these collections can be challenging, and obtaining relevance judgments, which indicate how well retrieved documents…

Information Retrieval · Computer Science 2025-10-07 Hossein A. Rahmani , Varsha Ramineni , Emine Yilmaz , Nick Craswell , Bhaskar Mitra

We investigate whether synthetic question-answer (QA) data generated by large language models (LLMs) can serve as an effective proxy for human-labeled benchmarks when the latter is unavailable. We assess the reliability of synthetic…

Computation and Language · Computer Science 2025-10-22 Jonas van Elburg , Peter van der Putten , Maarten Marx

We present a synthetic data approach for instruction-tuning large language models (LLMs) for low-resource languages in a data-efficient manner, specifically focusing on Thai. We identify three key properties that contribute to the…

Computation and Language · Computer Science 2024-11-26 Parinthapat Pengpun , Can Udomcharoenchaikit , Weerayut Buaphet , Peerat Limkonchotiwat

Despite limited success in large language model (LLM)-based register-transfer-level (RTL) code generation, the root causes of errors remain poorly understood. To address this, we conduct a comprehensive error analysis, finding that most…

Hardware Architecture · Computer Science 2026-02-03 Jiazheng Zhang , Cheng Liu , Long Cheng , Xiaowei Li , Huawei Li

LLMs are vulnerable to hallucinations, and thus their outputs generally require laborious human verification for high-stakes applications. To this end, we propose symbolically grounded generation (SymGen) as a simple approach for enabling…

Computation and Language · Computer Science 2024-04-16 Lucas Torroba Hennigen , Shannon Shen , Aniruddha Nrusimha , Bernhard Gapp , David Sontag , Yoon Kim

Generative optimization uses large language models (LLMs) to iteratively improve artifacts (such as code, workflows or prompts) using execution feedback. It is a promising approach to building self-improving agents, yet in practice remains…

Mathematical reasoning demands two critical, complementary skills: constructing rigorous proofs for true statements and discovering counterexamples that disprove false ones. However, current AI efforts in mathematics focus almost…

Artificial Intelligence · Computer Science 2026-03-23 Zenan Li , Zhaoyu Li , Kaiyu Yang , Xiaoxing Ma , Zhendong Su

Generative artificial intelligence (GenAI) holds great promise as a tool to support personalized learning. Teachers need tools to efficiently and effectively enhance content readability of educational texts so that they are matched to…

Real dialogues with AI assistants for solving data-centric tasks often follow dynamic, unpredictable paths due to imperfect information provided by the user or in the data, which must be caught and handled. Developing datasets which capture…

Computation and Language · Computer Science 2025-03-19 Christian Poelitz , Nick McKenna

Recent advances in Large Language Models (LLMs) have shown that their reasoning capabilities can be significantly improved through Reinforcement Learning with Verifiable Reward (RLVR), particularly in domains like mathematics and…

Effective teaching requires adapting instructional strategies to accommodate the diverse cognitive and behavioral profiles of students, a persistent challenge in education and teacher training. While Large Language Models (LLMs) offer…

Artificial Intelligence · Computer Science 2025-05-27 Debdeep Sanyal , Agniva Maiti , Umakanta Maharana , Dhruv Kumar , Ankur Mali , C. Lee Giles , Murari Mandal