English
Related papers

Related papers: Legion: Best-First Concolic Testing

200 papers

Concolic testing is a popular software verification technique based on a combination of concrete and symbolic execution. Its main focus is finding bugs and generating test cases with the aim of maximizing code coverage. A previous approach…

Logic in Computer Science · Computer Science 2020-09-23 Fred Mesnard , Etienne Payet , German Vidal

Monte Carlo Tree Search (MCTS) is a branch of stochastic modeling that utilizes decision trees for optimization, mostly applied to artificial intelligence (AI) game players. This project imagines a game in which an AI player searches for a…

Machine Learning · Computer Science 2020-12-01 Elana Kozak , Scott Hottovy

A common paradigm for improving fuzzing performance is to focus on selected regions of a program rather than its entirety. While previous work has largely explored how these locations can be reached, their selection, that is, the where, has…

Exhaustive testing of high-level designs pose an arduous challenge due to complex branching conditions, loop structures and inherent concurrency of hardware designs. Test engineers aim to generate quality test-cases satisfying various code…

Software Engineering · Computer Science 2022-07-15 Mukta Debnath , Animesh Basak Chowdhury , Debasri Saha , Susmita Sur-Kolay

The weakest precondition (WP) of a program describes the largest set of initial states from which all terminating executions of the program satisfy a given postcondition. The generation of WPs is an important task with practical…

Software Engineering · Computer Science 2025-12-18 Daragh King , Vasileios Koutavas , Laura Kovacs

Recent advancements in large language models (LLMs) have shown remarkable potential in automating machine learning tasks. However, existing LLM-based agents often struggle with low-diversity and suboptimal code generation. While recent work…

Computation and Language · Computer Science 2026-01-26 Zujie Liang , Feng Wei , Wujiang Xu , Lin Chen , Yuxi Qian , Xinhui Wu

Despite recent advances in large language models, open-source models often struggle to consistently perform well on complex reasoning tasks. Existing ensemble methods, whether applied at the token or output levels, fail to address these…

Computation and Language · Computer Science 2024-12-23 Sungjin Park , Xiao Liu , Yeyun Gong , Edward Choi

GraphQL's flexible query model and nested data dependencies expose APIs to complex, context-dependent vulnerabilities that are difficult to uncover using conventional testing tools. Existing fuzzers either rely on random payload generation…

Cryptography and Security · Computer Science 2025-10-21 Shaolun Liu , Sina Marefat , Omar Tsai , Yu Chen , Zecheng Deng , Jia Wang , Mohammad A. Tayebi

Software vulnerabilities pose critical security threats, with nearly 50,000 CVEs reported in 2025. While Large Language Models (LLMs) show promise for automated vulnerability detection, three key challenges remain. First, LLM-generated…

Cryptography and Security · Computer Science 2026-05-22 Ze Sheng , Zhicheng Chen , Qingxiao Xu , Kewen Zhu , Jeff Huang

In recent years, fuzzing has been widely applied not only to application software but also to system software, including the Linux kernel and firmware, and has become a powerful technique for vulnerability discovery. Among these approaches,…

Cryptography and Security · Computer Science 2026-03-27 Masami Ichikawa

Machine learning models are notoriously difficult to interpret and debug. This is particularly true of neural networks. In this work, we introduce automated software testing techniques for neural networks that are well-suited to discovering…

Machine Learning · Statistics 2018-07-31 Augustus Odena , Ian Goodfellow

We consider the problem of using a heuristic policy to improve the value approximation by the Upper Confidence Bound applied in Trees (UCT) algorithm in non-adversarial settings such as planning with large-state space Markov Decision…

Artificial Intelligence · Computer Science 2012-06-27 Truong-Huy Dinh Nguyen , Wee-Sun Lee , Tze-Yun Leong

Fuzzing has shown great success in evaluating the robustness of intelligent natural language processing (NLP) software. As large language model (LLM)-based NLP software is widely deployed in critical industries, existing methods still face…

Software Engineering · Computer Science 2025-09-23 Mingxuan Xiao , Yan Xiao , Shunhui Ji , Jiahe Tu , Pengcheng Zhang

Seamlessly integrating rules in Learning-from-Demonstrations (LfD) policies is a critical requirement to enable the real-world deployment of AI agents. Recently, Signal Temporal Logic (STL) has been shown to be an effective language for…

Robotics · Computer Science 2025-03-06 Jasmine Jerry Aloor , Jay Patrikar , Parv Kapoor , Jean Oh , Sebastian Scherer

With the rapid development of large models in the field of artificial intelligence, how to enhance their application capabilities in handling complex problems in the field of scientific research remains a challenging problem to be solved.…

Artificial Intelligence · Computer Science 2025-01-27 Zhihua Duan , Jialin Wang

Lazy search algorithms can efficiently solve problems where edge evaluation is the bottleneck in computation, as is the case for robotic motion planning. The optimal algorithm in this class, LazySP, lazily restricts edge evaluation to only…

Robotics · Computer Science 2019-07-24 Aditya Mandalika , Sanjiban Choudhury , Oren Salzman , Siddhartha Srinivasa

Reinforcement Learning (RL) has gained significant attention across various domains. However, the increasing complexity of RL programs presents testing challenges, particularly the oracle problem: defining the correctness of the RL program.…

Software Engineering · Computer Science 2024-07-01 Shiyu Zhang , Haoyang Song , Qixin Wang , Yu Pei

Large Language Models (LLMs) are increasingly evaluated on multiple-choice question answering (MCQA) tasks using *first-token probability* (FTP), which selects the answer option whose initial token has the highest likelihood. While…

Computation and Language · Computer Science 2026-04-06 Silvia Cappelletti , Tobia Poppi , Samuele Poppi , Zheng-Xin Yong , Diego Garcia-Olano , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

In response to the lack of trust in Artificial Intelligence (AI) for sequential planning, we design a Computational Tree Logic-guided large language model (LLM)-based natural language explanation framework designed for the Monte Carlo Tree…

Artificial Intelligence · Computer Science 2025-05-02 Ziyan An , Xia Wang , Hendrik Baier , Zirong Chen , Abhishek Dubey , Taylor T. Johnson , Jonathan Sprinkle , Ayan Mukhopadhyay , Meiyi Ma

With current state-of-the-art approaches aimed at enhancing the reasoning capabilities of Large Language Models(LLMs) through iterative preference learning inspired by AlphaZero, we propose to further enhance the step-wise reasoning…

Machine Learning · Computer Science 2024-12-24 Huchen Jiang , Yangyang Ma , Chaofan Ding , Kexin Luan , Xinhan Di