English
Related papers

Related papers: TheoremForge: Scaling up Formal Data Synthesis wit…

200 papers

Structured LLM workflows, where specialized LLM sub-agents execute according to a predefined graph, have become a powerful abstraction for solving complex tasks. Optimizing such workflows, i.e., selecting configurations for each sub-agent…

Computation and Language · Computer Science 2026-05-14 Junyan Li , Zhang-Wei Hong , Maohao Shen , Yang Zhang , Chuang Gan

Synthetic data generation has emerged as an invaluable solution in scenarios where real-world data collection and usage are limited by cost and scarcity. Large language models (LLMs) have demonstrated remarkable capabilities in producing…

Machine Learning · Computer Science 2025-07-22 Anh Nguyen , Sam Schafft , Nicholas Hale , John Alfaro

Modern AI systems increasingly rely on workflows composed of multiple interacting agents, some powered by large language models (LLMs) and others by conventional computational modules. This paper analyzes the fundamental tradeoffs between…

Artificial Intelligence · Computer Science 2026-05-26 Ya-Ting Yang , Quanyan Zhu

The automated generation of agentic workflows is a promising frontier for enabling large language models (LLMs) to solve complex tasks. However, our investigation reveals that the robustness of agentic workflow remains a critical,…

Multiagent Systems · Computer Science 2025-10-07 Shengxiang Xu , Jiayi Zhang , Shimin Di , Yuyu Luo , Liang Yao , Hanmo Liu , Jia Zhu , Fan Liu , Min-Ling Zhang

Recent advances in agentic frameworks have enabled AI agents to perform complex reasoning and decision-making. However, evidence comparing their reasoning performance, efficiency, and practical suitability remains limited. To address this…

Artificial Intelligence · Computer Science 2026-04-21 Zeeshan Rasheed , Abdul Malik Sami , Muhammad Waseem , Kai-Kristian Kemell , Mika Saari , Pekka Abrahamsson

Training models to high-end performance requires availability of large labeled datasets, which are expensive to get. The goal of our work is to automatically synthesize labeled datasets that are relevant for a downstream task. We propose…

Computer Vision and Pattern Recognition · Computer Science 2019-04-29 Amlan Kar , Aayush Prakash , Ming-Yu Liu , Eric Cameracci , Justin Yuan , Matt Rusiniak , David Acuna , Antonio Torralba , Sanja Fidler

Large Language Models (LLMs) extend their capabilities through function-calling (FC), which relies on training data with high quality, diversity, and broad coverage of scenario. However, obtaining and annotating real function-calling data…

Computation and Language · Computer Science 2026-05-29 Hao-Xiang Xu , Chong Deng , Jiaqing Liu , Wen Wang , Qian Chen , Lujia Bao , Xiangang Li , Zhen-Hua Ling

Formal methods (FM) are reliable but costly to apply, often requiring years of expert effort in industrial-scale projects such as seL4, especially for theorem proving. Recent advances in large language models (LLMs) have made automated…

Cryptography and Security · Computer Science 2026-02-10 Jianyu Zhang , Fuyuan Zhang , Jiayi Lu , Jilin Hu , Xiaoyi Yin , Long Zhang , Feng Yang , Yongwang Zhao

As large models evolve from conversational assistants into autonomous agents, challenges increasingly arise from long-horizon decision making, tool use, and real environment interaction. Existing agenticinfrastructure remain fragmented…

Despite rapid progress in logic locking (LL), reproducibility remains a challenge as codes are rarely made public. We present LockForge, a first-of-its-kind, multi-agent large language model (LLM) framework that turns LL descriptions in…

Cryptography and Security · Computer Science 2025-12-01 Akashdeep Saha , Zeng Wang , Prithwish Basu Roy , Johann Knechtel , Ozgur Sinanoglu , Ramesh Karri

Recent works improving LLM math reasoning with synthetic data have used unique setups, making comparison of data synthesis strategies impractical. This leaves many unanswered questions about the roles of different factors in the synthetic…

Large language models have recently made significant progress to generate rigorous mathematical proofs. In contrast, utilizing LLMs for theorem proving in formal languages (such as Lean) remains challenging and computationally expensive,…

Modern computer vision systems increasingly encounter performance limitations in data-scarce domains, where collecting large-scale, high-quality labeled data is costly or impractical. While controllable diffusion models enable scalable…

Image and Video Processing · Electrical Eng. & Systems 2026-05-12 Yukang Shen

Large language models can generate plausible code, but remain brittle for formal verification in proof assistants such as Lean. A central scalability challenge is that verified synthesis requires consistent artifacts across several coupled…

Machine Learning · Computer Science 2026-05-15 Robert Joseph George , Carson Eisenach , Udaya Ghai , Dominique Perrault-Joncas , Anima Anandkumar , Dean Foster

Existing browser agent benchmarks face a fundamental trilemma: real-website benchmarks lack reproducibility due to content drift, controlled environments sacrifice realism by omitting real-web noise, and both require costly manual curation…

Artificial Intelligence · Computer Science 2026-04-14 Peng Yuan , Yuyang Yin , Yuxuan Cai , Zheng Wei

Automated agentic workflow design currently relies on per-task iterative search, which is computationally prohibitive and fails to reuse structural knowledge across tasks. We observe that optimized workflows converge to a small family of…

Machine Learning · Computer Science 2026-04-29 Shiyi Du , Jiayuan Liu , Weihua Du , Yue Huang , Jiayi Li , Yingtao Luo , Xiangliang Zhang , Vincent Conitzer , Carl Kingsford

Automated fact-checking benchmarks have largely ignored the challenge of verifying claims against real-world, high-volume structured data, instead focusing on small, curated tables. We introduce a new large-scale, multilingual dataset to…

Computation and Language · Computer Science 2026-01-27 Jacob Devasier , Akshith Putta , Qing Wang , Alankrit Moses , Chengkai Li

Agentic theorem provers often introduce intermediate lemmas, proof sketches, or subgoal decompositions before returning to tactic-level search. This can look like an expensive detour: if proving lemmas is itself hard, why should a learned…

Machine Learning · Computer Science 2026-05-11 Sho Sonoda , Shunta Akiyama , Yuya Uezato

Large language model agents are increasingly expected to perform operational work: calling APIs, manipulating files, assembling workflows, and acting inside enterprise systems. Yet the tool layer on which this execution depends is still…

Software Engineering · Computer Science 2026-05-28 Swanand Rao

Large Language models (LLMs) have demonstrated significant potential in text-to-SQL reasoning tasks, yet a substantial performance gap persists between existing open-source models and their closed-source counterparts. In this paper, we…

Computation and Language · Computer Science 2025-09-23 Yu Guo , Dong Jin , Shenghao Ye , Shuangwu Chen , Jian Yang , Xiaobin Tan