English
Related papers

Related papers: MerLean: An Agentic Framework for Autoformalizatio…

200 papers

Despite the remarkable capabilities of large language models (LLMs) in various reasoning tasks, they still struggle with table reasoning tasks, particularly in maintaining consistency throughout multi-step reasoning processes. While…

Artificial Intelligence · Computer Science 2025-05-26 Peiying Yu , Guoxin Chen , Jingjing Wang

Autonomous machine learning research has gained significant attention recently. We present MLR-COPILOT, an autonomous Machine Learning Research framework powered by large language model agents. The system is designed to enhance ML research…

Artificial Intelligence · Computer Science 2025-11-18 Ruochen Li , Teerth Patel , Qingyun Wang , Xinya Du

Building and deploying machine learning solutions in healthcare remains expensive and labor-intensive due to fragmented preprocessing workflows, model compatibility issues, and stringent data privacy constraints. In this work, we introduce…

Artificial Intelligence · Computer Science 2025-07-25 Soorya Ram Shimgekar , Shayan Vassef , Abhay Goyal , Navin Kumar , Koustuv Saha

Chain-of-Thought (CoT) prompting has become the de facto method to elicit reasoning capabilities from large language models (LLMs). However, to mitigate hallucinations in CoT that are notoriously difficult to detect, current methods such as…

Computation and Language · Computer Science 2025-06-06 Chengwu Liu , Ye Yuan , Yichun Yin , Yan Xu , Xin Xu , Zaoyu Chen , Yasheng Wang , Lifeng Shang , Qun Liu , Ming Zhang

While large language models have significantly accelerated scientific code generation, comprehensively evaluating the generated code remains a major challenge. Traditional benchmarks reduce evaluation to test-case matching, an approach…

Artificial Intelligence · Computer Science 2026-03-18 Hong Zhang , Barry Smith , Satish Balay , Le Chen , Murat Keceli , Lois Curfman McInnes , Junchao Zhang

Autoformalization is the task of translating natural language materials into machine-verifiable formalisations. Progress in autoformalization research is hindered by the lack of a sizeable dataset consisting of informal-formal pairs…

Computation and Language · Computer Science 2023-11-10 Albert Q. Jiang , Wenda Li , Mateja Jamnik

This paper describes VILLAIN, a multimodal fact-checking system that verifies image-text claims through prompt-based multi-agent collaboration. For the AVerImaTeC shared task, VILLAIN employs vision-language model agents across multiple…

Computation and Language · Computer Science 2026-02-23 Jaeyoon Jung , Yejun Yoon , Kunwoo Park

Large language models (LLMs) are increasingly used for qualitative data analysis (QDA), yet their outputs often miss the depth and nuance of human analysis. We argue this gap reflects a missing credibility practice from human QDA: peer…

Artificial Intelligence · Computer Science 2026-05-26 Zhimin Lin , Kun Cheng , Fan Bai , Jie Gao

Large language models (LLMs) have sparked growing interest in machine learning research agents that can autonomously propose ideas and conduct experiments. However, existing benchmarks predominantly adopt an engineering-oriented…

Computation and Language · Computer Science 2026-02-26 Qiran Zou , Hou Hei Lam , Wenhao Zhao , Yiming Tang , Tingting Chen , Samson Yu , Tianyi Zhang , Chang Liu , Xiangyang Ji , Dianbo Liu

Autoformalization plays a crucial role in formal mathematical reasoning by enabling the automatic translation of natural language statements into formal languages. While recent advances using large language models (LLMs) have shown…

Computation and Language · Computer Science 2025-06-13 Lan Zhang , Marco Valentino , Andre Freitas

Legal decisions should be logical and based on statutory laws. While large language models(LLMs) are good at understanding legal text, they cannot provide verifiable justifications. We present L4L, a solver-centric framework that enforces…

Artificial Intelligence · Computer Science 2026-03-06 Linze Chen , Yufan Cai , Zhe Hou , Jin Song Dong

Large language models (LLMs) have recently gained significant attention as a promising approach to accelerate scientific discovery. However, their application in open-ended scientific domains such as biology remains limited, primarily due…

Machine Learning · Computer Science 2026-05-21 Yunhui Jang , Lu Zhu , Jake Fawkes , Alisandra Kaye Denton , Dominique Beaini , Emmanuel Noutahi

Despite demonstrating remarkable performance across a wide range of tasks, large language models (LLMs) have also been found to frequently produce outputs that are incomplete or selectively omit key information. In sensitive domains, such…

Computation and Language · Computer Science 2026-05-11 Adam Dejl , James Barry , Alessandra Pascale , Javier Carnerero Cano

While Language Models (LMs) have made significant progress in automating machine learning engineering (MLE), the acquisition of high-quality MLE training data is significantly constrained. Current MLE benchmarks suffer from low scalability…

Machine Learning · Computer Science 2025-10-09 Rushi Qiang , Yuchen Zhuang , Anikait Singh , Percy Liang , Chao Zhang , Sherry Yang , Bo Dai

Recent advancements in generative Large Language Models(LLMs) have been remarkable, however, the quality of the text generated by these models often reveals persistent issues. Evaluating the quality of text generated by these models,…

Computation and Language · Computer Science 2024-04-16 Yu Li , Shenyu Zhang , Rui Wu , Xiutian Huang , Yongrui Chen , Wenhao Xu , Guilin Qi , Dehai Min

We present Genie-CAT, a tool-augmented large-language-model (LLM) system designed to accelerate scientific hypothesis generation in protein design. Using metalloproteins (e.g., ferredoxins) as a case study, Genie-CAT integrates four…

Quantitative Methods · Quantitative Biology 2025-11-25 Bruno Jacob , Khushbu Agarwal , Marcel Baer , Peter Rice , Simone Raugei

AI agents powered by large language models exhibit strong reasoning and problem-solving capabilities, enabling them to assist scientific research tasks such as formula derivation and code generation. However, whether these agents can…

Large Language Model (LLM)-based agentic systems rely on in-context policy documents encoding diverse business rules. As requirements grow, these documents expand rapidly, causing high computational overhead. This motivates developing…

Artificial Intelligence · Computer Science 2025-10-14 Jiateng Liu , Zhenhailong Wang , Xiaojiang Huang , Yingjie Li , Xing Fan , Xiang Li , Chenlei Guo , Ruhi Sarikaya , Heng Ji

Large Language Models (LLMs) can generate Computer-Aided Design (CAD), yet lack physical comprehension required for reliable engineering design. Instead of attempting to implicitly learn physical laws from data, we propose a Hybrid…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Elias Berger , Muhammad Usama , Jan Mehlstäubl , Bernhard Saske , Kristin Paetzold-Byhain

Legal texts often contain computational legal clauses--provisions whose understanding requires complex logic. While frontier Large Reasoning Models (LRMs) can describe such clauses, building production-ready systems is limited by reasoning…

Computation and Language · Computer Science 2026-05-05 Stanisław Sójka , Witold Kowalczyk