English
Related papers

Related papers: Toward Autonomous Long-Horizon Engineering for ML …

200 papers

Current test and evaluation (T&E) methods for assessing machine learning (ML) system performance often rely on incomplete metrics. Testing is additionally often siloed from the other phases of the ML system lifecycle. Research investigating…

Software Engineering · Computer Science 2022-04-11 Violet Turri , Rachel Dzombak , Eric Heim , Nathan VanHoudnos , Jay Palat , Anusha Sinha

Markets are a promising way to coordinate AI agent activity for similar reasons to those used to justify markets more broadly. In order to effectively participate in markets, agents need to have informative signals of their own ability to…

Artificial Intelligence · Computer Science 2026-04-28 Andrey Fradkin , Rohit Krishnan

Large language models can perform well on many isolated tasks, yet they continue to struggle on multi-turn, long-horizon agentic problems that require skills such as planning, state tracking, and long context processing. In this work, we…

Artificial Intelligence · Computer Science 2026-01-26 Amin Rakhsha , Thomas Hehn , Pietro Mazzaglia , Fabio Valerio Massoli , Arash Behboodi , Tribhuvanesh Orekondy

The growing prevalence of artificial intelligence (AI) in various applications underscores the need for agents that can successfully navigate and adapt to an ever-changing, open-ended world. A key challenge is ensuring these AI agents are…

Machine Learning · Computer Science 2025-12-10 Mikayel Samvelyan

This paper introduces BioAgent Bench, a benchmark dataset and an evaluation suite designed for measuring the performance and robustness of AI agents in common bioinformatics tasks. The benchmark contains curated end-to-end tasks (e.g.,…

Artificial Intelligence · Computer Science 2026-05-08 Dionizije Fa , Marko Culjak , Bruno Pandza , Mateo Cupic

With the advent of AI agents, automatic scientific discovery has become a tenable goal. Many recent works scaffold agentic systems that can perform machine learning research, but don't offer a principled way to train such agents -- and…

Artificial Intelligence · Computer Science 2026-03-19 Ziyang Cai , Harkirat Behl

Large Language Models (LLMs) show promise as data analysis agents, but existing benchmarks overlook the iterative nature of the field, where experts' decisions evolve with deeper insights of the dataset. To address this, we introduce…

Computation and Language · Computer Science 2025-06-09 Hanyu Li , Haoyu Liu , Tingyu Zhu , Tianyu Guo , Zeyu Zheng , Xiaotie Deng , Michael I. Jordan

Machine Learning (ML) is profoundly reshaping the way researchers create, implement, and operate data-intensive software. Its adoption, however, introduces notable challenges for computing infrastructures, particularly when it comes to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-30 Lucio Anderlini , Giulio Bianchini , Diego Ciangottini , Stefano Dal Pra , Diego Michelotto , Rosa Petrini , Daniele Spiga

We present HardML, a benchmark designed to evaluate the knowledge and reasoning abilities in the fields of data science and machine learning. HardML comprises a diverse set of 100 challenging multiple-choice questions, handcrafted over a…

Machine Learning · Computer Science 2025-05-07 Tidor-Vlad Pricope

The proliferation of Large Language Models (LLMs) in recent years has realized many applications in various domains. Being trained with a huge of amount of data coming from various sources, LLMs can be deployed to solve different tasks,…

Software Engineering · Computer Science 2025-03-17 Duc S. H. Nguyen , Bach G. Truong , Phuong T. Nguyen , Juri Di Rocco , Davide Di Ruscio

Large Language Model (LLM)-based agents are increasingly deployed for complex, tool-based tasks where long-term memory is critical to driving actions. Existing benchmarks, however, primarily test a angent's ability to passively retrieve…

Computation and Language · Computer Science 2026-01-29 Yiting Shen , Kun Li , Wei Zhou , Songlin Hu

Information-seeking is a core capability for AI agents, requiring them to gather and reason over tool-generated information across long trajectories. However, such multi-step information-seeking tasks remain challenging for agents backed by…

Artificial Intelligence · Computer Science 2025-11-25 Jaewoo Lee , Archiki Prasad , Justin Chih-Yao Chen , Zaid Khan , Elias Stengel-Eskin , Mohit Bansal

Project-Based Learning (PBL) involves a variety of highly correlated multimodal data, making it a vital educational approach within STEM disciplines. With the rapid development of multimodal large language models (MLLMs), researchers have…

Computation and Language · Computer Science 2025-11-04 Xinyi Wu , Yanhao Jia , Qinglin Zhang , Yiran Qin , Luwei Xiao , Shuai Zhao

As reinforcement learning continues to scale the training of large language model-based agents, reliably verifying agent behaviors in complex environments has become increasingly challenging. Existing approaches rely on rule-based verifiers…

Artificial Intelligence · Computer Science 2026-04-21 Wentao Shi , Yu Wang , Yuyang Zhao , Yuxin Chen , Fuli Feng , Xueyuan Hao , Xi Su , Qi Gu , Hui Su , Xunliang Cai , Xiangnan He

The integration of Large Language Models (LLMs) into the scientific ecosystem raises fundamental questions about the creativity and originality of AI-generated research. Recent work has identified ``smart plagiarism'' as a concern in…

Computation and Language · Computer Science 2026-01-16 Devesh Saraogi , Rohit Singhee , Dhruv Kumar

Recent advancements in Large Language Models (LLMs) have greatly extended the capabilities of Multi-Agent Systems (MAS), demonstrating significant effectiveness across a wide range of complex and open-ended domains. However, despite this…

Agentic AI systems have gained significant attention for their ability to autonomously perform complex tasks. However, their reliance on well-prepared tools limits their applicability in the medical domain, which requires to train…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Jinghao Feng , Qiaoyu Zheng , Chaoyi Wu , Ziheng Zhao , Ya Zhang , Yanfeng Wang , Weidi Xie

Existing AI system benchmarks such as MLPerf often struggle to keep pace with the rapidly evolving AI landscape, making it difficult to support informed deployment, optimization, and co-design decisions for AI systems. We suggest that…

Machine Learning · Computer Science 2025-09-16 Grigori Fursin , Daniel Altunay

The potential of Large Language Model (LLM) as agents has been widely acknowledged recently. Thus, there is an urgent need to quantitatively \textit{evaluate LLMs as agents} on challenging tasks in interactive environments. We present…

AI for science (AI4S) is an emerging research field that aims to enhance the accuracy and speed of scientific computing tasks using machine learning methods. Traditional AI benchmarking methods struggle to adapt to the unique challenges…

Machine Learning · Computer Science 2023-08-14 Yatao Li , Wanling Gao , Lei Wang , Lixin Sun , Zun Wang , Jianfeng Zhan