English
Related papers

Related papers: Toward Autonomous Long-Horizon Engineering for ML …

200 papers

AI agents hold growing promise for accelerating scientific discovery; yet, a lack of frontier evaluations hinders adoption into real workflows. Expert-written benchmarks have proven effective at measuring AI reasoning, but most at this…

Mathematical modeling is a cornerstone of scientific discovery and engineering practice, enabling the translation of real-world problems into formal systems across domains such as physics, biology, and economics. Unlike mathematical…

Artificial Intelligence · Computer Science 2025-05-21 Fan Liu , Zherui Yang , Cancheng Liu , Tianrui Song , Xiaofeng Gao , Hao Liu

Contemporary large language model (LLM)-based multi-agent systems exhibit systematic advantages in deep research tasks, which emphasize iterative, vertically structured information seeking. However, when confronted with wide search tasks…

Multiagent Systems · Computer Science 2026-02-03 Mingju Chen , Guibin Zhang , Heng Chang , Yuchen Guo , Shiji Zhou

Large Language Models (LLMs) have shown remarkable capabilities as autonomous agents, yet existing benchmarks either focus on single-agent tasks or are confined to narrow domains, failing to capture the dynamics of multi-agent coordination…

Multiagent Systems · Computer Science 2025-03-05 Kunlun Zhu , Hongyi Du , Zhaochen Hong , Xiaocheng Yang , Shuyi Guo , Zhe Wang , Zhenhailong Wang , Cheng Qian , Xiangru Tang , Heng Ji , Jiaxuan You

Artificial intelligence (AI) and machine learning (ML) are increasingly broadly adopted in industry, However, based on well over a dozen case studies, we have learned that deploying industry-strength, production quality ML models in systems…

Machine Learning · Computer Science 2020-06-04 Jan Bosch , Ivica Crnkovic , Helena Holmström Olsson

Large Language Model (LLM) agents have shown great potential in addressing real-world data science problems. LLM-driven data science agents promise to automate the entire machine learning pipeline, yet their real-world effectiveness remains…

Computation and Language · Computer Science 2025-10-09 Yixin Ou , Yujie Luo , Jingsheng Zheng , Lanning Wei , Zhuoyun Yu , Shuofei Qiao , Jintian Zhang , Da Zheng , Yuren Mao , Yunjun Gao , Huajun Chen , Ningyu Zhang

The powerful reasoning capabilities of Large Language Models (LLMs) in mathematics and coding, combined with their ability to automate complex tasks through agentic frameworks, present unprecedented opportunities for accelerating scientific…

Artificial Intelligence · Computer Science 2025-05-27 Jiabin Tang , Lianghao Xia , Zhonghang Li , Chao Huang

As Large Language Models (LLMs) become ubiquitous across various scientific domains, their lack of ability to perform complex tasks like running simulations or to make complex decisions limits their utility. LLM-based agents bridge this gap…

Computation and Language · Computer Science 2026-01-21 Anurag Acharya , Timothy Vega , Rizwan A. Ashraf , Anshu Sharma , Derek Parker , Robert Rallo

Frontier AI models and multi-agent systems have led to significant improvements in mathematical reasoning. However, for problems requiring extended, long-horizon reasoning, existing systems continue to suffer from fundamental reliability…

Multiagent Systems · Computer Science 2026-05-20 Jiaao Wu , Xian Zhang , Hanzhang Liu , Sophia Zhang , Fan Yang , Yinpeng Dong

Computational materials science and chemistry span vast knowledge domains and fractured software ecosystems. Although large language models (LLMs) have demonstrated research capabilities, scaling monolithic agents to manage the rigor and…

Recent advances in AI agents for software engineering and scientific discovery have demonstrated remarkable capabilities, yet their application to developing novel ranking models in commercial search engines remains unexplored. In this…

Information Retrieval · Computer Science 2026-03-25 Liwei Wu , Cho-Jui Hsieh

The performance gap between closed-source and open-source large language models (LLMs) is largely attributed to disparities in access to high-quality training data. To bridge this gap, we introduce a novel framework for the automated…

Recent advancements in large language model (LLM) agents have significantly accelerated scientific discovery automation, yet concurrently raised critical ethical and safety concerns. To systematically address these challenges, we introduce…

Artificial Intelligence · Computer Science 2025-05-30 Kunlun Zhu , Jiaxun Zhang , Ziheng Qi , Nuoxing Shang , Zijia Liu , Peixuan Han , Yue Su , Haofei Yu , Jiaxuan You

The development of autonomous machine learning (ML) agents capable of end-to-end data science workflows represents a significant frontier in artificial intelligence. These agents must orchestrate complex sequences of data analysis, feature…

Machine Learning · Computer Science 2026-02-24 Yaswanth Chittepu , Raghavendra Addanki , Tung Mai , Anup Rao , Branislav Kveton

Federated Learning (FL) offers a powerful paradigm for training models on decentralized data, but its promise is often undermined by the immense complexity of designing and deploying robust systems. The need to select, combine, and tune…

Artificial Intelligence · Computer Science 2025-12-22 Haoyuan Li , Mathias Funk , Aaqib Saeed

The plethora of complex artificial intelligence (AI) algorithms and available high performance computing (HPC) power stimulates the expeditious development of AI components with heterogeneous designs. Consequently, the need for cross-stack…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-16 Zhixiang Ren , Yongheng Liu , Tianhui Shi , Lei Xie , Yue Zhou , Jidong Zhai , Youhui Zhang , Yunquan Zhang , Wenguang Chen

As AI capabilities advance toward and potentially beyond human-level performance, a natural transition emerges where AI-driven development becomes more efficient than human-centric approaches. A promising pathway toward this transition lies…

Artificial Intelligence · Computer Science 2025-06-23 Zexi Liu , Yuzhu Cai , Xinyu Zhu , Yujie Zheng , Runkun Chen , Ying Wen , Yanfeng Wang , Weinan E , Siheng Chen

Much previous AI research has focused on developing monolithic models to maximize their intelligence, with the primary goal of enhancing performance on specific tasks. In contrast, this work attempts to study using LLM-based agents to…

Computation and Language · Computer Science 2026-02-10 Xiangyuan Xue , Zeyu Lu , Di Huang , Zidong Wang , Wanli Ouyang , Lei Bai

Autonomous agents have recently achieved remarkable progress across diverse domains, yet most evaluations focus on short-horizon, fully observable tasks. In contrast, many critical real-world tasks, such as large-scale software development,…

The rapid advancement of artificial intelligence, particularly autonomous agentic systems based on Large Language Models (LLMs), presents new opportunities to accelerate drug discovery by improving in-silico modeling and reducing dependence…