English
Related papers

Related papers: AI Scientist via Synthetic Task Scaling

200 papers

As Large Language Models (LLMs) become ubiquitous across various scientific domains, their lack of ability to perform complex tasks like running simulations or to make complex decisions limits their utility. LLM-based agents bridge this gap…

Computation and Language · Computer Science 2026-01-21 Anurag Acharya , Timothy Vega , Rizwan A. Ashraf , Anshu Sharma , Derek Parker , Robert Rallo

As LLM agents are increasingly built around reusable skills, a central challenge is no longer only whether agents can use provided skills, but whether they can generate correct, reusable, and executable skills from repositories and…

Artificial Intelligence · Computer Science 2026-05-19 Yifan Zhou , Zhentao Zhang , Ziming Cheng , Shuo Zhang , Qizhen Lan , Zhangquan Chen , Zhi Yang , QianyuXu , Ronghao Chen , Huacan Wang , Sen Hu

Collecting large amounts of real-world interaction data to train general robotic policies is often prohibitively expensive, thus motivating the use of simulation data. However, existing methods for data generation have generally focused on…

Machine Learning · Computer Science 2024-01-23 Lirui Wang , Yiyang Ling , Zhecheng Yuan , Mohit Shridhar , Chen Bao , Yuzhe Qin , Bailin Wang , Huazhe Xu , Xiaolong Wang

Real dialogues with AI assistants for solving data-centric tasks often follow dynamic, unpredictable paths due to imperfect information provided by the user or in the data, which must be caught and handled. Developing datasets which capture…

Computation and Language · Computer Science 2025-03-19 Christian Poelitz , Nick McKenna

While rapid advances in large language models (LLMs) are reshaping data-driven intelligent education, accurately simulating students remains an important but challenging bottleneck for scalable educational data collection, evaluation, and…

Computers and Society · Computer Science 2025-12-05 Haoxuan Li , Jifan Yu , Xin Cong , Yang Dang , Daniel Zhang-li , Lu Mi , Yisi Zhan , Huiqin Liu , Zhiyuan Liu

Achieving mastery in real world software engineering tasks is fundamentally bottlenecked by the scarcity of large scale, high quality training data. Scaling such data has been limited by the complexity of environment setup, unit test…

AI agents hold growing promise for accelerating scientific discovery; yet, a lack of frontier evaluations hinders adoption into real workflows. Expert-written benchmarks have proven effective at measuring AI reasoning, but most at this…

Embodied systems, where generative autonomous agents engage with the physical world through integrated perception, cognition, action, and advanced reasoning powered by large language models (LLMs), hold immense potential for addressing…

Search agents have emerged as a pivotal paradigm for solving open-ended, knowledge-intensive reasoning tasks. However, training these agents via Reinforcement Learning (RL) faces a critical dilemma: interacting with live commercial Web APIs…

Computation and Language · Computer Science 2026-01-22 Xichen Zhang , Ziyi He , Yinghao Zhu , Sitong Wu , Shaozuo Yu , Meng Chu , Wenhu Zhang , Haoru Tan , Jiaya Jia

Autonomous agents, which perceive environments and take actions to achieve goals, have become increasingly feasible with the advancements in large language models (LLMs). However, current powerful agents often depend on sophisticated prompt…

Computation and Language · Computer Science 2025-05-27 Yihan Chen , Benfeng Xu , Xiaorui Wang , Yongdong Zhang , Zhendong Mao

Large language models (LLMs) are expected to be trained to act as agents in various real-world environments, but this process relies on rich and varied tool-interaction sandboxes. However, access to real systems is often restricted;…

Computation and Language · Computer Science 2026-04-20 Xiaoshuai Song , Haofei Chang , Guanting Dong , Yutao Zhu , Ji-Rong Wen , Zhicheng Dou

Extending the capabilities of Large Language Models (LLMs) with functions or tools for environment interaction has led to the emergence of the agent paradigm. In industry, training an LLM is not always feasible because of the scarcity of…

Computation and Language · Computer Science 2025-01-14 Saptarshi Sengupta , Harsh Vashistha , Kristal Curtis , Akshay Mallipeddi , Abhinav Mathur , Joseph Ross , Liang Gou

The scarcity of data depicting dangerous situations presents a major obstacle to training AI systems for safety-critical applications, such as construction safety, where ethical and logistical barriers hinder real-world data collection.…

Artificial Intelligence · Computer Science 2025-05-21 Vu Dinh Xuan , Hao Vo , David Murphy , Hoang D. Nguyen

Large language model based agents are increasingly deployed in complex, tool augmented environments. While reinforcement learning provides a principled mechanism for such agents to improve through interaction, its effectiveness critically…

Artificial Intelligence · Computer Science 2025-12-04 Shinji Mai , Yunpeng Zhai , Ziqian Chen , Cheng Chen , Anni Zou , Shuchang Tao , Zhaoyang Liu , Bolin Ding

Language model (LM) agents are increasingly being used to automate complicated tasks in digital environments. Just as humans benefit from powerful software applications, such as integrated development environments, for complex tasks like…

Software Engineering · Computer Science 2024-11-13 John Yang , Carlos E. Jimenez , Alexander Wettig , Kilian Lieret , Shunyu Yao , Karthik Narasimhan , Ofir Press

Synthetic Data Generation (SDG), leveraging Large Language Models (LLMs), has recently been recognized and broadly adopted as an effective approach to improve the performance of smaller but more resource and compute efficient LLMs through…

Machine Learning · Computer Science 2026-03-25 Srideepika Jayaraman , Achille Fokoue , Dhaval Patel , Jayant Kalagnanam

Large language models (LLMs) show their powerful automatic reasoning and planning capability with a wealth of semantic knowledge about the human world. However, the grounding problem still hinders the applications of LLMs in the real-world…

Computation and Language · Computer Science 2023-09-06 Shaohui Peng , Xing Hu , Qi Yi , Rui Zhang , Jiaming Guo , Di Huang , Zikang Tian , Ruizhi Chen , Zidong Du , Qi Guo , Yunji Chen , Ling Li

Large language models (LLMs) are increasingly deployed as agents, expected to decompose goals, invoke tools, and verify results in dynamic environments. Realizing these capabilities requires access to agentic data-structured interaction…

Artificial Intelligence · Computer Science 2025-10-22 Abhigya Verma , Seganrasan Subramanian , Nandhakumar Kandasamy , Naman Gupta

Graphical User Interface (GUI) agents can automate complex tasks across digital environments, but their development is hindered by the scarcity of high-quality trajectory data for training. Existing approaches rely on expensive human…

Computation and Language · Computer Science 2025-03-04 Yiheng Xu , Dunjie Lu , Zhennan Shen , Junli Wang , Zekun Wang , Yuchen Mao , Caiming Xiong , Tao Yu