English
Related papers

Related papers: CausalEvolve: Towards Open-Ended Discovery with Ca…

200 papers

Recent advancements in large language models (LLMs) have significantly enhanced the ability of LLM-based systems to perform complex tasks through natural language processing and tool interaction. However, optimizing these LLM-based systems…

Computation and Language · Computer Science 2025-06-19 Peiyan Zhang , Haibo Jin , Leyang Hu , Xinnuo Li , Liying Kang , Man Luo , Yangqiu Song , Haohan Wang

Autonomous agents driven by Large Language Models (LLMs) have revolutionized reasoning and problem-solving but remain static after training, unable to grow with experience as intelligent beings do during deployment. We introduce Forward…

Machine Learning · Computer Science 2025-12-09 Zhicheng Cai , Xinyuan Guo , Yu Pei , Jiangtao Feng , Jinsong Su , Jiangjie Chen , Ya-Qin Zhang , Wei-Ying Ma , Mingxuan Wang , Hao Zhou

Causal discovery (CD) and Large Language Models (LLMs) have emerged as transformative fields in artificial intelligence that have evolved largely independently. While CD specializes in uncovering cause-effect relationships from data, and…

Computation and Language · Computer Science 2025-02-18 Guangya Wan , Yunsheng Lu , Yuqi Wu , Mengxuan Hu , Sheng Li

The increasing adoption of Large Language Models (LLMs) has enabled AI scientists to perform complex end-to-end scientific discovery tasks requiring coordination of specialized roles, including idea generation and experimental execution.…

Computation and Language · Computer Science 2026-03-10 Yougang Lyu , Xi Zhang , Xinhao Yi , Yuyue Zhao , Shuyu Guo , Wenxiang Hu , Jan Piotrowski , Jakub Kaliski , Jacopo Urbani , Zaiqiao Meng , Lun Zhou , Xiaohui Yan

Clinical diagnosis is a complex cognitive process, grounded in dynamic cue acquisition and continuous expertise accumulation. Yet most current artificial intelligence (AI) systems are misaligned with this reality, treating diagnosis as…

Artificial Intelligence · Computer Science 2026-03-12 Ruiyang Ren , Yuhao Wang , Yunsen Liang , Lan Luo , Jing Liu , Haifeng Wang , Cong Feng , Yinan Zhang , Chunyan Miao , Ji-Rong Wen , Wayne Xin Zhao

We are in the midst of large-scale industrial and academic efforts to automate the processes of scientific, technological and creative production through AI-driven assistants. Historically, a fundamental property of these processes in their…

Artificial Intelligence · Computer Science 2026-05-28 Sam Earle , Kai Arulkumaran , Andrew Dai , Akarsh Kumar , Julian Togelius , Sebastian Risi

Causal reasoning capability is critical in advancing large language models (LLMs) toward strong artificial intelligence. While versatile LLMs appear to have demonstrated capabilities in understanding contextual causality and providing…

Artificial Intelligence · Computer Science 2025-06-30 Haoang Chi , He Li , Wenjing Yang , Feng Liu , Long Lan , Xiaoguang Ren , Tongliang Liu , Bo Han

Reward modelling from preference data is a crucial step in aligning large language models (LLMs) with human values, requiring robust generalisation to novel prompt-response pairs. In this work, we propose to frame this problem in a causal…

Artificial Intelligence · Computer Science 2026-05-12 Katarzyna Kobalczyk , Mihaela van der Schaar

The convergence of large language models and agents is catalyzing a new era of scientific discovery: Agentic Science. While the scientific method is inherently iterative, existing agent frameworks are predominantly static, narrowly scoped,…

Large language models (LLMs) like GitHub Copilot and ChatGPT have emerged as powerful tools for code generation, significantly enhancing productivity and accelerating software development. However, existing benchmarks primarily focus on…

Software Engineering · Computer Science 2024-09-27 Yixi Wu , Pengfei He , Zehao Wang , Shaowei Wang , Yuan Tian , Tse-Hsun Chen

The arrival of large language models (LLMs) capable of multi-step reasoning, tool use, and long-horizon planning has produced a qualitative shift in software engineering. Where earlier code-completion tools such as GitHub Copilot operated…

Software Engineering · Computer Science 2026-04-30 Happy Bhati

Scientific discovery is often slowed by the manual development of computational tools needed to analyze complex experimental data. Building such tools is costly and time-consuming because scientists must iteratively review literature, test…

Artificial Intelligence · Computer Science 2026-05-19 Alistair Turcan , Kexin Huang , Lei Li , Martin Jinye Zhang

Causal discovery aims to identify causal relationships between variables and is a fundamental problem across the sciences. Traditional statistical causal discovery (SCD) methods rely solely on observational data and ignore the contextual…

Artificial Intelligence · Computer Science 2026-05-27 Hao Duong Le , Xin Xia , Haijie Xu , Chen Zhang

Large Language Model (LLM)-based agents have recently shown impressive capabilities in complex reasoning and tool use via multi-step interactions with their environments. While these agents have the potential to tackle complicated tasks,…

Artificial Intelligence · Computer Science 2025-11-04 Jiaye Lin , Yifu Guo , Yuzhen Han , Sen Hu , Ziyi Ni , Licheng Wang , Mingguang Chen , Hongzhang Liu , Ronghao Chen , Yangfan He , Daxin Jiang , Binxing Jiao , Chen Hu , Huacan Wang

Large language models (LLMs) have not only revolutionized natural language processing but also extended their prowess to various domains, marking a significant stride towards artificial general intelligence. The interplay between LLMs and…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Xingyu Wu , Sheng-hao Wu , Jibin Wu , Liang Feng , Kay Chen Tan

Recovering the structure of causal graphical models from observational data is an essential yet challenging task for causal discovery in scientific scenarios. Domain-specific causal discovery usually relies on expert validation or prior…

Artificial Intelligence · Computer Science 2025-08-27 Taiyu Ban , Lyuzhou Chen , Derui Lyu , Xiangyu Wang , Qinrui Zhu , Qiang Tu , Huanhuan Chen

Agentic evolution has emerged as a powerful paradigm for improving programs, workflows, and scientific solutions by iteratively generating candidates, evaluating them, and using feedback to guide future search. However, existing methods are…

Artificial Intelligence · Computer Science 2026-05-14 Jiayi Zhang , Yongfeng Gu , Jianhao Ruan , Maojia Song , Yiran Peng , Zhiguang Han , Jinyu Xiang , Zhitao Wang , Caiyin Yang , Yixi Ouyang , Bang Liu , Chenglin Wu , Yuyu Luo

Large language models (LLMs) have been increasingly applied to tasks in language understanding and interactive decision-making, with their impressive performance largely attributed to the extensive domain knowledge embedded within them.…

Artificial Intelligence · Computer Science 2024-10-16 Zhiyuan Sun , Haochen Shi , Marc-Alexandre Côté , Glen Berseth , Xingdi Yuan , Bang Liu

Evolution, the engine behind the survival and growth of life on Earth, operates through the population-based process of reproduction. Inspired by this principle, this paper formally defines a newly emerging problem -- the population-based…

Computation and Language · Computer Science 2025-03-10 Yiqun Zhang , Peng Ye , Xiaocui Yang , Shi Feng , Shufei Zhang , Lei Bai , Wanli Ouyang , Shuyue Hu

Large language model (LLM) development is currently driven by large-scale empirical iteration over data mixtures, reward models, routing strategies, and evaluation pipelines. Here, we argue that many central questions in LLM development and…