English
Related papers

Related papers: EvoFSM: Controllable Self-Evolution for Deep Resea…

200 papers

Tasks requiring deductive reasoning, especially those involving multiple steps, often demand adaptive strategies such as intermediate generation of rationales or programs, as no single approach is universally optimal. While Language Models…

Artificial Intelligence · Computer Science 2024-10-22 Rongxing Liu , Kumar Shridhar , Manish Prajapat , Patrick Xia , Mrinmaya Sachan

Domain-specific large language models (LLMs), typically developed by fine-tuning a pre-trained general-purpose LLM on specialized datasets, represent a significant advancement in applied AI. A common strategy in LLM fine-tuning is…

Machine Learning · Computer Science 2026-01-08 Jing-Cheng Pang , Liu Sun , Chang Zhou , Xian Tang , Haichuan Ma , Kun Jiang , Jianlong Wang , Kai Zhang , Sijie Wu , Haoran Cai , Chenwei Wu , Xubin Li , Xin Chen

The evolve-filter (EF) model is a filter-based numerical stabilization for under-resolved convection-dominated flows. EF is a simple, modular, and effective strategy for both full-order models (FOMs) and reduced-order models (ROMs). It is…

Numerical Analysis · Mathematics 2025-02-03 Maria Strazzullo , Francesco Ballarin , Traian Iliescu , Tomás Chacón Rebollo

Optimization modeling via mixed-integer linear programming (MILP) is fundamental to industrial planning and scheduling, yet translating natural-language requirements into solver-executable models and maintaining them under evolving business…

Artificial Intelligence · Computer Science 2026-03-24 Yiliu He , Tianle Li , Binghao Ji , Zhiyuan Liu , Di Huang

Supervised Fine-Tuning (SFT) Large Language Models (LLM) fundamentally rely on high-quality training data. While data selection and data synthesis are two common strategies to improve data quality, existing approaches often face limitations…

Computation and Language · Computer Science 2025-10-23 Zinan Tang , Xin Gao , Qizhi Pei , Zhuoshi Pan , Mengzhang Cai , Jiang Wu , Conghui He , Lijun Wu

Autonomous LLM-based agents are increasingly engaging in decentralized service interactions to collaboratively execute complex tasks. However, the intrinsic instability and low-cost generativity of LLMs introduce a systemic vulnerability,…

Multiagent Systems · Computer Science 2026-02-24 Jiye Wang , Shiduo Yang , Jiayu Qin , Jianbin Li , Yu Wang , Yuanhe Zhao , Kenan Guo

Large Language Models (LLMs) possess substantial reasoning capabilities and are increasingly applied to optimization tasks, particularly in synergy with evolutionary computation. However, while recent surveys have explored specific aspects…

Neural and Evolutionary Computing · Computer Science 2026-01-08 Yisong Zhang , Ran Cheng , Guoxing Yi , Kay Chen Tan

The recent development of deep learning large models in medicine shows remarkable performance in medical image analysis and diagnosis, but their large number of parameters causes memory and inference latency challenges. Knowledge…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Shaojie Li , Zhaoshuo Diao

Configuring variational quantum algorithms for combinatorial optimization remains a difficult, expert-driven process requiring coordinated choices over solver family, ansatz, objective, and optimizer. We present AutoQResearch, an LLM-guided…

Quantum Physics · Physics 2026-04-28 Monit Sharma , Hoong Chuin Lau

Large language model (LLM) agents are increasingly equipped with memory, which are stored experience and reusable guidance that can improve task-solving performance. Recent \emph{self-evolving} systems update memory based on interaction…

Artificial Intelligence · Computer Science 2026-02-03 Yaolun Zhang , Yiran Wu , Yijiong Yu , Qingyun Wu , Huazheng Wang

Large Transformer models are capable of implementing a plethora of so-called in-context learning algorithms. These include gradient descent, classification, sequence completion, transformation, and improvement. In this work, we investigate…

Artificial Intelligence · Computer Science 2024-02-29 Robert Tjarko Lange , Yingtao Tian , Yujin Tang

LLM agents are widely deployed in complex interactive tasks, yet privacy constraints often preclude centralized optimization and co-evolution across dynamic environments. Despite the demonstrated success of Federated Learning (FL) on static…

Machine Learning · Computer Science 2026-01-13 Xiang Chen , Yuling Shi , Qizhen Lan , Yuchao Qiu , Min Wang , Xiaodong Gu , Yanfu Yan

Widely used language models (LMs) are typically built by scaling up a two-stage training pipeline: a pre-training stage that uses a very large, diverse dataset of text and a fine-tuning (sometimes, 'alignment') stage that uses targeted…

Computation and Language · Computer Science 2023-10-20 Eric Mitchell , Rafael Rafailov , Archit Sharma , Chelsea Finn , Christopher D. Manning

Language is a deep-rooted means of perpetration of stereotypes and discrimination. Large Language Models (LLMs), now a pervasive technology in our everyday lives, can cause extensive harm when prone to generating toxic responses. The…

Software Engineering · Computer Science 2026-02-06 Simone Corbo , Luca Bancale , Valeria De Gennaro , Livia Lestingi , Vincenzo Scotti , Matteo Camilli

We introduce DeepResearch$^{\text{Eco}}$, a novel agentic LLM-based system for automated scientific synthesis that supports recursive, depth- and breadth-controlled exploration of original research questions -- enhancing search diversity…

Artificial Intelligence · Computer Science 2025-07-15 Jennifer D'Souza , Endres Keno Sander , Andrei Aioanei

The increasing complexity of modern chemical processes, coupled with workforce shortages and intricate fault scenarios, demands novel automation paradigms that blend symbolic reasoning with adaptive control. In this work, we introduce a…

Artificial Intelligence · Computer Science 2025-07-11 Javal Vyas , Mehmet Mercangoz

Large Language Model (LLM) agents show great promise for complex, multi-turn tool-use tasks, but their development is often hampered by the extreme scarcity of high-quality training data. Supervised fine-tuning (SFT) on synthetic data leads…

Artificial Intelligence · Computer Science 2026-02-02 Siyuan Lu , Zechuan Wang , Hongxuan Zhang , Qintong Wu , Leilei Gan , Chenyi Zhuang , Jinjie Gu , Tao Lin

State-space models (SSMs) offer a powerful framework for dynamical system analysis, wherein the temporal dynamics of the system are assumed to be captured through the evolution of the latent states, which govern the values of the…

Machine Learning · Statistics 2024-12-17 Jiahe Lin , George Michailidis

Selective state-space models (SSMs) are an emerging alternative to the Transformer, offering the unique advantage of parallel training and sequential inference. Although these models have shown promising performance on a variety of tasks,…

Machine Learning · Computer Science 2025-07-08 Aleksandar Terzić , Michael Hersche , Giacomo Camposampiero , Thomas Hofmann , Abu Sebastian , Abbas Rahimi

While Vision-Language Models (VLMs) have shown remarkable abilities in visual and language reasoning tasks, they invariably generate flawed responses. Self-correction that instructs models to refine their outputs presents a promising…

Computation and Language · Computer Science 2025-06-06 Jiayi He , Hehai Lin , Qingyun Wang , Yi Fung , Heng Ji