中文
相关论文

相关论文: Optimas: Optimizing Compound AI Systems with Globa…

200 篇论文

Multi-agent systems powered by large language models have demonstrated remarkable capabilities across diverse domains, yet existing automated design approaches seek monolithic solutions that fail to adapt resource allocation based on query…

人工智能 · 计算机科学 2025-10-06 Bo Ma , Hang Li , ZeHua Hu , XiaoFan Gui , LuYao Liu , Simon Liu

A major contributor to the quality of a deep learning model is the selection of the optimizer. We propose a new dual-joint search space in the realm of neural optimizer search (NOS), along with an integrity check, to automate the process of…

神经与进化计算 · 计算机科学 2024-04-11 Brandon Morgan , Dean Hougen

Automated optimization modeling via Large Language Models (LLMs) has emerged as a promising approach to assist complex human decision-making. While post-training has become a pivotal technique to enhance LLMs' capabilities in this domain,…

机器学习 · 计算机科学 2026-02-13 Weiting Liu , Han Wu , Yufei Kuang , Xiongwei Han , Tao Zhong , Jianfeng Feng , Wenlian Lu

Optimization algorithms can be interpreted through the lens of dynamical systems as the interconnection of linear systems and a set of subgradient nonlinearities. This dynamical systems formulation allows for the analysis and synthesis of…

最优化与控制 · 数学 2026-03-27 Jared Miller , Carsten Scherer , Fabian Jakob , Andrea Iannelli

Combinatorial Optimization underpins many real-world applications and yet, designing performant algorithms to solve these complex, typically NP-hard, problems remains a significant research challenge. Reinforcement Learning (RL) provides a…

We study online learning problems in which a decision maker has to take a sequence of decisions subject to $m$ long-term constraints. The goal of the decision maker is to maximize their total reward, while at the same time achieving small…

机器学习 · 计算机科学 2022-09-16 Matteo Castiglioni , Andrea Celli , Alberto Marchesi , Giulia Romano , Nicola Gatti

Autonomous systems are composed of several subsystems such as mechanical, propulsion, perception, planning and control. These are traditionally designed separately which makes performance optimization of the integrated system a significant…

机器人学 · 计算机科学 2022-03-01 Hongrui Zheng , Johannes Betz , Rahul Mangharam

In many real-world applications, reinforcement learning (RL) agents might have to solve multiple tasks, each one typically modeled via a reward function. If reward functions are expressed linearly, and the agent has previously learned a set…

机器学习 · 计算机科学 2022-06-24 Lucas N. Alegre , Ana L. C. Bazzan , Bruno C. da Silva

Learning reward functions remains the bottleneck to equip a robot with a broad repertoire of skills. Large Language Models (LLM) contain valuable task-related knowledge that can potentially aid in the learning of reward functions. However,…

机器人学 · 计算机科学 2024-05-17 Yuwei Zeng , Yao Mu , Lin Shao

Many deep reinforcement learning algorithms contain inductive biases that sculpt the agent's objective and its interface to the environment. These inductive biases can take many forms, including domain knowledge and pretuned…

机器学习 · 计算机科学 2019-07-08 Matteo Hessel , Hado van Hasselt , Joseph Modayil , David Silver

Learning to optimize has emerged as a powerful framework for various optimization and machine learning tasks. Current such "meta-optimizers" often learn in the space of continuous optimization algorithms that are point-based and…

机器学习 · 计算机科学 2019-11-19 Yue Cao , Tianlong Chen , Zhangyang Wang , Yang Shen

The field of simulation optimization (SO) encompasses various methods developed to optimize complex, expensive-to-sample stochastic systems. Established methods include, but are not limited to, ranking-and-selection for finite alternatives…

机器学习 · 统计学 2025-11-04 Haoting Zhang , Haoxian Chen , Donglin Zhan , Hanyang Zhao , Henry Lam , Wenpin Tang , David Yao , Zeyu Zheng

As Large Language Models (LLMs) continue to progress toward more advanced forms of intelligence, Reinforcement Learning from Human Feedback (RLHF) is increasingly seen as a key pathway toward achieving Artificial General Intelligence (AGI).…

机器学习 · 计算机科学 2024-10-17 Yuzi Yan , Xingzhou Lou , Jialian Li , Yiping Zhang , Jian Xie , Chao Yu , Yu Wang , Dong Yan , Yuan Shen

Reinforcement Learning (RL) has the potential to improve the robustness of GUI agents in stochastic environments, yet training is highly sensitive to the quality of the reward function. Existing reward approaches struggle to achieve both…

To promote cooperation in Multi-Agent Reinforcement Learning, the reward signals of all agents can be aggregated together, forming global rewards that are commonly known as the fully cooperative setting. However, global rewards are usually…

机器学习 · 计算机科学 2026-01-30 Bang Giang Le , Viet Cuong Ta

Approximations of optimization problems arise in computational procedures and sensitivity analysis. The resulting effect on solutions can be significant, with even small approximations of components of a problem translating into large…

最优化与控制 · 数学 2022-08-10 Johannes O. Royset

A large-scale complex system comprising many, often spatially distributed, dynamical subsystems with partial autonomy and complex interactions are called system of systems. This paper describes an efficient algorithm for model predictive…

最优化与控制 · 数学 2019-04-25 Branimir Novoselnik , Vedrana Spudić , Mato Baotić

Large language model (LLM)-based Multi-agent systems (MAS) have shown promise in tackling complex collaborative tasks, where agents are typically orchestrated via role-specific prompts. While the quality of these prompts is pivotal, jointly…

人工智能 · 计算机科学 2026-05-11 Zhexuan Wang , Xuebo Liu , Li Wang , Zifei Shan , Yutong Wang , Zhenxi Song , Min Zhang

Optimization problems are pervasive in sectors from manufacturing and distribution to healthcare. However, most such problems are still solved heuristically by hand rather than optimally by state-of-the-art solvers because the expertise…

人工智能 · 计算机科学 2024-02-16 Ali AhmadiTeshnizi , Wenzhi Gao , Madeleine Udell

Congestion control is a fundamental component of Internet infrastructure, and researchers have dedicated considerable effort to developing improved congestion control algorithms. However, despite extensive study, existing algorithms…

网络与互联网体系结构 · 计算机科学 2025-08-25 Zhiyuan He , Aashish Gottipati , Lili Qiu , Yuqing Yang , Francis Y. Yan