中文
相关论文

相关论文: Smart Surrogate Losses for Contextual Stochastic L…

200 篇论文

In robust optimization, we would like to find a solution that is immunized against all scenarios that are modeled in an uncertainty set. Which scenarios to include in such a set is therefore of central importance for the tractability of the…

最优化与控制 · 数学 2024-10-14 Jamie Fairbrother , Marc Goerigk , Mohammad Khosravi

To solve real-world expensive constrained multi-objective optimization problems (ECMOPs), surrogate/approximation models are commonly incorporated in evolutionary algorithms to pre-select promising candidate solutions for evaluation.…

神经与进化计算 · 计算机科学 2024-05-24 Kamrul Hasan Rahi

Safe Reinforcement Learning (RL) often faces significant issues such as constraint violations and instability, necessitating the use of constrained policy optimization, which seeks optimal policies while ensuring adherence to specific…

机器学习 · 计算机科学 2025-08-07 Ning Yang , Pengyu Wang , Guoqing Liu , Haifeng Zhang , Pin Lv , Jun Wang

A significant portion of recent research on Large Language Model (LLM) alignment focuses on developing new policy optimization methods based on Group Relative Policy Optimization (GRPO). Two prominent directions have emerged: (i) a shift…

机器学习 · 计算机科学 2026-02-27 Svetlana Glazyrina , Maksim Kryzhanovskiy , Roman Ischenko

We consider adaptive decision-making problems where an agent optimizes a cumulative performance objective by repeatedly choosing among a finite set of options. Compared to the classical prediction-with-expert-advice set-up, we consider…

机器学习 · 计算机科学 2023-04-10 Michael Muehlebach

Classification tasks are usually evaluated in terms of accuracy. However, accuracy is discontinuous and cannot be directly optimized using gradient ascent. Popular methods minimize cross-entropy, hinge loss, or other surrogate losses, which…

机器学习 · 计算机科学 2024-07-25 Ivan Karpukhin , Stanislav Dereka , Sergey Kolesnikov

High penetration of renewable energy sources (RES) introduces significant uncertainty and intermittency into microgrid operations, posing challenges to economic and reliable scheduling. To address this, this paper proposes an end-to-end…

系统与控制 · 电气工程与系统科学 2026-02-04 Tingwei Cao , Yan Xu

Reinforcement learning has significantly enhanced the reasoning capabilities of Large Language Models (LLMs) in complex problem-solving tasks. Recently, the introduction of DeepSeek R1 has inspired a surge of interest in leveraging…

机器学习 · 计算机科学 2025-08-07 Jinghang Han , Jiawei Chen , Hang Shao , Hao Ma , Mingcheng Li , Xintian Shen , Lihao Zheng , Wei Chen , Tao Wei , Lihua Zhang

Contextual stochastic optimization is an advanced methodology to model uncertainty in the presence of contextual information during decision planning processes. Although classical methodologies focus on minimizing the expectation of a…

最优化与控制 · 数学 2025-11-24 Man Yiu Tsang , Tony Sit , Hoi Ying Wong

In multi-source learning with discrete labels, distributional heterogeneity across domains poses a central challenge to developing predictive models that transfer reliably to unseen domains. We study multi-source unsupervised domain…

统计方法学 · 统计学 2026-01-26 Zijian Guo , Zhenyu Wang , Yifan Hu , Francis Bach

We consider the problem of learning from training data obtained in different contexts, where the underlying context distribution is unknown and is estimated empirically. We develop a robust method that takes into account the uncertainty of…

机器学习 · 统计学 2022-02-18 Muhammad Osama , Dave Zachariah , Petre Stoica

Enhancing the reasoning capabilities of large language models effectively using reinforcement learning (RL) remains a crucial challenge. Existing approaches primarily adopt two contrasting advantage estimation granularities: token-level…

机器学习 · 计算机科学 2025-10-22 Yiran Guo , Lijie Xu , Jie Liu , Dan Ye , Shuang Qiu

Constructing uncertainty sets as unions of multiple subsets has emerged as an effective approach for creating compact and flexible uncertainty representations in data-driven robust optimization (RO). This paper focuses on two separate…

最优化与控制 · 数学 2025-02-18 Yun Li , Neil Yorke-Smith , Tamas Keviczky

Reinforcement learning (RL) has proven remarkably effective at improving the accuracy of language models in verifiable and deterministic domains like mathematics. Here, we examine if current RL methods are also effective at optimizing…

机器学习 · 计算机科学 2025-08-19 Michael Bereket , Jure Leskovec

Robust optimization is a very popular means to address decision-making problems affected by uncertainty. Its success has been fueled by its attractive robustness and scalability properties, by ease of modeling, and by the limited…

最优化与控制 · 数学 2020-06-17 Phebe Vayanos , Qing Jin , George Elissaios

Distributionally robust optimization (DRO) incorporates robustness against uncertainty in the specification of probabilistic models. This paper focuses on mitigating the curse of dimensionality in data-driven DRO problems with optimal…

最优化与控制 · 数学 2023-11-01 Lotfi M. Chaouach , Tom Oomen , Dimitris Boskos

We develop an approach for solving time-consistent risk-sensitive stochastic optimization problems using model-free reinforcement learning (RL). Specifically, we assume agents assess the risk of a sequence of random variables using dynamic…

机器学习 · 计算机科学 2022-12-01 Anthony Coache , Sebastian Jaimungal

Uncertainty sampling is a prevalent active learning algorithm that queries sequentially the annotations of data samples which the current prediction model is uncertain about. However, the usage of uncertainty sampling has been largely…

机器学习 · 计算机科学 2026-04-08 Shang Liu , Xiaocheng Li

Decision Focused Learning has emerged as a critical paradigm for integrating machine learning with downstream optimisation. Despite its promise, existing methodologies predominantly rely on probabilistic models and focus narrowly on task…

机器学习 · 计算机科学 2025-03-21 Keivan Shariatmadar , Neil Yorke-Smith , Ahmad Osman , Fabio Cuzzolin , Hans Hallez , David Moens

Decision making and learning in the presence of uncertainty has attracted significant attention in view of the increasing need to achieve robust and reliable operations. In the case where uncertainty stems from the presence of adversarial…

机器学习 · 计算机科学 2024-03-25 André Bertolace , Konstatinos Gatsis , Kostas Margellos