English
Related papers

Related papers: Scalable Decision Focused Learning via Online Trai…

200 papers

Robustness towards adversarial attacks is a vital property for classifiers in several applications such as autonomous driving, medical diagnosis, etc. Also, in such scenarios, where the cost of misclassification is very high, knowing when…

Machine Learning · Computer Science 2024-10-15 Vrund Shah , Tejas Chaudhari , Naresh Manwani

This paper presents a novel methodology that uses surrogate models in the form of neural networks to reduce the computation time of simulation-based optimization of a reference trajectory. Simulation-based optimization is necessary when…

Optimization and Control · Mathematics 2023-03-31 Evelyn Ruff , Rebecca Russell , Matthew Stoeckle , Piero Miotto , Jonathan P. How

We propose a novel family of decision-aware surrogate losses, called Perturbation Gradient (PG) losses, for the predict-then-optimize framework. The key idea is to connect the expected downstream decision loss with the directional…

Machine Learning · Computer Science 2024-11-01 Michael Huang , Vishal Gupta

We propose a novel learning-based surrogate data assimilation (DA) model for efficient state estimation in a limited area. Our model employs a feedforward neural network for online computation, eliminating the need for integrating…

Numerical Analysis · Mathematics 2023-07-17 Wei Kang , Liang Xu , Hong Zhou

Mathematical optimization is a fundamental tool for decision-making in a wide range of applications. However, in many real-world scenarios, the parameters of the optimization problem are not known a priori and must be predicted from…

Machine Learning · Computer Science 2025-11-13 Senne Berden , Ali İrfan Mahmutoğulları , Dimos Tsouros , Tias Guns

Derivative-Free Optimization (DFO) involves methods that rely solely on evaluations of the objective function. One of the earliest strategies for designing DFO methods is to adapt first-order methods by replacing gradients with…

Optimization and Control · Mathematics 2025-02-12 Timothé Taminiau , Estelle Massart , Geovani Nunes Grapiglia

Decision-focused learning (DFL) trains a machine learning (ML) model to predict parameters of an optimization problem, to directly minimize decision regret, i.e., maximize decision quality. Gradient-based DFL requires computing the…

Machine Learning · Computer Science 2025-08-26 Jayanta Mandi , Ali İrfan Mahmutoğulları , Senne Berden , Tias Guns

Multitask learning is widely used in practice to train a low-resource target task by augmenting it with multiple related source tasks. Yet, naively combining all the source tasks with a target task does not always improve the prediction…

Machine Learning · Computer Science 2023-12-29 Dongyue Li , Huy L. Nguyen , Hongyang R. Zhang

In NeuroEvolution, the topologies of artificial neural networks are optimized with evolutionary algorithms to solve tasks in data regression, data classification, or reinforcement learning. One downside of NeuroEvolution is the large amount…

Neural and Evolutionary Computing · Computer Science 2019-02-12 Jörg Stork , Martin Zaefferer , Thomas Bartz-Beielstein

Surrogate model-based optimization has been increasingly used in the field of engineering design. It involves creating a surrogate model with objective functions or constraints based on the data obtained from simulations or real-world…

Optimization and Control · Mathematics 2023-08-28 Minyoung Jwa , Jihoon Kim , Seungyeon Shin , Ah-hyeon Jin , Dongju Shin , Namwoo Kang

Performing reliability analysis on complex systems is often computationally expensive. In particular, when dealing with systems having high input dimensionality, reliability estimation becomes a daunting task. A popular approach to overcome…

Machine Learning · Statistics 2021-12-22 Navaneeth N. , Souvik Chakraborty

Gradient-free optimization methods, such as surrogate based optimization (SBO) methods, and genetic (GAs), or evolutionary (EAs) algorithms have gained popularity in the field of constrained optimization of expensive black-box functions.…

Optimization and Control · Mathematics 2021-07-22 Ahmed Abouhussein , Nusrat Islam , Yulia T. Peet

In various approaches to learning, notably in domain adaptation, active learning, learning under covariate shift, semi-supervised learning, learning with concept drift, and the like, one often wants to compare a baseline classifier to one…

Machine Learning · Computer Science 2017-07-14 Marco Loog , Jesse H. Krijthe , Are C. Jensen

This paper aims to understand whether machine learning models should be trained using cost-sensitive surrogates or cost-agnostic ones (e.g., cross-entropy). Analyzing this question through the lens of $\mathcal{H}$-calibration, we find that…

Machine Learning · Computer Science 2025-02-28 Sanket Shah , Milind Tambe , Jessie Finocchiaro

We present a probabilistic deep learning methodology that enables the construction of predictive data-driven surrogates for stochastic systems. Leveraging recent advances in variational inference with implicit distributions, we put forth a…

Machine Learning · Statistics 2019-01-16 Yibo Yang , Paris Perdikaris

We introduce the first one-stage Top-$k$ Learning-to-Defer framework, which unifies prediction and deferral by learning a shared score-based model that selects the $k$ most cost-effective entities-labels or experts-per input. While existing…

Machine Learning · Statistics 2025-10-14 Yannis Montreuil , Axel Carlier , Lai Xing Ng , Wei Tsang Ooi

Most existing multiobjetive evolutionary algorithms (MOEAs) implicitly assume that each objective function can be evaluated within the same period of time. Typically. this is untenable in many real-world optimization scenarios where…

Neural and Evolutionary Computing · Computer Science 2021-08-31 Xilu Wang , Yaochu Jin , Sebastian Schmitt , Markus Olhofer

This study presents a methodology to treat performance-based seismic design as an inverse engineering problem, where design parameters are directly derived to achieve specific performance objectives. By implementing explainable machine…

Machine Learning · Computer Science 2025-08-04 Mohsen Zaker Esteghamati

Recently, a surrogate model was proposed that employs a factorization machine to approximate the underlying input-output mapping of the original system, with quantum annealing used to optimize the resulting surrogate function. Inspired by…

Machine Learning · Computer Science 2026-01-21 Anbang Wang , Dunbo Cai , Yu Zhang , Yangqing Huang , Xiangyang Feng , Zhihong Zhang

Area under ROC (AUC) is an important metric for binary classification and bipartite ranking problems. However, it is difficult to directly optimizing AUC as a learning objective, so most existing algorithms are based on optimizing a…

Machine Learning · Computer Science 2018-05-28 Siwei Lyu , Yiming Ying
‹ Prev 1 3 4 5 6 7 10 Next ›