English
Related papers

Related papers: Barrier-enforced multi-objective optimization for …

200 papers

Conventional research attributes the improvements of generalization ability of deep neural networks either to powerful optimizers or the new network design. Different from them, in this paper, we aim to link the generalization ability of a…

Machine Learning · Computer Science 2018-11-06 Hui-Ling Zhen , Xi Lin , Alan Z. Tang , Zhenhua Li , Qingfu Zhang , Sam Kwong

In this work we consider the task of constructing prediction intervals in an inductive batch setting. We present a discriminative learning framework which optimizes the expected error rate under a budget constraint on the interval sizes.…

Machine Learning · Computer Science 2018-02-28 Nir Rosenfeld , Yishay Mansour , Elad Yom-Tov

In the era of increasingly complex AI models for time series forecasting, progress is often measured by marginal improvements on benchmark leaderboards. However, this approach suffers from a fundamental flaw: standard evaluation metrics…

Machine Learning · Computer Science 2026-05-28 Wanjin Feng , Yuan Yuan , Jingtao Ding , Yong Li

Probabilistic forecasting is not only a way to add more information to a prediction of the future, but it also builds on weaknesses in point prediction. Sudden changes in a time series can still be captured by a cumulative distribution…

Machine Learning · Computer Science 2025-11-19 Niklas Erdmann , Lars Bentsen , Roy Stenbro , Heine Nygard Riise , Narada Dilp Warakagoda , Paal E. Engelstad

While standard reinforcement learning optimizes a single reward signal, many applications require optimizing a nonlinear utility $f(J_1^\pi,\dots,J_M^\pi)$ over multiple objectives, where each $J_m^\pi$ denotes the expected discounted…

Machine Learning · Computer Science 2026-03-10 Swetha Ganesh , Vaneet Aggarwal

High penetration of renewable energy sources (RES) introduces significant uncertainty and intermittency into microgrid operations, posing challenges to economic and reliable scheduling. To address this, this paper proposes an end-to-end…

Systems and Control · Electrical Eng. & Systems 2026-02-04 Tingwei Cao , Yan Xu

We design multi-horizon forecasting models for limit order book (LOB) data by using deep learning techniques. Unlike standard structures where a single prediction is made, we adopt encoder-decoder models with sequence-to-sequence and…

Machine Learning · Computer Science 2021-08-30 Zihao Zhang , Stefan Zohren

Considering the worst-case scenario, junction tree algorithm remains the most general solution for exact MAP inference with polynomial run-time guarantees. Unfortunately, its main tractability assumption requires the treewidth of a…

Discrete Mathematics · Computer Science 2022-02-10 Alexander Bauer , Shinichi Nakajima

Accurate weather forecasts are important for disaster prevention, agricultural planning, etc. Traditional numerical weather prediction (NWP) methods offer physically interpretable high-accuracy predictions but are computationally expensive…

Machine Learning · Computer Science 2025-10-10 Yuan Gao , Hao Wu , Ruiqi Shu , Huanshuo Dong , Fan Xu , Rui Ray Chen , Yibo Yan , Qingsong Wen , Xuming Hu , Kun Wang , Jiahao Wu , Qing Li , Hui Xiong , Xiaomeng Huang

Consider the setting of constrained optimization, with some parameters unknown at solving time and requiring prediction from relevant features. Predict+Optimize is a recent framework for end-to-end training supervised learning models for…

Artificial Intelligence · Computer Science 2023-11-15 Xinyi Hu , Jasper C. H. Lee , Jimmy H. M. Lee

Multistage stochastic programming provides a modeling framework for sequential decision-making problems that involve uncertainty. One typically overlooked aspect of this methodology is how uncertainty is incorporated into modeling.…

Optimization and Control · Mathematics 2021-09-24 Juyoung Wang , Mucahit Cevik , Merve Bodur

Real-world scenarios frequently involve multi-objective data-driven optimization problems, characterized by unknown problem coefficients and multiple conflicting objectives. Traditional two-stage methods independently apply a machine…

Machine Learning · Computer Science 2024-06-04 Peng Li , Lixia Wu , Chaoqun Feng , Haoyuan Hu , Lei Fu , Jieping Ye

We study computational aspects of a key problem in robust statistics -- the penalized least trimmed squares (LTS) regression problem, a robust estimator that mitigates the influence of outliers in data by capping residuals with large…

Optimization and Control · Mathematics 2026-04-15 Xiang Meng , Andrés Gómez , Rahul Mazumder

In many contexts, customized and weighted classification scores are designed in order to evaluate the goodness of the predictions carried out by neural networks. However, there exists a discrepancy between the maximization of such scores…

Machine Learning · Computer Science 2023-05-24 Francesco Marchetti , Sabrina Guastavino , Cristina Campi , Federico Benvenuto , Michele Piana

The non-stationarity characteristic of the solar power renders traditional point forecasting methods to be less useful due to large prediction errors. This results in increased uncertainties in the grid operation, thereby negatively…

Machine Learning · Computer Science 2020-09-15 Sakshi Mishra , Praveen Palanisamy

Prior work in multi-objective reinforcement learning typically uses linear reward scalarization with fixed weights, which provably fails to capture non-convex Pareto fronts and thus yields suboptimal results. This limitation becomes…

Machine Learning · Computer Science 2026-04-01 Yining Lu , Zilong Wang , Shiyang Li , Xin Liu , Changlong Yu , Qingyu Yin , Zhan Shi , Zixuan Zhang , Meng Jiang

Real-world multiobjective optimization problems usually involve conflicting objectives that change over time, which requires the optimization algorithms to quickly track the Pareto optimal front (POF) when the environment changes. In recent…

Neural and Evolutionary Computing · Computer Science 2021-02-25 Dejun Xu , Min Jiang , Weizhen Hu , Shaozi Li , Renhu Pan , Gary G. Yen

Modern deep neural networks achieved remarkable progress in medical image segmentation tasks. However, it has recently been observed that they tend to produce overconfident estimates, even in situations of high uncertainty, leading to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Agostina Larrazabal , Cesar Martinez , Jose Dolz , Enzo Ferrante

Conformal Prediction (CP) is a distribution-free method for constructing prediction sets with marginal finite-sample coverage guarantees, making it a suitable framework for reliable uncertainty quantification in safety-critical object…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Christopher Ries , Moussa Kassem Sbeyti , Nicolas Bianco , Nadja Klein

When training deep learning models, the performance depends largely on the selected hyperparameters. However, hyperparameter optimization (HPO) is often one of the most expensive parts of model design. Classical HPO methods treat this as a…