English
Related papers

Related papers: Same Error, Different Function: The Optimizer as a…

200 papers

The diverse world of machine learning applications has given rise to a plethora of algorithms and optimization methods, finely tuned to the specific regression or classification task at hand. We reduce the complexity of algorithm design for…

Optimization and Control · Mathematics 2016-05-23 Zeyuan Allen-Zhu , Elad Hazan

Real-world scenarios frequently involve multi-objective data-driven optimization problems, characterized by unknown problem coefficients and multiple conflicting objectives. Traditional two-stage methods independently apply a machine…

Machine Learning · Computer Science 2024-06-04 Peng Li , Lixia Wu , Chaoqun Feng , Haoyuan Hu , Lei Fu , Jieping Ye

Traditional neural networks are simple to train but they typically produce overconfident predictions. In contrast, Bayesian neural networks provide good uncertainty quantification but optimizing them is time consuming due to the large…

Machine Learning · Computer Science 2024-11-07 Yadi Wei , Roni Khardon

Several applications in time series forecasting require predicting multiple steps ahead. Despite the vast amount of literature in the topic, both classical and recent deep learning based approaches have mostly focused on minimising…

Machine Learning · Computer Science 2024-07-15 Ignacio Hounie , Javier Porras-Valenzuela , Alejandro Ribeiro

A distribution shift between the training and test data can severely harm performance of machine learning models. Importance weighting addresses this issue by assigning different weights to data points during training. We argue that…

Machine Learning · Statistics 2025-11-17 Floris Holstege , Bram Wouters , Noud van Giersbergen , Cees Diks

This article investigates the use of Machine Learning and Deep Learning models in multivariate time series analysis within financial markets. It compares small and big data approaches, focusing on their distinct challenges and the benefits…

Machine Learning · Computer Science 2025-05-09 Grégory Bournassenko

Time series modeling techniques based on deep learning have seen many advancements in recent years, especially in data-abundant settings and with the central aim of learning global models that can extract patterns across multiple time…

Machine Learning · Computer Science 2020-05-21 Stephan Rabanser , Tim Januschowski , Valentin Flunkert , David Salinas , Jan Gasthaus

The application of transformer-based models on time series forecasting (TSF) tasks has long been popular to study. However, many of these works fail to beat the simple linear residual model, and the theoretical understanding of this issue…

Machine Learning · Computer Science 2025-03-04 Yekun Ke , Yingyu Liang , Zhenmei Shi , Zhao Song , Chiwun Yang

Forecasting with multivariate time series, which aims to predict future values given previous and current several univariate time series data, has been studied for decades, with one example being ARIMA. Because it is difficult to measure…

Artificial Intelligence · Computer Science 2020-10-19 Youngjin Park , Deokjun Eom , Byoungki Seo , Jaesik Choi

For any financial organization, computing accurate quarterly forecasts for various products is one of the most critical operations. As the granularity at which forecasts are needed increases, traditional statistical time series models may…

Machine Learning · Computer Science 2020-01-28 Allison Koenecke , Amita Gajewar

A multitude of classifiers can be trained on the same data to achieve similar performances during test time, while having learned significantly different classification patterns. This phenomenon, which we call prediction discrepancies, is…

Machine Learning · Computer Science 2024-08-01 Xavier Renard , Thibault Laugel , Marcin Detyniecki

Neural networks often learn to make predictions that overly rely on spurious correlation existing in the dataset, which causes the model to be biased. While previous work tackles this issue by using explicit labeling on the spuriously…

Machine Learning · Computer Science 2020-11-24 Junhyun Nam , Hyuntak Cha , Sungsoo Ahn , Jaeho Lee , Jinwoo Shin

Modern neural networks can achieve high accuracy while remaining poorly calibrated, producing confidence estimates that do not match empirical correctness. Yet calibration is often treated as a post-hoc attribute. We take a different…

Machine Learning · Computer Science 2026-04-23 Alessandro Morosini , Matea Gjika , Tomaso Poggio , Pierfrancesco Beneventano

We consider the problem of model multiplicity in downstream decision-making, a setting where two predictive models of equivalent accuracy cannot agree on the best-response action for a downstream loss function. We show that even when the…

Machine Learning · Computer Science 2024-05-31 Ally Yalei Du , Dung Daniel Ngo , Zhiwei Steven Wu

This paper carries out sparse-penalized deep neural networks predictors for learning weakly dependent processes, with a broad class of loss functions. We deal with a general framework that includes, regression estimation, classification,…

Machine Learning · Statistics 2023-05-11 William Kengne , Modou Wade

Training deep neural networks for classification often includes minimizing the training loss beyond the zero training error point. In this phase of training, a "neural collapse" behavior has been observed: the variability of features…

Machine Learning · Computer Science 2023-05-30 Tom Tirer , Haoxiang Huang , Jonathan Niles-Weed

We present a systematic trading framework that forecasts short-horizon market risk, identifies its underlying drivers, and generates alpha using a hybrid machine learning ensemble built to trade on the resulting signal. The framework…

Computational Finance · Quantitative Finance 2025-10-28 Aryan Ranjan

Precise financial series predicting has long been a difficult problem because of unstableness and many noises within the series. Although Traditional time series models like ARIMA and GARCH have been researched and proved to be effective in…

Machine Learning · Computer Science 2018-12-11 Xin-Yao Qian

In this work we propose deep learning-based algorithms for the computation of systemic shortfall risk measures defined via multivariate utility functions. We discuss the key related theoretical aspects, with a particular focus on the…

Machine Learning · Computer Science 2023-06-16 Alessandro Doldi , Yichen Feng , Jean-Pierre Fouque , Marco Frittelli

Great research efforts have been devoted to exploiting deep neural networks in stock prediction. While long-range dependencies and chaotic property are still two major issues that lower the performance of state-of-the-art deep learning…

Statistical Finance · Quantitative Finance 2021-11-02 Junran Wu , Ke Xu , Xueyuan Chen , Shangzhe Li , Jichang Zhao