English
Related papers

Related papers: Look-Ahead Benchmark Bias in Portfolio Performance…

200 papers

What can be considered an appropriate statistical method for the primary analysis of a randomized clinical trial (RCT) with a time-to-event endpoint when we anticipate non-proportional hazards owing to a delayed effect? This question has…

Methodology · Statistics 2023-04-18 José L. Jiménez , Isobel Barrott , Francesca Gasperoni , Dominic Magirr

This paper introduces \emph{biased mean regression}, estimating the \emph{biased mean}, i.e., $\mathbb{E}[Y] + x$, where $x \in \mathbb{R}$. The approach addresses a fundamental statistical problem that covers numerous applications. For…

Applications · Statistics 2026-03-31 Anton Malandii , Stan Uryasev

Applying LLMs to predictive tasks in finance is challenging due to look-ahead bias resulting from their training on long time-series data. This precludes the backtests typically employed in finance since retraining frontier models from…

Machine Learning · Computer Science 2025-12-09 Humzah Merchant , Bradford Levy

Stochastic dominance serves as a general framework for modeling a broad spectrum of decision preferences under uncertainty, with risk aversion as one notable example, as it naturally captures the intrinsic structure of the underlying…

Machine Learning · Computer Science 2026-01-06 Shicong Cen , Jincheng Mei , Hanjun Dai , Dale Schuurmans , Yuejie Chi , Bo Dai

Large language model (LLM) evaluation is increasingly costly, prompting interest in methods that speed up evaluation by shrinking benchmark datasets. Benchmark prediction (also called efficient LLM evaluation) aims to select a small subset…

Machine Learning · Computer Science 2025-06-10 Guanhua Zhang , Florian E. Dorner , Moritz Hardt

The source code of Function as a Service (FaaS) applications is constantly being refined. To detect if a source code change introduces a significant performance regression, the traditional benchmarking approach evaluates both the old and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-08 Martin Grambow , Tim Dockenfuß , Trever Schirmer , Nils Japke , David Bermbach

Performance regression testing is essential in large-scale continuous-integration (CI) systems, yet executing full performance suites for every commit is prohibitively expensive. Prior work on performance regression prediction and batch…

Software Engineering · Computer Science 2026-04-02 Ali Sayedsalehi , Peter C. Rigby , Gregory Mierzwinski

The world of empirical machine learning (ML) strongly relies on benchmarks in order to determine the relative effectiveness of different algorithms and methods. This paper proposes the notion of "a benchmark lottery" that describes the…

Machine Learning · Computer Science 2021-07-19 Mostafa Dehghani , Yi Tay , Alexey A. Gritsenko , Zhe Zhao , Neil Houlsby , Fernando Diaz , Donald Metzler , Oriol Vinyals

We study mean-risk optimal portfolio problems where risk is measured by Recovery Average Value at Risk, a prominent example in the class of recovery risk measures. We establish existence results in the situation where the joint distribution…

Portfolio Management · Quantitative Finance 2023-03-03 Cosimo Munari , Justin Plückebaum , Stefan Weber

Portfolio management problems are often divided into two types: active and passive, where the objective is to outperform and track a preselected benchmark, respectively. Here, we formulate and solve a dynamic asset allocation problem that…

Portfolio Management · Quantitative Finance 2018-07-31 Ali Al-Aradi , Sebastian Jaimungal

It has been widely observed that capitalization-weighted indexes can be beaten by surprisingly simple, systematic investment strategies. Indeed, in the U.S. stock market, equal-weighted portfolios, random-weighted portfolios, and other…

Portfolio Management · Quantitative Finance 2018-09-12 Adrian Banner , Robert Fernholz , Vassilios Papathanakos , Johannes Ruf , David Schofield

Calibrated probability outputs of trained classifiers are increasingly used as inputs to downstream regression estimands such as effects, prevalences, or disparities for a latent group observed only on a small labelled subset. A standard…

Methodology · Statistics 2026-05-14 Marcell T. Kurbucz

Forming quantitative portfolios using statistical risk models presents a significant challenge for hedge funds and portfolio managers. This research investigates three distinct statistical risk models to construct quantitative portfolios of…

Portfolio Management · Quantitative Finance 2024-09-24 Maysam Khodayari Gharanchaei , Reza Babazadeh

The rapid growth of e-commerce has made people accustomed to shopping online. Before making purchases on e-commerce websites, most consumers tend to rely on rating scores and review information to make purchase decisions. With this…

Information Retrieval · Computer Science 2020-07-07 Yingqiang Ge , Shuyuan Xu , Shuchang Liu , Zuohui Fu , Fei Sun , Yongfeng Zhang

Public AI benchmark results are widely broadcast by model developers as indicators of model quality within a growing and competitive market. However, these advertised scores do not necessarily reflect the traits of interest to those who…

We study Cressie Read power divergence (CRPD) estimation for moment based models, focusing on finite sample behavior. While generalized empirical likelihood estimators, dual to CRPD, are known to outperform generalized method of moments…

Econometrics · Economics 2026-03-25 Jieun Lee , Anil K. Bera

Standard benchmarks fixate on how well large language model (LLM) agents perform in finance, yet say little about whether they are safe to deploy. We argue that accuracy metrics and return-based scores provide an illusion of reliability,…

General Finance · Quantitative Finance 2025-06-03 Zichen Chen , Jiaao Chen , Jianda Chen , Misha Sra

Decisions taken in our everyday lives are based on a wide variety of information so it is generally very difficult to assess what are the strategies that guide us. Stock market therefore provides a rich environment to study how people take…

General Finance · Quantitative Finance 2016-09-28 Mario Gutiérrez-Roig , Carlota Segura , Jordi Duch , Josep Perelló

This study examines the generalization ability of algorithm performance prediction models across various benchmark suites. Comparing the statistical similarity between the problem collections with the accuracy of performance prediction…

Machine Learning · Computer Science 2024-05-22 Ana Nikolikj , Ana Kostovska , Gjorgjina Cenikj , Carola Doerr , Tome Eftimov

Beta-sorted portfolios -- portfolios comprised of assets with similar covariation to selected risk factors -- are a popular tool in empirical finance to analyze models of (conditional) expected returns. Despite their widespread use, little…

Econometrics · Economics 2024-11-12 Matias D. Cattaneo , Richard K. Crump , Weining Wang