English
Related papers

Related papers: Using Proxies to Improve Forecast Evaluation

200 papers

Since the Great Financial Crisis (GFC), the use of stress tests as a tool for assessing the resilience of financial institutions to adverse financial and economic developments has increased significantly. One key part in such exercises is…

Econometrics · Economics 2022-02-08 Martin Guth

While much research focused on producing explanations, it is still unclear how the produced explanations' quality can be evaluated in a meaningful way. Today's predominant approach is to quantify explanations using proxy scores which…

Computation and Language · Computer Science 2023-03-10 Hendrik Schuff , Heike Adel , Peng Qi , Ngoc Thang Vu

Discovering causal relations is fundamental to reasoning and intelligence. In particular, observational causal discovery algorithms estimate the cause-effect relation between two random entities $X$ and $Y$, given $n$ samples from $P(X,Y)$.…

Machine Learning · Statistics 2017-02-24 Mateo Rojas-Carulla , Marco Baroni , David Lopez-Paz

In recent years, probabilistic forecasts techniques were proposed in research as well as in applications to integrate volatile renewable energy resources into the electrical grid. These techniques allow decision makers to take the…

Machine Learning · Statistics 2024-10-30 Jens Schreiber , Bernhard Sick

New methods for time-to-event prediction are proposed by extending the Cox proportional hazards model with neural networks. Building on methodology from nested case-control studies, we propose a loss function that scales well to large data…

Machine Learning · Statistics 2019-09-16 Håvard Kvamme , Ørnulf Borgan , Ida Scheel

We propose a method for learning linear models whose predictive performance is robust to causal interventions on unobserved variables, when noisy proxies of those variables are available. Our approach takes the form of a regularization term…

Machine Learning · Computer Science 2021-06-29 Michael Oberst , Nikolaj Thams , Jonas Peters , David Sontag

In many scientific domains, including experimentation, researchers rely on measurements of proxy outcomes to achieve faster and more frequent reads, especially when the primary outcome of interest is challenging to measure directly. While…

Methodology · Statistics 2026-05-08 Steven Wilkins-Reeves , Alexandra N. M. Darmon , Deeksha Sinha

Forecasting risk (as measured by quantiles) and systemic risk (as measured by Adrian and Brunnermeiers's (2016) CoVaR) is important in economics and finance. However, past research has shown that predictive relationships may be unstable…

Methodology · Statistics 2026-03-11 Yannick Hoga

The efficient market hypothesis considers all available information already reflected in asset prices and limits the possibility of consistently achieving above-average returns by trading on publicly available data. We analyzed low…

Applications · Statistics 2026-03-13 Jose M. G. Vilar

We investigate the predictability of extreme events in time series. The focus of this work is to understand under which circumstances large events are better predictable than smaller events. Therefore we use a simple prediction algorithm…

Data Analysis, Statistics and Probability · Physics 2008-01-30 S. Hallerberg , H. Kantz

People vary in their ability to make accurate predictions about the future. Prior studies have shown that some individuals can predict the outcome of future events with consistently better accuracy. This leads to a natural question: what…

Computation and Language · Computer Science 2020-06-17 Shi Zong , Alan Ritter , Eduard Hovy

We present an extension of local sensitivity analysis, also referred to as the perturbation approach for uncertainty quantification, to Bayesian inverse problems. More precisely, we show how moments of random variables with respect to the…

Numerical Analysis · Mathematics 2026-04-06 Jürgen Dölz , David Ebert

Leveraging concepts from state machine refinement proofs, we use prophecy variables, which predict information about the future program execution, to enable forward reasoning for backward dataflow analyses. Drawing prophecy and history…

Programming Languages · Computer Science 2020-07-24 Martin Rinard , Austin Gadient

The leverage effect refers to the well-established relationship between returns and volatility. When returns fall, volatility increases. We examine the role of the leverage effect with regards to generating density forecasts of equity…

Applications · Statistics 2016-11-04 Leopoldo Catania , Nima Nonejad

Prognostics is a process of assessing the extent of deviation or degradation of a product from its expected normal operating condition, and then, based on continuous monitoring, predicting the future reliability of the product. By being…

Materials Science · Physics 2007-09-13 N. Vchare , M. Pecht

Starting from two case histories, where only after thorough Failure Analysis the suddenly appearance of a failure was linked to much earlier events, the possibility of improving the reliability and of adjusting the reliability prediction…

Other Condensed Matter · Physics 2007-09-17 G. Mura , G. Cassanelli

Models for forecasting earthquakes are currently tested prospectively in well-organized testing centers, using data collected after the models and their parameters are completely specified. The extent to which these models agree with the…

Methodology · Statistics 2013-12-23 Andrew Bray , Frederic Paik Schoenberg

Recent studies have analyzed whether one forecast method dominates another under a class of consistent scoring functions. While the existing literature focuses on empirical tests of forecast dominance, little is known about the theoretical…

Methodology · Statistics 2019-12-19 Fabian Krüger , Johanna F. Ziegel

Bayesian aggregation lets election forecasters combine diverse sources of information, such as state polls and economic and political indicators: as in our collaboration with The Economist magazine. However, the demands of real-time…

Methodology · Statistics 2025-10-23 Geonhee Han , Andrew Gelman , Aki Vehtari

Environmental research increasingly uses high-dimensional remote sensing and numerical model output to help fill space-time gaps between traditional observations. Such output is often a noisy proxy for the process of interest. Thus one…

Methodology · Statistics 2012-04-30 Christopher J. Paciorek