English
Related papers

Related papers: PROPHET: An Inferable Future Forecasting Benchmark…

200 papers

Inferential models (IMs) are data-dependent, imprecise-probabilistic structures designed to quantify uncertainty about unknowns. As the name suggests, the focus has been on uncertainty quantification for inference and on its reliability…

Statistics Theory · Mathematics 2026-05-01 Ryan Martin , Shih-Ni Prim , Jonathan Williams

Causality is essential for understanding complex systems, such as the economy, the brain, and the climate. Constructing causal graphs often relies on either data-driven or expert-driven approaches, both fraught with challenges. The former…

Artificial Intelligence · Computer Science 2024-06-12 Kai-Hendrik Cohrs , Gherardo Varando , Emiliano Diaz , Vasileios Sitokonstantinou , Gustau Camps-Valls

Most of the literature on online algorithms in revenue management focuses on settings with irrevocable decisions, where once a decision is made upon the arrival of a new input, it cannot be canceled later. Motivated by modern applications…

Data Structures and Algorithms · Computer Science 2025-04-22 Farbod Ekbatani , Rad Niazadeh , Pranav Nuti , Jan Vondrak

Recent advancements in Large Language Models (LLMs) have empowered LLM agents to autonomously collect world information, over which to conduct reasoning to solve complex problems. Given this capability, increasing interests have been put…

Computation and Language · Computer Science 2024-07-02 Chenchen Ye , Ziniu Hu , Yihe Deng , Zijie Huang , Mingyu Derek Ma , Yanqiao Zhu , Wei Wang

Recent advances in probabilistic modelling have led to a large number of simulation-based inference algorithms which do not require numerical evaluation of likelihoods. However, a public benchmark with appropriate performance metrics for…

Machine Learning · Statistics 2021-04-12 Jan-Matthis Lueckmann , Jan Boelts , David S. Greenberg , Pedro J. Gonçalves , Jakob H. Macke

Causal inference in social science relies on end-to-end, intervention-centered research-design reasoning grounded in real-world policy interventions, but current benchmarks fail to evaluate this capability of large language models (LLMs).…

Motivated by the need to analyze continuously updated data sets in the context of time-to-event modeling, we propose a novel nonparametric approach to estimate the conditional hazard function given a set of continuous and discrete…

Methodology · Statistics 2025-07-03 Daphné Aurouet , Valentin Patilea

Causal inference analysis is the estimation of the effects of actions on outcomes. In the context of healthcare data this means estimating the outcome of counter-factual treatments (i.e. including treatments that were not observed) on a…

Methodology · Statistics 2018-03-21 Yishai Shimoni , Chen Yanover , Ehud Karavani , Yaara Goldschmnidt

Pursuing invariant prediction from heterogeneous environments opens the door to learning causality in a purely data-driven way and has several applications in causal discovery and robust transfer learning. However, existing methods such as…

Statistics Theory · Mathematics 2025-01-30 Yihong Gu , Cong Fang , Yang Xu , Zijian Guo , Jianqing Fan

Recent advances in time-series forecasting increasingly rely on pre-trained foundation-style models. While these models often claim broad generalization, existing evaluation protocols provide limited evidence. Indeed, most current…

One of the most common solutions adopted by software researchers to address code generation is by training Large Language Models (LLMs) on massive amounts of source code. Although a number of studies have shown that LLMs have been…

Software Engineering · Computer Science 2023-08-25 Daniel Rodriguez-Cardenas , David N. Palacio , Dipin Khati , Henry Burke , Denys Poshyvanyk

Script event prediction aims to predict the subsequent event given the context. This requires the capability to infer the correlations between events. Recent works have attempted to improve event correlation reasoning by using pretrained…

Computation and Language · Computer Science 2022-12-12 Fangqi Zhu , Jun Gao , Changlong Yu , Wei Wang , Chen Xu , Xin Mu , Min Yang , Ruifeng Xu

Forecasting is a challenging task that offers a clearly measurable way to study AI systems. Forecasting requires a large amount of research on the internet, and evaluations require time for events to happen, making the development of…

Computation and Language · Computer Science 2025-06-30 FutureSearch , : , Jack Wildman , Nikos I. Bosse , Daniel Hnyk , Peter Mühlbacher , Finn Hambly , Jon Evans , Dan Schwarz , Lawrence Phillips

Judgmental forecasting employs human opinions to make predictions about future events, rather than exclusively historical data as in quantitative forecasting. When these opinions form an argumentative structure around forecasts, it is…

Artificial Intelligence · Computer Science 2025-08-26 Deniz Gorur , Antonio Rago , Francesca Toni

Stocks can't be predicted. Despite many hopes, this premise held itself true for many years due to the nature of quantitative stock data lacking causal logic along with rapid market changes hindering accumulation of significant data for…

Machine Learning · Computer Science 2025-12-16 Olivia Kim

Recent text-based causal methods attempt to mitigate confounding bias by estimating proxies of confounding variables that are partially or imperfectly measured from unstructured text data. These approaches, however, assume analysts have…

Computation and Language · Computer Science 2024-10-30 Jacob M. Chen , Rohit Bhattacharya , Katherine A. Keith

Deep learning (DL) has recently drawn much attention in image analysis, natural language process, and high-dimensional medical data analysis. Under the causal direct acyclic graph (DAG) interpretation, the input variables without incoming…

Applications · Statistics 2022-03-22 Jong-Hyeon Jeong , Yichen Jia

We explored the challenge of predicting and explaining the occurrence of events within sequences of data points. Our focus was particularly on scenarios in which unknown triggers causing the occurrence of events may consist of…

Machine Learning · Computer Science 2024-06-11 Harrison Lam , Yuanjie Chen , Noboru Kanazawa , Mohammad Chowdhury , Anna Battista , Stephan Waldert

An inferential model (IM) is a model describing the construction of provably reliable, data-driven uncertainty quantification and inference about relevant unknowns. IMs and Fisher's fiducial argument have similar objectives, but a…

Statistics Theory · Mathematics 2026-05-06 Ryan Martin

Real-world data streams can change unpredictably due to distribution shifts, feedback loops and adversarial actors, which challenges the validity of forecasts. We present a forecasting framework ensuring valid uncertainty estimates…

Machine Learning · Computer Science 2025-03-04 Charles Marx , Volodymyr Kuleshov , Stefano Ermon