English
Related papers

Related papers: PROPHET: An Inferable Future Forecasting Benchmark…

200 papers

Reconstructing past events requires reasoning across long time horizons. To figure out what happened, we need to use our prior knowledge about the world and human behavior and draw inferences from various sources of evidence including…

We introduce PRELUDE, a benchmark for evaluating long-context understanding through the task of determining whether a character's prequel story is consistent with the canonical narrative of the original book. Our task poses a stronger…

Computation and Language · Computer Science 2025-08-15 Mo Yu , Tsz Ting Chung , Chulun Zhou , Tong Li , Rui Lu , Jiangnan Li , Liyan Xu , Haoshu Lu , Ning Zhang , Jing Li , Jie Zhou

Uncertainty quantification is a key pillar of trustworthy machine learning. It enables safe reactions under unsafe inputs, like predicting only when the machine learning model detects sufficient evidence, discarding anomalous data, or…

Machine Learning · Computer Science 2024-08-27 Michael Kirchhof

Trajectory prediction for multi-agents in complex scenarios is crucial for applications like autonomous driving. However, existing methods often overlook environmental biases, which leads to poor generalization. Additionally, hardware…

Machine Learning · Computer Science 2024-11-20 Xiaohe Li , Feilong Huang , Zide Fan , Fangli Mou , Leilei Lin , Yingyan Hou , Lijie Wen

Large Language Models are rapidly gaining traction in software engineering, yet their growing carbon footprint raises pressing sustainability concerns. While training emissions are substantial, inference quickly surpasses them due to the…

Software Engineering · Computer Science 2026-03-04 Priyavanshi Pathania , Rohit Mehra , Vibhu Saujanya Sharma , Vikrant Kaulgud , Tiffani Nevels , Sanjay Podder , Adam P. Burden

For a given causal question, it is important to efficiently decide which causal inference method to use for a given dataset. This is challenging because causal methods typically rely on complex and difficult-to-verify assumptions, and…

Machine Learning · Computer Science 2023-11-09 Shantanu Gupta , Cheng Zhang , Agrin Hilmkil

Forecasting future events is important for policy and decision making. In this work, we study whether language models (LMs) can forecast at the level of competitive human forecasters. Towards this goal, we develop a retrieval-augmented LM…

Machine Learning · Computer Science 2024-02-29 Danny Halawi , Fred Zhang , Chen Yueh-Han , Jacob Steinhardt

Understanding directed temporal interactions in multivariate time series is essential for interpreting complex dynamical systems and the predictive models trained on them. We present Causal-INSIGHT, a model-agnostic, post-hoc interpretation…

Machine Learning · Computer Science 2026-03-27 Benjamin Redden , Hui Wang , Shuyan Li

LLM-as-a-judge has become a promising paradigm for using large language models (LLMs) to evaluate natural language generation (NLG), but the uncertainty of its evaluation remains underexplored. This lack of reliability may limit its…

Computation and Language · Computer Science 2025-09-24 Huanxin Sheng , Xinyi Liu , Hangfeng He , Jieyu Zhao , Jian Kang

We present a general framework for stochastic online maximization problems with combinatorial feasibility constraints. The framework establishes prophet inequalities by constructing price-based online approximation algorithms, a natural…

Computer Science and Game Theory · Computer Science 2017-07-11 Paul Dütting , Michal Feldman , Thomas Kesselheim , Brendan Lucier

Conformal prediction is a popular method to construct prediction intervals with marginal coverage guarantees from black-box machine learning models. In applications with potentially high-impact events, such as flooding or financial crises,…

Methodology · Statistics 2026-04-02 Olivier C. Pasche , Henry Lam , Sebastian Engelke

This paper develops several interesting, significant, and interconnected approaches to nonparametric or semi-parametric statistical inferences. The overwhelmingly favoured maximum likelihood estimator (MLE) under parametric model is…

Statistics Theory · Mathematics 2023-03-30 Haodi Liang , Jiahua Chen

Language models (LMs) are statistical models trained to assign probability to human-generated text. As such, it is reasonable to question whether they approximate linguistic variability exhibited by humans well. This form of statistical…

Computation and Language · Computer Science 2024-03-19 Evgenia Ilia , Wilker Aziz

Class-incremental learning (CIL) is a particularly challenging variant of continual learning, where the goal is to learn to discriminate between all classes presented in an incremental fashion. Existing approaches often suffer from…

Machine Learning · Computer Science 2024-03-12 Michał Zając , Tinne Tuytelaars , Gido M. van de Ven

MolProphecy is a human-in-the-loop (HITL) multi-modal framework designed to integrate chemists' domain knowledge into molecular property prediction models. While molecular pre-trained models have enabled significant gains in predictive…

Machine Learning · Computer Science 2025-07-08 Jianping Zhao , Qiong Zhou , Tian Wang , Yusi Fan , Qian Yang , Li Jiao , Chang Liu , Zhehao Guo , Qi Lu , Fengfeng Zhou , Ruochi Zhang

Nonlinear machine-learning models are increasingly used to discover causal relationships in time-series data, yet the interpretation of their outputs remains poorly understood. In particular, causal scores produced by regularized neural…

Machine Learning · Computer Science 2026-05-27 Valentina Kuskova , Dmitry Zaytsev , Michael Coppedge

The advent of Generative Artificial Intelligence (GAI) has heralded an inflection point that changed how society thinks about knowledge acquisition. While GAI cannot be fully trusted for decision-making, it may still provide valuable…

Methodology · Statistics 2025-05-20 Sean O'Hagan , Veronika Ročková

A growing literature on human-AI decision-making investigates strategies for combining human judgment with statistical models to improve decision-making. Research in this area often evaluates proposed improvements to models, interfaces, or…

Computers and Society · Computer Science 2023-05-29 Luke Guerdan , Amanda Coston , Zhiwei Steven Wu , Kenneth Holstein

Causal mediation analysis with random interventions has become an area of significant interest for understanding time-varying effects with longitudinal and survival outcomes. To tackle causal and statistical challenges due to the complex…

Methodology · Statistics 2023-04-12 Zeyi Wang , Lars van der Laan , Maya Petersen , Thomas Gerds , Kajsa Kvist , Mark van der Laan

No man is an island, as individuals interact and influence one another daily in our society. When social influence takes place in experiments on a population of interconnected individuals, the treatment on a unit may affect the outcomes of…

Methodology · Statistics 2017-08-30 Edward K. Kao