English
Related papers

Related papers: Using LLMs to Directly Guess Conditional Expectati…

200 papers

The adoption of generative AI technologies is swiftly expanding. Services employing both linguistic and mul-timodal models are evolving, offering users increasingly precise responses. Consequently, human reliance on these technologies is…

Computers and Society · Computer Science 2023-11-17 Jaeyoun You , Bongwon Suh

Recent claims of strong performance by Large Language Models (LLMs) on causal discovery are undermined by a key flaw: many evaluations rely on benchmarks likely included in pretraining corpora. Thus, apparent success suggests that LLM-only…

Large language models (LLMs) offer the potential to automate a large number of tasks that previously have not been possible to automate, including some in science. There is considerable interest in whether LLMs can automate the process of…

Econometrics · Economics 2024-12-17 Nick Huntington-Klein , Eleanor J. Murray

Causal graph recovery is traditionally done using statistical estimation-based methods or based on individual's knowledge about variables of interests. They often suffer from data collection biases and limitations of individuals' knowledge.…

Computation and Language · Computer Science 2024-06-19 Yuzhe Zhang , Yipeng Zhang , Yidong Gan , Lina Yao , Chen Wang

Understanding how events in a scenario causally connect with each other is important for effectively modeling and reasoning about events. But event reasoning remains a difficult challenge, and despite recent advances, Large Language Models…

Artificial Intelligence · Computer Science 2025-06-10 Mahnaz Koupaee , Xueying Bai , Mudan Chen , Greg Durrett , Nathanael Chambers , Niranjan Balasubramanian

Forecasting future events is important for policy and decision making. In this work, we study whether language models (LMs) can forecast at the level of competitive human forecasters. Towards this goal, we develop a retrieval-augmented LM…

Machine Learning · Computer Science 2024-02-29 Danny Halawi , Fred Zhang , Chen Yueh-Han , Jacob Steinhardt

Recent breakthroughs in artificial intelligence have driven a paradigm shift, where large language models (LLMs) with billions or trillions of parameters are trained on vast datasets, achieving unprecedented success across a series of…

Computation and Language · Computer Science 2024-10-22 Anpeng Wu , Kun Kuang , Minqin Zhu , Yingrong Wang , Yujia Zheng , Kairong Han , Baohong Li , Guangyi Chen , Fei Wu , Kun Zhang

Large language model (LLM) development is currently driven by large-scale empirical iteration over data mixtures, reward models, routing strategies, and evaluation pipelines. Here, we argue that many central questions in LLM development and…

Recovering the structure of causal graphical models from observational data is an essential yet challenging task for causal discovery in scientific scenarios. Domain-specific causal discovery usually relies on expert validation or prior…

Artificial Intelligence · Computer Science 2025-08-27 Taiyu Ban , Lyuzhou Chen , Derui Lyu , Xiangyu Wang , Qinrui Zhu , Qiang Tu , Huanhuan Chen

Large language models (LLMs) have shown various ability on natural language processing, including problems about causality. It is not intuitive for LLMs to command causality, since pretrained models usually work on statistical associations,…

Computation and Language · Computer Science 2024-08-27 Chenyang Zhang , Haibo Tong , Bin Zhang , Dongyu Zhang

Many recent papers have studied the development of superforecaster-level event forecasting LLMs. While methodological problems with early studies cast doubt on the use of LLMs for event forecasting, recent studies with improved evaluation…

Machine Learning · Computer Science 2025-07-28 Sang-Woo Lee , Sohee Yang , Donghyun Kwak , Noah Y. Siegel

State of the art large language models (LLMs) have shown impressive performance on a variety of benchmark tasks and are increasingly used as components in larger applications, where LLM-based predictions serve as proxies for human…

Computation and Language · Computer Science 2024-06-14 Michael Franke , Polina Tsvilodub , Fausto Carcassi

Human choice prediction in economic contexts is crucial for applications in marketing, finance, public policy, and more. This task, however, is often constrained by the difficulties in acquiring human choice data. With most experimental…

Machine Learning · Computer Science 2025-11-21 Eilam Shapira , Omer Madmon , Roi Reichart , Moshe Tennenholtz

Causal structure discovery from observations can be improved by integrating background knowledge provided by an expert to reduce the hypothesis space. Recently, Large Language Models (LLMs) have begun to be considered as sources of prior…

Machine Learning · Computer Science 2024-05-24 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

Large Language Models (LLMs) have shown their success in language understanding and reasoning on general topics. However, their capability to perform inference based on user-specified structured data and knowledge in corpus-rare concepts,…

Computation and Language · Computer Science 2024-10-29 Haitao Jiang , Lin Ge , Yuhe Gao , Jianian Wang , Rui Song

Unlike parametric regression, machine learning (ML) methods do not generally require precise knowledge of the true data generating mechanisms. As such, numerous authors have advocated for ML methods to estimate causal effects.…

Methodology · Statistics 2020-05-15 Ashley I Naimi , Alan E Mishler , Edward H Kennedy

Large language models (LLMs) are increasingly used in statistical research and applications. However,they are also notorious for unreliable or biased information. Here, we explore whether LLMs can be used to improve the precision of…

Applications · Statistics 2026-05-29 Jaylin Lowe , Adam Sales , Johann A. Gagnon-Bartsch

This paper explores the seamless integration of Generative AI (GenAI) and Evolutionary Algorithms (EAs) within the domain of large-scale multi-objective optimization. Focusing on the transformative role of Large Language Models (LLMs), our…

Neural and Evolutionary Computing · Computer Science 2024-05-14 Gaurav Singh , Kavitesh Kumar Bali

Large Language Models (LLMs) have demonstrated impressive capabilities in reasoning and prediction across different domains. Yet, their ability to infer temporal regularities from structured behavioral data remains underexplored. This paper…

Predicting the effect of interventions with many possible variations, e.g., therapeutic content that affects mental health outcomes or an earnings call transcript that drives movement in share price, is useful across several domains.…

Machine Learning · Computer Science 2026-05-27 Nikita Dhawan , Arnav Paruthi , Andrew Kim , Lovedeep Gondara , Jekaterina Novikova , Chris J. Maddison