中文
相关论文

相关论文: Evaluating Strategic Reasoning in Forecasting Agen…

200 篇论文

When people reason about cause and effect, they often consider many competing "what if" scenarios before deciding which explanation fits best. Analogously, advanced language models capable of causal inference can consider multiple…

机器学习 · 计算机科学 2026-03-10 Finn G. Vamosi , Nils D. Forkert

Large language models (LLMs) have sparked growing interest in machine learning research agents that can autonomously propose ideas and conduct experiments. However, existing benchmarks predominantly adopt an engineering-oriented…

计算与语言 · 计算机科学 2026-02-26 Qiran Zou , Hou Hei Lam , Wenhao Zhao , Yiming Tang , Tingting Chen , Samson Yu , Tianyi Zhang , Chang Liu , Xiangyang Ji , Dianbo Liu

As language models (LMs) evolve from chat assistants to long-horizon agents capable of multi-step reasoning and tool use, existing benchmarks remain largely confined to structured or exam-style tasks that fall short of real-world…

Large Language Models (LLMs) have achieved strong performance on static reasoning benchmarks, yet their effectiveness as interactive agents operating in adversarial, time-sensitive environments remains poorly understood. Existing…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Yang Li , Xing Chen , Yutao Liu , Gege Qi , Yanxian BI , Zizhe Wang , Yunjian Zhang , Yao Zhu

Strategic classification(SC) studies the interaction between decision models and agents who strategically manipulate their features for favorable outcomes. Existing SC frameworks typically rely on the idealized assumption that agents are…

Many emerging applications of AI--from scientific discovery to medical diagnosis--require agents to seek information strategically: forming hypotheses, asking targeted questions, and making decisions under uncertainty. In high-stakes…

计算与语言 · 计算机科学 2026-03-09 Gabriel Grand , Valerio Pepe , Jacob Andreas , Joshua B. Tenenbaum

LLM-based multi-agent systems are increasingly deployed on long-horizon tasks, but a single decisive error is often accepted by downstream agents and cascades into trajectory-level failure. Existing work frames this as \emph{post-hoc…

计算与语言 · 计算机科学 2026-05-15 Boxuan Zhang , Jianing Zhu , Zeru Shi , Dongfang Liu , Ruixiang Tang

Long-term time series forecasting (LTSF) is widely recognized as a central challenge in data mining and machine learning. LTSF has increasingly evolved into a benchmark-driven ''GAME,'' where models are ranked, compared, and declared…

机器学习 · 计算机科学 2026-03-10 Thanapol Phungtua-eng , Yoshitaka Yamamoto

Present bias, the tendency to weigh costs and benefits incurred in the present too heavily, is one of the most widespread human behavioral biases. It has also been the subject of extensive study in the behavioral economics literature. While…

计算机科学与博弈论 · 计算机科学 2016-03-29 Jon Kleinberg , Sigal Oren , Manish Raghavan

Artificial intelligence and machine learning are increasingly used for forecasting, optimization, and policy design in the energy sector, yet no standardized framework exists to evaluate whether these systems reason correctly. Current…

人工智能 · 计算机科学 2025-10-24 Eliseo Curcio

Long-term time series forecasting (LTSF) remains challenging due to the trade-off between parallel efficiency and sequential modeling of temporal coherence. Direct multi-step forecasting (DMS) methods enable fast, parallel prediction of all…

机器学习 · 计算机科学 2026-02-03 Sunho Kim , Susik Yoon

Explanations for AI models in high-stakes domains like medicine often lack verifiability, which can hinder trust. To address this, we propose an interactive agent that produces explanations through an auditable sequence of actions. The…

人工智能 · 计算机科学 2025-11-04 Yuhang Huang , Zekai Lin , Fan Zhong , Lei Liu

Reasoning ability is crucial for solving challenging tasks. With the advancement of foundation models, such as the emergence of large language models (LLMs), a wide range of reasoning strategies has been proposed, including test-time…

机器学习 · 计算机科学 2025-03-17 Haoxin Liu , Zhiyuan Zhao , Shiduo Li , B. Aditya Prakash

If AI models can detect when they are being evaluated, the effectiveness of evaluations might be compromised. For example, models could have systematically different behavior during evaluations, leading to less reliable benchmarks for…

计算与语言 · 计算机科学 2025-07-17 Joe Needham , Giles Edkins , Govind Pimpale , Henning Bartsch , Marius Hobbhahn

We consider the problem of evaluating forecasts of binary events whose predictions are consumed by rational agents who take an action in response to a prediction, but whose utility is unknown to the forecaster. We show that optimizing…

机器学习 · 计算机科学 2023-07-04 Robert Kleinberg , Renato Paes Leme , Jon Schneider , Yifeng Teng

Behavioural characterizations (BCs) of decision-making agents, or their policies, are used to study outcomes of training algorithms and as part of the algorithms themselves to encourage unique policies, match expert policy or restrict…

人工智能 · 计算机科学 2021-10-29 Anssi Kanervisto , Tomi Kinnunen , Ville Hautamäki

We present an outcome-driven fine-tuning framework that enhances the forecasting capabilities of large language models (LLMs) without relying on human-curated reasoning samples. Our method leverages model self-play to generate pairs of…

计算与语言 · 计算机科学 2025-02-11 Benjamin Turtel , Danny Franklin , Philipp Schoenegger

Can artificial intelligence outperform humans at strategic foresight -- the capacity to form accurate judgments about uncertain, high-stakes outcomes before they unfold? We address this question through a fully prospective prediction…

综合经济学 · 经济学 2026-02-03 Felipe A. Csaszar , Aticus Peterson , Daniel Wilde

Statistical protocols are often used for decision-making involving multiple parties, each with their own incentives, private information, and ability to influence the distributional properties of the data. We study a game-theoretic version…

统计方法学 · 统计学 2024-12-24 Flora C. Shi , Stephen Bates , Martin J. Wainwright

We formalize two independent computational limitations that constrain algorithmic intelligence: formal incompleteness and dynamical unpredictability. The former limits the deductive power of consistent reasoning systems while the latter…

人工智能 · 计算机科学 2025-12-23 Abhisek Ganguly