English
Related papers

Related papers: How Far Can LLMs Improve from Experience? Measurin…

200 papers

We aim to better understand the emergence of `situational awareness' in large language models (LLMs). A model is situationally aware if it's aware that it's a model and can recognize whether it's currently in testing or deployment. Today's…

Computation and Language · Computer Science 2023-09-06 Lukas Berglund , Asa Cooper Stickland , Mikita Balesni , Max Kaufmann , Meg Tong , Tomasz Korbak , Daniel Kokotajlo , Owain Evans

Despite their outstanding performance, large language models (LLMs) suffer notorious flaws related to their preference for simple, surface-level textual relations over full semantic complexity of the problem. This proposal investigates a…

Computation and Language · Computer Science 2022-06-20 Michal Štefánik

Large language models (LLMs) are increasingly used as simulated participants in social science experiments, but their behavior is often unstable and highly sensitive to design choices. Prior evaluations frequently conflate base-model…

Artificial Intelligence · Computer Science 2026-02-03 Xuan Liu , Haoyang Shang , Zizhang Liu , Xinyan Liu , Yunze Xiao , Yiwen Tu , Haojian Jin

Large Vision Language Models (LVLMs) have demonstrated remarkable abilities in understanding and reasoning about both visual and textual information. However, existing evaluation methods for LVLMs, primarily based on benchmarks like Visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Xinyu Wang , Bohan Zhuang , Qi Wu

As language models accelerate scientific research by automating hypothesis generation and implementation, a new bottleneck emerges: evaluating and filtering hundreds of AI-generated ideas without exhaustive experimentation. We ask whether…

Machine Learning · Computer Science 2026-05-22 Srujan P Mule , Aniketh Garikaparthi , Manasi Patwardhan

While pre-trained language models (LMs) have brought great improvements in many NLP tasks, there is increasing attention to explore capabilities of LMs and interpret their predictions. However, existing works usually focus only on a certain…

Computation and Language · Computer Science 2022-07-29 Yaozong Shen , Lijie Wang , Ying Chen , Xinyan Xiao , Jing Liu , Hua Wu

The exponential growth of text-based data in domains such as healthcare, education, and social sciences has outpaced the capacity of traditional qualitative analysis methods, which are time-intensive and prone to subjectivity. Large…

The rapid advancements in large Language models (LLMs) have significantly enhanced their reasoning capabilities, driven by various strategies such as multi-agent collaboration. However, unlike the well-established performance improvements…

Artificial Intelligence · Computer Science 2026-04-23 Zihan Chen , Song Wang , Zhen Tan , Xingbo Fu , Zhenyu Lei , Peng Wang , Huan Liu , Cong Shen , Jundong Li

Nowadays, pretrained language models (PLMs) have dominated the majority of NLP tasks. While, little research has been conducted on systematically evaluating the language abilities of PLMs. In this paper, we present a large-scale empirical…

Computation and Language · Computer Science 2022-05-04 Junyi Li , Tianyi Tang , Zheng Gong , Lixin Yang , Zhuohao Yu , Zhipeng Chen , Jingyuan Wang , Wayne Xin Zhao , Ji-Rong Wen

Large Language Models (LLMs) have demonstrated their capabilities across various tasks, from language translation to complex reasoning. Understanding and predicting human behavior and biases are crucial for artificial intelligence (AI)…

Artificial Intelligence · Computer Science 2024-08-06 Thuy Ngoc Nguyen , Kasturi Jamale , Cleotilde Gonzalez

Given the remarkable performance of Large Language Models (LLMs), an important question arises: Can LLMs conduct human-like scientific research and discover new knowledge, and act as an AI scientist? Scientific discovery is an iterative…

Machine Learning · Computer Science 2025-02-24 Tingting Chen , Srinivas Anumasa , Beibei Lin , Vedant Shah , Anirudh Goyal , Dianbo Liu

Large language models (LLMs) exhibit expert-level performance in tasks across a wide range of different domains. Ethical issues raised by LLMs and the need to align future versions makes it important to know how state of the art models…

Artificial Intelligence · Computer Science 2024-05-24 Guilherme F. C. F. Almeida , José Luiz Nunes , Neele Engelmann , Alex Wiegmann , Marcelo de Araújo

Large Language Models (LLMs) have shown promising performance in time series modeling tasks, but do they truly understand time series data? While multiple benchmarks have been proposed to answer this fundamental question, most are manually…

Artificial Intelligence · Computer Science 2026-04-15 Malgorzata Gwiazda , Yifu Cai , Mononito Goswami , Arjun Choudhry , Artur Dubrawski

This paper explores the impact of extending input lengths on the capabilities of Large Language Models (LLMs). Despite LLMs advancements in recent times, their performance consistency across different input lengths is not well understood.…

Computation and Language · Computer Science 2024-07-11 Mosh Levy , Alon Jacoby , Yoav Goldberg

Large language models (LLMs) have exploded in popularity in the past few years and have achieved undeniably impressive results on benchmarks as varied as question answering and text summarization. We provide a simple new prompting strategy…

Computation and Language · Computer Science 2022-12-14 Joshua Albrecht , Ellie Kitanidis , Abraham J. Fetterman

Evaluating the performance of Large Language Models (LLMs) is a critical yet challenging task, particularly when aiming to avoid subjective assessments. This paper proposes a framework for leveraging subjective metrics derived from the…

Computation and Language · Computer Science 2025-08-13 Haoze Du , Richard Li , Edward Gehringer

Large language models (LLMs) are increasingly used to support the analysis of complex financial disclosures, yet their reliability, behavioral consistency, and transparency remain insufficiently understood in high-stakes settings. This…

Computation and Language · Computer Science 2026-01-21 Md Talha Mohsin

Recent research has highlighted that Large Language Models (LLMs), even when trained to generate extended long reasoning steps, still face significant challenges on hard reasoning problems. However, much of the existing literature relies on…

Artificial Intelligence · Computer Science 2025-05-29 Fanzeng Xia , Yidong Luo , Tinko Sebastian Bartels , Yaqi Xu , Tongxin Li

Large language models (LLMs) are increasingly used to predict human behavior. We propose a measure for evaluating how much knowledge a pretrained LLM brings to such a prediction: its equivalent sample size, defined as the amount of…

Econometrics · Economics 2026-01-21 Wayne Gao , Sukjin Han , Annie Liang

Large Language Models (LLMs) have shown remarkable capabilities in manipulating natural language across multiple applications, but their ability to handle simple reasoning tasks is often questioned. In this work, we aim to provide a…

Computation and Language · Computer Science 2025-05-05 Alessandro Raganato , Rafael Peñaloza , Marco Viviani , Gabriella Pasi