English
Related papers

Related papers: Evaluating Ill-Defined Tasks in Large Language Mod…

200 papers

The ability to follow instructions is crucial for Large Language Models (LLMs) to handle various real-world applications. Existing benchmarks primarily focus on evaluating pure response quality, rather than assessing whether the response…

Computation and Language · Computer Science 2024-06-06 Yuxin Jiang , Yufei Wang , Xingshan Zeng , Wanjun Zhong , Liangyou Li , Fei Mi , Lifeng Shang , Xin Jiang , Qun Liu , Wei Wang

While large language models (LLMs) have demonstrated impressive capabilities across various natural language processing tasks by acquiring rich factual knowledge from their broad training data, their ability to synthesize and logically…

Computation and Language · Computer Science 2024-07-31 Tianshi Zheng , Jiaxin Bai , Yicheng Wang , Tianqing Fang , Yue Guo , Yauwai Yim , Yangqiu Song

Large language models (LLMs) have shown impressive performance in following natural language instructions to solve unseen tasks. However, it remains unclear whether models truly understand task definitions and whether the human-written…

Computation and Language · Computer Science 2023-06-05 Fan Yin , Jesse Vig , Philippe Laban , Shafiq Joty , Caiming Xiong , Chien-Sheng Jason Wu

Despite the recent ubiquity of large language models and their high zero-shot prompted performance across a wide range of tasks, it is still not known how well they perform on tasks which require processing of potentially idiomatic…

Computation and Language · Computer Science 2024-05-16 Dylan Phelps , Thomas Pickard , Maggie Mi , Edward Gow-Smith , Aline Villavicencio

Large Language Models (LLMs) are increasingly deployed to automatically label and analyze educational dialogue at scale, yet current pipelines lack reliable ways to detect when models are wrong. We investigate whether reasoning generated by…

Computation and Language · Computer Science 2026-02-11 Bakhtawar Ahtisham , Kirk Vanacore , Zhuqian Zhou , Jinsook Lee , Rene F. Kizilcec

Large language models (LLMs) have demonstrated strong performance on formal language tasks, yet whether this reflects genuine symbolic reasoning or pattern matching on familiar constructions remains unclear. We introduce a benchmark for…

Computation and Language · Computer Science 2026-01-21 Shlok Shelat , Jay Raval , Souvik Roy , Manas Gaur

Large Language Models (LLMs) have attracted extensive attention due to their remarkable performance across various tasks. However, the substantial computational and memory requirements of LLM inference pose challenges for deployment in…

Reinforcement learning (RL) has become a key technique for enhancing the reasoning abilities of large language models (LLMs), with policy-gradient algorithms dominating the post-training stage because of their efficiency and effectiveness.…

Artificial Intelligence · Computer Science 2025-08-08 Chang Tian , Matthew B. Blaschko , Mingzhe Xing , Xiuxing Li , Yinliang Yue , Marie-Francine Moens

Large Language Models (LLMs) remain difficult to evaluate comprehensively, particularly for languages other than English, where high-quality data is often limited. Existing benchmarks and leaderboards are predominantly English-centric, with…

With the rapid adoption of large language models (LLMs) in natural language processing, the ability to follow instructions has emerged as a key metric for evaluating their practical utility. However, existing evaluation methods often focus…

Computation and Language · Computer Science 2025-06-04 Yile Liu , Ziwei Ma , Xiu Jiang , Jinglu Hu , Jing Chang , Liang Li

Large Language Models are essential coding assistants, yet their training is predominantly English-centric. In this study, we evaluate the performance of code language models in non-English contexts, identifying challenges in their adoption…

Evaluation for many natural language understanding (NLU) tasks is broken: Unreliable and biased systems score so highly on standard benchmarks that there is little room for researchers who develop better systems to demonstrate their…

Computation and Language · Computer Science 2021-10-19 Samuel R. Bowman , George E. Dahl

Large language models (LLMs) have demonstrated remarkable performances on a wide range of natural language tasks. Yet, LLMs' successes have been largely restricted to tasks concerning words, sentences, or documents, and it remains…

Computation and Language · Computer Science 2024-07-24 Andrew Shin , Kunitake Kaneko

Multimodal Large Language Models (MLLMs) have displayed remarkable performance in multi-modal tasks, particularly in visual comprehension. However, we reveal that MLLMs often generate incorrect answers even when they understand the visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yexin Liu , Zhengyang Liang , Yueze Wang , Xianfeng Wu , Feilong Tang , Muyang He , Jian Li , Zheng Liu , Harry Yang , Sernam Lim , Bo Zhao

Instruction following is a core capability of modern Large language models (LLMs), making evaluating this capability essential to understanding these models. The Instruction Following Evaluation (IFEval) benchmark from the literature does…

Computation and Language · Computer Science 2025-02-10 Antoine Dussolle , Andrea Cardeña Díaz , Shota Sato , Peter Devine

Large language models (LLMs) have shown to be valuable tools for tackling process mining tasks. Existing studies report on their capability to support various data-driven process analyses and even, to some extent, that they are able to…

Databases · Computer Science 2025-05-01 Adrian Rebmann , Fabian David Schmidt , Goran Glavaš , Han van der Aa

Large language models (LLMs) demonstrate strong performance on standard digital logic and Boolean reasoning tasks, yet their reliability under locally redefined semantics remains poorly understood. In many formal settings, such as circuit…

Hardware Architecture · Computer Science 2026-02-20 Yogeswar Reddy Thota , Setareh Rafatirad , Homayoun Houman , Tooraj Nikoubin

We investigate the predictability of large language model (LLM) capabilities: given records of past experiments using different model families, numbers of parameters, tasks, and numbers of in-context examples, can we accurately predict LLM…

Computation and Language · Computer Science 2023-11-01 Qinyuan Ye , Harvey Yiyun Fu , Xiang Ren , Robin Jia

As large language models (LLMs) continue to advance and gain widespread use, establishing systematic and reliable evaluation methodologies for LLMs and vision-language models (VLMs) has become essential to ensure their real-world…

Artificial Intelligence · Computer Science 2025-06-03 Jie Feng , Jun Zhang , Tianhui Liu , Xin Zhang , Tianjian Ouyang , Junbo Yan , Yuwei Du , Siqi Guo , Yong Li

Chart descriptions are essential for accessibility, cross-modal retrieval, and assisting readers in extracting insights from complex visualizations. As multimodal large language models (MLLMs) are increasingly adopted for automated chart…

Computation and Language · Computer Science 2026-05-25 Fen Wang , Zekai Shao , Qiman Kang , Chunran Hu , Zhixuan Zhang , Lexu Xie , Chao Liu , Siming Chen