English
Related papers

Related papers: Becoming Experienced Judges: Selective Test-Time L…

200 papers

Large language models (LLMs) can improve their accuracy on various tasks through iteratively refining and revising their output based on feedback. We observe that these revisions can introduce errors, in which case it is better to roll back…

Artificial Intelligence · Computer Science 2023-09-26 Kumar Shridhar , Harsh Jhamtani , Hao Fang , Benjamin Van Durme , Jason Eisner , Patrick Xia

The performance of Large Language Models (LLMs) is highly sensitive to the prompts they are given. Drawing inspiration from the field of prompt optimization, this study investigates the potential for enhancing Automated Essay Scoring (AES)…

Computation and Language · Computer Science 2025-10-13 Keno Harada , Lui Yoshida , Takeshi Kojima , Yusuke Iwasawa , Yutaka Matsuo

Prompt engineering is an iterative procedure often requiring extensive manual effort to formulate suitable instructions for effectively directing large language models (LLMs) in specific tasks. Incorporating few-shot examples is a vital and…

This research investigates prompt designs of evaluating generated texts using large language models (LLMs). While LLMs are increasingly used for scoring various inputs, creating effective prompts for open-ended text evaluation remains…

Computation and Language · Computer Science 2024-06-28 KuanChao Chu , Yi-Pei Chen , Hideki Nakayama

The rapid advancement of Large Language Models (LLMs) has driven their expanding application across various fields. One of the most promising applications is their role as evaluators based on natural language responses, referred to as…

Computation and Language · Computer Science 2024-12-11 Haitao Li , Qian Dong , Junjie Chen , Huixue Su , Yujia Zhou , Qingyao Ai , Ziyi Ye , Yiqun Liu

Using Large Language Models (LLMs) for relevance assessments offers promising opportunities to improve Information Retrieval (IR), Natural Language Processing (NLP), and related fields. Indeed, LLMs hold the promise of allowing IR…

Reinforcement Learning (RL) has demonstrated significant potential in enhancing the reasoning capabilities of large language models (LLMs). However, the success of RL for LLMs heavily relies on human-curated datasets and verifiable rewards,…

Artificial Intelligence · Computer Science 2025-10-31 Yixing Chen , Yiding Wang , Siqi Zhu , Haofei Yu , Tao Feng , Muhan Zhang , Mostofa Patwary , Jiaxuan You

Significant progress has been made in automatic text evaluation with the introduction of large language models (LLMs) as evaluators. However, current sample-wise evaluation paradigm suffers from the following issues: (1) Sensitive to prompt…

Computation and Language · Computer Science 2024-01-02 Peiwen Yuan , Shaoxiong Feng , Yiwei Li , Xinglin Wang , Boyuan Pan , Heda Wang , Kan Li

Large Language Models (LLMs) can propose rules in natural language, sidestepping the need for a predefined predicate space in traditional rule learning. Yet many LLM-based approaches ignore interactions among rules, and the opportunity to…

Artificial Intelligence · Computer Science 2026-02-16 Yang Yang , Hua XU , Zhangyi Hu , Yutao Yue

Reinforcement Learning with Verifiable Rewards (RLVR) elicits long chain-of-thought reasoning in large language models (LLMs), but outcome-based rewards lead to coarse-grained advantage estimation. While existing approaches improve RLVR via…

Computation and Language · Computer Science 2026-01-08 Fei Wu , Zhenrong Zhang , Qikai Chang , Jianshu Zhang , Quan Liu , Jun Du

By simply composing prompts, developers can prototype novel generative applications with Large Language Models (LLMs). To refine prototypes into products, however, developers must iteratively revise prompts by evaluating outputs to diagnose…

Human-Computer Interaction · Computer Science 2024-02-28 Tae Soo Kim , Yoonjoo Lee , Jamin Shin , Young-Ho Kim , Juho Kim

In an effort to automatically evaluate and select the best model and improve code quality for automatic incident remediation in IT Automation, it is crucial to verify if the generated code for remediation action is syntactically and…

Software Engineering · Computer Science 2025-06-16 Ngoc Phuoc An Vo , Brent Paulovicks , Vadim Sheinin

We investigate how agents built on pretrained large language models (LLMs) can learn target classification functions from labeled examples without parameter updates. While conventional approaches like fine-tuning are often costly,…

Computation and Language · Computer Science 2026-05-06 Jackson Hassell , Dan Zhang , Hannah Kim , Tom Mitchell , Estevam Hruschka

Scaling test-time compute brings substantial performance gains for large language models (LLMs). By sampling multiple answers and heuristically aggregate their answers (e.g., either through majority voting or using verifiers to rank the…

Computation and Language · Computer Science 2025-10-13 Jianing Qi , Xi Ye , Hao Tang , Zhigang Zhu , Eunsol Choi

Modern Large Language Models (LLMs) have shown rapid improvements in reasoning capabilities, driven largely by reinforcement learning (RL) with verifiable rewards. Here, we ask whether these LLMs can self-improve without the need for…

Computation and Language · Computer Science 2026-02-04 Yufan Zhuang , Chandan Singh , Liyuan Liu , Yelong Shen , Dinghuai Zhang , Jingbo Shang , Jianfeng Gao , Weizhu Chen

With the broad availability of large language models and their ability to generate vast outputs using varied prompts and configurations, determining the best output for a given task requires an intensive evaluation process, one where…

Automated assessment of open-ended student responses is a critical capability for scaling personalized feedback in education. While large language models (LLMs) have shown promise in grading tasks via in-context learning (ICL), their…

Artificial Intelligence · Computer Science 2026-03-03 Yucheng Chu , Hang Li , Kaiqi Yang , Yasemin Copur-Gencturk , Kevin Haudek , Joseph Krajcik , Jiliang Tang

Reinforcement learning (RL) often encounters delayed and sparse feedback in real-world applications, even with only episodic rewards. Previous approaches have made some progress in reward redistribution for credit assignment but still face…

Machine Learning · Computer Science 2025-01-10 Yun Qu , Yuhang Jiang , Boyuan Wang , Yixiu Mao , Cheems Wang , Chang Liu , Xiangyang Ji

Traditional reference-based metrics, such as BLEU and ROUGE, are less effective for assessing outputs from Large Language Models (LLMs) that produce highly creative or superior-quality text, or in situations where reference outputs are…

Human-Computer Interaction · Computer Science 2024-07-08 Qian Pan , Zahra Ashktorab , Michael Desmond , Martin Santillan Cooper , James Johnson , Rahul Nair , Elizabeth Daly , Werner Geyer

Mixture of Experts (MoE) architectures have recently advanced the scalability and adaptability of large language models (LLMs) for continual multimodal learning. However, efficiently extending these models to accommodate sequential tasks…

Computation and Language · Computer Science 2025-06-26 Hengyuan Zhao , Ziqin Wang , Qixin Sun , Kaiyou Song , Yilin Li , Xiaolin Hu , Qingpei Guo , Si Liu