English
Related papers

Related papers: Reviewer2: Optimizing Review Generation Through Pr…

200 papers

Like humans, large language models (LLMs) do not always generate the best output on their first try. Motivated by how humans refine their written text, we introduce Self-Refine, an approach for improving initial outputs from LLMs through…

Large language models (LLMs) are increasingly used in academic peer review, yet their reliability, alignment with human judgment, and robustness to adversarial attacks remain poorly understood. We present a systematic benchmark of…

Computation and Language · Computer Science 2026-05-26 Lingyao Li , Junjie Xiong , Changjia Zhu , Runlong Yu , Chen Chen , Junyu Wang , Renkai Ma , Zhicong Lu

It is known that user-centered approaches to requirements engineering in general lead to a better suited product for the end-users. LLM4RE provides promising approaches to support the requirements elicitation process (e.g. classification of…

Software Engineering · Computer Science 2026-05-14 Cedric Wellhausen , Laura Reinhardt , Kurt Schneider

The rapid advancement of large language models (LLMs) has inspired researchers to integrate them extensively into the academic workflow, potentially reshaping how research is practiced and reviewed. While previous studies highlight the…

Computation and Language · Computer Science 2025-10-15 Rui Li , Jia-Chen Gu , Po-Nien Kung , Heming Xia , Junfeng liu , Xiangwen Kong , Zhifang Sui , Nanyun Peng

How well can large language models (LLMs) generate summaries? We develop new datasets and conduct human evaluation experiments to evaluate the zero-shot generation capability of LLMs across five distinct summarization tasks. Our findings…

Computation and Language · Computer Science 2023-09-19 Xiao Pu , Mingqi Gao , Xiaojun Wan

Large Language Models (LLMs) have in recent years demonstrated impressive prowess in natural language generation. A common practice to improve generation diversity is to sample multiple outputs from the model. However, there lacks a simple…

Computation and Language · Computer Science 2022-09-23 Xingdi Yuan , Tong Wang , Yen-Hsiang Wang , Emery Fine , Rania Abdelghani , Pauline Lucas , Hélène Sauzéon , Pierre-Yves Oudeyer

Recent work has explored the capability of large language models (LLMs) to identify and correct errors in LLM-generated responses. These refinement approaches frequently evaluate what sizes of models are able to do refinement for what…

Computation and Language · Computer Science 2025-06-23 Manya Wadhwa , Xinyu Zhao , Junyi Jessy Li , Greg Durrett

The advent of Large Language Models (LLMs) has revolutionized various domains of artificial intelligence, including the realm of software engineering. In this research, we evaluate the efficacy of pre-trained LLMs in replicating the tasks…

Software Engineering · Computer Science 2024-06-10 Tajmilur Rahman , Rahul Singh , Mir Yousuf Sultan

An important task for recommender system is to generate explanations according to a user's preferences. Most of the current methods for explainable recommendations use structured sentences to provide descriptions along with the…

Computation and Language · Computer Science 2017-07-07 Felipe Costa , Sixun Ouyang , Peter Dolog , Aonghus Lawlor

Previous studies have demonstrated that proactive interaction with user reviews has a positive impact on the perception of app users and encourages them to submit revised ratings. Nevertheless, developers encounter challenges in managing a…

Computation and Language · Computer Science 2024-05-08 Guy Azov , Tatiana Pelc , Adi Fledel Alon , Gila Kamhi

Large Language Models (LLMs) have demonstrated exceptional comprehension capabilities and a vast knowledge base, suggesting that LLMs can serve as efficient tools for automated survey generation. However, recent research related to…

Computation and Language · Computer Science 2025-02-28 Xun Liang , Jiawei Yang , Yezhaohui Wang , Chen Tang , Zifan Zheng , Shichao Song , Zehao Lin , Yebin Yang , Simin Niu , Hanyu Wang , Bo Tang , Feiyu Xiong , Keming Mao , Zhiyu li

Large language models (LLMs) have demonstrated impressive capabilities in natural language generation. However, their output quality can be inconsistent, posing challenges for generating natural language from logical forms (LFs). This task…

Computation and Language · Computer Science 2023-09-22 Levon Haroutunian , Zhuang Li , Lucian Galescu , Philip Cohen , Raj Tumuluri , Gholamreza Haffari

Large Language Models (LLMs) excel in data synthesis but can be inaccurate in domain-specific tasks, which retrieval-augmented generation (RAG) systems address by leveraging user-provided data. However, RAGs require optimization in both…

Computation and Language · Computer Science 2024-11-05 Kazi Ahmed Asif Fuad , Lizhong Chen

The creation of systematic literature reviews (SLR) is critical for analyzing the landscape of a research field and guiding future research directions. However, retrieving and filtering the literature corpus for an SLR is highly…

Machine Learning · Computer Science 2026-02-18 Lucas Joos , Daniel A. Keim , Maximilian T. Fischer

This work proposes a novel approach to enhancing annotated bibliography generation through Large Language Model (LLM) ensembles. In particular, multiple LLMs in different roles -- controllable text generation, evaluation, and summarization…

Computation and Language · Computer Science 2024-12-31 Sergio Bermejo

App store reviews provide a constant flow of real user feedback that can help improve software requirements. However, these reviews are often messy, informal, and difficult to analyze manually at scale. Although automated techniques exist,…

Computation and Language · Computer Science 2026-03-31 Shadman Sakib , Oishy Fatema Akhand , Tasnia Tasneem , Shohel Ahmed

Story-writing is a fundamental aspect of human imagination, relying heavily on creativity to produce narratives that are novel, effective, and surprising. While large language models (LLMs) have demonstrated the ability to generate…

Computation and Language · Computer Science 2025-05-13 Mete Ismayilzada , Claire Stevenson , Lonneke van der Plas

Reviews contain rich information about product characteristics and user interests and thus are commonly used to boost recommender system performance. Specifically, previous work show that jointly learning to perform review generation…

Information Retrieval · Computer Science 2022-09-13 Zhouhang Xie , Julian McAuley , Bodhisattwa Prasad Majumder

Large language models (LLMs) are increasingly used to generate feedback, yet their impact on learning remains underexplored, especially compared to existing feedback methods. This study investigates how on-demand LLM-generated explanatory…

Computation and Language · Computer Science 2025-06-23 Danielle R. Thomas , Conrad Borchers , Shambhavi Bhushan , Erin Gatz , Shivang Gupta , Kenneth R. Koedinger

Generating unbiased summaries in real-world settings such as political perspective summarization remains a crucial application of Large Language Models (LLMs). Yet, existing evaluation frameworks rely on traditional metrics for measuring…

Computation and Language · Computer Science 2025-06-23 Narutatsu Ri , Nicholas Deas , Kathleen McKeown