English
Related papers

Related papers: Understanding Dominant Themes in Reviewing Agentic…

200 papers

Identifying and articulating limitations is essential for transparent and rigorous scientific research. However, zero-shot large language models (LLMs) approach often produce superficial or general limitation statements (e.g., dataset bias…

Computation and Language · Computer Science 2026-03-17 Ibrahim Al Azher , Zhishuai Guo , Hamed Alhoori

LLM-based autonomous coding agents have reshaped software development. While these agents excel at code generation, open questions persist about the long-term maintainability of AI-generated code. This study empirically investigates the…

Software Engineering · Computer Science 2026-05-12 Shota Sawada , Tatsuya Shirai , Yutaro Kashiwa , Ken'ichi Yamaguchi , Hiroshi Iwata , Hajimu Iida

As generative AI models such as large language models (LLMs) become more pervasive, ensuring the safety, robustness, and overall trustworthiness of these systems is paramount. However, AI is currently facing a reproducibility crisis driven…

Machine Learning · Computer Science 2026-05-14 Deepak Pandita , Flip Korn , Chris Welty , Christopher M. Homan

Large language models show promising capabilities for contextual fact-checking on social media: they can verify contested claims through deep research, synthesize evidence from multiple sources, and draft explanations at scale. However,…

Computers and Society · Computer Science 2026-04-15 Haiwen Li , Michiel A. Bakker

Critique, as a natural language description for assessing the quality of model-generated content, has played a vital role in the training, evaluation, and refinement of LLMs. However, a systematic method to evaluate the quality of critique…

Computation and Language · Computer Science 2024-06-04 Shichao Sun , Junlong Li , Weizhe Yuan , Ruifeng Yuan , Wenjie Li , Pengfei Liu

This research examines the use of Reinforcement Learning from AI Feedback (RLAIF) techniques to improve healthcare dialogue models, with the aim of tackling the challenges of preference-aligned data annotation while reducing the reliance on…

Computation and Language · Computer Science 2024-10-08 Chengfeng Dou , Ying Zhang , Zhi Jin , Wenpin Jiao , Haiyan Zhao , Yongqiang Zhao , Zhengwei Tao

AI agent research spans a wide spectrum: from RL agents that learn from scratch to foundation model agents that leverage pre-trained knowledge, yet no unified benchmark enables fair comparison across these approaches. We present Agentick, a…

Artificial Intelligence · Computer Science 2026-05-14 Roger Creus Castanyer , Pablo Samuel Castro , Glen Berseth

The integration of artificial intelligence (AI) continues to increase and evolve, including in software engineering (SE). This integration involves processes traditionally entrusted to humans, such as coding. However, the impact on…

Software Engineering · Computer Science 2025-01-07 Adam Alami , Neil A. Ernst

This paper presents the system submitted by the team from IIT(ISM) Dhanbad in FIRE IRSE 2023 shared task 1 on the automatic usefulness prediction of code-comment pairs as well as the impact of Large Language Model(LLM) generated data on…

Software Engineering · Computer Science 2023-10-24 Tripti Kumari , Chakali Sai Charan , Ayan Das

Peer review serves as the gatekeeper of science, yet the surge in submissions and widespread adoption of large language models (LLMs) in scholarly evaluation present unprecedented challenges. While recent work has focused on using LLMs to…

Artificial Intelligence is moving from models that only generate text to Agentic AI, where systems behave as autonomous entities that can perceive, reason, plan, and act. Large Language Models (LLMs) are no longer used only as passive…

Artificial Intelligence · Computer Science 2026-01-21 Arunkumar V , Gangadharan G. R. , Rajkumar Buyya

Recent advances in the intrinsic reasoning capabilities of large language models (LLMs) have given rise to LLM-based agent systems that exhibit near-human performance on a variety of automated tasks. However, although these systems share…

Artificial Intelligence · Computer Science 2025-08-26 Bingxi Zhao , Lin Geng Foo , Ping Hu , Christian Theobalt , Hossein Rahmani , Jun Liu

The rapid development of AI-driven tools, particularly large language models (LLMs), is reshaping professional writing. Still, key aspects of their adoption such as languages support, ethics, and long-term impact on writers voice and…

Computation and Language · Computer Science 2025-07-31 Anastasiia Ivanova , Natalia Fedorova , Sergei Tilga , Ekaterina Artemova

Large Language Models are increasingly used in software engineering, but both code generation and its evaluation remain predominantly English-centric. This leaves a major gap in our understanding of how well current tools support…

The rapid expansion of AI research has intensified the Reviewer Gap, threatening the peer-review sustainability and perpetuating a cycle of low-quality evaluations. This position paper critiques existing LLM approaches that automatically…

Artificial Intelligence · Computer Science 2026-01-15 JungMin Yun , JuneHyoung Kwon , MiHyeon Kim , YoungBin Kim

Large Language Models (LLMs) demonstrate strong potential for automated code generation, yet their ability to iteratively refine solutions using execution feedback remains underexplored. Competitive programming offers an ideal testbed for…

Software Engineering · Computer Science 2026-05-19 Anika Tabassum , Md Sifat Hossain , Md. Fahim Arefin , Tariqul Islam , Tarannum Shaila Zaman

Recent Large Language Models (LLMs) have shown the ability to generate content that is difficult or impossible to distinguish from human writing. We investigate the ability of differently-sized LLMs to replicate human writing style in…

Computation and Language · Computer Science 2024-05-06 Tolga Buz , Benjamin Frost , Nikola Genchev , Moritz Schneider , Lucie-Aimée Kaffee , Gerard de Melo

Large language model (LLM)-driven multi-agent systems (MAS) are transforming how humans and AIs collaboratively generate ideas and artifacts. While existing surveys provide comprehensive overviews of MAS infrastructures, they largely…

Human-Computer Interaction · Computer Science 2025-05-28 Yi-Cheng Lin , Kang-Chieh Chen , Zhe-Yan Li , Tzu-Heng Wu , Tzu-Hsuan Wu , Kuan-Yu Chen , Hung-yi Lee , Yun-Nung Chen

Agents powered by large language models (LLMs) are increasingly adopted in the software industry, contributing code as collaborators or even autonomous developers. As their presence grows, it becomes important to assess the current…

Software Engineering · Computer Science 2026-02-12 Qixing Zhou , Jiacheng Zhang , Haiyang Wang , Rui Hao , Jiahe Wang , Minghao Han , Yuxue Yang , Shuzhe Wu , Feiyang Pan , Lue Fan , Dandan Tu , Zhaoxiang Zhang

AI coding agents are increasingly contributing to software development, yet their impact on mobile development has received little empirical attention. In this paper, we present the first category-level empirical study of agent-generated…

Software Engineering · Computer Science 2026-02-13 Muhammad Ahmad Khan , Hasnain Ali , Muneeb Rana , Muhammad Saqib Ilyas , Abdul Ali Bangash