English
Related papers

Related papers: A Benchmark Dataset And LLMs Comparison For NFR Cl…

200 papers

This paper presents an extensive examination of Parameter-Efficient Fine-Tuning (PEFT) for embedding domain specific facts into Large Language Models (LLMs), focusing on improving the fine-tuning process by categorizing question-answer (QA)…

Computation and Language · Computer Science 2025-10-28 Shivam Ratnakar , Abhiroop Talasila , Raghav Chamadiya , Nikhil Agarwal , Vinayak K Doifode

The use of Service-Based Architecture in modern telecommunications has exponentially increased Network Functions (NFs) and Application Programming Interfaces (APIs), creating substantial operational complexities in service discovery and…

Networking and Internet Architecture · Computer Science 2025-08-14 Zainab Khan , Ahmed Hussain , Mukesh Thakur , Arto Hellas , Panos Papadimitratos

Large Language Models (LLMs) have demonstrated remarkable progress through preference-based fine-tuning, which critically depends on the quality of the underlying training data. While human feedback is essential for improving data quality,…

Artificial Intelligence · Computer Science 2025-10-31 Derin Cayir , Renjie Tao , Rashi Rungta , Kai Sun , Sean Chen , Haidar Khan , Minseok Kim , Julia Reinspach , Yue Liu

The use of large language models (LLMs) is expanding rapidly, and open-source versions are becoming available, offering users safer and more adaptable options. These models enable users to protect data privacy by eliminating the need to…

Machine Learning · Computer Science 2024-08-06 Hui Yin , Amir Aryani , Nakul Nambiar

Ransomware continues to evolve in complexity, making early and explainable detection a critical requirement for modern cybersecurity systems. This study presents a comparative analysis of three Transformer-based Large Language Models (LLMs)…

Cryptography and Security · Computer Science 2026-01-21 Elodie Mutombo Ngoie , Mike Nkongolo Wa Nkongolo , Peace Azugo , Mahmut Tokmak

Intermediate Representations (IRs) play a critical role in compiler design and program analysis, yet their comprehension by Large Language Models (LLMs) remains underexplored. In this paper, we present an explorative empirical study…

Machine Learning · Computer Science 2025-06-06 Hailong Jiang , Jianfeng Zhu , Yao Wan , Bo Fang , Hongyu Zhang , Ruoming Jin , Qiang Guan

Code comment classification is a critical task for automated software documentation and analysis. In the context of the NLBSE'26 Tool Competition, we present LoRA-MME, a Multi-Model Ensemble architecture utilizing Parameter-Efficient…

Software Engineering · Computer Science 2026-04-16 Md Akib Haider , Ahsan Bulbul , Nafis Fuad Shahid , Aimaan Ahmed , Mohammad Ishrak Abedin

The Consolidated Standards of Reporting Trials statement is the global benchmark for transparent and high-quality reporting of randomized controlled trials. Manual verification of CONSORT adherence is a laborious, time-intensive process…

Computation and Language · Computer Science 2025-11-18 Zhichao He , Mouxiao Bian , Jianhong Zhu , Jiayuan Chen , Yunqiu Wang , Wenxia Zhao , Tianbin Li , Bing Han , Jie Xu , Junyan Wu

The growing trend of vulnerability issues in software development as a result of a large dependence on open-source projects has received considerable attention recently. This paper investigates the effectiveness of Large Language Models…

Software Engineering · Computer Science 2024-09-17 Shaznin Sultana , Sadia Afreen , Nasir U. Eisty

This paper introduces the Decomposed Requirements Following Ratio (DRFR), a new metric for evaluating Large Language Models' (LLMs) ability to follow instructions. Addressing a gap in current methodologies, DRFR breaks down complex…

Computation and Language · Computer Science 2024-01-09 Yiwei Qin , Kaiqiang Song , Yebowen Hu , Wenlin Yao , Sangwoo Cho , Xiaoyang Wang , Xuansheng Wu , Fei Liu , Pengfei Liu , Dong Yu

The combination of multimodal Vision-Language Models (VLMs) and Large Language Models (LLMs) opens up new possibilities for medical classification. This work offers a rigorous, unified benchmark by using four publicly available datasets…

Artificial Intelligence · Computer Science 2026-01-26 Meet Raval , Tejul Pandit , Dhvani Upadhyay

Clinical document classification is essential for converting unstructured medical texts into standardised ICD-10 diagnoses, yet it faces challenges due to complex medical language, privacy constraints, and limited annotated datasets. Large…

Computation and Language · Computer Science 2026-02-03 Akram Mustafa , Usman Naseem , Mostafa Rahimi Azghadi

Radiology reports are critical for clinical decision-making but often lack a standardized format, limiting both human interpretability and machine learning (ML) applications. While large language models (LLMs) have shown strong capabilities…

Computation and Language · Computer Science 2025-07-15 Johannes Moll , Louisa Fay , Asfandyar Azhar , Sophie Ostmeier , Tim Lueth , Sergios Gatidis , Curtis Langlotz , Jean-Benoit Delbrouck

Tracking how data is mentioned and used in research papers provides critical insights for improving data discoverability, quality, and production. However, manually identifying and classifying dataset mentions across vast academic…

Computation and Language · Computer Science 2025-02-17 Aivin V. Solatorio , Rafael Macalaba , James Liounis

Automation in software engineering increasingly relies on large language models (LLMs) to generate, review, and assess code artifacts. However, establishing LLMs as reliable evaluators remains an open challenge: human evaluations are…

Software Engineering · Computer Science 2025-08-06 Ora Nova Fandina , Eitan Farchi , Shmulik Froimovich , Rami Katan , Alice Podolsky , Orna Raz , Avi Ziv

Requirements identification in textual documents or extraction is a tedious and error prone task that many researchers suggest automating. We manually annotated the PURE dataset and thus created a new one containing both requirements and…

Software Engineering · Computer Science 2022-02-07 Vladimir Ivanov , Andrey Sadovykh , Alexandr Naumchev , Alessandra Bagnato , Kirill Yakovlev

As Large Language Models (LLMs) advance in natural language processing, there is growing interest in leveraging their capabilities to simplify software interactions. In this paper, we propose a novel system that integrates LLMs for both…

Computation and Language · Computer Science 2024-09-19 Chunliang Tao , Xiaojing Fan , Yahe Yang

Excel is a pervasive yet often complex tool, particularly for novice users, where runtime errors arising from logical mistakes or misinterpretations of functions pose a significant challenge. While large language models (LLMs) offer…

Human feedback plays a pivotal role in aligning large language models (LLMs) with human preferences. However, such feedback is often noisy or inconsistent, which can degrade the quality of reward models and hinder alignment. While various…

Artificial Intelligence · Computer Science 2025-10-15 Samuel Yeh , Sharon Li

Requirements Engineering (RE) is essential for developing complex and regulated software projects. Given the challenges in transforming stakeholder inputs into consistent software designs, Qualitative Data Analysis (QDA) provides a…

Software Engineering · Computer Science 2025-04-29 Syed Tauhid Ullah Shah , Mohamad Hussein , Ann Barcomb , Mohammad Moshirpour