English
Related papers

Related papers: Demystifying Issues, Causes and Solutions in LLM O…

200 papers

Native Language Identification (NLI) - the task of identifying the native language (L1) of a person based on their writing in the second language (L2) - has applications in forensics, marketing, and second language acquisition.…

Computation and Language · Computer Science 2025-01-22 Yee Man Ng , Ilia Markov

The democratization of open-source Large Language Models (LLMs) allows users to fine-tune and deploy models on local infrastructure but exposes them to a First Mile deployment landscape. Unlike black-box API consumption, the reliability of…

Software Engineering · Computer Science 2026-01-21 Guangba Yu , Zirui Wang , Yujie Huang , Renyi Zhong , Yuedong Zhong , Yilun Wang , Michael R. Lyu

Context: An increasing demand is observed in various domains to employ Machine Learning (ML) for solving complex problems. ML models are implemented as software components and deployed in Machine Learning Software Systems (MLSSs). Problem:…

Software Engineering · Computer Science 2024-08-06 Pierre-Olivier Côté , Amin Nikanjam , Rached Bouchoucha , Ilan Basta , Mouna Abidi , Foutse Khomh

Large Language Models (LLMs) have demonstrated unprecedented capabilities in code generation. However, there remains a limited understanding of code generation errors that LLMs can produce. To bridge the gap, we conducted an in-depth…

Software Engineering · Computer Science 2025-02-14 Zhijie Wang , Zijie Zhou , Da Song , Yuheng Huang , Shengmai Chen , Lei Ma , Tianyi Zhang

Due to its enormous benefits, the research and industry communities have shown an increasing interest in the Microservices Architecture (MSA) style over the last few years. Despite this, there is a limited evidence-based and thorough…

Software Engineering · Computer Science 2021-05-05 Muhammad Waseem , Peng Liang , Mojtaba Shahin , Aakash Ahmad , Ali Rezaei Nasab

Personalization of Large Language Models (LLMs) has recently become increasingly important with a wide range of applications. Despite the importance and recent progress, most existing works on personalized LLMs have focused either entirely…

Software issue resolution aims to address real-world issues in software repositories (e.g., bug fixing and efficiency optimization) based on natural language descriptions provided by users, representing a key aspect of software maintenance.…

Software Engineering · Computer Science 2025-12-30 Zhonghao Jiang , David Lo , Zhongxin Liu

Large language models can produce creative and diverse responses. However, to integrate them into current developer workflows, it is essential to constrain their outputs to follow specific formats or standards. In this work, we surveyed 51…

Human-Computer Interaction · Computer Science 2024-04-12 Michael Xieyang Liu , Frederick Liu , Alexander J. Fiannaca , Terry Koo , Lucas Dixon , Michael Terry , Carrie J. Cai

AI-assisted code generation tools have revolutionized software development, offering unprecedented efficiency and scalability. However, multiple studies have consistently highlighted challenges such as security vulnerabilities, reliability…

Software Engineering · Computer Science 2025-06-16 Ahilan Ayyachamy Nadar Ponnusamy

Large Language Models (LLMs) have achieved unparalleled success across diverse language modeling tasks in recent years. However, this progress has also intensified ethical concerns, impacting the deployment of LLMs in everyday contexts.…

Large Language Models (LLMs) and Multi-Agent LLMs (MALLMs) introduce non-determinism unlike traditional or machine learning software, requiring new approaches to verifying correctness beyond simple output comparisons or statistical accuracy…

Software Engineering · Computer Science 2025-10-22 Felix Dobslaw , Robert Feldt , Juyeon Yoon , Shin Yoo

Measurement systems (e.g., currencies) differ across cultures, but the conversions between them are well defined so that humans can state facts using any measurement system of their choice. Being available to users from diverse cultural…

Computation and Language · Computer Science 2025-06-04 Minh Duc Bui , Kyung Eun Park , Goran Glavaš , Fabian David Schmidt , Katharina von der Wense

Large language models (LLMs) have exhibited remarkable capabilities across various domains. The ability to call external tools further expands their capability to handle real-world tasks. However, LLMs often follow an opaque reasoning…

Machine Learning · Computer Science 2025-11-20 Ruixin Zhang , Jon Donnelly , Zhicheng Guo , Ghazal Khalighinejad , Haiyang Huang , Alina Jade Barnett , Cynthia Rudin

Large language models (LLMs) have developed rapidly in recent years, revolutionizing various fields. Despite their widespread success, LLMs heavily rely on external code dependencies from package management systems, creating a complex and…

Cryptography and Security · Computer Science 2025-09-01 Shuhan Liu , Xing Hu , Xin Xia , David Lo , Xiaohu Yang

Large Language Models (LLMs) are large-scale pretrained models that have achieved remarkable success across diverse domains. These successes have been driven by unprecedented complexity and scale in both data and computations. However, due…

Code translation aims to convert source code from one programming language (PL) to another. Given the promising abilities of large language models (LLMs) in code synthesis, researchers are exploring their potential to automate code…

This paper investigates the complexities of integrating Large Language Models (LLMs) into software products, with a focus on the challenges encountered for determining their readiness for release. Our systematic review of grey literature…

Software Engineering · Computer Science 2024-03-29 Harsh Patel , Dominique Boucher , Emad Fallahzadeh , Ahmed E. Hassan , Bram Adams

Large Language Models (LLMs) are transforming the way people generate, explore, and engage with content. We study how we can develop LLM applications for online social networks. Despite LLMs' successes in other domains, it is challenging to…

Social and Information Networks · Computer Science 2024-01-08 Jingying Zeng , Richard Huang , Waleed Malik , Langxuan Yin , Bojan Babic , Danny Shacham , Xiao Yan , Jaewon Yang , Qi He

Large Language Models (LLMs) have gained widespread popularity due to their exceptional capabilities across various domains, including chatbots, healthcare, education, content generation, and automated support systems. However, developers…

Software Engineering · Computer Science 2024-11-26 Khairul Alam , Kartik Mittal , Banani Roy , Chanchal Roy

This paper investigates the capabilities of large language models (LLMs) in formulating and solving decision-making problems using mathematical programming. We first conduct a systematic review and meta-analysis of recent literature to…

Artificial Intelligence · Computer Science 2025-08-26 Mohammad J. Abdel-Rahman , Yasmeen Alslman , Dania Refai , Amro Saleh , Malik A. Abu Loha , Mohammad Yahya Hamed