English
Related papers

Related papers: A RAG Method for Source Code Inquiry Tailored to L…

200 papers

Recent advancements in Large Vision Language Models (LVLMs) have significantly improved performance in Visual Question Answering (VQA) tasks through multimodal Retrieval-Augmented Generation (RAG). However, existing methods still face…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Qi Yang , Chenghao Zhang , Lubin Fan , Kun Ding , Jieping Ye , Shiming Xiang

Deep learning models have been successfully applied to a variety of software engineering tasks, such as code classification, summarisation, and bug and vulnerability detection. In order to apply deep learning to these tasks, source code…

Software Engineering · Computer Science 2022-08-02 Fuwei Tian , Christoph Treude

Software systems usually provide numerous configuration options that can affect performance metrics such as execution time, memory usage, binary size, or bitrate. On the one hand, making informed decisions is challenging and requires domain…

This study applies Large Language Models (LLMs) to two foundational Electronic Health Record (EHR) data science tasks: structured data querying (using programmatic languages, Python/Pandas) and information extraction from unstructured…

Computation and Language · Computer Science 2026-01-29 Juan Jose Rubio Jan , Jack Wu , Julia Ive

Large Language Models (LLMs) have demonstrated remarkable performance in various tasks and gained significant attention. LLMs are also used for local sequence transduction tasks, including grammatical error correction (GEC) and formality…

Computation and Language · Computer Science 2023-10-24 Masahiro Kaneko , Naoaki Okazaki

In retrieval-augmented generation (RAG) question answering systems, generating citations for large language model (LLM) outputs enhances verifiability and helps users identify potential hallucinations. However, we observe two problems in…

Computation and Language · Computer Science 2025-10-21 Guo Chen , Qiuyuan Li , Qiuxian Li , Hongliang Dai , Xiang Chen , Piji Li

We address the task of evidence retrieval for long document question answering, which involves locating relevant paragraphs within a document to answer a question. We aim to assess the applicability of large language models (LLMs) in the…

Computation and Language · Computer Science 2023-11-23 Inderjeet Nair , Shwetha Somasundaram , Apoorv Saxena , Koustava Goswami

Retrieval-augmented generation (RAG) systems have been widely adopted in contemporary large language models (LLMs) due to their ability to improve generation quality while reducing the required input context length. In this work, we focus…

Computation and Language · Computer Science 2026-04-07 Tianyi Zhang , Andreas Marfurt

Large language models (LLMs) have shown promise in medical question answering but often struggle with hallucinations and shallow reasoning, particularly in tasks requiring nuanced clinical understanding. Retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2025-08-25 Ziyu Wang , Elahe Khatibi , Amir M. Rahmani

The advent of Large Language Models (LLMs) has significantly advanced the field of automated code generation. LLMs rely on large and diverse datasets to learn syntax, semantics, and usage patterns of programming languages. For low-resource…

Software Engineering · Computer Science 2025-02-03 Alessandro Giagnorio , Alberto Martin-Lopez , Gabriele Bavota

Biomedical question answering (QA) poses significant challenges due to the need for precise interpretation of specialized knowledge drawn from a vast, complex, and rapidly evolving corpus. In this work, we explore how large language models…

Computation and Language · Computer Science 2025-09-11 Dima Galat , Diego Molla-Aliod

Recent advances have been improving the context windows of Large Language Models (LLMs). To quantify the real long-context capabilities of LLMs, evaluators such as the popular Needle in a Haystack have been developed to test LLMs over a…

Software Engineering · Computer Science 2024-06-11 Jiawei Liu , Jia Le Tian , Vijay Daita , Yuxiang Wei , Yifeng Ding , Yuhan Katherine Wang , Jun Yang , Lingming Zhang

Retrieval-augmented generation (RAG) has demonstrated significant proficiency in conducting question-answering (QA) tasks within a specified corpus. Nonetheless, numerous failure instances of RAG in QA still exist. These failures are not…

Machine Learning · Computer Science 2025-06-09 Jintao Zhang , Guoliang Li , Jinyang Su

The integration of large language models (LLMs) into education offers significant potential to enhance accessibility and engagement, yet their high computational demands limit usability in low-resource settings, exacerbating educational…

Computers and Society · Computer Science 2025-10-09 Juan Segundo Hevia , Facundo Arredondo , Vishesh Kumar

Large language models (LLMs) are being increasingly integrated into legal applications, including judicial decision support, legal practice assistance, and public-facing legal services. While LLMs show strong potential in handling legal…

In the short period since the release of ChatGPT, large language models (LLMs) have changed the software engineering research landscape. While there are numerous opportunities to use LLMs for supporting research or software engineering…

Software Engineering · Computer Science 2025-02-05 Stefan Wagner , Marvin Muñoz Barón , Davide Falessi , Sebastian Baltes

Large language models (LLMs) increasingly solve difficult problems by producing "reasoning traces" before emitting a final response. However, it remains unclear how accuracy and decision commitment evolve along a reasoning trajectory, and…

Machine Learning · Computer Science 2026-02-02 Marthe Ballon , Brecht Verbeken , Vincent Ginis , Andres Algaba

Large Language Models (LLMs) are starting to be profiled as one of the most significant disruptions in the Software Testing field. Specifically, they have been successfully applied in software testing tasks such as generating test code, or…

Software Engineering · Computer Science 2025-09-30 Cristian Augusto , Antonia Bertolino , Guglielmo De Angelis , Francesca Lonetti , Jesús Morán

The recent advent of powerful Large-Language Models (LLM) provides a new conversational form of inquiry into historical memory (or, training data, in this case). We show that by augmenting such LLMs with vector embeddings from highly…

Information Retrieval · Computer Science 2023-10-18 Giselle Gonzalez Garcia , Christian Weilbach

Large Language Models (LLMs) have achieved remarkable success across a wide range of natural language tasks, and recent efforts have sought to extend their capabilities to multimodal domains and resource-constrained environments. However,…

Machine Learning · Computer Science 2025-05-26 Yun-Da Tsai