English
Related papers

Related papers: MDKeyChunker: Single-Call LLM Enrichment with Roll…

200 papers

The inception of Large Language Models (LLMs) has catalyzed AI adoption in the finance sector, yet their reliability in complex, jurisdiction-specific tasks like Indian Chartered Accountancy (CA) remains limited. The models display…

Computation and Language · Computer Science 2026-05-04 Jatin Gupta , Akhil Sharma , Saransh Singhania , Ali Imam Abidi

Recent studies show that large language models (LLMs) struggle with technical standards in telecommunications. We propose a fine-tuned retrieval-augmented generation (RAG) system based on the Phi-2 small language model (SLM) to serve as an…

Computation and Language · Computer Science 2025-01-17 Omar Erak , Nouf Alabbasi , Omar Alhussein , Ismail Lotfi , Amr Hussein , Sami Muhaidat , Merouane Debbah

Large Language Models (LLMs) for code generation evolve rapidly through fine-tuning, merging, or new model releases. However, such updates can introduce regressions, not only in correctness but also in code quality and performance. To…

Software Engineering · Computer Science 2025-07-28 Altaf Allah Abbassi , Leuson Da Silva , Amin Nikanjam , Foutse Khomh

Candidate sourcing for recruiters is best viewed as a two-stage retrieval and reranking pipeline with recall as the primary objective under a limited review budget. An upstream production retriever first returns a candidate shortlist for…

Computation and Language · Computer Science 2026-04-21 Zhaohua Liang , Zhilin Wang , Renjie Cao , Yining Zhang

Large Language Models (LLMs) excel in data synthesis but can be inaccurate in domain-specific tasks, which retrieval-augmented generation (RAG) systems address by leveraging user-provided data. However, RAGs require optimization in both…

Computation and Language · Computer Science 2024-11-05 Kazi Ahmed Asif Fuad , Lizhong Chen

Large language models (LLMs) can face factual limitations when responding to time-sensitive queries about recent events that arise after their knowledge thresholds in the training corpus. Existing search-augmented approaches fall into two…

Information Retrieval · Computer Science 2025-06-11 Wentao Shi , Yiqing Shen

Systematic reviews and meta-analyses rely on converting narrative articles into structured, numerically grounded study records. Despite rapid advances in large language models (LLMs), it remains unclear whether they can meet the structural…

Computation and Language · Computer Science 2026-02-12 Zhiyin Tan , Jennifer D'Souza

With the rapid growth in the size and complexity of large language models (LLMs), the costs associated with their training and inference have escalated significantly. Research indicates that certain layers in LLMs harbor substantial…

Computation and Language · Computer Science 2025-05-23 Longguang Zhong , Fanqi Wan , Ruijun Chen , Xiaojun Quan , Liangzhi Li

Retrieval-Augmented Generation (RAG) systems using Multimodal Large Language Models (MLLMs) show great promise for complex document understanding, yet their development is critically hampered by inadequate evaluation. Current benchmarks…

Computation and Language · Computer Science 2025-08-06 Wenxuan Shen , Mingjia Wang , Yaochen Wang , Dongping Chen , Junjie Yang , Yao Wan , Weiwei Lin

Extracting structured information from clinical notes requires navigating a dense web of interdependent variables where the value of one attribute logically constrains others. Existing Large Language Model (LLM)-based extraction pipelines…

At the core of Deep Research is knowledge mining, the task of extracting structured information from massive unstructured text in response to user instructions. Large language models (LLMs) excel at interpreting such instructions but are…

Artificial Intelligence · Computer Science 2025-10-16 Sipeng Zhang , Longfei Yun , Zilong Wang , Jingbo Shang , Letian Peng

Prompt compression methods enhance the efficiency of Large Language Models (LLMs) and minimize the cost by reducing the length of input context. The goal of prompt compression is to shorten the LLM prompt while maintaining a high generation…

Computation and Language · Computer Science 2025-08-25 Tinghui Zhang , Yifan Wang , Daisy Zhe Wang

This paper investigates chunking strategies for retrieval-augmented generation on German statutory law, using the German Civil Code as a structured benchmark corpus. We implement and compare a range of segmentation approaches, including…

Computation and Language · Computer Science 2026-05-20 Max Prior , Natalia Milanova , Andreas Schultz

Large language models (LLMs) have recently shown strong potential for ranking by capturing semantic relevance and adapting across diverse domains, yet existing methods remain constrained by limited context length and high computational…

Information Retrieval · Computer Science 2026-05-28 Tao Feng , Zijie Lei , Zhigang Hua , Yan Xie , Shuang Yang , Ge Liu , Jiaxuan You

Corporate credit underwriting requires analysts to extract actionable evidence from long, heterogeneous financial documents spanning hundreds of pages and multiple languages. Standard Retrieval-Augmented Generation (RAG) pipelines optimize…

Computation and Language · Computer Science 2026-05-21 Linus Ng Junjia , Ezekiel Tee Kongquan , Kelvin Heng , Kenneth Zhu Ke , Zhao Jing Yuan

A Retrieval-Augmented Generation (RAG) model powered by a large language model (LLM) provides a faster and more cost-effective solution for adapting to new data and knowledge. It also delivers more specialized responses compared to…

Computation and Language · Computer Science 2025-01-29 Zheng Zheng , Xinyi Ni , Pengyu Hong

Applying LLMs to complex industrial processes remains challenging due to the semantic gap between natural language design intents and the rigorous physical logic of engineering. In the field of petroleum refining engineering, a critical…

Computational Engineering, Finance, and Science · Computer Science 2026-05-20 Dongxiao Liu , Yuwen Ding , Xinghai Wei , Jiacheng Ji , Lei Li , Linghui Li , Xiaoyong Li

Retrieval augmented generation (RAG) pipelines are commonly used in tasks such as question-answering (QA), relying on retrieving relevant documents from a vector store computed using a pretrained embedding model. However, if the retrieved…

Computation and Language · Computer Science 2024-10-18 Ambuje Gupta , Mrinal Rawat , Andreas Stolcke , Roberto Pieraccini

The versatility of large language models (LLMs) has been explored across various sectors, but their application in healthcare poses challenges, particularly in the domain of pharmaceutical contraindications where accurate and reliable…

Artificial Intelligence · Computer Science 2025-08-11 Byeonghun Bang , Jongsuk Yoon , Dong-Jin Chang , Seho Park , Yong Oh Lee

Modern retrieval pipelines increasingly serve downstream consumers like retrieval-augmented generation (RAG) and autonomous agents that need more than a scalar relevance score. A reranker that only tells the caller "how relevant" forces the…

Information Retrieval · Computer Science 2026-04-28 Dun Zhang