English
Related papers

Related papers: Optimizing Multi-Stage Language Models for Effecti…

200 papers

We present a hybrid multi-phase page matching algorithm for automated comparison of Japanese building permit document sets. Building permit review in Japan requires cross-referencing large PDF document sets across revision cycles, a process…

Computation and Language · Computer Science 2026-04-23 Mitsumasa Wada

Large Language Models (LLMs) have demonstrated remarkable capabilities across numerous tasks, yet they often rely on external context to handle complex tasks. While retrieval-augmented frameworks traditionally focus on selecting top-ranked…

Computation and Language · Computer Science 2025-04-16 Quanyu Long , Jianda Chen , Zhengyuan Liu , Nancy F. Chen , Wenya Wang , Sinno Jialin Pan

Providing example sentences that are diverse and aligned with learners' proficiency levels is essential for fostering effective language acquisition. This study examines the use of Pre-trained Language Models (PLMs) to produce example…

Computation and Language · Computer Science 2025-06-05 Enrico Benedetti , Akiko Aizawa , Florian Boudin

Fine-tuning of Large Language Models (LLMs) for downstream tasks, performed on domain-specific data has shown significant promise. However, commercial use of such LLMs is limited by the high computational cost required for their deployment…

Computation and Language · Computer Science 2025-03-06 Boris Nazarov , Darya Frolova , Yackov Lubarsky , Alexei Gaissinski , Pavel Kisilev

Recently, there have been significant advances in neural methods for tackling knowledge-intensive tasks such as open domain question answering (QA). These advances are fueled by combining large pre-trained language models with learnable…

Computation and Language · Computer Science 2021-04-21 Hengxin Fun , Sunil Gandhi , Sujith Ravi

This article aims to provide the information retrieval community with some reflections on recent advances in retrieval learning by analyzing the reproducibility of image-text retrieval models. Due to the increase of multimodal data over the…

Information Retrieval · Computer Science 2022-08-30 Jun Rao , Fei Wang , Liang Ding , Shuhan Qi , Yibing Zhan , Weifeng Liu , Dacheng Tao

Efficiently reranking documents retrieved from information retrieval (IR) pipelines to enhance overall quality of Retrieval-Augmented Generation (RAG) system remains an important yet challenging problem. Recent studies have highlighted the…

Computation and Language · Computer Science 2025-11-12 Jingyu Wu , Aditya Shrivastava , Jing Zhu , Alfy Samuel , Anoop Kumar , Daben Liu

In enterprise settings, efficiently retrieving relevant information from large and complex knowledge bases is essential for operational productivity and informed decision-making. This research presents a systematic empirical framework for…

We introduce an advanced information extraction pipeline to automatically process very large collections of unstructured textual data for the purpose of investigative journalism. The pipeline serves as a new input processor for the upcoming…

Computation and Language · Computer Science 2018-09-17 Gregor Wiedemann , Seid Muhie Yimam , Chris Biemann

Neural information retrieval systems typically use a cascading pipeline, in which a first-stage model retrieves a candidate set of documents and one or more subsequent stages re-rank this set using contextualized language models such as…

Information Retrieval · Computer Science 2021-04-27 Antonio Mallia , Omar Khattab , Nicola Tonellotto , Torsten Suel

Text-based retrieval of Computer-Aided Design (CAD) models is a critical yet underexplored task for the reuse of legacy industrial designs. Existing CAD repositories are typically searched using filenames or directories, which limits the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Honghu Pan , Zibo Du , Daxiang Liu , Chengliang Liu , Xiaoling Luo

The rapid increase in unstructured data across various fields has made multi-document comprehension and summarization a critical task. Traditional approaches often fail to capture relevant context, maintain logical consistency, and extract…

Computation and Language · Computer Science 2024-09-30 Aditi Godbole , Jabin Geevarghese George , Smita Shandilya

Generative retrieval, which is a new advanced paradigm for document retrieval, has recently attracted research interests, since it encodes all documents into the model and directly generates the retrieved documents. However, its power is…

Information Retrieval · Computer Science 2023-10-31 Tianchi Yang , Minghui Song , Zihan Zhang , Haizhen Huang , Weiwei Deng , Feng Sun , Qi Zhang

Data efficiency, despite being an attractive characteristic, is often challenging to measure and optimize for in task-oriented semantic parsing; unlike exact match, it can require both model- and domain-specific setups, which have,…

Computation and Language · Computer Science 2021-07-13 Shrey Desai , Akshat Shrivastava , Justin Rill , Brian Moran , Safiyyah Saleem , Alexander Zotov , Ahmed Aly

Investigative journalists routinely confront large document collections. Large language models (LLMs) with retrieval-augmented generation (RAG) capabilities promise to accelerate the process of document discovery, but newsroom adoption…

Information Retrieval · Computer Science 2025-10-01 Nick Hagar , Nicholas Diakopoulos , Jeremy Gilbert

Multimodal Large Language Models (MLLMs) have seen rapid advances in recent years and are now being applied to visual document understanding tasks. They are expected to process a wide range of document images across languages, including…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Keito Sasagawa , Shuhei Kurita , Daisuke Kawahara

Dense retrieval systems increasingly need to handle complex queries. In many realistic settings, users express intent through long instructions or task-specific descriptions, while target documents remain relatively simple and static. This…

Information Retrieval · Computer Science 2026-04-07 Seiji Maekawa , Moin Aminnaseri , Pouya Pezeshkpour , Estevam Hruschka

Scene text retrieval aims to localize and search all text instances from an image gallery, which are the same or similar to a given query text. Such a task is usually realized by matching a query text to the recognized words, outputted by…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Hao Wang , Xiang Bai , Mingkun Yang , Shenggao Zhu , Jing Wang , Wenyu Liu

Information retrieval systems are crucial for enabling effective access to large document collections. Recent approaches have leveraged Large Language Models (LLMs) to enhance retrieval performance through query augmentation, but often rely…

Information Retrieval · Computer Science 2025-04-15 Pengcheng Jiang , Jiacheng Lin , Lang Cao , Runchu Tian , SeongKu Kang , Zifeng Wang , Jimeng Sun , Jiawei Han

The ability to understand and answer questions over documents can be useful in many business and practical applications. However, documents often contain lengthy and diverse multimodal contents such as texts, figures, and tables, which are…

Computation and Language · Computer Science 2024-11-12 Yew Ken Chia , Liying Cheng , Hou Pong Chan , Chaoqun Liu , Maojia Song , Sharifah Mahani Aljunied , Soujanya Poria , Lidong Bing