English
Related papers

Related papers: An Efficient Rubric-based Generative Verifier for …

200 papers

Large Language Models (LLMs) have demonstrated impressive capabilities in complex reasoning tasks, yet they still struggle to reliably verify the correctness of their own outputs. Existing solutions to this verification challenge often…

Computation and Language · Computer Science 2025-06-13 Yuhua Jiang , Yuwen Xiong , Yufeng Yuan , Chao Xin , Wenyuan Xu , Yu Yue , Qianchuan Zhao , Lin Yan

This paper introduces a framework for the automated evaluation of natural language texts. A manually constructed rubric describes how to assess multiple dimensions of interest. To evaluate a text, a large language model (LLM) is prompted…

Computation and Language · Computer Science 2025-01-03 Helia Hashemi , Jason Eisner , Corby Rosset , Benjamin Van Durme , Chris Kedzie

We propose a scalable and cost-efficient framework for deploying Graph-based Retrieval-Augmented Generation (GraphRAG) in enterprise environments. While GraphRAG has shown promise for multi- hop reasoning and structured retrieval, its…

Artificial Intelligence · Computer Science 2025-12-19 Congmin Min , Sahil Bansal , Joyce Pan , Abbas Keshavarzi , Rhea Mathew , Amar Viswanathan Kannan

Large Language Models (LLMs) have demonstrated remarkable creative writing capabilities, yet their substantial computational demands hinder widespread use. Enhancing Small Language Models (SLMs) offers a promising alternative, but current…

Computation and Language · Computer Science 2025-09-01 Xiaolong Wei , Bo Lu , Xingyu Zhang , Zhejun Zhao , Dongdong Shen , Long Xia , Dawei Yin

Deliberative tree search is a cornerstone of modern Large Language Model (LLM) research, driving the pivot from brute-force scaling toward algorithmic efficiency. This single paradigm unifies two critical frontiers: \textbf{Test-Time…

Large language models (LLMs) have demonstrated impressive success in a wide range of natural language processing (NLP) tasks due to their extensive general knowledge of the world. Recent works discovered that the performance of LLMs is…

Computation and Language · Computer Science 2024-11-25 Yuze Liu , Tingjie Liu , Tiehua Zhang , Youhua Xia , Jinze Wang , Zhishu Shen , Jiong Jin , Fei Richard Yu

Large Language Models (LLMs) have demonstrated significant performance improvements across various cognitive tasks. An emerging application is using LLMs to enhance retrieval-augmented generation (RAG) capabilities. These systems require…

Computation and Language · Computer Science 2025-01-28 Satyapriya Krishna , Kalpesh Krishna , Anhad Mohananey , Steven Schwarcz , Adam Stambler , Shyam Upadhyay , Manaal Faruqui

Retrieval-Augmented Generation (RAG) is a technique that enhances the capabilities of large language models (LLMs) by incorporating external knowledge sources. This method addresses common LLM limitations, including outdated information and…

Computation and Language · Computer Science 2024-07-16 Yuanjie Lyu , Zhiyu Li , Simin Niu , Feiyu Xiong , Bo Tang , Wenjin Wang , Hao Wu , Huanyong Liu , Tong Xu , Enhong Chen

Recently, Large Language Models (LLMs) have been increasingly used to support various decision-making tasks, assisting humans in making informed decisions. However, when LLMs confidently provide incorrect information, it can lead humans to…

Information Retrieval · Computer Science 2025-10-16 Chaeyun Jang , Deukhwan Cho , Seanie Lee , Hyungi Lee , Juho Lee

This paper focuses on the dynamic optimization of the Retrieval-Augmented Generation (RAG) architecture. It proposes a state-aware dynamic knowledge retrieval mechanism to enhance semantic understanding and knowledge scheduling efficiency…

Computation and Language · Computer Science 2025-04-29 Jacky He , Guiran Liu , Binrong Zhu , Hanlu Zhang , Hongye Zheng , Xiaokai Wang

Code Search is a key task that many programmers often have to perform while developing solutions to problems. Current methodologies suffer from an inability to perform accurately on prompts that contain some ambiguity or ones that require…

Software Engineering · Computer Science 2024-08-22 Sarthak Jain , Aditya Dora , Ka Seng Sam , Prabhat Singh

Retrieval Augmented Generation (RAG) has proven to be highly effective in boosting the generative performance of language model in knowledge-intensive tasks. However, existing RAG framework either indiscriminately perform retrieval or rely…

Artificial Intelligence · Computer Science 2025-01-03 Xiaqiang Tang , Qiang Gao , Jian Li , Nan Du , Qi Li , Sihong Xie

Recent Retrieval Augmented Generation (RAG) aims to enhance Large Language Models (LLMs) by incorporating extensive knowledge retrieved from external sources. However, such approach encounters some challenges: Firstly, the original queries…

Computation and Language · Computer Science 2024-10-10 Bolei He , Nuo Chen , Xinran He , Lingyong Yan , Zhenkai Wei , Jinchang Luo , Zhen-Hua Ling

Retrieval-Augmented Generation (RAG) enhances the performance of Large Language Models (LLMs) by incorporating external knowledge. However, LLMs still encounter challenges in effectively utilizing the knowledge from retrieved documents,…

Computation and Language · Computer Science 2025-02-26 Mingyan Wu , Zhenghao Liu , Yukun Yan , Xinze Li , Shi Yu , Zheni Zeng , Yu Gu , Ge Yu

Despite the advancements made in Vision Large Language Models (VLLMs), like text Large Language Models (LLMs), they have limitations in addressing questions that require real-time information or are knowledge-intensive. Indiscriminately…

Computation and Language · Computer Science 2025-08-26 Zhuo Chen , Xinyu Wang , Yong Jiang , Zhen Zhang , Xinyu Geng , Pengjun Xie , Fei Huang , Kewei Tu

We introduce our Leanabell-Prover-V2, a 7B large language models (LLMs) that can produce formal theorem proofs in Lean 4, with verifier-integrated Long Chain-of-Thoughts (CoT). Following our previous work Leanabell-Prover-V1, we continual…

Artificial Intelligence · Computer Science 2025-07-14 Xingguang Ji , Yahui Liu , Qi Wang , Jingyuan Zhang , Yang Yue , Rui Shi , Chenxi Sun , Fuzheng Zhang , Guorui Zhou , Kun Gai

Evaluation is fundamental in optimizing search experiences and supporting diverse user intents in Information Retrieval (IR). Traditional search evaluation methods primarily rely on relevance labels, which assess how well retrieved…

Information Retrieval · Computer Science 2025-05-09 Mouly Dewan , Jiqun Liu , Aditya Gautam , Chirag Shah

With the rapid advancement of large language models (LLMs), the diversity of multi-LLM tasks and the variability in their pricing structures have become increasingly important, as costs can vary greatly between different LLMs. To tackle…

Machine Learning · Computer Science 2024-10-03 Xiangxiang Dai , Jin Li , Xutong Liu , Anqi Yu , John C. S. Lui

Generative large language models (LLMs) can be a powerful tool for augmenting text annotation procedures, but their performance varies across annotation tasks due to prompt quality, text data idiosyncrasies, and conceptual difficulty.…

Computation and Language · Computer Science 2023-06-02 Nicholas Pangakis , Samuel Wolken , Neil Fasching

Natural Language Processing and Generation systems have recently shown the potential to complement and streamline the costly and time-consuming job of professional fact-checkers. In this work, we lift several constraints of current…

Computation and Language · Computer Science 2025-10-30 Daniel Russo , Stefano Menini , Jacopo Staiano , Marco Guerini