Computation and Language · Computer Science
Benchmarking Cognitive Domains for LLMs: Insights from Taiwanese Hakka Culture
Chen-Chi Chang, Ching-Yuan Chen, Hung-Shin Lee, Chih-Cheng Lee
2024-09-26
Computation and Language · Computer Science
KBM: Delineating Knowledge Boundary for Adaptive Retrieval in Large Language Models
Zhen Zhang, Xinyu Wang, Yong Jiang, Zile Qiao +6
2025-09-18
Computation and Language · Computer Science
Benchmarking Large Language Models in Retrieval-Augmented Generation
Jiawei Chen, Hongyu Lin, Xianpei Han, Le Sun
2023-12-21
Computation and Language · Computer Science
DomainRAG: A Chinese Benchmark for Evaluating Domain-specific Retrieval-Augmented Generation
Shuting Wang, Jiongnan Liu, Shiren Song, Jiehan Cheng +5
2024-06-18
Computation and Language · Computer Science
Retrieval Augmented Generation Evaluation in the Era of Large Language Models: A Comprehensive Survey
Aoran Gan, Hao Yu, Kai Zhang, Qi Liu +4
2025-04-22
Computation and Language · Computer Science
PRGB Benchmark: A Robust Placeholder-Assisted Algorithm for Benchmarking Retrieval-Augmented Generation
Zhehao Tan, Yihan Jiao, Dan Yang, Lei Liu +6
2025-08-01
Computation and Language · Computer Science
Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving
Yuxuan Zhou, Xien Liu, Chenwei Yan, Chen Ning +7
2025-06-11
Computation and Language · Computer Science
Knowledge-Graph Based RAG System Evaluation Framework
Sicheng Dong, Vahid Zolfaghari, Nenad Petrovic, Alois Knoll
2025-10-06
Computation and Language · Computer Science
CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models
Yuanjie Lyu, Zhiyu Li, Simin Niu, Feiyu Xiong +6
2024-07-16
Computation and Language · Computer Science
RAG over Tables: Hierarchical Memory Index, Multi-Stage Retrieval, and Benchmarking
Jiaru Zou, Dongqi Fu, Sirui Chen, Xinrui He +4
2025-10-07
Machine Learning · Computer Science
Towards Knowledge Checking in Retrieval-augmented Generation: A Representation Perspective
Shenglai Zeng, Jiankun Zhang, Bingheng Li, Yuping Lin +8
2024-11-25
Computation and Language · Computer Science
KoLA: Carefully Benchmarking World Knowledge of Large Language Models
Jifan Yu, Xiaozhi Wang, Shangqing Tu, Shulin Cao +31
2024-07-02
Computation and Language · Computer Science
Retrieval-Augmented Generation for Large Language Models: A Survey
Yunfan Gao, Yun Xiong, Xinyu Gao, Kangxiang Jia +6
2024-03-28
Computation and Language · Computer Science
BERGEN: A Benchmarking Library for Retrieval-Augmented Generation
David Rau, Hervé Déjean, Nadezhda Chirkova, Thibault Formal +3
2024-07-02
Computation and Language · Computer Science
Evaluating and Improving Cultural Awareness of Reward Models for LLM Alignment
Hongbin Zhang, Kehai Chen, Xuefeng Bai, Yang Xiang +1
2025-10-27
Computation and Language · Computer Science
Towards Geo-Culturally Grounded LLM Generations
Piyawat Lertvittayakumjorn, David Kinney, Vinodkumar Prabhakaran, Donald Martin +1
2025-07-17
Computation and Language · Computer Science
RAGCap-Bench: Benchmarking Capabilities of LLMs in Agentic Retrieval Augmented Generation Systems
Jingru Lin, Chen Zhang, Stephen Y. Liu, Haizhou Li
2026-05-22
Information Retrieval · Computer Science
mmRAG: A Modular Benchmark for Retrieval-Augmented Generation over Text, Tables, and Knowledge Graphs
Chuan Xu, Qiaosheng Chen, Yutong Feng, Gong Cheng
2025-05-19
Computation and Language · Computer Science
Enhancing Low-Resource Minority Language Translation with LLMs and Retrieval-Augmented Generation for Cultural Nuances
Chen-Chi Chang, Chong-Fu Li, Chu-Hsuan Lee, Hung-Shin Lee
2025-05-19
Computation and Language · Computer Science
Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generation
Satyapriya Krishna, Kalpesh Krishna, Anhad Mohananey, Steven Schwarcz +3
2025-01-28
Computation and Language · Computer Science
Enhancing Large Language Models (LLMs) for Telecommunications using Knowledge Graphs and Retrieval-Augmented Generation
Dun Yuan, Hao Zhou, Di Wu, Xue Liu +4
2025-05-22
Computation and Language · Computer Science
INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge
Angelika Romanou, Negar Foroutan, Anna Sotnikova, Zeming Chen +55
2024-12-02
Information Retrieval · Computer Science
Optimizing and Evaluating Enterprise Retrieval-Augmented Generation (RAG): A Content Design Perspective
Sarah Packowski, Inge Halilovic, Jenifer Schlotfeldt, Trish Smith
2024-10-18