English

Logic-Oriented Retriever Enhancement via Contrastive Learning

Computation and Language 2026-02-03 v1

Abstract

Large language models (LLMs) struggle in knowledge-intensive tasks, as retrievers often overfit to surface similarity and fail on queries involving complex logical relations. The capacity for logical analysis is inherent in model representations but remains underutilized in standard training. LORE (Logic ORiented Retriever Enhancement) introduces fine-grained contrastive learning to activate this latent capacity, guiding embeddings toward evidence aligned with logical structure rather than shallow similarity. LORE requires no external upervision, resources, or pre-retrieval analysis, remains index-compatible, and consistently improves retrieval utility and downstream generation while maintaining efficiency. The datasets and code are publicly available at https://github.com/mazehart/Lore-RAG.

Keywords

Cite

@article{arxiv.2602.01116,
  title  = {Logic-Oriented Retriever Enhancement via Contrastive Learning},
  author = {Wenxuan Zhang and Yuan-Hao Jiang and Changyong Qi and Rui Jia and Yonghe Wu},
  journal= {arXiv preprint arXiv:2602.01116},
  year   = {2026}
}

Comments

accepted by icassp 2026

R2 v1 2026-07-01T09:30:02.072Z