English

CRCL at SemEval-2024 Task 2: Simple prompt optimizations

Computation and Language 2024-05-06 v1

Abstract

We present a baseline for the SemEval 2024 task 2 challenge, whose objective is to ascertain the inference relationship between pairs of clinical trial report sections and statements. We apply prompt optimization techniques with LLM Instruct models provided as a Language Model-as-a-Service (LMaaS). We observed, in line with recent findings, that synthetic CoT prompts significantly enhance manually crafted ones.

Keywords

Cite

@article{arxiv.2405.01942,
  title  = {CRCL at SemEval-2024 Task 2: Simple prompt optimizations},
  author = {Clément Brutti-Mairesse and Loïc Verlingue},
  journal= {arXiv preprint arXiv:2405.01942},
  year   = {2024}
}
R2 v1 2026-06-28T16:15:17.337Z