English

WorkRB: A Community-Driven Evaluation Framework for AI in the Work Domain

Computation and Language 2026-04-16 v1 Artificial Intelligence

Abstract

Today's evolving labor markets rely increasingly on recommender systems for hiring, talent management, and workforce analytics, with natural language processing (NLP) capabilities at the core. Yet, research in this area remains highly fragmented. Studies employ divergent ontologies (ESCO, O*NET, national taxonomies), heterogeneous task formulations, and diverse model families, making cross-study comparison and reproducibility exceedingly difficult. General-purpose benchmarks lack coverage of work-specific tasks, and the inherent sensitivity of employment data further limits open evaluation. We present \textbf{WorkRB} (Work Research Benchmark), the first open-source, community-driven benchmark tailored to work-domain AI. WorkRB organizes 13 diverse tasks from 7 task groups as unified recommendation and NLP tasks, including job/skill recommendation, candidate recommendation, similar item recommendation, and skill extraction and normalization. WorkRB enables both monolingual and cross-lingual evaluation settings through dynamic loading of multilingual ontologies. Developed within a multi-stakeholder ecosystem of academia, industry, and public institutions, WorkRB has a modular design for seamless contributions and enables integration of proprietary tasks without disclosing sensitive data. WorkRB is available under the Apache 2.0 license at https://github.com/techwolf-ai/WorkRB.

Keywords

Cite

@article{arxiv.2604.13055,
  title  = {WorkRB: A Community-Driven Evaluation Framework for AI in the Work Domain},
  author = {Matthias De Lange and Warre Veys and Federico Retyk and Daniel Deniz and Warren Jouanneau and Mike Zhang and Aleksander Bielinski and Emma Jouffroy and Nicole Clobes and Nina Baranowska and David Graus and Marc Palyart and Rabih Zbib and Dimitra Gkatzia and Thomas Demeester and Tijl De Bie and Toine Bogers and Jens-Joris Decorte and Jeroen Van Hautte},
  journal= {arXiv preprint arXiv:2604.13055},
  year   = {2026}
}

Comments

Community paper preprint

R2 v1 2026-07-01T12:09:22.312Z