DialogPII: A multilingual dataset of synthetic dialog transcripts to detect personal information
Abstract
Conversational data collected in domains such as healthcare or social sciences is a valuable resource for research and automated analysis. However, responsible data sharing requires the detection and removal of personally identifiable and sensitive information to protect individual privacy. To support the development and evaluation of automatic de-identification systems, we present DialogPII, a multilingual dataset of synthetic dialogs and speech-derived transcripts for personal information detection. DialogPII covers eight interaction scenarios (emergency calls, medical anamnesis interviews, therapy sessions, insurance communication, customer support, clinical interviews regarding an AI-supported dashboard, police reports, and group therapy discussions), 19 entity types, and 11 languages (English, Arabic, Finnish, French, German, Hindi, Italian, Polish, Portuguese, Spanish, and Turkish). Dialogs were generated semi-automatically using large language models, manually curated for plausibility and diversity, and localized to country- and city-specific contexts. All dialogs were additionally converted to speech via text-to-speech synthesis, transcribed with Whisper, and annotated through automatic projection and manual correction, yielding aligned written and speech-derived resources across all languages. We further release baseline multilingual named entity recognition models and provide technical validation through inter-annotator agreement analysis, translation quality evaluation, annotation projection assessment, and benchmark experiments with transformer-based sequence labeling models.
Keywords
Cite
@article{arxiv.2606.30312,
title = {DialogPII: A multilingual dataset of synthetic dialog transcripts to detect personal information},
author = {Roland Roller and Vera Czehmann and Derya Erman and Luke Flanagan and Ibrahim Baroud and Frédéric Blain and Viviana Cotik and Eletta Giusto and Akhil Juneja and Mariana Neves and Maria Słowińska and Christine Hovhannisyan and Aaron Louis Eidt and Lisa Raithel and Sebastian Möller and Maija Poikela},
journal= {arXiv preprint arXiv:2606.30312},
year = {2026}
}
Comments
currently under review