English

Detecting Structured Language Alternations in Historical Documents by Combining Language Identification with Fourier Analysis

Computation and Language 2024-01-29 v1
Authors: Hale Sirin , Sabrina Li , Tom Lippincott
View on arXiv ↗ PDF ↗

Abstract

In this study, we present a generalizable workflow to identify documents in a historic language with a nonstandard language and script combination, Armeno-Turkish. We introduce the task of detecting distinct patterns of multilinguality based on the frequency of structured language alternations within a document.

Cite

@article{arxiv.2401.14569,
  title  = {Detecting Structured Language Alternations in Historical Documents by Combining Language Identification with Fourier Analysis},
  author = {Hale Sirin and Sabrina Li and Tom Lippincott},
  journal= {arXiv preprint arXiv:2401.14569},
  year   = {2024}
}

Comments

Accepted to LaTeCH@EACL2024

Related papers

View all related →
Artificial Intelligence · Computer Science
Identification of arabic word from bilingual text using character features
Sofiene Haboubi, Samia Maddouri, Hamid Amiri
2012-04-05
Computation and Language · Computer Science
Detecting Turkish Synonyms Used in Different Time Periods
Umur Togay Yazar, Mucahid Kutlu
2024-11-26
Computation and Language · Computer Science
Language Lexicons for Hindi-English Multilingual Text Processing
Mohd Zeeshan Ansari, Tanvir Ahmad, Noaima Bari
2021-06-30
Computation and Language · Computer Science
Multilingual person name recognition and transliteration
Bruno Pouliquen, Ralf Steinberger, Camelia Ignat, Irina Temnikova +3
2007-05-23
Computation and Language · Computer Science
LanideNN: Multilingual Language Identification on Character Window
Tom Kocmi, Ondřej Bojar
2017-08-01
Computation and Language · Computer Science
UPV at CheckThat! 2021: Mitigating Cultural Differences for Identifying Multilingual Check-worthy Claims
Ipek Baris Schlicht, Angel Felipe Magnossão de Paula, Paolo Rosso
2021-09-21
Computation and Language · Computer Science
Detecting Structural Irregularity in Electronic Dictionaries Using Language Modeling
Paul Rodrigues, David Zajic, David Doermann, Michael Bloodgood +1
2016-02-18
Computation and Language · Computer Science
Automatic Identification of Document Translations in Large Multilingual Document Collections
Bruno Pouliquen, Ralf Steinberger, Camelia Ignat
2007-05-23
Computation and Language · Computer Science
ARC-NLP at PAN 2023: Transition-Focused Natural Language Inference for Writing Style Detection
Izzet Emre Kucukkaya, Umitcan Sahin, Cagri Toraman
2023-07-28
Computer Vision and Pattern Recognition · Computer Science
Font Identification in Historical Documents Using Active Learning
Anshul Gupta, Ricardo Gutierrez-Osuna, Matthew Christy, Richard Furuta +1
2016-01-28
Computation and Language · Computer Science
Detecting Latin in Historical Books with Large Language Models: A Multimodal Benchmark
Yu Wu, Ke Shu, Jonas Fischer, Lidia Pivovarova +3
2026-02-09
Computation and Language · Computer Science
ATLANTIC: Structure-Aware Retrieval-Augmented Language Model for Interdisciplinary Science
Sai Munikoti, Anurag Acharya, Sridevi Wagle, Sameera Horawalavithana
2023-11-22
Computation and Language · Computer Science
Challenges Encountered in Turkish Natural Language Processing Studies
Kadir Tohma, Yakup Kutlu
2021-01-28
Applications · Statistics
Statistical Properties of European Languages and Voynich Manuscript Analysis
Andronik Arutyunov, Leonid Borisov, Sergey Fedorov, Anastasiya Ivchenko +5
2016-11-29
Information Retrieval · Computer Science
Lost in Transliteration: Bridging the Script Gap in Neural IR
Andreas Chari, Iadh Ounis, Sean MacAvaney
2025-05-14
Computation and Language · Computer Science
Exploring Linguistic Features for Turkish Text Readability
Ahmet Yavuz Uluslu, Gerold Schneider
2025-09-05
Programming Languages · Computer Science
Applying static code analysis to firewall policies for the purpose of anomaly detection
Vadim Zaliva
2011-02-08
Computation and Language · Computer Science
Detecting Text Formality: A Study of Text Classification Approaches
Daryna Dementieva, Nikolay Babakov, Alexander Panchenko
2023-09-11
Computation and Language · Computer Science
Exploiting multilingual nomenclatures and language-independent text features as an interlingua for cross-lingual text analysis applications
Ralf Steinberger, Bruno Pouliquen, Camelia Ignat
2007-05-23
Computer Vision and Pattern Recognition · Computer Science
MDIW-13: a New Multi-Lingual and Multi-Script Database and Benchmark for Script Identification
Miguel A. Ferrer, Abhijit Das, Moises Diaz, Aythami Morales +2
2024-05-30
Digital Libraries · Computer Science
Structuring Authenticity Assessments on Historical Documents using LLMs
Andrea Schimmenti, Valentina Pasqual, Francesca Tomasi, Fabio Vitali +1
2024-07-15
Computation and Language · Computer Science
Automatic Language Identification in Texts: A Survey
Tommi Jauhiainen, Marco Lui, Marcos Zampieri, Timothy Baldwin +1
2018-11-22
Computer Vision and Pattern Recognition · Computer Science
Classifying Fonts and Calligraphy Styles Using Complex Wavelet Transform
Alican Bozkurt, Pinar Duygulu, A. Enis Cetin
2014-07-11
Information Retrieval · Computer Science
Cross-Lingual Document Retrieval with Smooth Learning
Jiapeng Liu, Xiao Zhang, Dan Goldwasser, Xiao Wang
2020-11-03
Computation and Language · Computer Science
Reliable Detection and Quantification of Selective Forces in Language Change
Juan Guerrero Montero, Andres Karjus, Kenny Smith, Richard A. Blythe
2023-08-22
R2 v1 2026-06-28T14:27:40.558Z