English
Related papers

Related papers: Detecting covariate drift in text data using docum…

200 papers

Theory of convolutional neural networks suggests the property of shift equivariance, i.e., that a shifted input causes an equally shifted output. In practice, however, this is not always the case. This poses a great problem for scene text…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Markus Glitzner , Jan-Hendrik Neudeck , Philipp Härtinger

Concept drift is formally defined as the change in joint distribution of a set of input variables X and a target variable y. The two types of drift that are extensively studied are real drift and virtual drift where the former is the change…

Machine Learning · Computer Science 2019-11-12 Chang How Tan , Vincent CS Lee , Mahsa Salehi

In applied machine learning, concept drift, which is either gradual or abrupt changes in data distribution, can significantly reduce model performance. Typical detection methods,such as statistical tests or reconstruction-based models,are…

Machine Learning · Computer Science 2025-08-12 N Harshit , K Mounvik

Common statistical prediction models often require and assume stationarity in the data. However, in many practical applications, changes in the relationship of the response and predictor variables are regularly observed over time, resulting…

Machine Learning · Statistics 2015-05-05 Heng Wang , Zubin Abraham

With the rapid proliferation of textual data, predicting long texts has emerged as a significant challenge in the domain of natural language processing. Traditional text prediction methods encounter substantial difficulties when grappling…

Computation and Language · Computer Science 2024-01-24 Jiahui Zhao , Ziyi Meng , Stepan Gordeev , Zijie Pan , Dongjin Song , Sandro Steinbach , Caiwen Ding

The notion of concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time; as a consequence machine learning models may become inaccurate and need adjustment. Many unsupervised…

Machine Learning · Computer Science 2022-02-22 Fabian Hinder , Valerie Vaquet , Barbara Hammer

We present a novel deep neural model for text detection in document images. For robust text detection in noisy scanned documents, the advantages of multi-task learning are adopted by adding an auxiliary task of text enhancement. Namely, our…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Eun-Soo Jung , HyeongGwan Son , Kyusam Oh , Yongkeun Yun , Soonhwan Kwon , Min Soo Kim

Concept drift is the phenomenon in which the underlying data distributions and statistical properties of a target domain change over time, leading to a degradation in model performance. Consequently, production models require continuous…

Machine Learning · Computer Science 2025-08-07 Salvatore Greco , Bartolomeo Vacchetti , Daniele Apiletti , Tania Cerquitelli

Text anomaly detection is a critical task in natural language processing (NLP), with applications spanning fraud detection, misinformation identification, spam detection and content moderation, etc. Despite significant advances in large…

Computation and Language · Computer Science 2025-07-17 Feng Xiao , Jicong Fan

Concept drift in learning and classification occurs when the statistical properties of either the data features or target change over time; evidence of drift has appeared in search data, medical research, malware, web data, and video. Drift…

Machine Learning · Computer Science 2019-10-03 Abhijit Suprem

In modern NLP applications, word embeddings are a crucial backbone that can be readily shared across a number of tasks. However as the text distributions change and word semantics evolve over time, the downstream applications using the…

Computation and Language · Computer Science 2022-06-17 Nishtha Madaan , Prateek Chaudhury , Nishant Kumar , Srikanta Bedathur

A trained ML model is deployed on another `test' dataset where target feature values (labels) are unknown. Drift is distribution change between the training and deployment data, which is concerning if model performance changes. For a…

Applications · Statistics 2022-09-07 Samuel Ackerman , Eitan Farchi , Orna Raz , Marcel Zalmanovici , Parijat Dube

Detecting drift in performance of Machine Learning (ML) models is an acknowledged challenge. For ML models to become an integral part of business applications it is essential to detect when an ML model drifts away from acceptable operation.…

Machine Learning · Computer Science 2021-08-12 Samuel Ackerman , Parijat Dube , Eitan Farchi , Orna Raz , Marcel Zalmanovici

Large language model (LLM)-based embedding models, benefiting from large scale pre-training and post-training, have begun to surpass BERT and T5-based models on general-purpose text embedding tasks such as document retrieval. However, a…

Computation and Language · Computer Science 2025-05-22 Siyue Zhang , Yilun Zhao , Liyuan Geng , Arman Cohan , Anh Tuan Luu , Chen Zhao

In Continual Learning (CL) contexts, concept drift typically refers to the analysis of changes in data distribution. A drift in the input data can have negative consequences on a learning predictor and the system's stability. The majority…

Machine Learning · Computer Science 2024-10-23 Sebastian Basterrech

Document comparison typically relies on optical character recognition (OCR) as its core technology. However, OCR requires the selection of appropriate language models for each document and the performance of multilingual or hybrid models…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Doyoung Park , Naresh Reddy Yarram , Sunjin Kim , Minkyu Kim , Seongho Cho , Taehee Lee

Many methods have been proposed to detect concept drift, i.e., the change in the distribution of streaming data, due to concept drift causes a decrease in the prediction accuracy of algorithms. However, the most of current detection methods…

Artificial Intelligence · Computer Science 2021-05-05 Hang Yu , Tianyu Liu , Jie Lu , Guangquan Zhang

When monitoring machine learning systems, two-sample tests of homogeneity form the foundation upon which existing approaches to drift detection build. They are used to test for evidence that the distribution underlying recent deployment…

Machine Learning · Statistics 2022-08-03 Oliver Cobb , Arnaud Van Looveren

The monitoring and management of high-volume feature-rich traffic in large networks offers significant challenges in storage, transmission and computational costs. The predominant approach to reducing these costs is based on performing a…

Machine Learning · Computer Science 2016-06-16 Tingshan Huang , Harish Sethu , Nagarajan Kandasamy

While many real-world data streams imply that they change frequently in a nonstationary way, most of deep learning methods optimize neural networks on training data, and this leads to severe performance degradation when dataset shift…

Machine Learning · Computer Science 2021-07-02 Wonju Lee , Seok-Yong Byun , Jooeun Kim , Minje Park , Kirill Chechil