English
Related papers

Related papers: Detecting covariate drift in text data using docum…

200 papers

The reliability and proper function of data-driven applications hinge on the data's continued conformance to the applications' initial design. When data deviates from this initial profile, system behavior becomes unpredictable. Data…

Databases · Computer Science 2021-01-05 Anna Fariha , Ashish Tiwari , Arjun Radhakrishna , Sumit Gulwani , Alexandra Meliou

Deploying robust machine learning models has to account for concept drifts arising due to the dynamically changing and non-stationary nature of data. Addressing drifts is particularly imperative in the security domain due to the…

Cryptography and Security · Computer Science 2022-06-16 Aditya Kuppa , Nhien-An Le-Khac

Text embedding models enable semantic search, powering several NLP applications like Retrieval Augmented Generation by efficient information retrieval (IR). However, text embedding models are commonly studied in scenarios where the training…

Information Retrieval · Computer Science 2025-10-07 Dipam Goswami , Liying Wang , Bartłomiej Twardowski , Joost van de Weijer

In our digital universe nowadays, enormous amount of data are produced in a streaming manner in a variety of application areas. These data are often unlabelled. In this case, identifying infrequent events, such as anomalies, poses a great…

Machine Learning · Computer Science 2023-09-07 Jin Li , Kleanthis Malialis , Marios M. Polycarpou

In the covariate shift learning scenario, the training and test covariate distributions differ, so that a predictor's average loss over the training and test distributions also differ. In this work, we explore the potential of extreme…

Machine Learning · Computer Science 2018-03-13 Fulton Wang , Cynthia Rudin

Classifying streaming data requires the development of methods which are computationally efficient and able to cope with changes in the underlying distribution of the stream, a phenomenon known in the literature as concept drift. We propose…

Machine Learning · Statistics 2012-12-27 Gordon J. Ross , Niall M. Adams , Dimitris K. Tasoulis , David J. Hand

Missing values, widely called as \textit{sparsity} in literature, is a common characteristic of many real-world datasets. Many imputation methods have been proposed to address this problem of data incompleteness or sparsity. However, the…

Machine Learning · Computer Science 2022-07-28 Vishwas Choudhary , Binay Gupta , Anirban Chatterjee , Subhadip Paul , Kunal Banerjee , Vijay Agneeswaran

Institutional bias can impact patient outcomes, educational attainment, and legal system navigation. Written records often reflect bias, and once bias is identified; it is possible to refer individuals for training to reduce bias. Many…

Detecting lexical semantic change in smaller data sets, e.g. in historical linguistics and digital humanities, is challenging due to a lack of statistical power. This issue is exacerbated by non-contextual embedding models that produce one…

Computation and Language · Computer Science 2022-02-23 Yang Liu , Alan Medlar , Dorota Glowacka

Systems and individuals produce data continuously. On the Internet, people share their knowledge, sentiments, and opinions, provide reviews about services and products, and so on. Automatically learning from these textual data can provide…

This study evaluates the performance of TF-IDF weighting, averaged Word2Vec embeddings, and BERT embeddings for document similarity scoring across two contrasting textual domains. By analysing cosine similarity scores, the methods'…

Computation and Language · Computer Science 2024-12-24 Klara Kramer

In this paper, we model the document revision detection problem as a minimum cost branching problem that relies on computing document distances. Furthermore, we propose two new document distance measures, word vector-based Dynamic Time…

Information Retrieval · Computer Science 2020-01-08 Xiaofeng Zhu , Diego Klabjan , Patrick Bless

In data streams, the data distribution of arriving observations at different time points may change - a phenomenon called concept drift. While detecting concept drift is a relatively mature area of study, solutions to the uncertainty…

Machine Learning · Computer Science 2020-08-11 Anjin Liu , Jie Lu , Guangquan Zhang

Deployed machine learning models are confronted with the problem of changing data over time, a phenomenon also called concept drift. While existing approaches of concept drift detection already show convincing results, they require true…

Machine Learning · Computer Science 2022-09-26 Lucas Baier , Tim Schlör , Jakob Schöffer , Niklas Kühl

Word embedding is a useful approach to capture co-occurrence structures in large text corpora. However, in addition to the text data itself, we often have additional covariates associated with individual corpus documents---e.g. the…

Computation and Language · Computer Science 2018-07-10 Kevin Tian , Teng Zhang , James Zou

Cross-modal retrieval has drawn much attention in both computer vision and natural language processing domains. With the development of convolutional and recurrent neural networks, the bottleneck of retrieval across image-text modalities is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Jianan Chen , Lu Zhang , Qiong Wang , Cong Bai , Kidiyo Kpalma

Uncertain changes in data streams present challenges for machine learning models to dynamically adapt and uphold performance in real-time. Particularly, classification boundary change, also known as real concept drift, is the major cause of…

Machine Learning · Computer Science 2024-05-24 Feng Gu , Jie Lu , Zhen Fang , Kun Wang , Guangquan Zhang

Detecting vulnerabilities within compiled binaries is challenging due to lost high-level code structures and other factors such as architectural dependencies, compilers, and optimization options. To address these obstacles, this research…

Cryptography and Security · Computer Science 2024-12-17 Gary A. McCully , John D. Hastings , Shengjie Xu , Adam Fortier

In safety-critical domains such as autonomous driving and medical diagnosis, the reliability of machine learning models is crucial. One significant challenge to reliability is concept drift, which can cause model deterioration over time.…

Machine Learning · Computer Science 2023-11-23 Anton Winter , Nicolas Jourdan , Tristan Wirth , Volker Knauthe , Arjan Kuijper

Continuous machine learning pipelines are common in industrial settings where models are periodically trained on data streams. Unfortunately, concept drifts may occur in data streams where the joint distribution of the data X and label y,…

Machine Learning · Computer Science 2023-12-18 Minsu Kim , Seong-Hyeon Hwang , Steven Euijong Whang