中文
相关论文

相关论文: Detecting covariate drift in text data using docum…

200 篇论文

The reliability and proper function of data-driven applications hinge on the data's continued conformance to the applications' initial design. When data deviates from this initial profile, system behavior becomes unpredictable. Data…

数据库 · 计算机科学 2021-01-05 Anna Fariha , Ashish Tiwari , Arjun Radhakrishna , Sumit Gulwani , Alexandra Meliou

Deploying robust machine learning models has to account for concept drifts arising due to the dynamically changing and non-stationary nature of data. Addressing drifts is particularly imperative in the security domain due to the…

密码学与安全 · 计算机科学 2022-06-16 Aditya Kuppa , Nhien-An Le-Khac

Text embedding models enable semantic search, powering several NLP applications like Retrieval Augmented Generation by efficient information retrieval (IR). However, text embedding models are commonly studied in scenarios where the training…

信息检索 · 计算机科学 2025-10-07 Dipam Goswami , Liying Wang , Bartłomiej Twardowski , Joost van de Weijer

In our digital universe nowadays, enormous amount of data are produced in a streaming manner in a variety of application areas. These data are often unlabelled. In this case, identifying infrequent events, such as anomalies, poses a great…

机器学习 · 计算机科学 2023-09-07 Jin Li , Kleanthis Malialis , Marios M. Polycarpou

In the covariate shift learning scenario, the training and test covariate distributions differ, so that a predictor's average loss over the training and test distributions also differ. In this work, we explore the potential of extreme…

机器学习 · 计算机科学 2018-03-13 Fulton Wang , Cynthia Rudin

Classifying streaming data requires the development of methods which are computationally efficient and able to cope with changes in the underlying distribution of the stream, a phenomenon known in the literature as concept drift. We propose…

机器学习 · 统计学 2012-12-27 Gordon J. Ross , Niall M. Adams , Dimitris K. Tasoulis , David J. Hand

Missing values, widely called as \textit{sparsity} in literature, is a common characteristic of many real-world datasets. Many imputation methods have been proposed to address this problem of data incompleteness or sparsity. However, the…

机器学习 · 计算机科学 2022-07-28 Vishwas Choudhary , Binay Gupta , Anirban Chatterjee , Subhadip Paul , Kunal Banerjee , Vijay Agneeswaran

Institutional bias can impact patient outcomes, educational attainment, and legal system navigation. Written records often reflect bias, and once bias is identified; it is possible to refer individuals for training to reduce bias. Many…

Detecting lexical semantic change in smaller data sets, e.g. in historical linguistics and digital humanities, is challenging due to a lack of statistical power. This issue is exacerbated by non-contextual embedding models that produce one…

计算与语言 · 计算机科学 2022-02-23 Yang Liu , Alan Medlar , Dorota Glowacka

Systems and individuals produce data continuously. On the Internet, people share their knowledge, sentiments, and opinions, provide reviews about services and products, and so on. Automatically learning from these textual data can provide…

This study evaluates the performance of TF-IDF weighting, averaged Word2Vec embeddings, and BERT embeddings for document similarity scoring across two contrasting textual domains. By analysing cosine similarity scores, the methods'…

计算与语言 · 计算机科学 2024-12-24 Klara Kramer

In this paper, we model the document revision detection problem as a minimum cost branching problem that relies on computing document distances. Furthermore, we propose two new document distance measures, word vector-based Dynamic Time…

信息检索 · 计算机科学 2020-01-08 Xiaofeng Zhu , Diego Klabjan , Patrick Bless

In data streams, the data distribution of arriving observations at different time points may change - a phenomenon called concept drift. While detecting concept drift is a relatively mature area of study, solutions to the uncertainty…

机器学习 · 计算机科学 2020-08-11 Anjin Liu , Jie Lu , Guangquan Zhang

Deployed machine learning models are confronted with the problem of changing data over time, a phenomenon also called concept drift. While existing approaches of concept drift detection already show convincing results, they require true…

机器学习 · 计算机科学 2022-09-26 Lucas Baier , Tim Schlör , Jakob Schöffer , Niklas Kühl

Word embedding is a useful approach to capture co-occurrence structures in large text corpora. However, in addition to the text data itself, we often have additional covariates associated with individual corpus documents---e.g. the…

计算与语言 · 计算机科学 2018-07-10 Kevin Tian , Teng Zhang , James Zou

Cross-modal retrieval has drawn much attention in both computer vision and natural language processing domains. With the development of convolutional and recurrent neural networks, the bottleneck of retrieval across image-text modalities is…

计算机视觉与模式识别 · 计算机科学 2022-07-14 Jianan Chen , Lu Zhang , Qiong Wang , Cong Bai , Kidiyo Kpalma

Uncertain changes in data streams present challenges for machine learning models to dynamically adapt and uphold performance in real-time. Particularly, classification boundary change, also known as real concept drift, is the major cause of…

机器学习 · 计算机科学 2024-05-24 Feng Gu , Jie Lu , Zhen Fang , Kun Wang , Guangquan Zhang

Detecting vulnerabilities within compiled binaries is challenging due to lost high-level code structures and other factors such as architectural dependencies, compilers, and optimization options. To address these obstacles, this research…

密码学与安全 · 计算机科学 2024-12-17 Gary A. McCully , John D. Hastings , Shengjie Xu , Adam Fortier

In safety-critical domains such as autonomous driving and medical diagnosis, the reliability of machine learning models is crucial. One significant challenge to reliability is concept drift, which can cause model deterioration over time.…

机器学习 · 计算机科学 2023-11-23 Anton Winter , Nicolas Jourdan , Tristan Wirth , Volker Knauthe , Arjan Kuijper

Continuous machine learning pipelines are common in industrial settings where models are periodically trained on data streams. Unfortunately, concept drifts may occur in data streams where the joint distribution of the data X and label y,…

机器学习 · 计算机科学 2023-12-18 Minsu Kim , Seong-Hyeon Hwang , Steven Euijong Whang