English
Related papers

Related papers: Towards Practicable Sequential Shift Detectors

200 papers

In many real applications of statistical learning, collecting sufficiently many training data is often expensive, time-consuming, or even unrealistic. In this case, a transfer learning approach, which aims to leverage knowledge from a…

Machine Learning · Statistics 2025-02-26 Baozhen Wang , Xingye Qiao

With the attention mechanism, transformers achieve significant empirical successes. Despite the intuitive understanding that transformers perform relational inference over long sequences to produce desirable representations, we lack a…

Machine Learning · Computer Science 2024-04-02 Yufeng Zhang , Boyi Liu , Qi Cai , Lingxiao Wang , Zhaoran Wang

Deep neural network based object detectors are continuously evolving and are used in a multitude of applications, each having its own set of requirements. While safety-critical applications need high accuracy and reliability, low-latency…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Elahe Arani , Shruthi Gowda , Ratnajit Mukherjee , Omar Magdy , Senthilkumar Kathiresan , Bahram Zonooz

Most research designing novel predictive models, or employing existing ones, assumes that training and testing data are independent and identically distributed. In practice, the data encountered at serving time often deviate from the…

Machine Learning · Computer Science 2026-03-30 Hanyu Duan , Yi Yang , Ahmed Abbasi , Kar Yan Tam

Despite advancements in splicing detection, practitioners still struggle to fully leverage forensic tools from the literature due to a critical issue: deep learning-based detectors are extremely sensitive to their trained instances. Simple…

Signal Processing · Electrical Eng. & Systems 2024-09-09 Julien Simon de Kergunic , Rony Abecidan , Patrick Bas , Vincent Itier

Safely deploying machine learning models to the real world is often a challenging process. Models trained with data obtained from a specific geographic location tend to fail when queried with data obtained elsewhere, agents trained in a…

Machine Learning · Computer Science 2021-11-02 Marco Federici , Ryota Tomioka , Patrick Forré

The dynamic nature of many real-world systems can lead to temporal outcome model shifts, causing a deterioration in model accuracy and reliability over time. This requires change-point detection on the outcome models to guide model…

Methodology · Statistics 2026-01-13 Zhuofan Dong , Yiwen Huang , Yan Dong , Mengying Yan , Ziye Tian , Chuan Hong , Doudou Zhou , Molei Liu

A change points detection aims to catch an abrupt disorder in data distribution. Common approaches assume that there are only two fixed distributions for data: one before and another after a change point. Real-world data are richer than…

Machine Learning · Computer Science 2022-04-18 Alexander Stepikin , Evgenia Romanenkova , Alexey Zaytsev

Data drift is the change in model input data that is one of the key factors leading to machine learning models performance degradation over time. Monitoring drift helps detecting these issues and preventing their harmful consequences.…

Computation and Language · Computer Science 2023-05-30 Ella Rabinovich , Matan Vetzler , Samuel Ackerman , Ateret Anaby-Tavor

An interesting phenomenon arises: Empirical Risk Minimization (ERM) sometimes outperforms methods specifically designed for out-of-distribution tasks. This motivates an investigation into the reasons behind such behavior beyond algorithmic…

Machine Learning · Computer Science 2026-01-21 Hong Zheng , Fei Teng

Detectors with high coverage have direct and far-reaching benefits for road users in route planning and avoiding traffic congestion, but utilizing these data presents unique challenges including: the dynamic temporal correlation, and the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 He Li , Shiyu Zhang , Xuejiao Li , Liangcai Su , Hongjie Huang , Duo Jin , Linghao Chen , Jianbing Huang , Jaesoo Yoo

Transformer-based sequential recommenders are very powerful for capturing both short-term and long-term sequential item dependencies. This is mainly attributed to their unique self-attention networks to exploit pairwise item-item…

Information Retrieval · Computer Science 2022-12-09 Huiyuan Chen , Yusan Lin , Menghai Pan , Lan Wang , Chin-Chia Michael Yeh , Xiaoting Li , Yan Zheng , Fei Wang , Hao Yang

In recent years, machine learning has witnessed extensive adoption across various sectors, yet its application in medical image-based disease detection and diagnosis remains challenging due to distribution shifts in real-world data. In…

Machine Learning · Computer Science 2024-02-13 Masoumeh Javanbakhat , Md Tasnimul Hasan , Cristoph Lippert

Practical applications of artificial intelligence increasingly often have to deal with the streaming properties of real data, which, considering the time factor, are subject to phenomena such as periodicity and more or less chaotic…

Machine Learning · Computer Science 2025-03-05 Joanna Komorniczak , Paweł Ksieniewicz

We present a new 3D point-based detector model, named Shift-SSD, for precise 3D object detection in autonomous driving. Traditional point-based 3D object detectors often employ architectures that rely on a progressive downsampling of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Zhili Chen , Kien T. Pham , Maosheng Ye , Zhiqiang Shen , Qifeng Chen

Efficient implementations of concurrent objects such as atomic collections are essential to modern computing. Programming such objects is error prone: in minimizing the synchronization overhead between concurrent object invocations, one…

Programming Languages · Computer Science 2017-07-04 Ahmed Bouajjani , Constantin Enea , Chao Wang

Transformers have recently been utilized to perform object detection and tracking in the context of autonomous driving. One unique characteristic of these models is that attention weights are computed in each forward pass, giving insights…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Felicia Ruppel , Florian Faion , Claudius Gläser , Klaus Dietmayer

Recently, transformers have demonstrated great potential for modeling long-term dependencies from skeleton sequences and thereby gained ever-increasing attention in skeleton action recognition. However, the existing transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Wenhan Wu , Ce Zheng , Zihao Yang , Chen Chen , Srijan Das , Aidong Lu

Machine learning models are essential tools in various domains, but their performance can degrade over time due to changes in data distribution or other factors. On one hand, detecting and addressing such degradations is crucial for…

Machine Learning · Computer Science 2023-09-28 Florian Heinrichs

Explicit finite-sample statistical guarantees on model performance are an important ingredient in responsible machine learning. Previous work has focused mainly on bounding either the expected loss of a predictor or the probability that an…

Machine Learning · Computer Science 2024-03-07 Zhun Deng , Thomas P. Zollo , Jake C. Snell , Toniann Pitassi , Richard Zemel