English
Related papers

Related papers: MedShift: identifying shift data for medical datas…

200 papers

Medical Image Analysis (MedIA) has become indispensable in modern healthcare, enhancing clinical diagnostics and personalized treatment. Despite the remarkable advancements supported by deep learning (DL) technologies, their practical…

Image and Video Processing · Electrical Eng. & Systems 2026-04-21 Zixian Su , Jingwei Guo , Xi Yang , Qiufeng Wang , Frans Coenen , Amir Hussain , Kaizhu Huang

In recent years, machine learning has witnessed extensive adoption across various sectors, yet its application in medical image-based disease detection and diagnosis remains challenging due to distribution shifts in real-world data. In…

Machine Learning · Computer Science 2024-02-13 Masoumeh Javanbakhat , Md Tasnimul Hasan , Cristoph Lippert

Purpose: Machine learning models can only be reliably evaluated if training, validation, and test data splits are representative and not affected by the absence of classes of interest. Surgical workflow and instrument recognition tasks are…

Machine Learning · Computer Science 2024-02-06 Georgii Kostiuchik , Lalith Sharan , Benedikt Mayer , Ivo Wolf , Bernhard Preim , Sandy Engelhardt

Standard Control Chart techniques to detect level shift in data streams assume independence between observations. As data today is collected with high frequency, this assumption is seldom valid. To overcome this, we propose to adapt the…

Methodology · Statistics 2019-11-11 Jacob Søgaard Larsen , Anders Stockmarr , Bjarne Kjær Ersbøll , Murat Kulahci

While previous distribution shift detection approaches can identify if a shift has occurred, these approaches cannot localize which specific features have caused a distribution shift -- a critical step in diagnosing or fixing any underlying…

Machine Learning · Computer Science 2021-07-16 Sean Kulinski , Saurabh Bagchi , David I. Inouye

A trained ML model is deployed on another `test' dataset where target feature values (labels) are unknown. Drift is distribution change between the training and deployment data, which is concerning if model performance changes. For a…

Applications · Statistics 2022-09-07 Samuel Ackerman , Eitan Farchi , Orna Raz , Marcel Zalmanovici , Parijat Dube

The problem of inhomogeneous cluster densities has been a long-standing issue for distance-based and density-based algorithms in clustering and anomaly detection. These algorithms implicitly assume that all clusters have approximately the…

Machine Learning · Computer Science 2024-01-30 Ye Zhu , Kai Ming Ting , Mark Carman , Maia Angelova

Reliable medical image classification requires accurate predictions and well-calibrated uncertainty estimates, especially in high-stakes clinical settings. This work presents MedSymmFlow, a generative-discriminative hybrid model built on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Francisco Caetano , Lemar Abdi , Christiaan Viviers , Amaan Valiuddin , Fons van der Sommen

Identifying covariate shift is crucial for making machine learning systems robust in the real world and for detecting training data biases that are not reflected in test data. However, detecting covariate shift is challenging, especially…

Machine Learning · Computer Science 2021-08-20 Matthew L. Olson , Thuy-Vy Nguyen , Gaurav Dixit , Neale Ratzlaff , Weng-Keen Wong , Minsuk Kahng

An important topic in medical research is the process of improving the images obtained from medical devices. As a consequence, there is also a need to improve medical image resolution and analysis. Another issue in this field is the large…

Image and Video Processing · Electrical Eng. & Systems 2023-05-26 Elena-Simona Apostol , Ciprian-Octavian Truică

We aim to select data subsets for the fine-tuning of large language models to more effectively follow instructions. Prior work has emphasized the importance of diversity in dataset curation but relied on heuristics such as the number of…

Machine Learning · Computer Science 2024-02-07 Peiqi Wang , Yikang Shen , Zhen Guo , Matthew Stallone , Yoon Kim , Polina Golland , Rameswar Panda

Quantification is the supervised learning task that consists of training predictors of the class prevalence values of sets of unlabelled data, and is of special interest when the labelled data on which the predictor has been trained and the…

Machine Learning · Computer Science 2023-10-10 Pablo González , Alejandro Moreo , Fabrizio Sebastiani

Sensor signals acquired in the industrial process contain rich information which can be analyzed to facilitate effective monitoring of the process, early detection of system anomalies, quick diagnosis of fault root causes, and intelligent…

Signal Processing · Electrical Eng. & Systems 2020-05-27 Feng Ye , Zhijie Xia , Min Dai , Zhisheng Zhang

Dataset shift is common in credit scoring scenarios, and the inconsistency between the distribution of training data and the data that actually needs to be predicted is likely to cause poor model performance. However, most of the current…

Machine Learning · Computer Science 2021-12-21 Hongyi Qian , Baohui Wang , Ping Ma , Lei Peng , Songfeng Gao , You Song

The increased presence of advanced sensors on the production floors has led to the collection of datasets that can provide significant insights into machine health. An important and reliable indicator of machine health, vibration signal…

Signal Processing · Electrical Eng. & Systems 2021-02-04 Rishikesh Magar , Lalit Ghule , Junhan Li , Yang Zhao , Amir Barati Farimani

Due to the edge's position between the cloud and the users, and the recent surge of deep neural network (DNN) applications, edge computing brings about uncertainties that must be understood separately. Particularly, the edge users' locally…

Information Theory · Computer Science 2020-06-02 Sejin Seo , Sang Won Choi , Sujin Kook , Seong-Lyun Kim , Seung-Woo Ko

Domain shift, the mismatch between training and testing data characteristics, causes significant degradation in the predictive performance in multi-source imaging scenarios. In medical imaging, the heterogeneity of population, scanners and…

Machine Learning · Computer Science 2021-12-21 Rongguang Wang , Pratik Chaudhari , Christos Davatzikos

Removing the bias and variance of multicentre data has always been a challenge in large scale digital healthcare studies, which requires the ability to integrate clinical features extracted from data acquired by different scanners and…

This paper seeks to address the dense labeling problems where a significant fraction of the dataset can be pruned without sacrificing much accuracy. We observe that, on standard medical image segmentation benchmarks, the loss gradient…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Yongkang He , Mingjin Chen , Zhijing Yang , Yongyi Lu

Recent advancements in deep learning for medical image segmentation are often limited by the scarcity of high-quality training data.While diffusion models provide a potential solution by generating synthetic images, their effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jianhao Xie , Ziang Zhang , Zhenyu Weng , Yuesheng Zhu , Guibo Luo