中文
相关论文

相关论文: On the impact of dataset size and class imbalance …

200 篇论文

Coping with malware is getting more and more challenging, given their relentless growth in complexity and volume. One of the most common approaches in literature is using machine learning techniques, to automatically learn models and…

密码学与安全 · 计算机科学 2018-11-27 Daniele Ucci , Leonardo Aniello , Roberto Baldoni

In the era of large-scale model training, the extensive use of available datasets has resulted in significant computational inefficiencies. To tackle this issue, we explore methods for identifying informative subsets of training data that…

机器学习 · 计算机科学 2025-04-21 Jinghan Yang , Anupam Pani , Yunchao Zhang

Class imbalance in deep neural networks (DNNs) has witnessed a rapid increase in research attention in recent years. However, the varying accounts of the reasons behind the poor performance of DNN on imbalance data in pertinent literature…

机器学习 · 计算机科学 2026-05-26 Ismail B. Mustapha , Shafaatunnur Hasan , Sunday O. Olatunji , Hatem S. Y. Nabus

Risk prediction models are increasingly used in healthcare to aid in clinical decision making. In most clinical contexts, model calibration (i.e., assessing the reliability of risk estimates) is critical. Data available for model…

统计方法学 · 统计学 2024-05-01 Alex Carriero , Kim Luijken , Anne de Hond , Karel GM Moons , Ben van Calster , Maarten van Smeden

Monitoring data transfer performance is a crucial task in scientific computing networks. By predicting performance early in the communication phase, potentially sluggish transfers can be identified and selectively monitored, optimizing…

机器学习 · 计算机科学 2025-12-17 Jacob Taegon Kim , Alex Sim , Kesheng Wu , Jinoh Kim

Machine learning has been proven to be effective in various application areas, such as object and speech recognition on mobile systems. Since a critical key to machine learning success is the availability of large training data, many…

机器学习 · 计算机科学 2021-01-06 Hyeongmin Cho , Sangkyun Lee

The collected data from industrial machines are often imbalanced, which poses a negative effect on learning algorithms. However, this problem becomes more challenging for a mixed type of data or while there is overlapping between classes.…

计算机视觉与模式识别 · 计算机科学 2020-08-10 Masoumeh Zareapoor , Pourya Shamsolmoali , Jie Yang

Machine learning techniques help to understand patterns of a dataset to create a defense mechanism against cyber attacks. However, it is difficult to construct a theoretical model due to the imbalances in the dataset for discriminating…

机器学习 · 计算机科学 2019-12-11 Ibrahim Yilmaz , Rahat Masum

Deep image clustering methods are typically evaluated on small-scale balanced classification datasets while feature-based $k$-means has been applied on proprietary billion-scale datasets. In this work, we explore the performance of…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Nikolas Adaloglou , Felix Michels , Kaspar Senft , Diana Petrusheva , Markus Kollmann

The breakthrough in Deep Learning neural networks has transformed the use of AI and machine learning technologies for the analysis of very large experimental datasets. These datasets are typically generated by large-scale experimental…

机器学习 · 计算机科学 2021-10-26 Jeyan Thiyagalingam , Mallikarjun Shankar , Geoffrey Fox , Tony Hey

Malware detection is an important topic of current cybersecurity, and Machine Learning appears to be one of the main considered solutions even if certain problems to generalize to new malware remain. In the aim of exploring the potential of…

密码学与安全 · 计算机科学 2023-12-20 Tony Quertier , Grégoire Barrué

As a data-driven method, the performance of deep convolutional neural networks (CNN) relies heavily on training data. The prediction results of traditional networks give a bias toward larger classes, which tend to be the background in the…

计算机视觉与模式识别 · 计算机科学 2022-03-04 N. Anantrasirichai , David Bull

This study is part of a larger project focused on measuring, understanding, and improving student engagement in programming education. We investigate whether synthetic data generation can help identify at-risk students earlier in a small,…

计算机与社会 · 计算机科学 2025-05-26 Daniel Flood , Matthew England , Beate Grawemeyer

Data quality affects machine learning (ML) model performances, and data scientists spend considerable amount of time on data cleaning before model training. However, to date, there does not exist a rigorous study on how exactly cleaning…

数据库 · 计算机科学 2021-04-07 Peng Li , Xi Rao , Jennifer Blase , Yue Zhang , Xu Chu , Ce Zhang

Imbalanced problems can arise in different real-world situations, and to address this, certain strategies in the form of resampling or balancing algorithms are proposed. This issue has largely been studied in the context of classification,…

机器学习 · 计算机科学 2025-07-17 Juscimara G. Avelino , George D. C. Cavalcanti , Rafael M. O. Cruz

Intelligent diagnosis method based on data-driven and deep learning is an attractive and meaningful field in recent years. However, in practical application scenarios, the imbalance of time-series fault is an urgent problem to be solved.…

机器学习 · 计算机科学 2021-07-15 Xingtai Gui , Jiyang Zhang

Learning from imbalanced data is one of the most significant challenges in real-world classification tasks. In such cases, neural networks performance is substantially impaired due to preference towards the majority class. Existing…

机器学习 · 计算机科学 2022-11-13 Bronislav Yasinnik , Moshe Salhov , Ofir Lindenbaum , Amir Averbuch

In real world datasets, particular groups are under-represented, much rarer than others, and machine learning classifiers will often preform worse on under-represented populations. This problem is aggravated across many domains where…

机器学习 · 计算机科学 2023-02-10 Arghya Datta , S. Joshua Swamidass

With the increasing extent of malware attacks in the present day along with the difficulty in detecting modern malware, it is necessary to evaluate the effectiveness and performance of Deep Neural Networks (DNNs) for malware classification.…

密码学与安全 · 计算机科学 2023-10-12 Akhil M R , Adithya Krishna V Sharma , Harivardhan Swamy , Pavan A , Ashray Shetty , Anirudh B Sathyanarayana

Large-scale datasets have played a crucial role in the advancement of computer vision. However, they often suffer from problems such as class imbalance, noisy labels, dataset bias, or high resource costs, which can inhibit model performance…

计算机视觉与模式识别 · 计算机科学 2023-10-09 Zhijing Wan , Zhixiang Wang , CheukTing Chung , Zheng Wang