English
Related papers

Related papers: On the Reliability and Stability of Selective Meth…

200 papers

In recent years, the rise of cyber threats has emphasized the need for robust malware detection systems, especially on mobile devices. Malware, which targets vulnerabilities in devices and user data, represents a substantial security risk.…

Cryptography and Security · Computer Science 2025-04-08 J. V. S. Souza , C. B. Vieira , G. D. C. Cavalcanti , R. M. O. Cruz

In training their newly-developed malware detection methods, researchers rely on threshold-based labeling strategies that interpret the scan reports provided by online platforms, such as VirusTotal. The dynamicity of this platform renders…

Cryptography and Security · Computer Science 2020-07-02 Aleieldin Salem

It is well-known that Android malware constantly evolves so as to evade detection. This causes the entire malware population to be non-stationary. Contrary to this fact, most of the prior works on Machine Learning based Android malware…

Cryptography and Security · Computer Science 2017-07-07 Annamalai Narayanan , Mahinthan Chandramohan , Lihui Chen , Yang Liu

Behavior of a malware varies with respect to malware types. Therefore,knowing type of a malware affects strategies of system protection softwares. Many malware type classification models empowered by machine and deep learning achieve…

Cryptography and Security · Computer Science 2020-08-25 Aykut Çayır , Uğur Ünal , Hasan Dağ

Malware is being increasingly threatening and malware detectors based on traditional signature-based analysis are no longer suitable for current malware detection. Recently, the models based on machine learning (ML) are developed for…

Cryptography and Security · Computer Science 2021-01-18 Yuzhou Lin , Xiaolin Chang

To fight against the evolution of malware and its development, the specific methodologies that are applied by the malware analysts are crucial. Yet, this is something often overlooked in the relevant bibliography or in the formal and…

Cryptography and Security · Computer Science 2021-12-09 Ioannis G. Kiachidis , Dimitrios A. Baltatzis

Selective classifiers improve model reliability by abstaining on inputs the model deems uncertain. However, few practical approaches achieve the gold-standard performance of a perfect-ordering oracle that accepts examples exactly in order…

Machine Learning · Computer Science 2025-10-27 Stephan Rabanser , Nicolas Papernot

Reliable reward models (RMs) are critical for ensuring the safe alignment of large language models (LLMs). However, current RM evaluation methods focus solely on preference perception accuracies in given specific scenarios, obscuring the…

Computation and Language · Computer Science 2026-05-18 Jianxiang Zang , Yongda Wei , Ruxue Bai , Shiyu Jiang , Nijia Mo , Binhong Li , Qiang Sun , Hui Liu

This paper revisits the simple, long-studied, yet still unsolved problem of making image classifiers robust to imperceptible perturbations. Taking CIFAR10 as an example, SOTA clean accuracy is about $100$%, but SOTA robustness to…

Machine Learning · Computer Science 2024-07-11 Brian R. Bartoldson , James Diffenderfer , Konstantinos Parasyris , Bhavya Kailkhura

We argue that the current practice of evaluating AI/ML time-series forecasting models, predominantly on benchmarks characterized by strong, persistent periodicities and seasonalities, obscures real progress by overlooking the performance of…

Machine Learning · Computer Science 2026-03-17 Raeid Saqur , Christoph Bergmeir , Blanka Horvath , Daniel Schmidt , Frank Rudzicz , Terry Lyons

Time series anomaly detection is widely used in IoT and cyber-physical systems, yet its evaluation remains challenging due to diverse application objectives and heterogeneous metric assumptions. This study introduces a problem-oriented…

Artificial Intelligence · Computer Science 2026-05-15 Kaixiang Yang , Jiarong Liu , Yupeng Song , Shuanghua Yang , Yujue Zhou

Since neural classifiers are known to be sensitive to adversarial perturbations that alter their accuracy, \textit{certification methods} have been developed to provide provable guarantees on the insensitivity of their predictions to such…

Machine Learning · Computer Science 2025-02-26 Cornelius Emde , Francesco Pinto , Thomas Lukasiewicz , Philip H. S. Torr , Adel Bibi

Despite their success, modern language models are fragile. Even small changes in their training pipeline can lead to unexpected results. We study this phenomenon by examining the robustness of ALBERT (arXiv:1909.11942) in combination with…

Computation and Language · Computer Science 2021-11-19 Urja Khurana , Eric Nalisnick , Antske Fokkens

The modernization of existing and new nuclear power plants with digital instrumentation and control systems (DI&C) is a recent and highly trending topic. However, there lacks strong consensus on best-estimate reliability methodologies by…

Software Engineering · Computer Science 2022-05-25 Edward Chen , Han Bao , Tate Shorthill , Carl Elks , Athira Varma Jayakumar , Nam Dinh

Robustness is critical for machine learning (ML) classifiers to ensure consistent performance in real-world applications where models may encounter corrupted or adversarial inputs. In particular, assessing the robustness of classifiers to…

Machine Learning · Computer Science 2024-09-06 Georg Siedel , Ekagra Gupta , Andrey Morozov

Obviously, the dynamism of software reliability research has speeded up significantly in the last period, and we can state the fact that its intensity is approaching, and in some cases is ahead of the information systems hardware…

Software Engineering · Computer Science 2020-03-06 Anton Petrov , Elena Popova , Alexander Petrov

Quantitative analysis of computing systems is an emerging area in automated formal analysis. Such properties address aspects such as costs and rewards, quality measures, resource consumption, distance metrics, etc. Existing solutions for…

Formal Languages and Automata Theory · Computer Science 2020-10-06 Suguman Bansal

The detection of malware is a critical task for the protection of computing environments. This task often requires extremely low false positive rates (FPR) of 0.01% or even lower, for which modern machine learning has no readily available…

Machine Learning · Computer Science 2021-09-07 Andre T. Nguyen , Edward Raff , Charles Nicholas , James Holt

Considering the ever-evolving threat landscape and rapid changes in software development, we propose a risk assessment framework called SAFER (Software Analysis Framework for Evaluating Risk). This framework is based on the necessity of a…

Software Engineering · Computer Science 2024-12-25 Sarah Ali Siddiqui , Chandra Thapa , Rayne Holland , Wei Shao , Seyit Camtepe

My research lies in the intersection of security and machine learning. This overview summarizes one component of my research: combining computer vision with malware exploit detection for enhanced security solutions. I will present the…

Cryptography and Security · Computer Science 2019-04-25 Li Chen