English
Related papers

Related papers: Mining Scientific Workflows for Anomalous Data Tra…

200 papers

In this work we propose a one-class self-supervised method for anomaly segmentation in images that benefits both from a modern machine learning approach and a more classic statistical detection theory. The method consists of four phases.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Matías Tailanian , Álvaro Pardo , Pablo Musé

Irregularities in public health data streams (like COVID-19 Cases) hamper data-driven decision-making for public health stakeholders. A real-time, computer-generated list of the most important, outlying data points from thousands of…

Artificial Intelligence · Computer Science 2024-01-04 Ananya Joshi , Kathryn Mazaitis , Roni Rosenfeld , Bryan Wilder

Performance analysis is challenging as different components (e.g.,different libraries, and applications) of a complex system can interact with each other. However, few existing tools focus on understanding such interactions. To bridge this…

Performance · Computer Science 2024-10-24 Steven , Tang , Mingcan Xiang , Yang Wang , Bo Wu , Jianjun Chen , Tongping Liu

Anomaly detection in process mining focuses on identifying anomalous cases or events in process executions. The resulting diagnostics are used to provide measures to prevent fraudulent behavior, as well as to derive recommendations for…

Machine Learning · Computer Science 2022-03-21 Suhwan Lee , Xixi Lu , Hajo A. Reijers

State-of-the-art space science missions increasingly rely on automation due to spacecraft complexity and the costs of human oversight. The high volume of data, including scientific and telemetry data, makes manual inspection challenging.…

Machine Learning · Computer Science 2024-11-11 Pablo Gómez , Roland D. Vavrek , Guillermo Buenadicha , John Hoar , Sandor Kruk , Jan Reerink

Scientific workflows process extensive data sets over clusters of independent nodes, which requires a complex stack of infrastructure components, especially a resource manager (RM) for task-to-node assignment, a distributed file system…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-12 Fabian Lehmann , Jonathan Bader , Friedrich Tschirpke , Ninon De Mecquenem , Ansgar Lößer , Soeren Becker , Katarzyna Ewa Lewińska , Lauritz Thamsen , Ulf Leser

Many algorithms in workflow scheduling and resource provisioning rely on the performance estimation of tasks to produce a scheduling plan. A profiler that is capable of modeling the execution of tasks and predicting their runtime…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-01 Muhammad H. Hilman , Maria A. Rodriguez , Rajkumar Buyya

Privacy has raised considerable concerns recently, especially with the advent of information explosion and numerous data mining techniques to explore the information inside large volumes of data. In this context, a new distributed learning…

Machine Learning · Computer Science 2019-10-15 Mengwei Yang , Linqi Song , Jie Xu , Congduan Li , Guozhen Tan

Modern data science relies on data analytic pipelines to organize interdependent computational steps. Such analytic pipelines often involve different algorithms across multiple steps, each with its own hyperparameters. To achieve the best…

Machine Learning · Computer Science 2016-06-27 Yuyu Zhang , Mohammad Taha Bahadori , Hang Su , Jimeng Sun

Nowadays, the volume of network traffic continues to grow, along with the frequency and sophistication of attacks. This scenario highlights the need for solutions capable of continuously adapting, since network behavior is dynamic and…

In the recent years, scientific workflows gained more and more popularity. In scientific workflows, tasks are typically treated as black boxes. Dealing with their complex interrelations to identify optimization potentials and bottlenecks is…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-13 Ansgar Lößer , Joel Witzke , Florian Schintke , Björn Scheuermann

Several techniques for multivariate time series anomaly detection have been proposed recently, but a systematic comparison on a common set of datasets and metrics is lacking. This paper presents a systematic and comprehensive evaluation of…

Machine Learning · Computer Science 2021-09-24 Astha Garg , Wenyu Zhang , Jules Samaran , Savitha Ramasamy , Chuan-Sheng Foo

The increasing automation of traffic management systems has made them prime targets for cyberattacks, disrupting urban mobility and public safety. Traditional network-layer defenses are often inaccessible to transportation agencies,…

Anomaly detection and its explanation is important in many research areas such as intrusion detection, fraud detection, unknown attack detection in network traffic and logs. It is challenging to identify the cause or explanation of why one…

Machine Learning · Computer Science 2023-08-02 Khushnaseeb Roshan , Aasim Zafar

Scientific applications in HPC environment are more com-plex and more data-intensive nowadays. Scientists usually rely on workflow system to manage the complexity: simply define multiple processing steps into a single script and let the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-17 Dong Dai , Robert Ross , Dounia Khaldi , Yonghong Yan , Matthieu Dorier , Neda Tavakoli , Yong Chen

Uncertain data streams have been widely generated in many Web applications. The uncertainty in data streams makes anomaly detection from sensor data streams far more challenging. In this paper, we present a novel framework that supports…

Artificial Intelligence · Computer Science 2016-07-21 Jiangang Ma , Le Sun , Hua Wang , Yanchun Zhang , Uwe Aickelin

Computer network anomaly detection and log analysis, as an important topic in the field of network security, has been a key task to ensure network security and system reliability. First, existing network anomaly detection and log analysis…

Machine Learning · Computer Science 2024-09-17 Shuzhan Wang , Ruxue Jiang , Zhaoqi Wang , Yan Zhou

With the wide application of IoT and industrial IoT technologies, the network structure is becoming more and more complex, and the traffic scale is growing rapidly, which makes the traditional security protection mechanism face serious…

Computers and Society · Computer Science 2025-04-25 Qiuyan Xiang , Shuang Wu , Dongze Wu , Yuxin Liu , Zhenkai Qin

With the increasing amount of data available to scientists in disciplines as diverse as bioinformatics, physics, and remote sensing, scientific workflow systems are becoming increasingly important for composing and executing scalable data…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-20 Jonathan Bader , Nils Diedrich , Lauritz Thamsen , Odej Kao

Scientific workflows are a cornerstone of modern scientific computing. They are used to describe complex computational applications that require efficient and robust management of large volumes of data, which are typically stored/processed…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-03 Rafael Ferreira da Silva , Loïc Pottier , Tainã Coleman , Ewa Deelman , Henri Casanova