English
Related papers

Related papers: Mining Scientific Workflows for Anomalous Data Tra…

200 papers

The detection of anomalies in non-stationary time-series streams is a critical but challenging task across numerous industrial and scientific domains. Traditional models, trained offline, suffer significant performance degradation when…

Machine Learning · Computer Science 2025-09-01 Ashok Devireddy , Shunping Huang

In recent years, rapid technological advancements and expanded Internet access have led to a significant rise in anomalies within network traffic and time-series data. Prompt detection of these irregularities is crucial for ensuring service…

Machine Learning · Computer Science 2025-11-10 Mahshid Rezakhani , Tolunay Seyfi , Fatemeh Afghah

Anomaly detection in multivariate time series (MTS) has been widely studied in one-class classification (OCC) setting. The training samples in OCC are assumed to be normal, which is difficult to guarantee in practical situations. Such a…

Machine Learning · Computer Science 2024-02-08 Qihang Zhou , Shibo He , Haoyu Liu , Jiming Chen , Wenchao Meng

Recently, advanced cyber attacks, which consist of a sequence of steps that involve many vulnerabilities and hosts, compromise the security of many well-protected businesses. This has led to the solutions that ubiquitously monitor system…

Cryptography and Security · Computer Science 2018-06-26 Peng Gao , Xusheng Xiao , Ding Li , Zhichun Li , Kangkook Jee , Zhenyu Wu , Chung Hwan Kim , Sanjeev R. Kulkarni , Prateek Mittal

Computational science relies on scientific software as its primary instrument for scientific discovery. Therefore, similar to the use of other types of scientific instruments, correct software and the correct operation of the software is…

Software Engineering · Computer Science 2024-05-20 Akash Dhruv , Rajeev Jain , Jared O'Neal , Klaus Weide , Anshu Dubey

Cyberthreats are a permanent concern in our modern technological world. In the recent years, sophisticated traffic analysis techniques and anomaly detection (AD) algorithms have been employed to face the more and more subversive adversarial…

Machine Learning · Computer Science 2022-05-17 Paul Irofti , Andrei Pătraşcu , Andrei Iulian Hîji

Coherent microscopy techniques provide an unparalleled multi-scale view of materials across scientific and technological fields, from structural materials to quantum devices, from integrated circuits to biological cells. Driven by the…

Scientific workflows are designed as directed acyclic graphs (DAGs) and consist of multiple dependent task definitions. They are executed over a large amount of data, often resulting in thousands of tasks with heterogeneous compute…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-19 Jonathan Bader , Nicolas Zunker , Soeren Becker , Odej Kao

Anomaly detection has many applications ranging from bank-fraud detection and cyber-threat detection to equipment maintenance and health monitoring. However, choosing a suitable algorithm for a given application remains a challenging design…

Anomaly is defined as a state of the system that do not conform to the normal behavior. For example, the emission of neutrons in a nuclear reactor channel above the specified threshold is an anomaly. Big data refers to the data set that is…

Machine Learning · Computer Science 2022-03-04 Chandresh Kumar Maurya

A software vulnerability could be exploited without any visible symptoms. When no source code is available, although such silent program executions could cause very serious damage, the general problem of analyzing silent yet harmful…

Cryptography and Security · Computer Science 2021-02-23 Zhilong Wang , Li Yu , Suhang Wang , Peng Liu

Scientific workflow has become essential in software engineering because it provides a structured approach to designing, executing, and analyzing scientific experiments. Software developers and researchers have developed hundreds of…

Software Engineering · Computer Science 2023-09-15 Khairul Alam , Banani Roy , Alexander Serebrenik

The FAIR principles for scientific data (Findable, Accessible, Interoperable, Reusable) are also relevant to other digital objects such as research software and scientific workflows that operate on scientific data. The FAIR principles can…

Digital Libraries · Computer Science 2022-12-16 Sean R. Wilkinson , Greg Eisenhauer , Anuj J. Kapadia , Kathryn Knight , Jeremy Logan , Patrick Widener , Matthew Wolf

In the AI-for-science era, scientific computing scenarios such as concurrent learning and high-throughput computing demand a new generation of infrastructure that supports scalable computing resources and automated workflow management on…

The continued digitization of societal processes translates into a proliferation of time series data that cover applications such as fraud detection, intrusion detection, and energy management, where anomaly detection is often essential to…

Anomaly Detection (AD) is crucial in industrial settings to streamline operations by detecting underlying issues. Conventional methods merely label observations as normal or anomalous, lacking crucial insights. In Industry 5.0,…

Machine Learning · Computer Science 2026-04-03 Davide Frizzo , Francesco Borsatti , Alessio Arcudi , Antonio De Moliner , Roberto Oboe , Gian Antonio Susto

Ever growing volume and velocity of data coupled with decreasing attention span of end users underscore the critical need for real-time analytics. In this regard, anomaly detection plays a key role as an application as well as a means to…

Machine Learning · Statistics 2017-10-16 Dhruv Choudhary , Arun Kejariwal , Francois Orsini

Distributed filesystem metadata updates are typically synchronous. This creates inherent challenges for access efficiency, load balancing, and directory contention, especially under dynamic and skewed workloads. This paper argues that…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-01 Jingwei Xu , Mingkai Dong , Qiulin Tian , Ziyi Tian , Tong Xin , Haibo Chen

Anomaly detection in computational workflows is critical for ensuring system reliability and security. However, traditional rule-based methods struggle to detect novel anomalies. This paper leverages large language models (LLMs) for…

Software Engineering · Computer Science 2024-07-26 Hongwei Jin , George Papadimitriou , Krishnan Raghavan , Pawel Zuk , Prasanna Balaprakash , Cong Wang , Anirban Mandal , Ewa Deelman

The Workflows Community Summit gathered 111 participants from 18 countries to discuss emerging trends and challenges in scientific workflows, focusing on six key areas: time-sensitive workflows, AI-HPC convergence, multi-facility workflows,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-22 Rafael Ferreira da Silva , Deborah Bard , Kyle Chard , Shaun de Witt , Ian T. Foster , Tom Gibbs , Carole Goble , William Godoy , Johan Gustafsson , Utz-Uwe Haus , Stephen Hudson , Shantenu Jha , Laila Los , Drew Paine , Frédéric Suter , Logan Ward , Sean Wilkinson , Marcos Amaris , Yadu Babuji , Jonathan Bader , Riccardo Balin , Daniel Balouek , Sarah Beecroft , Khalid Belhajjame , Rajat Bhattarai , Wes Brewer , Paul Brunk , Silvina Caino-Lores , Henri Casanova , Daniela Cassol , Jared Coleman , Taina Coleman , Iacopo Colonnelli , Anderson Andrei Da Silva , Daniel de Oliveira , Pascal Elahi , Nour Elfaramawy , Wael Elwasif , Brian Etz , Thomas Fahringer , Wesley Ferreira , Rosa Filgueira , Jacob Fosso Tande , Luiz Gadelha , Andy Gallo , Daniel Garijo , Yiannis Georgiou , Philipp Gritsch , Patricia Grubel , Amal Gueroudji , Quentin Guilloteau , Carlo Hamalainen , Rolando Hong Enriquez , Lauren Huet , Kevin Hunter Kesling , Paula Iborra , Shiva Jahangiri , Jan Janssen , Joe Jordan , Sehrish Kanwal , Liliane Kunstmann , Fabian Lehmann , Ulf Leser , Chen Li , Peini Liu , Jakob Luettgau , Richard Lupat , Jose M. Fernandez , Ketan Maheshwari , Tanu Malik , Jack Marquez , Motohiko Matsuda , Doriana Medic , Somayeh Mohammadi , Alberto Mulone , John-Luke Navarro , Kin Wai Ng , Klaus Noelp , Bruno P. Kinoshita , Ryan Prout , Michael R. Crusoe , Sashko Ristov , Stefan Robila , Daniel Rosendo , Billy Rowell , Jedrzej Rybicki , Hector Sanchez , Nishant Saurabh , Sumit Kumar Saurav , Tom Scogland , Dinindu Senanayake , Woong Shin , Raul Sirvent , Tyler Skluzacek , Barry Sly-Delgado , Stian Soiland-Reyes , Abel Souza , Renan Souza , Domenico Talia , Nathan Tallent , Lauritz Thamsen , Mikhail Titov , Benjamin Tovar , Karan Vahi , Eric Vardar-Irrgang , Edite Vartina , Yuandou Wang , Merridee Wouters , Qi Yu , Ziad Al Bkhetan , Mahnoor Zulfiqar