English
Related papers

Related papers: A horizontally scalable online processing system f…

200 papers

Given the rapid rise in energy demand by data centers and computing systems in general, it is fundamental to incorporate energy considerations when designing (scheduling) algorithms. Machine learning can be a useful approach in practice by…

Data Structures and Algorithms · Computer Science 2021-12-07 Antonios Antoniadis , Peyman Jabbarzade Ganje , Golnoosh Shahkarami

Developing state-machine replication protocols for practical use is a complex and labor-intensive process because of the myriad of essential tasks (e.g., deployment, communication, recovery) that need to be taken into account in an…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-25 Laura Lawniczak , Tobias Distler

The LHCb Stripping project is a pivotal component of the experiment's data processing framework, designed to refine vast volumes of collision data into manageable samples for offline analysis. It ensures the re-analysis of Runs 1 and 2…

High Energy Physics - Experiment · Physics 2025-12-19 Nathan Grieser , Eduardo Rodrigues , Niladri Sahoo , Shuqi Sheng , Nicole Skidmore , Mark Smith

Model-free and data-driven prediction of tipping point transitions in nonlinear dynamical systems is a challenging and outstanding task in complex systems science. We propose a novel, fully data-driven machine learning algorithm based on…

Machine Learning · Computer Science 2023-12-12 Daniel Köglmayr , Christoph Räth

High-throughput physics experiments require efficient and increasingly complex real-time processing. This paper presents a modular, software-defined platform combining high-bandwidth PCIe digitizers with consumer GPUs to achieve continuous,…

Instrumentation and Detectors · Physics 2026-05-12 Toma-Stefan Cezar , Marios Maroudas , Dieter Horns

High-throughput solid-state nanopore experiments generate continuous MHz-rate data streams in which only a small fraction of data contains informative molecular information. This creates storage and processing bottlenecks that limit…

The exploding research interest for neural networks in modeling nonlinear dynamical systems is largely explained by the networks' capacity to model complex input-output relations directly from data. However, they typically need vast…

Artificial Intelligence · Computer Science 2023-02-27 Erlend Torje Berg Lundby , Adil Rasheed , Ivar Johan Halvorsen , Dirk Reinhardt , Sebastien Gros , Jan Tommy Gravdahl

Recent studies shows that the majority of existing deep steganalysis models have a large amount of redundancy, which leads to a huge waste of storage and computing resources. The existing model compression method cannot flexibly compress…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Shunquan Tan , Qiushi Li , Laiyuan Li , Bin Li , Jiwu Huang

Data scouting, introduced by CMS in 2011, is the use of specialized data streams based on reduced event content, enabling LHC experiments to record unprecedented numbers of proton-proton collision events that would otherwise be rejected by…

High Energy Physics - Experiment · Physics 2018-08-03 Javier Duarte

High fidelity estimation algorithms for robotics require accurate data. However, timestamping of sensor data is a key issue that rarely receives the attention it deserves. Inaccurate timestamping can be compensated for in post-processing…

Robotics · Computer Science 2025-07-09 Morten Nissov , Nikhil Khedekar , Kostas Alexis

Data-driven control methods based on subspace representations are powerful but are often limited to linear time-invariant systems where the model order is known. A key challenge is developing online data-driven control algorithms for…

Optimization and Control · Mathematics 2026-04-13 Dian Jin , Jeremy Coulson

Recursive query processing has experienced a recent resurgence, as a result of its use in many modern application domains, including data integration, graph analytics, security, program analysis, networking and decision making. Due to the…

Databases · Computer Science 2018-12-11 Zhiwei Fan , Jianqiao Zhu , Zuyu Zhang , Aws Albarghouthi , Paraschos Koutris , Jignesh Patel

A novel procedure for the online identification of a class of discrete-time switched linear systems, which simultaneously estimates the parameters and switching manifolds of the systems, is proposed in this paper. Firstly, to estimate the…

Systems and Control · Electrical Eng. & Systems 2023-03-08 Zengjie Zhang , Yingwei Du , Tong Liu , Fangzhou Liu , Martin Buss

Experimental protocols at synchrotron light sources typically process and validate data only after an experiment has completed, which can lead to undetected errors and cannot enable online steering. Real-time data analysis can enable both…

Image and Video Processing · Electrical Eng. & Systems 2019-10-10 Zhengchun Liu , Tekin Bicer , Rajkumar Kettimuthu , Ian Foster

Recent advancements in detector technology have significantly increased the size and complexity of experimental data, and high-performance computing (HPC) provides a path towards more efficient and timely data processing. However, movement…

Networking and Internet Architecture · Computer Science 2024-07-03 Samuel S. Welborn , Bjoern Enders , Chris Harris , Peter Ercius , Deborah J. Bard

Contextual online decision-making problems with constraints appear in a wide range of real-world applications, such as adaptive experimental design under safety constraints, personalized recommendation with resource limits, and dynamic…

Machine Learning · Statistics 2025-05-23 Haichen Hu , David Simchi-Levi , Navid Azizan

The High Level Trigger (HLT) system of the ALICE experiment is an online event filter and trigger system designed for input bandwidths of up to 25 GB/s at event rates of up to 1 kHz. The system is designed as a scalable PC cluster,…

Pulsar data analysis pipelines have historically been comprised of bespoke software systems, supporting the off-line analysis of data. However modern data acquisition systems are making off-line analyses impractical. They often output…

Instrumentation and Methods for Astrophysics · Physics 2018-10-16 R. J. Lyon , B. W. Stappers , L. Levin , M. B. Mickaliger , A. Scaife

Conformance checking techniques aim to collate observed process behavior with normative/modeled process models. The majority of existing approaches focuses on completed process executions, i.e., offline conformance checking. Recently, novel…

Logic in Computer Science · Computer Science 2022-11-23 Daniel Schuster , Gero J. Kolhof

Cybersecurity systems are continuously producing a huge number of time-stamped events in the form of high-order tensors, such as {count; time, port, flow duration, packet size, . . . }, and so how can we detect anomalies/intrusions in real…

Machine Learning · Computer Science 2025-03-04 Kota Nakamura , Koki Kawabata , Shungo Tanaka , Yasuko Matsubara , Yasushi Sakurai