English
Related papers

Related papers: Corral Framework: Trustworthy and Fully Functional…

200 papers

We present COALA, a vision-centric Federated Learning (FL) platform, and a suite of benchmarks for practical FL scenarios, which we categorize into three levels: task, data, and model. At the task level, COALA extends support from simple…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Weiming Zhuang , Jian Xu , Chen Chen , Jingtao Li , Lingjuan Lyu

Control system middle layers act as a co-ordination and communication bridge between end users, including operators, system experts, scientists, and experimental users, and the low-level control system interface. This article describes a…

HEP-Frame is a new C++ package designed to efficiently perform analyses of data sets from a very large number of events, like those available at the Large Hadron Collider (LHC) at CERN, Geneva. It mainly targets high performance servers and…

High Energy Physics - Experiment · Physics 2023-03-10 A. Pereira , A. Onofre , A. Proenca

At the Canadian Astronomy Data Centre, we have combined our cloud computing system, CANFAR, with the world's most advanced machine learning software, Skytree, to create the world's first cloud computing system for data mining in astronomy.…

Instrumentation and Methods for Astrophysics · Physics 2013-12-17 Nicholas M. Ball

Significant obstacles exist in scientific domains including genetics, climate modeling, and astronomy due to the management, preprocess, and training on complicated data for deep learning. Even while several large-scale solutions offer…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-23 Arup Kumar Sarker , Aymen Alsaadi , Alexander James Halpern , Prabhath Tangella , Mikhail Titov , Niranda Perera , Mills Staylor , Gregor von Laszewski , Shantenu Jha , Geoffrey Fox

Creating a vision pipeline for different datasets to solve a computer vision task is a complex and time consuming process. Currently, these pipelines are developed with the help of domain experts. Moreover, there is no systematic structure…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Aditya Kapoor , Nijil George , Vartika Sengar , Vighnesh Vatsal , Jayavardhana Gubbi

ScopeSim is a flexible multipurpose instrument data simulation framework built in Python. It enables both raw and reduced observation data to be simulated for a wide range of telescopes and instruments quickly and efficiently on a personal…

Instrumentation and Methods for Astrophysics · Physics 2021-09-29 Kieran Leschinski , Hugo Buddelmeijer , Oliver Czoske , Miguel Verdugo , Gijs Verdoes-Kleijn , Werner Zeilinger

Point clouds are commonly used in various practical applications such as autonomous driving and the manufacturing industry. However, these point clouds often suffer from incompleteness due to limited perspectives, scanner resolution and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Fan Duan , Jiahao Yu , Li Chen

An open-source, Python-based Temporal Analysis of Products (TAP) reactor simulation and processing program is introduced. TAPsolver utilizes algorithmic differentiation for the calculation of highly accurate derivatives, which are used to…

Computational Engineering, Finance, and Science · Computer Science 2020-09-01 Adam Yonge , M. Ross Kunz , Rakesh Batchu , Zongtang Fang , Tobin Issac , Rebecca Fushimi , Andrew J. Medford

Message Passing Interface (MPI) plays a crucial role in distributed memory parallelization across multiple nodes. However, parallelizing MPI code manually, and specifically, performing domain decomposition, is a challenging, error-prone…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-31 Nadav Schneider , Tal Kadosh , Niranjan Hasabnis , Timothy Mattson , Yuval Pinter , Gal Oren

LOFAR is a leading aperture synthesis telescope operated in the Netherlands with stations across Europe. The LOFAR Two-meter Sky Survey (LoTSS) will produce more than 3000 14 TB data sets, mapping the entire northern sky at low frequencies.…

Instrumentation and Methods for Astrophysics · Physics 2019-06-28 A. P. Mechev , T. W. Shimwell , A. Plaat , H. Intema , A. L. Varbanescu , H. J. A Rottgering

Low-power multicore platforms are suitable for running data-intensive tasks in parallel, but they are highly inefficient for computing on intermittent power. In this work, we present PEARL (PowEr And eneRgy-aware MuLticore Intermittent…

Emerging Technologies · Computer Science 2025-11-04 Khakim Akhunov , Eren Yildiz , Kasim Sinan Yildirim

Accelerator design languages (ADLs), high-level languages that compile to hardware units, help domain experts quickly design efficient application-specific hardware. ADL compilers optimize datapaths and convert software-like control flow…

Programming Languages · Computer Science 2025-11-26 Ayaka Yorihiro , Griffin Berlstein , Pedro Pontes García , Kevin Laeufer , Adrian Sampson

Kepler mission will provide a huge amount of asteroseismic data during the next few years, among which hundreds of solar-like stars will be targeted. The amount of stars and their observation length represent a step forward in the…

Solar and Stellar Astrophysics · Physics 2009-10-02 S. Mathur , R. A. Garcia , C. Regulo , J. Ballot , D. Salabert , W. J. Chaplin

Data pre-processing pipelines are the bread and butter of any successful AI project. We introduce a novel programming model for pipelines in a data lakehouse, allowing users to interact declaratively with assets in object storage. Motivated…

Databases · Computer Science 2024-11-14 Jacopo Tagliabue , Ryan Curtin , Ciro Greco

Particle filters are a group of algorithms to solve inverse problems through statistical Bayesian methods when the model does not comply with the linear and Gaussian hypothesis. Particle filters are used in domains like data assimilation,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-10 Sebastian Friedemann , Kai Keller , Yen-Sen Lu , Bruno Raffin , Leonardo Bautista Gomez

A data analysis pipeline is a structured sequence of steps that transforms raw data into meaningful insights by integrating multiple analysis algorithms. In many practical applications, analytical findings are obtained only after data pass…

Machine Learning · Statistics 2026-05-04 Yugo Miyata , Tomohiro Shiraishi , Shuichi Nishino , Ichiro Takeuchi

Upcoming and future astronomy research facilities will systematically generate terabyte-sized data sets moving astronomy into the Petascale data era. While such facilities will provide astronomers with unprecedented levels of accuracy and…

Instrumentation and Methods for Astrophysics · Physics 2011-11-30 A. H. Hassan , C. J. Fluke , D. G. Barnes

TOPCAT is a desktop application for interactive analysis of tabular data, especially source catalogues. Along with its command-line counterpart STILTS, it has been under more or less continuous development for the past 15 years and is now…

Instrumentation and Methods for Astrophysics · Physics 2017-11-07 Mark Taylor

Transient radio phenomena and pulsars are one of six LOFAR Key Science Projects (KSPs). As part of the Transients KSP, the Pulsar Working Group (PWG) has been developing the LOFAR Pulsar Data Pipelines to both study known pulsars as well as…

Instrumentation and Methods for Astrophysics · Physics 2015-03-17 A. Alexov , J. W. T. Hessels , J. D. Mol , B. Stappers , J. van Leeuwen