English
Related papers

Related papers: Big Data Staging with MPI-IO for Interactive X-ray…

200 papers

This is a position paper, submitted to the Future Online Analysis Platform Workshop (https://press3.mcs.anl.gov/futureplatform/), which argues that simple data analysis applications are common today, but future online supercomputing…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-27 Justin M Wozniak , Jonathan Ozik , Daniel S. Katz , Michael Wilde

Thanks to the latest advancements in wavefront shaping, optical methods have proven crucial to achieve imaging and control light in multiply scattering media, like biological tissues. However, the stability times of living biological…

Optics · Physics 2023-09-21 Lorenzo Valzania , Sylvain Gigan

Large-scale HPC simulations of plasma dynamics in fusion devices require efficient parallel I/O to avoid slowing down the simulation and to enable the post-processing of critical information. Such complex simulations lacking parallel I/O…

Today's scientists are quickly moving from in vitro to in silico experimentation: they no longer analyze natural phenomena in a petri dish, but instead they build models and simulate them. Managing and analyzing the massive amounts of data…

Databases · Computer Science 2012-08-02 Farhan Tauheed , Thomas Heinis , Felix Shürmann , Henry Markram , Anastasia Ailamaki

The use of brain images as markers for diseases or behavioral differences is challenged by the small effects size and the ensuing lack of power, an issue that has incited researchers to rely more systematically on large cohorts. Coupled…

Machine Learning · Statistics 2015-11-17 Bertrand Thirion , Andrés Hoyos-Idrobo , Jonas Kahn , Gael Varoquaux

The deployment of instantaneous CSI-based power control schemes necessitates computationally intensive signal processing operations, requiring substantial resources to handle real-time CSI updates and the associated overhead. Conversely,…

Information Theory · Computer Science 2025-05-08 Zahra Mobini , Hien Quoc Ngo

Magnetic particle imaging (MPI) is an emerging medical imaging modality which offers a unique combination of high temporal and spatial resolution, sensitivity and biocompatibility. For system-matrix (SM) based image reconstruction in MPI, a…

Software Engineering · Computer Science 2024-01-12 Anselm von Gladiss , Amir Shayan Ahmadian , Jan Jürjens

Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing…

Neural and Evolutionary Computing · Computer Science 2020-05-05 Qiang Yu , Shenglan Li , Huajin Tang , Longbiao Wang , Jianwu Dang , Kay Chen Tan

One of the hardest challenges of the current Big Data landscape is the lack of ability to process huge volumes of information in an acceptable time. The goal of this work, is to ascertain if it is useful to use typical Big Data tools to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-08 Adrian Bazaga , Michal Pitonak

Scientific workflows bridge scientific challenges with computational resources. While dispel4py, a stream-based workflow system, offers mappings to parallel enactment engines like MPI or Multiprocessing, its optimization primarily focuses…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-04 Liang Liang , Heting Zhang , Guang Yang , Thomas Heinis , Rosa Filgueira

While detailed resource usage monitoring is possible on the low-level using proper tools, associating such usage with higher-level abstractions in the application layer that actually cause the resource usage in the first place presents a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-02 Joel Witzke , Ansgar Lößer , Vasilis Bountris , Florian Schintke , Björn Scheuermann

Recent years have seen a huge development in spatial modelling and prediction methodology, driven by the increased availability of remote-sensing data and the reduced cost of distributed-processing technology. It is well known that…

Computation · Statistics 2020-02-18 Andrew Zammit-Mangion , Jonathan Rougier

Techniques for recording large-scale neuronal spiking activity are developing very fast. This leads to an increasing demand for algorithms capable of analyzing large amounts of experimental spike train data. One of the most crucial and…

Data Analysis, Statistics and Probability · Physics 2015-04-16 Thomas Kreuz , Mario Mulansky , Nebojsa Bozanic

High-energy X-ray diffraction methods can non-destructively map the 3D microstructure and associated attributes of metallic polycrystalline engineering materials in their bulk form. These methods are often combined with external stimuli…

Debugging parallel and distributed programs is a difficult activitiy due to the multiplicity of sequential bugs, the existence of malign effects like race conditions and deadlocks, and the huge amounts of data that have to be processed.…

Software Engineering · Computer Science 2009-10-02 Dieter Kranzlmueller , Christian Schaubschlaeger , Jens Volkert

Time series data are ubiquitous in real-world applications. However, one of the most common problems is that the time series data could have missing values by the inherent nature of the data collection process. So imputing missing values…

Machine Learning · Computer Science 2022-09-23 Eunkyu Oh , Taehun Kim , Yunhu Ji , Sushil Khyalia

Distributed approaches based on the map-reduce programming paradigm have started to be proposed in the bioinformatics domain, due to the large amount of data produced by the next-generation sequencing techniques. However, the use of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-05 Umberto Ferraro Petrillo , Mara Sorella , Giuseppe Cattaneo , Raffaele Giancarlo , Simona Rombo

Photonic integrated circuits have been extensively explored for optical processing with the aim of breaking the speed bottleneck of digital electronics. However, the input/output (IO) bottleneck remains one of the key barriers. Here we…

Emerging Technologies · Computer Science 2024-05-24 Minjia Chen , Yizhi Wang , Chunhui Yao , Adrian Wonfor , Shuai Yang , Richard Penty , Qixiang Cheng

Upcoming astronomical surveys will observe billions of galaxies across cosmic time, providing a unique opportunity to map the many pathways of galaxy assembly to an incredibly high resolution. However, the huge amount of data also poses an…

Instrumentation and Methods for Astrophysics · Physics 2022-11-08 Bingjie Wang , Joel Leja , Ashley Villar , Joshua S. Speagle

The next generation of AI applications will continuously interact with the environment and learn from these interactions. These applications impose new and demanding systems requirements, both in terms of performance and flexibility. In…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-02 Philipp Moritz , Robert Nishihara , Stephanie Wang , Alexey Tumanov , Richard Liaw , Eric Liang , Melih Elibol , Zongheng Yang , William Paul , Michael I. Jordan , Ion Stoica