English
Related papers

Related papers: Landscape of High-performance Python to Develop Da…

200 papers

The reproducibility of scientific research has become a point of critical concern. We argue that openness and transparency are critical for reproducibility, and we outline an ecosystem for open and transparent science that has emerged…

Computers and Society · Computer Science 2018-09-27 Russell A. Poldrack , Krzysztof J. Gorgolewski , Gael Varoquaux

Computational analysis has become ubiquitous within the heliophysics community. However, community standards for peer-review of codes and analysis have lagged behind these developments. This absence has contributed to the reproducibility…

Instrumentation and Methods for Astrophysics · Physics 2019-01-03 A. G. Burrell , A. Halford , J. Klenzing , R. A. Stoneback , S. K. Morley , A. M. Annex , K. M. Laundal , A. C. Kellerman , D. Stansby , J. Ma

The transition from AI/ML models to production-ready AI-based systems is a challenge for both data scientists and software engineers. In this paper, we report the results of a workshop conducted in a consulting company to understand how…

Software Engineering · Computer Science 2021-06-01 Filippo Lanubile , Fabio Calefato , Luigi Quaranta , Maddalena Amoruso , Fabio Fumarola , Michele Filannino

Languages such as P4 and NPL have enabled a wide and diverse range of networking applications that take advantage of programmable dataplanes. However, software development in these languages is difficult. To address this issue, high-level…

Networking and Internet Architecture · Computer Science 2024-06-21 Mihai-Valentin Dumitru , Vlad-Andrei Bădoiu , Costin Raiciu

Effective performance profiling and analysis are essential for optimizing training and inference of deep learning models, especially given the growing complexity of heterogeneous computing environments. However, existing tools often lack…

Performance · Computer Science 2024-11-06 Qidong Zhao , Hao Wu , Yuming Hao , Zilingfeng Ye , Jiajia Li , Xu Liu , Keren Zhou

In the realm of scientific computing, both Julia and Python have established themselves as powerful tools. Within the context of High Energy Physics (HEP) data analysis, Python has been traditionally favored, yet there exists a compelling…

Programming Languages · Computer Science 2024-04-30 Ianna Osborne , Jim Pivarski , Jerry Ling

Large language models (LLMs) and transformer-based architectures are increasingly utilized for source code analysis. As software systems grow in complexity, integrating LLMs into code analysis workflows becomes essential for enhancing…

Software Engineering · Computer Science 2025-03-25 Hamed Jelodar , Mohammad Meymani , Roozbeh Razavi-Far

Despite incredible recent advances in machine learning, building machine learning applications remains prohibitively time-consuming and expensive for all but the best-trained, best-funded engineering organizations. This expense comes not…

Machine Learning · Computer Science 2017-06-12 Peter Bailis , Kunle Olukotun , Christopher Re , Matei Zaharia

Accurate hardware performance models are critical to efficient code generation. They can be used by compilers to make heuristic decisions, by superoptimizers as a minimization objective, or by autotuners to find an optimal configuration for…

The success of AI models relies on the availability of large, diverse, and high-quality datasets, which can be challenging to obtain due to data scarcity, privacy concerns, and high costs. Synthetic data has emerged as a promising solution…

Computation and Language · Computer Science 2024-08-13 Ruibo Liu , Jerry Wei , Fangyu Liu , Chenglei Si , Yanzhe Zhang , Jinmeng Rao , Steven Zheng , Daiyi Peng , Diyi Yang , Denny Zhou , Andrew M. Dai

With web and mobile platforms becoming more prominent devices utilized in data analysis, there are currently few systems which are not without flaw. In order to increase the performance of these systems and decrease errors of data…

Databases · Computer Science 2022-05-03 Daniel Szelogowski

Currently, a variety of pipeline tools are available for use in data engineering. Data scientists can use these tools to resolve data wrangling issues associated with data and accomplish some data engineering tasks from data ingestion…

Machine Learning · Computer Science 2024-06-21 Anthony Mbata , Yaji Sripada , Mingjun Zhong

Domain experts are increasingly employing machine learning to solve their domain-specific problems. This article presents six key challenges that a domain expert faces in transforming their problem into a computational workflow, and then…

Software Engineering · Computer Science 2023-12-27 Bentley James Oakes , Michalis Famelis , Houari Sahraoui

Micro-core architectures combine many low memory, low power computing cores together in a single package. These are attractive for use as accelerators but due to limited on-chip memory and multiple levels of memory hierarchy, the way in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-06 Maurice Jamieson , Nick Brown

Automated documentation of programming source code and automated code generation from natural language are challenging tasks of both practical and scientific interest. Progress in these areas has been limited by the low availability of…

Computation and Language · Computer Science 2017-07-10 Antonio Valerio Miceli Barone , Rico Sennrich

High Performance Research Desktops are used by HPC centers and research computing organizations to lower the barrier of entry to HPC systems. These Linux desktops are deployed alongside HPC systems, leveraging the investments in HPC compute…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-05 Robert Henschel , Jonas Lindemann , Anders Follin , Bernd Dammann , Cicada Dennis , Abhinav Thota

In recent years, there has been increasing interest in network diffusion models and related problems. The most popular of these are the independent cascade and linear threshold models. Much of the recent experimental work done on these…

Social and Information Networks · Computer Science 2024-04-29 Eliot W. Robson , Dhemath Reddy , Abhishek K. Umrawal

While automated experiments and high-throughput methods are becoming more mainstream in the age of data, empowering individual researchers to capture, collate, and contextualize their data faster and more reproducibly still remains a…

Computers and Society · Computer Science 2020-07-30 Ha-Kyung Kwon , Chirranjeevi Balaji Gopal , Jared Kirschner , Santiago Caicedo , Brian D. Storey

Many types of geospatial analyses are computationally complex, involving, for example, solution processes that require numerous iterations or combinatorial comparisons. This complexity has motivated the application of high performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-16 Marc P. Armstrong

Significant investments to upgrade and construct large-scale scientific facilities demand commensurate investments in R&D to design algorithms and computing approaches to enable scientific and engineering breakthroughs in the big data era.…