English
Related papers

Related papers: Porting the LSST Data Management Pipeline Software…

200 papers

We classify and review current approaches to software infrastructure for research, development and delivery of NLP systems. The task is motivated by a discussion of current trends in the field of NLP and Language Engineering. We describe a…

cmp-lg · Computer Science 2008-02-03 Hamish Cunningham , Kevin Humphreys , Robert Gaizauskas , Yorick Wilks

Developers heavily rely on Application Programming Interfaces (APIs) from libraries to build their software. As software evolves, developers may need to replace the used libraries with alternate libraries, a process known as library…

Software Engineering · Computer Science 2024-02-01 Mohayeminul Islam , Ajay Kumar Jha , Ildar Akhmetov , Sarah Nadi

The end of Moore's Law has ushered in a diversity of hardware not seen in decades. Operating system (and system software) portability is accordingly becoming increasingly critical. Simultaneously, there has been tremendous progress in…

Programming Languages · Computer Science 2022-09-23 Jingmei Hu , Eric Lu , David A. Holland , Ming Kawaguchi , Stephen Chong , Margo I. Seltzer

Existing C to Rust translation techniques fail to balance quality and scalability: transpilation-based approaches scale to large projects but produce code with poor safety, idiomaticity, and readability. In contrast, LLM-based techniques…

Software Engineering · Computer Science 2025-11-26 Saman Dehghan , Tianran Sun , Tianxiang Wu , Zihan Li , Reyhaneh Jabbarvand

Source code repositories allow developers to manage multiple versions (or branches) of a software system. Pull-requests are used to modify a branch, and backporting is a regular activity used to port changes from a current development…

Software Engineering · Computer Science 2022-04-11 Debasish Chakroborti , Kevin A. Schneider , Chanchal K. Roy

Recent advances in machine learning have significantly improved the understanding of source code data and achieved good performance on a number of downstream tasks. Open source repositories like GitHub enable this process with rich…

Software Engineering · Computer Science 2022-06-20 Ming Zhu , Aneesh Jain , Karthik Suresh , Roshan Ravindran , Sindhu Tipirneni , Chandan K. Reddy

Pre-training state-of-the-art large language models (LLMs) requires vast amounts of clean and diverse text data. While the open development of large high-quality English pre-training datasets has seen substantial recent progress, training…

As the need for large-scale data processing grows, distributed programming frameworks like PySpark have become increasingly popular. However, the task of converting traditional, sequential code to distributed code remains a significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-11 Arun Sanjel , Bikram Khanal , Greg Speegle , Pablo Rivas

Selecting third-party software packages in open-source ecosystems like Python is challenging due to the large number of alternatives and limited transparent evidence for comparison. Generative AI tools are increasingly used in development…

Logs are a common way to record detailed run-time information in software. As modern software systems evolve in scale and complexity, logs have become indispensable to understanding the internal states of the system. At the same time…

Machine Learning · Computer Science 2021-03-15 Armin Catovic , Carolyn Cartwright , Yasmin Tesfaldet Gebreyesus , Simone Ferlin

In this work we compute a reasonably comprehensive set of tables for current and next generation survey facility filter conversions. Almost all useful transforms are included with the ProSpect software package described in Robotham et al…

Instrumentation and Methods for Astrophysics · Physics 2020-10-26 Aaron S. G. Robotham

With the ever-increasing adoption of machine learning for data analytics, maintaining a machine learning pipeline is becoming more complex as both the datasets and trained models evolve with time. In a collaborative environment, the changes…

Software Engineering · Computer Science 2021-03-17 Zhaojing Luo , Sai Ho Yeung , Meihui Zhang , Kaiping Zheng , Lei Zhu , Gang Chen , Feiyi Fan , Qian Lin , Kee Yuan Ngiam , Beng Chin Ooi

Python has gained widespread popularity in the fields of machine learning, artificial intelligence, and data engineering due to its effectiveness and extensive libraries. R, on its side, remains a dominant language for statistical analysis…

We report on the modernization of the ESRF beamline application software with Python modules. The current building blocks used around the SPEC data acquisition software together with the new elements are presented.

Condensed Matter · Physics 2007-05-23 Jorg Klora

Large amounts of Adaptive-Optics (AO) control loop data and telemetry are currently inaccessible to end-users. Broadening access to those data has the potential to change the AO landscape on many fronts, addressing several use-cases such as…

We describe how Python can be leveraged to streamline the curation, modelling and dissemination of drug discovery data as well as the development of innovative, freely available tools for the related scientific community. We look at various…

Other Computer Science · Computer Science 2016-07-05 Michał Nowotka , George Papadatos , Mark Davies , Nathan Dedman , Anne Hersey

In this document, we introduce PyCSP$3$, a Python library that allows us to write models of combinatorial constrained problems in a declarative manner. Currently, with PyCSP$3$, you can write models of constraint satisfaction and…

Artificial Intelligence · Computer Science 2024-08-30 Christophe Lecoutre , Nicolas Szczepanski

Across an aggregation of EuSpRIG presentation papers, two maxims hold true: spreadsheets models are akin to software, yet spreadsheet developers are not software engineers. As such, the lack of traditional software engineering tools and…

Software Engineering · Computer Science 2018-01-31 Oliver Beavers

The increasing electricity demands of personal computers, communication networks, and data centers contribute to higher atmospheric greenhouse gas emissions, which in turn lead to global warming and climate change. Therefore the energy…

Software Engineering · Computer Science 2025-06-24 Tom Cappendijk , Pepijn de Reus , Ana Oprescu