English
Related papers

Related papers: Towards Evolution Capabilities in Data Pipelines

200 papers

Complex systems' modeling and simulation are powerful ways to investigate a multitude of natural phenomena providing extended knowledge on their structure and behavior. However, enhanced modeling and simulation require integration of…

In today's digital world, we are faced with an explosion of data and models produced and manipulated by numerous large-scale cloud-based applications. Under such settings, existing transfer evolutionary optimization frameworks grapple with…

Neural and Evolutionary Computing · Computer Science 2022-05-13 Mojtaba Shakeri , Erfan Miahi , Abhishek Gupta , Yew-Soon Ong

Rapid progress in deep learning is leading to a diverse set of quickly changing models, with a dramatically growing demand for compute. However, as frameworks specialize performance optimization to patterns in popular networks, they…

Machine Learning · Computer Science 2022-08-31 Oliver Rausch , Tal Ben-Nun , Nikoli Dryden , Andrei Ivanov , Shigang Li , Torsten Hoefler

Establishing the emergence of evolutionary behavior as a defining characteristic of 'life' is a major step in the Artificial life (ALife) studies. We present here an abstract formal framework for this aim based upon the notion of high-level…

Neural and Evolutionary Computing · Computer Science 2009-01-13 Janardan Misra

The ability to independently deploy parts of a software system is one of the cornerstones of modern software development, and allows for these parts to evolve independently and at different speeds. A major challenge of such independent…

Software Engineering · Computer Science 2021-03-24 Holger Knoche , Wilhelm Hasselbring

Biological organisms adapt to changes by processing informations from different sources, most notably from their ancestors and from their environment. We review an approach to quantify these informations by analyzing mathematical models of…

Populations and Evolution · Quantitative Biology 2016-03-23 Olivier Rivoire

Traditional data processing pipelines are typically static and handcrafted for specific tasks, limiting their adaptability to evolving requirements. While general-purpose agents and coding assistants can generate code for well-understood…

Artificial Intelligence · Computer Science 2026-02-20 Udayan Khurana

Evolving a software process model without a retrospective and, in consequence, without an understanding of the process evolution, can lead to severe problems for the software development organization, e.g., inefficient performance as a…

Software Engineering · Computer Science 2014-01-21 Alexis Ocampo , Jürgen Münch

Behavioral changes in animals and humans, as a consequence of an error or a verbal instruction, can be extremely rapid. Improvement in behavioral performances are usually associated in machine learning and reinforcement learning to synaptic…

Neurons and Cognition · Quantitative Biology 2025-03-12 Cristiano Capone , Luca Falorsi

Systems evolving according to the standard concept of biological or technological evolution are often described by catalytic evolution equations. We study the structure of these equations and find a deep relationship to classical…

Physics and Society · Physics 2007-05-23 Rudolf Hanel , Stuart A. Kauffman , Stefan Thurner

Ecological systems are emergent features of ecological and adaptive dynamics of a community of interacting species. By natural selection through the abiotic environment and by co-adaptation within the community, species evolve, thereby…

Populations and Evolution · Quantitative Biology 2018-07-03 Katharina Brinck , Henrik Jeldtoft Jensen

Biological information processing manifests a huge variety in its complexity and capability among different organisms, which presumably stems from the evolutionary optimization under limited computational resources. Starting from the…

Biological Physics · Physics 2025-10-21 Takehiro Tottori , Tetsuya J. Kobayashi

Data scientists develop ML pipelines in an iterative manner: they repeatedly screen a pipeline for potential issues, debug it, and then revise and improve its code according to their findings. However, this manual process is tedious and…

Databases · Computer Science 2024-05-01 Stefan Grafberger , Paul Groth , Sebastian Schelter

The idea that there are any large-scale trends in the evolution of biological organisms is highly controversial. It is commonly believed, for example, that there is a large-scale trend in evolution towards increasing complexity, but…

Neural and Evolutionary Computing · Computer Science 2021-06-08 Peter D. Turney

Ecology and evolution are inseparable. Motivated by some recent experiments, we have developed models of evolutionary ecology from the perspective of dynamic networks. In these models, in addition to the intra-node dynamics, which…

Populations and Evolution · Quantitative Biology 2009-11-10 Debashish Chowdhury , Dietrich Stauffer

Mission critical software is often required to comply with multiple regulations, standards or policies. Recent paradigms, such as cloud computing, also require software to operate in heterogeneous, highly distributed, and changing…

Software Engineering · Computer Science 2016-11-18 Jesús García-Galán , Liliana Pasquale , George Grispos , Bashar Nuseibeh

Recognising and reacting to change in non-stationary data-streams is a challenging task. The majority of research in this area assumes that the true class label of incoming points are available, either at each time step or intermittently…

Neural and Evolutionary Computing · Computer Science 2023-12-27 Conor Fahy , Shengxiang Yang

Increasingly larger number of software systems today are including data science components for descriptive, predictive, and prescriptive analytics. The collection of data science stages from acquisition, to cleaning/curation, to modeling,…

Software Engineering · Computer Science 2022-02-15 Sumon Biswas , Mohammad Wardat , Hridesh Rajan

Entity alignment has always had significant uses within a multitude of diverse scientific fields. In particular, the concept of matching entities across networks has grown in significance in the world of social science as communicative…

Social and Information Networks · Computer Science 2020-04-21 James Flamino , Christopher Abriola , Ben Zimmerman , Zhongheng Li , Joel Douglas

Context: Mining software repositories is a popular means to gain insights into a software project's evolution, monitor project health, support decisions and derive best practices. Tools supporting the mining process are commonly applied by…

Software Engineering · Computer Science 2025-11-13 Nicole Hoess , Carlos Paradis , Rick Kazman , Wolfgang Mauerer