English
Related papers

Related papers: Data Science Methodologies: Current Challenges and…

200 papers

The amount of data in the world is expanding rapidly. Every day, huge amounts of data are created by scientific experiments, companies, and end users' activities. These large data sets have been labeled as "Big Data", and their storage,…

Databases · Computer Science 2020-04-29 Mahdi Bohlouli , Frank Schulz , Lefteris Angelis , David Pahor , Ivona Brandic , David Atlan , Rosemary Tate

Large systems biology projects can encompass several workgroups often located in different countries. An overview about existing data standards in systems biology and the management, storage, exchange and integration of the generated data…

Databases · Computer Science 2009-12-15 Gerhard Mayer

Machine learning is now used in many applications thanks to its ability to predict, generate, or discover patterns from large quantities of data. However, the process of collecting and transforming data for practical use is intricate. Even…

Organizations across all sectors are increasingly undergoing deep transformation and restructuring towards data-driven operations. The central role of data highlights the need for reliable and clean data. Unreliable, erroneous, and…

Databases · Computer Science 2020-04-20 George Fletcher , Paul Groth , Juan Sequeda

Data science agents promise to accelerate discovery and insight-generation by turning data into executable analyses and findings. Yet existing data science benchmarks fall short due to fragmented evaluation interfaces that make…

Artificial Intelligence · Computer Science 2026-01-26 Fan Nie , Junlin Wang , Harper Hua , Federico Bianchi , Yongchan Kwon , Zhenting Qi , Owen Queen , Shang Zhu , James Zou

The term scientific workflow has evolved over the last two decades to encompass a broad range of compositions of interdependent compute tasks and data movements. It has also become an umbrella term for processing in modern scientific…

Data science models, although successful in a number of commercial domains, have had limited applicability in scientific problems involving complex physical phenomena. Theory-guided data science (TGDS) is an emerging paradigm that aims to…

Data science pipelines inform and influence many daily decisions, from what we buy to who we work for and even where we live. When designed incorrectly, these pipelines can easily propagate social inequity and harm. Traditional solutions…

Computers and Society · Computer Science 2024-10-24 Ziwei Dong , Ameya Patil , Yuichi Shoda , Leilani Battle , Emily Wall

Today, data guides the decision-making process of most companies. Effectively analyzing and manipulating data at scale to extract and exploit relevant knowledge is a challenging task, due to data characteristics such as its size, the rate…

Software Engineering · Computer Science 2025-03-24 Arianna Dragoni , Alessandro Margara

Data management, which encompasses activities and strategies related to the storage, organization, and description of data and other research materials, helps ensure the usability of datasets -- both for the original research team and for…

Digital Libraries · Computer Science 2022-04-14 John A. Borghi , Ana E. Van Gulick

Data science (DS) projects often follow a lifecycle that consists of laborious tasks for data scientists and domain experts (e.g., data exploration, model training, etc.). Only till recently, machine learning(ML) researchers have developed…

Human-Computer Interaction · Computer Science 2021-01-15 Dakuo Wang , Josh Andres , Justin Weisz , Erick Oduor , Casey Dugan

Data Science is a complex and evolving field, but most agree that it can be defined as a combination of expertise drawn from three broad areascomputer science and technology, math and statistics, and domain knowledge -- with the purpose of…

Databases · Computer Science 2023-11-15 Rafael C. Alvarado

In the data science courses at the University of British Columbia, we define data science as the study, development and practice of reproducible and auditable processes to obtain insight from data. While reproducibility is core to our…

Computers and Society · Computer Science 2022-07-26 Joel Ostblom , Tiffany Timbers

Evaluation of potential AGI systems and methods is difficult due to the breadth of the engineering goal. We have no methods for perfect evaluation of the end state, and instead measure performance on small tests designed to provide…

Artificial Intelligence · Computer Science 2025-10-03 John Hawkins

This is a thought piece on data-intensive science requirements for databases and science centers. It argues that peta-scale datasets will be housed by science centers that provide substantial storage and processing for scientists who access…

Databases · Computer Science 2007-05-23 Jim Gray , David T. Liu , Maria Nieto-Santisteban , Alexander S. Szalay , David DeWitt , Gerd Heber

Spreadsheet engineering methodologies are diverse and sometimes contradictory. It is difficult for spreadsheet developers to identify a spreadsheet engineering methodology that is appropriate for their class of spreadsheet, with its unique…

Human-Computer Interaction · Computer Science 2008-02-28 Thomas A. Grossman , Ozgur Ozluk

Nowadays, science has been coming into a new paradigm, called data-intensive science. While current studies of the new phenomenon focused on building up infrastructure for this new paradigm, yet a few studies concern users of scientific…

Instrumentation and Methods for Astrophysics · Physics 2011-02-08 Jian Zhang , Chaomei Chen , Michael S. Vogeley

Due to the popularity of smart mobile phones and context-aware technology, various contextual data relevant to users' diverse activities with mobile phones is available around us. This enables the study on mobile phone data and…

Computers and Society · Computer Science 2018-11-07 Iqbal H. Sarker

FuturICT foundations are social science, complex systems science, and ICT. The main concerns and challenges in the science of complex systems in the context of FuturICT are laid out in this paper with special emphasis on the Complex Systems…

Adaptation and Self-Organizing Systems · Physics 2015-06-04 Maxi San Miguel , Jeffrey H. Johnson , Janos Kertesz , Kimmo Kaski , Albert Díaz-Guilera , Robert S. MacKay , Vittorio Loreto , Peter Erdi , Dirk Helbing

In this perspective, we argue that despite the democratization of powerful tools for data science and machine learning over the last decade, developing the code for a trustworthy and effective data science system (DSS) is getting harder.…