English
Related papers

Related papers: Automating Data Science: Prospects and Challenges

200 papers

The Science of Science (SoS) explores the mechanisms underlying scientific discovery, and offers valuable insights for enhancing scientific efficiency and fostering innovation. Traditional approaches often rely on simplistic assumptions and…

Artificial Intelligence · Computer Science 2025-05-20 Renqi Chen , Haoyang Su , Shixiang Tang , Zhenfei Yin , Qi Wu , Hui Li , Ye Sun , Nanqing Dong , Wanli Ouyang , Philip Torr

This two-part review examines how automation has contributed to different aspects of discovery in the chemical sciences. In this second part, we reflect on a selection of exemplary studies. It is increasingly important to articulate what…

Quantitative Methods · Quantitative Biology 2020-04-01 Connor W. Coley , Natalie S. Eyke , Klavs F. Jensen

Many have argued that statistics students need additional facility to express statistical computations. By introducing students to commonplace tools for data management, visualization, and reproducible analysis in data science and applying…

Computation · Statistics 2020-07-21 Nicholas J. Horton , Benjamin S. Baumer , Hadley Wickham

As we are fast approaching the beginning of a paradigm shift in the field of science, Data driven science (the so called fourth science paradigm) is going to be the driving force in research and innovation. From medicine to biodiversity and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-07 Hrishav Bakul Barua

Data engineering is one of the fastest-growing fields within machine learning (ML). As ML becomes more common, the appetite for data grows more ravenous. But ML requires more data than individual teams of data engineers can readily produce,…

Machine Learning · Computer Science 2021-02-24 Vijay Janapa Reddi , Greg Diamos , Pete Warden , Peter Mattson , David Kanter

AutoML systems can speed up routine data science work and make machine learning available to those without expertise in statistics and computer science. These systems have gained traction in enterprise settings where pools of skilled data…

Human-Computer Interaction · Computer Science 2021-01-13 Anamaria Crisan , Brittany Fiore-Gartland

Recent advances in large language models (LLMs) have enabled a new class of AI agents that automate multiple stages of the data science workflow by integrating planning, tool use, and multimodal reasoning across text, code, tables, and…

The last two decades have seen tremendous advances in Artificial Intelligence. The exponential growth in terms of computation capabilities has given us hope of developing humans like robots. The question is: are we there yet? Maybe not.…

Artificial Intelligence · Computer Science 2022-02-02 Madhav Agarwal , Siddhant Bansal

Everybody wants to analyse their data, but only few posses the data science expertise to to this. Motivated by this observation we introduce a novel framework and system \textsc{VisualSynth} for human-machine collaboration in data science.…

Artificial Intelligence · Computer Science 2020-04-24 Clément Gautrais , Yann Dauxais , Stefano Teso , Samuel Kolb , Gust Verbruggen , Luc De Raedt

A main driver behind the digitization of industry and society is the belief that data-driven model building and decision making can contribute to higher degrees of automation and more informed decisions. Building such models from data often…

We explore trust in a relatively new area of data science: Automated Machine Learning (AutoML). In AutoML, AI methods are used to generate and optimize machine learning models by automatically engineering features, selecting models, and…

Machine Learning · Computer Science 2020-01-22 Jaimie Drozdal , Justin Weisz , Dakuo Wang , Gaurav Dass , Bingsheng Yao , Changruo Zhao , Michael Muller , Lin Ju , Hui Su

There has been considerable growth and interest in industrial applications of machine learning (ML) in recent years. ML engineers, as a consequence, are in high demand across the industry, yet improving the efficiency of ML engineers…

Machine Learning · Computer Science 2020-05-05 Anh Truong , Austin Walters , Jeremy Goodsitt , Keegan Hines , C. Bayan Bruss , Reza Farivar

Data science, and machine learning in particular, is rapidly transforming the scientific and industrial landscapes. The aerospace industry is poised to capitalize on big data and machine learning, which excels at solving the types of…

Data science is the business of learning from data, which is traditionally the business of statistics. Data science, however, is often understood as a broader, task-driven and computationally-oriented version of statistics. Both the term…

Other Statistics · Statistics 2018-10-11 Iain Carmichael , J. S. Marron

With the continuous and vast increase in the amount of data in our digital world, it has been acknowledged that the number of knowledgeable data scientists can not scale to address these challenges. Thus, there was a crucial need for…

Machine Learning · Computer Science 2019-06-12 Radwa Elshawi , Mohamed Maher , Sherif Sakr

Data science is creating very exciting trends as well as significant controversy. A critical matter for the healthy development of data science in its early stages is to deeply understand the nature of data and data science, and to discuss…

Computers and Society · Computer Science 2020-07-01 Longbing Cao

The emergence and continued reliance on the Internet and related technologies has resulted in the generation of large amounts of data that can be made available for analyses. However, humans do not possess the cognitive capabilities to…

Machine Learning · Computer Science 2021-01-12 MohammadNoor Injadat , Abdallah Moubayed , Ali Bou Nassif , Abdallah Shami

Science has a data management problem, as well as a project management problem. While industrial-grade data science teams have embraced the agile mindset, and adopted or created all kind of tools to create reproducible workflows,…

Computers and Society · Computer Science 2022-07-05 Juan Julián Merelo-Guervós , Mario García-Valdez

Analytics play an important role in modern business. Companies adapt data science lifecycles to their culture to seek productivity and improve their competitiveness among others. Data science lifecycles are fairly an important contributing…

Machine Learning · Computer Science 2025-10-09 Rohith Mahadevan