English
Related papers

Related papers: Data Pricing in Machine Learning Pipelines

200 papers

Machine learning (ML) offers powerful methods for detecting and modeling associations often in data with large feature spaces and complex associations. Many useful tools/packages (e.g. scikit-learn) have been developed to make the various…

Machine Learning · Computer Science 2022-06-27 Ryan J. Urbanowicz , Robert Zhang , Yuhan Cui , Pranshu Suri

Smarter applications are making better use of the insights gleaned from data, having an impact on every industry and research discipline. At the core of this revolution lies the tools and the methods that are driving it, from processing the…

Machine Learning · Computer Science 2020-04-01 Sebastian Raschka , Joshua Patterson , Corey Nolet

Data is the new oil of the 21st century. The growing trend of trading data for greater welfare has led to the emergence of data markets. A data market is any mechanism whereby the exchange of data products including datasets and data…

Traditional machine learning methods have been widely studied in financial innovation. My study focuses on the application of deep learning methods on asset pricing. I investigate various deep learning methods for asset pricing, especially…

Statistical Finance · Quantitative Finance 2022-09-27 Chen Zhang

How do you scale a machine learning product at a startup? In particular, how do you serve a greater volume, velocity, and variety of queries cost-effectively? We break down costs into variable costs-the cost of serving the model and…

Machine Learning · Computer Science 2023-04-24 Atul Dhingra , Gaurav Sood

Data engineering pipelines are a widespread way to provide high-quality data for all kinds of data science applications. However, numerous challenges still remain in the composition and operation of such pipelines. Data engineering…

Databases · Computer Science 2025-07-30 Kevin M. Kramer , Valerie Restat , Sebastian Strasser , Uta Störl , Meike Klettke

Increased adoption and deployment of machine learning (ML) models into business, healthcare and other organisational processes, will result in a growing disconnect between the engineers and researchers who developed the models and the…

Machine Learning · Computer Science 2019-07-09 Iain Barclay , Alun Preece , Ian Taylor , Dinesh Verma

Internet of things (IoT) produces massive data from devices embedded with sensors. The IoT data allows creating profitable services using machine learning. However, previous research does not address the problem of optimal pricing and…

Networking and Internet Architecture · Computer Science 2020-02-17 Mohammad Abu Alsheikh , Dinh Thai Hoang , Dusit Niyato , Derek Leong , Ping Wang , Zhu Han

This paper provides a short overview of how to use machine learning to build data-driven models in fluid mechanics. The process of machine learning is broken down into five stages: (1) formulating a problem to model, (2) collecting and…

Fluid Dynamics · Physics 2021-10-06 Steven L. Brunton

In a multi-party machine learning system, different parties cooperate on optimizing towards better models by sharing data in a privacy-preserving way. A major challenge in learning is the incentive issue. For example, if there is…

Multiagent Systems · Computer Science 2020-08-11 Mengjing Chen , Yang Liu , Weiran Shen , Yiheng Shen , Pingzhong Tang , Qiang Yang

The input data pipeline is an essential component of each machine learning (ML) training job. It is responsible for reading massive amounts of training data, processing batches of samples using complex transformations, and loading them onto…

Machine Learning · Computer Science 2024-11-28 Mark Zhao , Emanuel Adamiak , Christos Kozyrakis

In industrial machine learning pipelines, data often arrive in parts. Particularly in the case of deep neural networks, it may be too expensive to train the model from scratch each time, so one would rather use a previously learned model…

Machine Learning · Statistics 2018-03-29 Max Kochurov , Timur Garipov , Dmitry Podoprikhin , Dmitry Molchanov , Arsenii Ashukha , Dmitry Vetrov

Stock price prediction is a complicated and interesting task. Noisy trends make stock pricing sensitive and complicated while the economical motivation behind, keeps it interesting for researchers and investors. In this paper we are to…

Optimization and Control · Mathematics 2023-12-19 Negin Bagherpour

The explosion of digital data has created multiple opportunities for organizations and individuals to leverage machine learning (ML) to transform the way they operate. However, the shortage of experts in the field of machine learning --…

Machine Learning · Computer Science 2019-11-21 Doron Laadan , Roman Vainshtein , Yarden Curiel , Gilad Katz , Lior Rokach

Collaborative machine learning involves training models on data from multiple parties but must incentivize their participation. Existing data valuation methods fairly value and reward each party based on shared data or model parameters but…

Machine Learning · Computer Science 2024-04-03 Rachael Hwee Ling Sim , Yehong Zhang , Trong Nghia Hoang , Xinyi Xu , Bryan Kian Hsiang Low , Patrick Jaillet

Much of the alignment tuning literature is organized around optimization objectives, while the construction of alignment data is often treated implicitly. In this survey, we adopt a data centric perspective and reframe alignment tuning as a…

Computation and Language · Computer Science 2026-05-27 Hwanjun Song

Pricing advanced data products - particularly in complex fields such as semiconductor manufacturing - is a fundamentally challenging task due to the sparsity of publicly available transaction data, and its frequent heterogeneity and…

Computational Finance · Quantitative Finance 2026-02-03 Adam L. Siemiatkowski , Victor Zhirnov , Kashyap Yellai , Gabriella Bein , Terresa Zimmerman

As Machine Learning (ML) models are becoming increasingly complex, one of the central challenges is their deployment at scale, such that companies and organizations can create value through Artificial Intelligence (AI). An emerging paradigm…

Machine Learning · Computer Science 2021-12-07 Lam Duc Nguyen , Shashi Raj Pandey , Soret Beatriz , Arne Broering , Petar Popovski

The fluid dynamics community has increasingly adopted machine learning to analyze, model, predict, and control a wide range of flows. These methods offer powerful computational capabilities for regression, compression, and optimization. In…

Fluid Dynamics · Physics 2025-08-26 Kunihiko Taira , Georgios Rigas , Kai Fukami

We propose an innovative data-driven option pricing methodology that relies exclusively on the dataset of historical underlying asset prices. While the dataset is rooted in the objective world, option prices are commonly expressed as…

Pricing of Securities · Quantitative Finance 2024-01-23 Min Dai , Hanqing Jin , Xi Yang