English
Related papers

Related papers: Automating Data Science Pipelines with Tensor Comp…

200 papers

The effectiveness of the machine learning methods for real-world tasks depends on the proper structure of the modeling pipeline. The proposed approach is aimed to automate the design of composite machine learning pipelines, which is…

The integration of behavioral phenomena into mechanistic models of cognitive function is a fundamental staple of cognitive science. Yet, researchers are beginning to accumulate increasing amounts of data without having the temporal or…

Machine Learning · Computer Science 2021-05-18 Sebastian Musslick

Multidimensional arrays (NDArrays) are a central abstraction in modern scientific computing environments. Unfortunately, they can make reasoning about programs harder as the number of different array shapes used in an execution of a program…

Programming Languages · Computer Science 2021-03-01 Adam Paszke , Brennan Saeta

This study proposes a framework for the automated hyperparameter optimization of a bearing fault detection pipeline for permanent magnet synchronous motors (PMSMs) without the need of external sensors. A automated machine learning (AutoML)…

Signal Processing · Electrical Eng. & Systems 2023-06-21 Tobias Wagner , Alexander Gepperth , Elmar Engels

Tensor completion is a technique of filling missing elements of the incomplete data tensors. It being actively studied based on the convex optimization scheme such as nuclear-norm minimization. When given data tensors include some noises,…

Computer Vision and Pattern Recognition · Computer Science 2018-01-11 Tatsuya Yokota , Hidekata Hontani

In this paper, we present a novel technique to search for hardware architectures of accelerators optimized for end-to-end training of deep neural networks (DNNs). Our approach addresses both single-device and distributed pipeline and tensor…

Hardware Architecture · Computer Science 2024-04-24 Muhammad Adnan , Amar Phanishayee , Janardhan Kulkarni , Prashant J. Nair , Divya Mahajan

The common pipeline of training deep neural networks consists of several building blocks such as data augmentation and network architecture selection. AutoML is a research field that aims at automatically designing those parts, but most…

Machine Learning · Computer Science 2021-01-13 Taiga Kashima , Yoshihiro Yamada , Shunta Saito

Tensor completion is a natural higher-order generalization of matrix completion where the goal is to recover a low-rank tensor from sparse observations of its entries. Existing algorithms are either heuristic without provable guarantees,…

Data Structures and Algorithms · Computer Science 2023-07-14 Allen Liu , Ankur Moitra

Matrix completion, the problem of completing missing entries in a data matrix with low dimensional structure (such as rank), has seen many fruitful approaches and analyses. Tensor completion is the tensor analog, that attempts to impute…

Numerical Analysis · Mathematics 2021-07-07 Zehan Chao , Longxiu Huang , Deanna Needell

Modern data science relies on data analytic pipelines to organize interdependent computational steps. Such analytic pipelines often involve different algorithms across multiple steps, each with its own hyperparameters. To achieve the best…

Machine Learning · Computer Science 2016-06-27 Yuyu Zhang , Mohammad Taha Bahadori , Hang Su , Jimeng Sun

Automated Machine Learning (AutoML) is a promising direction for democratizing AI by automatically deploying Machine Learning systems with minimal human expertise. The core technical challenge behind AutoML is optimizing the pipelines of…

Machine Learning · Computer Science 2023-05-26 Sebastian Pineda Arango , Josif Grabocka

Hyperparameter tuning of multi-stage pipelines introduces a significant computational burden. Motivated by the observation that work can be reused across pipelines if the intermediate computations are the same, we propose a pipeline-aware…

Machine Learning · Computer Science 2019-03-14 Liam Li , Evan Sparks , Kevin Jamieson , Ameet Talwalkar

Data provenance has numerous applications in the context of data preparation pipelines. It can be used for debugging faulty pipelines, interpreting results, verifying fairness, and identifying data quality issues, which may affect the…

Databases · Computer Science 2025-11-06 Khalid Belhajjame , Haroun Mezrioui , Yuyan Zhao

Data pipeline frameworks provide abstractions for implementing sequences of data-intensive transformation operators, automating the deployment and execution of such transformations in a cluster. Deploying a data pipeline, however, requires…

Artificial Intelligence · Computer Science 2026-01-13 Leonardo Rosa Amado , Adriano Vogel , Dalvan Griebler , Gabriel Paludo Licks , Eric Simon , Felipe Meneguzzi

How can we predict missing values in multi-dimensional data (or tensors) more accurately? The task of tensor completion is crucial in many applications such as personalized recommendation, image and video restoration, and link prediction in…

Machine Learning · Computer Science 2021-08-24 Sejoon Oh , Sungchul Kim , Ryan A. Rossi , Srijan Kumar

The automated machine learning (AutoML) process can require searching through complex configuration spaces of not only machine learning (ML) components and their hyperparameters but also ways of composing them together, i.e. forming ML…

Machine Learning · Computer Science 2022-08-10 David Jacob Kedziora , Tien-Dung Nguyen , Katarzyna Musial , Bogdan Gabrys

High-dimensional data has become ubiquitous across the sciences but presents computational and statistical challenges. A common approach to addressing these challenges is through sparsity. In this paper, we introduce a new concept of…

Statistics Theory · Mathematics 2025-09-03 Ali Mohades , Johannes Lederer

As the field of data science continues to grow, there will be an ever-increasing demand for tools that make machine learning accessible to non-experts. In this paper, we introduce the concept of tree-based pipeline optimization for…

Neural and Evolutionary Computing · Computer Science 2016-03-22 Randal S. Olson , Nathan Bartley , Ryan J. Urbanowicz , Jason H. Moore

Lack of data on which to perform experimentation is a recurring issue in many areas of research, particularly in machine learning. The inability of most automated data mining techniques to be generalized to all types of data is inherently…

Machine Learning · Computer Science 2024-10-17 Gustavo Assunção , Paulo Menezes

Tensor completion is a core machine learning algorithm used in recommender systems and other domains with missing data. While the matrix case is well-understood, theoretical results for tensor problems are limited, particularly when the…

Machine Learning · Statistics 2023-06-13 Kameron Decker Harris , Oscar López , Angus Read , Yizhe Zhu