English
Related papers

Related papers: Towards Scalable Dataframe Systems

200 papers

Online learning in large-scale structured bandits is known to be challenging due to the curse of dimensionality. In this paper, we propose a unified meta-learning framework for a general class of structured bandit problems where the…

Machine Learning · Computer Science 2022-03-01 Runzhe Wan , Lin Ge , Rui Song

Over the past decade, the data lake concept has emerged as an alternative to data warehouses for storing and analyzing big data. A data lake allows storing data without any predefined schema. Therefore, data querying and analysis depend on…

Python is a particularly appealing language to carry out data analysis, owing in part to its user-friendly character as well as its access to well maintained and powerful libraries like NumPy and SciPy. Still, for the purpose of analyzing…

High Energy Physics - Lattice · Physics 2024-02-01 Luis Altenkort , David Anthony Clarke , Jishnu Goswami , Hauke Sandmeyer

Despite incredible recent advances in machine learning, building machine learning applications remains prohibitively time-consuming and expensive for all but the best-trained, best-funded engineering organizations. This expense comes not…

Machine Learning · Computer Science 2017-06-12 Peter Bailis , Kunle Olukotun , Christopher Re , Matei Zaharia

The performance of machine learning models relies heavily on the quality of input data, yet real-world applications often face significant data-related challenges. A common issue arises when curating training data or deploying models: two…

Machine Learning · Computer Science 2025-09-24 Varun Babbar , Zhicheng Guo , Cynthia Rudin

Domains such as scientific workflows and business processes exhibit data models with complex relationships between objects. This relationship is typically represented as sequences, where each data item is annotated with multi-dimensional…

Databases · Computer Science 2019-05-06 Phuong Nguyen , Vatche Ishakian , Vinod Muthusamy , Aleksander Slominski

The advent of modern technology, permitting the measurement of thousands of characteristics simultaneously, has given rise to floods of data characterized by many large or even huge datasets. This new paradigm presents extraordinary…

Methodology · Statistics 2019-02-14 A. M. Pires , J. A. Branco

Python data science libraries such as Pandas and NumPy have recently gained immense popularity. Although these libraries are feature-rich and easy to use, their scalability limitations require more robust computational resources. In this…

Databases · Computer Science 2024-07-17 Hesam Shahrokhi , Amirali Kaboli , Mahdi Ghorbani , Amir Shaikhha

Scientific computing requires handling large linear models, which are often composed of structured matrices. With increasing model size, dense representations quickly become infeasible to compute or store. Matrix-free implementations are…

Mathematical Software · Computer Science 2021-11-30 Christoph Wilfried Wagner , Sebastian Semper , Jan Kirchhof

Traditional software engineering programming paradigms are mostly object or procedure oriented, driven by deterministic algorithms. With the advent of deep learning and cognitive sciences there is an emerging trend for data-driven…

Software Engineering · Computer Science 2017-11-17 Anush Sankaran , Rahul Aralikatte , Senthil Mani , Shreya Khare , Naveen Panwar , Neelamadhav Gantayat

The role of scalable high-performance workflows and flexible workflow management systems that can support multiple simulations will continue to increase in importance. For example, with the end of Dennard scaling, there is a need to…

Software Engineering · Computer Science 2017-10-19 Jay Jay Billings , Shantenu Jha

Present day machine learning is computationally intensive and processes large amounts of data. It is implemented in a distributed fashion in order to address these scalability issues. The work is parallelized across a number of computing…

Machine Learning · Computer Science 2017-03-28 Alexander Ulanov , Andrey Simanovsky , Manish Marwah

A data representation for system behavior telemetry for scalable big data security analytics is presented, affording telemetry consumers comprehensive visibility into workloads at reduced storage and processing overheads. The new…

Cryptography and Security · Computer Science 2021-01-27 Teryl Taylor , Frederico Araujo , Xiaokui Shu

While the state-of-the-art for frame semantic parsing has progressed dramatically in recent years, it is still difficult for end-users to apply state-of-the-art models in practice. To address this, we present Frame Semantic Transformer, an…

Computation and Language · Computer Science 2023-03-23 David Chanin

Applications are increasingly written as dynamic workflows underpinned by an execution framework that manages asynchronous computations across distributed hardware. However, execution frameworks typically offer one-size-fits-all solutions…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-18 J. Gregory Pauloski , Klaudiusz Rydzy , Valerie Hayot-Sasson , Ian Foster , Kyle Chard

Graphs are ubiquitous real-world data structures, and generative models that approximate distributions over graphs and derive new samples from them have significant importance. Among the known challenges in graph generation tasks,…

Machine Learning · Computer Science 2019-10-04 Wataru Kawai , Yusuke Mukuta , Tatsuya Harada

Tight frames can be characterized as those frames which possess optimal numerical stability properties. In this paper, we consider the question of modifying a general frame to generate a tight frame by rescaling its frame vectors; a process…

Numerical Analysis · Mathematics 2012-04-17 Gitta Kutyniok , Kasso A. Okoudjou , Friedrich Philipp , Elizabeth K. Tuley

Python is a popular high-level general-purpose programming language also heavily used by the scientific community. It supports a variety of different programming paradigms and is preferred by many for its ease of use. With the vision of…

Programming Languages · Computer Science 2021-09-08 Maximilian A. Köhl

We present an expository overview of technical and cultural challenges to the development and adoption of automation at various stages in the data science prediction lifecycle, restricting focus to supervised learning with structured…

Machine Learning · Computer Science 2022-08-26 Nicholas Hoell

Research publication requires public datasets. In recommender systems, some datasets are largely used to compare algorithms against a --supposedly-- common benchmark. Problem: for various reasons, these datasets are heavily preprocessed,…

Information Retrieval · Computer Science 2019-09-30 Anne-Marie Tousch