English
Related papers

Related papers: Delta Tensor: Efficient Vector and Tensor Storage …

200 papers

This paper shows how to optimize sparse tensor algebraic expressions by introducing temporary tensors, called workspaces, into the resulting loop nests. We develop a new intermediate language for tensor operations called concrete index…

Mathematical Software · Computer Science 2023-10-18 Fredrik Kjolstad , Willow Ahrens , Shoaib Kamil , Saman Amarasinghe

The widespread use of multisensor technology and the emergence of big data sets have brought the necessity to develop more versatile tools to represent higher-order data with multiple aspects and high dimensionality. Data in the form of…

Signal Processing · Electrical Eng. & Systems 2018-06-27 Ali Zare , Alp Ozdemir , Mark A. Iwen , Selin Aviyente

Lightweight data compression is a key technique that allows column stores to exhibit superior performance for analytical queries. Despite a comprehensive study on dictionary-based encodings to approach Shannon's entropy, few prior works…

Databases · Computer Science 2023-11-27 Yihao Liu , Xinyu Zeng , Huanchen Zhang

Tensor computations, with matrix multiplication being the primary operation, serve as the fundamental basis for data analysis, physics, machine learning, and deep learning. As the scale and complexity of data continue to grow rapidly, the…

Hardware Architecture · Computer Science 2024-10-24 Qizhe Wu , Yuchen Gui , Zhichen Zeng , Xiaotian Wang , Huawen Liang , Xi Jin

Automatic optimization for tensor programs becomes increasingly important as we deploy deep learning in various environments, and efficient optimization relies on a rich search space and effective search. Most existing efforts adopt a…

Machine Learning · Computer Science 2022-10-11 Junru Shao , Xiyou Zhou , Siyuan Feng , Bohan Hou , Ruihang Lai , Hongyi Jin , Wuwei Lin , Masahiro Masuda , Cody Hao Yu , Tianqi Chen

Advanced algorithms for large-scale electronic structure calculations are mostly based on processing multi-dimensional sparse data. Examples are sparse matrix-matrix multiplications in linear-scaling Kohn-Sham calculations or the efficient…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-31 Ilia Sivkov , Patrick Seewald , Alfio Lazzaro , Juerg Hutter

Data management applications store their data using structured files in which data are usually sorted to serve indexing and queries. However, in-place insertions and removals of data are not naturally supported in a file's address space. To…

Operating Systems · Computer Science 2021-08-06 Chen Chen , Wenshao Zhong , Xingbo Wu

This paper proposes a framework for distributed, in-storage training of neural networks on clusters of computational storage devices. Such devices not only contain hardware accelerators but also eliminate data movement between the host and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-14 Ali HeydariGorji , Mahdi Torabzadehkashi , Siavash Rezaei , Hossein Bobarshad , Vladimir Alves , Pai H. Chou

Data discovery from data lakes is an essential application in modern data science. While many previous studies focused on improving the efficiency and effectiveness of data discovery, little attention has been paid to the usability of such…

Databases · Computer Science 2025-04-04 Yihao Hu , Jin Wang , Sajjadur Rahman

Tensor algebra lies at the core of computational science and machine learning. Due to its high usage, entire libraries exist dedicated to improving its performance. Conventional tensor algebra performance boosts focus on algorithmic…

Programming Languages · Computer Science 2022-08-16 Sathvik Redrouthu , Rishi Athavale

Columnar storage is a core component of a modern data analytics system. Although many database management systems (DBMSs) have proprietary storage formats, most provide extensive support to open-source storage formats such as Parquet and…

Databases · Computer Science 2023-11-08 Xinyu Zeng , Yulong Hui , Jiahong Shen , Andrew Pavlo , Wes McKinney , Huanchen Zhang

Developments in Artificial Intelligence (AI) and Distributed Ledger Technology (DLT) currently lead to lively debates in academia and practice. AI processes data to perform tasks that were previously thought possible only for humans. DLT…

Cryptography and Security · Computer Science 2020-02-06 Konstantin D. Pandl , Scott Thiebes , Manuel Schmidt-Kraepelin , Ali Sunyaev

In this era of big data, data analytics and machine learning, it is imperative to find ways to compress large data sets such that intrinsic features necessary for subsequent analysis are not lost. The traditional workhorse for data…

Numerical Analysis · Mathematics 2020-01-03 Misha Kilmer , Lior Horesh , Haim Avron , Elizabeth Newman

Tabular data comprising rows (samples) with the same set of columns (attributes, is one of the most widely used data-type among various industries, including financial services, health care, research, retail, and logistics, to name a few.…

Machine Learning · Computer Science 2023-02-24 Rajat Singh , Srikanta Bedathur

Tensor datasets (two-, three-, or higher-dimensional) are fundamental to many scientific fields utilizing imaging or simulation technologies. Advances in these methods have led to ever-increasing data sizes and, consequently, interest and…

Graphics · Computer Science 2025-10-01 Dominik Drees , Benjamin Risse

Activation sparsity improves compute efficiency and resource utilization in sparsity-aware neural network accelerators. As the predominant operation in DNNs is multiply-accumulate (MAC) of activations with weights to compute inner products,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Amirreza Yousefzadeh , Manolis Sifalakis

Computationally efficient classification system architecture is proposed. It utilizes fast tensor-vector multiplication algorithm to apply linear operators upon input signals . The approach is applicable to wide variety of recognition…

Computer Vision and Pattern Recognition · Computer Science 2016-03-08 Pavel Dourbal , Mikhail Pekker

As the rate of data collection continues to grow rapidly, developing visualization tools that scale to immense data sets is a serious and ever-increasing challenge. Existing approaches generally seek to decouple storage and visualization…

Databases · Computer Science 2021-06-24 Sam Kumar , Michael P Andersen , David E. Culler

The increase in data storage and power consumption at data-centers has made it imperative to design energy efficient Distributed Storage Systems (DSS). The energy efficiency of DSS is strongly influenced not only by the volume of data,…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-25 Akshay Kumar , Ravi Tandon , T. Charles Clancy

We consider tensors in the Hierarchical Tucker format and suppose the tensor data to be distributed among several compute nodes. We assume the compute nodes to be in a one-to-one correspondence with the nodes of the Hierarchical Tucker…

Numerical Analysis · Mathematics 2017-11-07 Lars Grasedyck , Christian Löbbert