English
Related papers

Related papers: Tuple-oriented Compression for Large-scale Mini-ba…

200 papers

We investigate a novel approach to approximate tensor-network contraction via the exact, matrix-free decomposition of full tensor-networks. We study this method as a means to eliminate the propagation of error in the approximation of…

Chemical Physics · Physics 2025-06-23 Karl Pierce

Scientific applications in fields such as high energy physics, computational fluid dynamics, and climate science generate vast amounts of data at high velocities. This exponential growth in data production is surpassing the advancements in…

Machine Learning · Computer Science 2024-09-10 Xiao Li , Jaemoon Lee , Anand Rangarajan , Sanjay Ranka

Coded distributed computing (CDC) is a new technique proposed with the purpose of decreasing the intense data exchange required for parallelizing distributed computing systems. Under the famous MapReduce paradigm, this coded approach has…

Information Theory · Computer Science 2022-06-28 Federico Brunero , Petros Elia

Deep neural networks (DNNs) are the de facto standard for essential use cases, such as image classification, computer vision, and natural language processing. As DNNs and datasets get larger, they require distributed training on…

Machine Learning · Computer Science 2024-03-07 Minghao Li , Ran Ben Basat , Shay Vargaftik , ChonLam Lao , Kevin Xu , Michael Mitzenmacher , Minlan Yu

Topology Optimization (TO) provides a systematic approach for obtaining structure design with optimum performance of interest. However, the process requires numerical evaluation of objective function and constraints at each iteration, which…

Machine Learning · Computer Science 2022-03-22 Ren Kai Tan , Chao Qian , Dan Xu , Wenjing Ye

Recently, min-max optimization problems have received increasing attention due to their wide range of applications in machine learning (ML). However, most existing min-max solution techniques are either single-machine or distributed…

Machine Learning · Computer Science 2023-03-07 Zhuqing Liu , Xin Zhang , Songtao Lu , Jia Liu

Deep learning models in large-scale machine learning systems are often continuously trained with enormous data from production environments. The sheer volume of streaming training data poses a significant challenge to real-time training…

Machine Learning · Computer Science 2021-04-28 Chaosheng Dong , Xiaojie Jin , Weihao Gao , Yijia Wang , Hongyi Zhang , Xiang Wu , Jianchao Yang , Xiaobing Liu

Scalable machine learning over big data is an important problem that is receiving a lot of attention in recent years. On popular distributed environments such as Hadoop running on a cluster of commodity machines, communication costs are…

Machine Learning · Computer Science 2015-03-18 Dhruv Mahajan , Nikunj Agrawal , S. Sathiya Keerthi , S. Sundararajan , Leon Bottou

State-of-the-art optimization is steadily shifting towards massively parallel pipelines with extremely large batch sizes. As a consequence, CPU-bound preprocessing and disk/memory/network operations have emerged as new performance…

Machine Learning · Computer Science 2020-10-27 Naman Agarwal , Rohan Anil , Tomer Koren , Kunal Talwar , Cyril Zhang

Deploying large and complex deep neural networks on resource-constrained edge devices poses significant challenges due to their computational demands and the complexities of non-convex optimization. Traditional compression methods such as…

Machine Learning · Computer Science 2024-10-10 Prateek Varshney , Mert Pilanci

Recurrent neural networks can be large and compute-intensive, yet many applications that benefit from RNNs run on small devices with very limited compute and storage capabilities while still having run-time constraints. As a result, there…

Machine Learning · Computer Science 2020-08-14 Urmish Thakker , Jesse Beu , Dibakar Gope , Ganesh Dasika , Matthew Mattina

Recent advances in diffusion models have demonstrated their strong capabilities in generating high-fidelity samples from complex distributions through an iterative refinement process. Despite the empirical success of diffusion models in…

Robotics · Computer Science 2024-07-03 Chaoyi Pan , Zeji Yi , Guanya Shi , Guannan Qu

Many industry verticals are confronted with small-sized tabular data. In this low-data regime, it is currently unclear whether the best performance can be expected from simple baselines, or more complex machine learning approaches that…

Machine Learning · Computer Science 2024-05-14 Ricardo Knauer , Erik Rodner

We introduce a simple yet significant improvement to the time-evolving block decimation (TEBD) tensor network algorithm for simulating the time dynamics of strongly correlated one-dimensional (1D) mixed quantum states. The efficiency of 1D…

Quantum Physics · Physics 2026-05-19 Sayak Guha Roy , Kevin Slagle

We study the best low-rank Tucker decomposition of symmetric tensors. The motivating application is decomposing higher-order multivariate moments. Moment tensors have special structure and are important to various data science problems. We…

Numerical Analysis · Mathematics 2023-06-13 Ruhui Jin , Joe Kileel , Tamara G. Kolda , Rachel Ward

Gradient compression (GC) is a promising approach to addressing the communication bottleneck in distributed deep learning (DDL). However, it is challenging to find the optimal compression strategy for applying GC to DDL because of the…

Machine Learning · Computer Science 2022-06-08 Zhuang Wang , Haibin Lin , Yibo Zhu , T. S. Eugene Ng

Distance metric learning (DML) is an important task that has found applications in many domains. The high computational cost of DML arises from the large number of variables to be determined and the constraint that a distance metric has to…

Machine Learning · Computer Science 2013-04-05 Qi Qian , Rong Jin , Jinfeng Yi , Lijun Zhang , Shenghuo Zhu

Multilevel optimization has gained renewed interest in machine learning due to its promise in applications such as hyperparameter tuning and continual learning. However, existing methods struggle with the inherent difficulty of efficiently…

Machine Learning · Computer Science 2024-10-16 Yuntian Gu , Xuzheng Chen

Compressed indexing is a powerful technique that enables efficient querying over data stored in compressed form, significantly reducing memory usage and often accelerating computation. While extensive progress has been made for…

Data Structures and Algorithms · Computer Science 2025-10-23 Rajat De , Dominik Kempa

The Massive Parallel Computation (MPC) model is a theoretical framework for popular parallel and distributed platforms such as MapReduce, Hadoop, or Spark. We consider the task of computing a large matching or small vertex cover in this…

Data Structures and Algorithms · Computer Science 2018-07-24 Krzysztof Onak