English
Related papers

Related papers: Optimal Approximate Matrix Multiplication over Sli…

200 papers

In a recent breakthrough, Paz and Schwartzman (SODA'17) presented a single-pass ($2+\epsilon$)-approximation algorithm for the maximum weight matching problem in the semi-streaming model. Their algorithm uses $O(n\log^2 n)$ bits of space,…

Data Structures and Algorithms · Computer Science 2019-01-01 Mohsen Ghaffari , David Wajc

Edge computing is emerging as a new paradigm to allow processing data at the edge of the network, where data is typically generated and collected, by exploiting multiple devices at the edge collectively. However, exploiting the potential of…

Information Theory · Computer Science 2021-06-17 Elahe Vedadi , Hulya Seferoglu

Max-Cut is a fundamental combinatorial optimization problem that has been studied in various computational settings. We initiate the study of its streaming complexity in \emph{general metric spaces} with access to distance oracles. We give…

Data Structures and Algorithms · Computer Science 2026-05-01 Shaofeng H. -C. Jiang , Pan Peng , Haoze Wang

The sliding window approach provides an elegant way to handle contexts of sizes larger than the Transformer's input window, for tasks like language modeling. Here we extend this approach to the sequence-to-sequence task of document parsing.…

Computation and Language · Computer Science 2023-05-30 Sadhana Kumaravel , Tahira Naseem , Ramon Fernandez Astudillo , Radu Florian , Salim Roukos

Many real-world matrix datasets arrive as high-throughput vector streams, making it impractical to store or process them in their entirety. To enable real-time analytics under limited computational, memory, and communication resources,…

Databases · Computer Science 2026-01-12 Hanyan Yin , Dongxie Wen , Jiajun Li , Zhewei Wei , Xiao Zhang , Peng Zhao , Zhi-Hua Zhou

In this paper we study the extraction of representative elements in the data stream model in the form of submodular maximization. Different from the previous work on streaming submodular maximization, we are interested only in the recent…

Data Structures and Algorithms · Computer Science 2016-11-02 Jiecao Chen , Huy L. Nguyen , Qin Zhang

We show how to utilize machine learning approaches to improve sliding window algorithms for approximate frequency estimation problems, under the ``algorithms with predictions'' framework. In this dynamic environment, previous…

Data Structures and Algorithms · Computer Science 2024-09-19 Rana Shahout , Ibrahim Sabek , Michael Mitzenmacher

Finding the $r\times r$ submatrix of maximum volume of a matrix $A\in\mathbb R^{n\times n}$ is an NP hard problem that arises in a variety of applications. We propose a new greedy algorithm of cost $\mathcal O(n)$, for the case $A$…

Numerical Analysis · Mathematics 2021-04-05 Stefano Massei

Sliding-window aggregation summarizes the most recent information in a data stream. Users specify how that summary is computed, usually as an associative binary operator because this is the most general known form for which it is possible…

Data Structures and Algorithms · Computer Science 2018-10-29 Kanat Tangwongsan , Martin Hirzel , Scott Schneider

We develop several efficient algorithms for the classical \emph{Matrix Scaling} problem, which is used in many diverse areas, from preconditioning linear systems to approximation of the permanent. On an input $n\times n$ matrix $A$, this…

Data Structures and Algorithms · Computer Science 2017-04-10 Zeyuan Allen-Zhu , Yuanzhi Li , Rafael Oliveira , Avi Wigderson

The Segment Anything Model (SAM) has achieved a notable success in two-dimensional image segmentation in natural images. However, the substantial gap between medical and natural images hinders its direct application to medical image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Quan Quan , Fenghe Tang , Zikang Xu , Heqin Zhu , S. Kevin Zhou

We consider a smoothed online convex optimization (SOCO) problem with predictions, where the learner has access to a finite lookahead window of time-varying stage costs, but suffers a switching cost for changing its actions at each stage.…

Optimization and Control · Mathematics 2023-10-16 Spandan Senapati , Ashwin Shenai , Ketan Rajawat

Image modeling and simulation are critical to extending the limits of leading edge lithography technologies used for IC making. Simultaneous source mask optimization (SMO) has become an important objective in the field of computational…

We propose a novel application of coded computing to the problem of the nearest neighbor estimation using MatDot Codes [Fahim. et.al. 2017], that are known to be optimal for matrix multiplication in terms of recovery threshold under storage…

Information Theory · Computer Science 2018-11-30 Utsav Sheth , Sanghamitra Dutta , Malhar Chaudhari , Haewon Jeong , Yaoqing Yang , Jukka Kohonen , Teemu Roos , Pulkit Grover

The communication bottleneck of over-the-air federated learning (OA-FL) lies in uploading the gradients of local learning models. In this paper, we study the reduction of the communication overhead in the gradients uploading by using the…

Signal Processing · Electrical Eng. & Systems 2023-04-11 Chenxi Zhong , Xiaojun Yuan

Model merging offers a scalable alternative to multi-task learning but often yields suboptimal performance on classification tasks. We attribute this degradation to a geometric misalignment between the merged encoder and static…

Machine Learning · Computer Science 2026-02-03 Fanshuang Kong , Richong Zhang , Zhijie Nie , Hang Zhou , Ziqiao Wang , Qiang Sun , Chunming Hu

Simultaneous clustering and optimization (SCO) has recently drawn much attention due to its wide range of practical applications. Many methods have been previously proposed to solve this problem and obtain the optimal model. However, when a…

Machine Learning · Computer Science 2019-08-06 Yawei Zhao , En Zhu , Xinwang Liu , Chang Tang , Deke Guo , Jianping Yin

We consider the problem of estimating the value of max cut in a graph in the streaming model of computation. At one extreme, there is a trivial $2$-approximation for this problem that uses only $O(\log n)$ space, namely, count the number of…

Data Structures and Algorithms · Computer Science 2014-09-09 Michael Kapralov , Sanjeev Khanna , Madhu Sudan

We extend the multi-pass streaming model to sliding window problems, and address the problem of computing order statistics on fixed-size sliding windows, in the multi-pass streaming model as well as the closely related communication…

Data Structures and Algorithms · Computer Science 2018-07-13 Dhruv Rohatgi

The past decade has witnessed many interesting algorithms for maintaining statistics over a data stream. This paper initiates a theoretical study of algorithms for monitoring distributed data streams over a time-based sliding window (which…

Data Structures and Algorithms · Computer Science 2010-02-03 Ho-Leung Chan , Tak-Wah Lam , Lap-Kei Lee , Hing-Fung Ting