English
Related papers

Related papers: On Efficiently Partitioning a Topic in Apache Kafk…

200 papers

Load balancing, operator instance collocations and horizontal scaling are critical issues in Parallel Stream Processing Engines to achieve low data processing latency, optimized cluster utilization and minimized communication cost…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-12 Kasper Grud Skat Madsen , Yongluan Zhou , Jianneng Cao

This paper addresses the efficient computation of Jacobian matrices for programs composed of sequential differentiable subprograms. By representing the overall Jacobian as a chain product of the Jacobians of these subprograms, we reduce the…

Discrete Mathematics · Computer Science 2025-05-12 Simon Märtens , Uwe Naumann

Recent advances in data analytics have enabled the accurate prediction of user access patterns, giving rise to the idea of packed caching delivering multiple co accessed data items together as a bundle. This improves caching efficiency, as…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-17 Suvarthi Sarkar , Aadarshraj Sah , Poddutoori Sweeya Reddy , Aryabartta Sahu

Many academic disciplines - including information systems, computer science, and operations management - face scheduling problems as important decision making tasks. Since many scheduling problems are NP-hard in the strong sense, there is a…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-26 Gerhard Rauchecker , Guido Schryen

Markov chain Monte Carlo (MCMC) methods are often used in clustering since they guarantee asymptotically exact expectations in the infinite-time limit. In finite time, though, slow mixing often leads to poor performance. Modern computing…

Methodology · Statistics 2022-02-24 Tin D. Nguyen , Brian L. Trippe , Tamara Broderick

We consider a fundamental generalization of the classical newsvendor problem where the seller needs to decide on the inventory of a product jointly for multiple locations on a metric as well as a fulfillment policy to satisfy the uncertain…

Optimization and Control · Mathematics 2025-06-04 Ayoub Foussoul , Vineet Goyal

We present scalable parallel algorithms with sublinear per-processor communication volume and low latency for several fundamental problems related to finding the most relevant elements in a set, for various notions of relevance: We begin…

Data Structures and Algorithms · Computer Science 2015-10-20 Lorenz Hübschle-Schneider , Peter Sanders , Ingo Müller

This paper studies chance-constrained stochastic optimization problems with finite support. It presents an iterative method that solves reduced-size chance-constrained models obtained by partitioning the scenario set. Each reduced problem…

Optimization and Control · Mathematics 2024-11-26 Marius Roland , Alexandre Forel , Thibaut Vidal

Current algorithms for large-scale industrial optimization problems typically face a trade-off: they either require exponential time to reach optimal solutions, or employ problem-specific heuristics. To overcome these limitations, we…

Quantum Physics · Physics 2025-10-16 Matteo Vandelli , Francesco Ferrari , Daniele Dragoni

We present a scheduler that improves cluster utilization and job completion times by packing tasks having multi-resource requirements and inter-dependencies. While the problem is algorithmically very hard, we achieve near-optimality on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-26 Robert Grandl , Srikanth Kandula , Sriram Rao , Aditya Akella , Janardhan Kulkarni

Traditionally, clustering algorithms focus on partitioning the data into groups of similar instances. The similarity objective, however, is not sufficient in applications where a fair-representation of the groups in terms of protected…

Machine Learning · Computer Science 2021-11-08 Tai Le Quy , Arjun Roy , Gunnar Friege , Eirini Ntoutsi

As the development of distributed systems progresses, more and more challenges arise and the need for developing optimized systems and for optimizing existing systems from multiple perspectives becomes more stringent. In this paper I…

Data Structures and Algorithms · Computer Science 2009-03-21 Mugurel Ionut Andreica

Kernel segmentation aims at partitioning a data sequence into several non-overlapping segments that may have nonlinear and complex structures. In general, it is formulated as a discrete optimization problem with combinatorial constraints. A…

Machine Learning · Computer Science 2022-06-23 Tung Doan , Atsuhiro Takasu

We investigate a new model for partitioning a set of items into groups (clusters). The number of groups is given and the distances between items are well defined. These distances may include weights. The sum of the distances between all…

Optimization and Control · Mathematics 2023-12-20 Pawel Kalczynski , Zvi Goldstein , Zvi Drezner

This paper addresses the problem of managing perishable inventory under multiple sources of uncertainty, including stochastic demand, unreliable supplier fulfillment, and probabilistic product shelf life. We develop a discrete-event…

Neural and Evolutionary Computing · Computer Science 2025-11-04 Leonardo Kanashiro Felizardo , Edoardo Fadda , Mariá Cristina Vasconcelos Nascimento

quest for processing speed potential. In fact, we always get a fraction of the technically available computing power (so-called {\em theoretical peak}), and the gap is likely to go hand-to-hand with the hardware complexity of the target…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-23 Claude Tadonki

Modern commodity computing systems are composed by a number of different heterogeneous processing units, each of which has its own unique performance and energy characteristics. However, the majority of current network packet processing…

Networking and Internet Architecture · Computer Science 2022-05-02 Giannis Giakoumakis , Eva Papadogiannaki , Giorgos Vasiliadis , Sotiris Ioannidis

There is an explosion of data, documents, and other content, and people require tools to analyze and interpret these, tools to turn the content into information and knowledge. Topic modeling have been developed to solve these problems.…

Computation and Language · Computer Science 2015-10-23 Aaron Q Li

Recent years have witnessed the emergence of textual commonsense knowledge bases, aimed at providing more nuanced and context-rich knowledge. The integration of external commonsense into language models has been shown to be a key enabler in…

Computation and Language · Computer Science 2023-05-26 Wanyun Cui , Xingran Chen

The multiple knapsack problem with grouped items aims to maximize rewards by assigning groups of items among multiple knapsacks, considering knapsack capacities. Either all items in a group are assigned or none at all. We propose algorithms…

Data Structures and Algorithms · Computer Science 2020-06-02 Francisco Castillo-Zunino , Pinar Keskinocak