English
Related papers

Related papers: Checkmate: Breaking the Memory Wall with Optimal T…

200 papers

Effective resource allocation plays a pivotal role for performance optimization in wireless networks. Unfortunately, typical resource allocation problems are mixed-integer nonlinear programming (MINLP) problems, which are NP-hard. Machine…

Signal Processing · Electrical Eng. & Systems 2018-11-20 Yifei Shen , Yuanming Shi , Jun Zhang , Khaled B. Letaief

The next-generation CMB experiments are expected to constrain the tensor-to-scalar ratio $r$ with high precision. Delensing is an important process as the observed CMB $B$-mode polarization that contains the primordial tensor perturbation…

Cosmology and Nongalactic Astrophysics · Physics 2022-10-17 Chen Heinrich , Trey Driskell , Chris Heinrich

The integration of event cameras and spiking neural networks (SNNs) promises energy-efficient visual intelligence, yet scarce event data and the sparsity of DVS outputs hinder effective training. Prior knowledge transfers from RGB to DVS…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yuqi Xie , Shuhan Ye , Yi Yu , Chong Wang , Qixin Zhang , Jiazhen Xu , Le Shen , Yuanbin Qian , Jiangbo Qian , Guoqi Li

Distributed applications running on a large cluster environment, such as the cloud instances will have shorter execution time. However, the application might suffer from sudden termination due to unpredicted computing node failures, thus…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-30 Basma Abdel Azeem , Manal Helal

Reallocation scheduling is one of the most fundamental problems in various areas such as supply chain management, logistics, and transportation science. In this paper, we introduce the reallocation problem that models the scheduling in…

Data Structures and Algorithms · Computer Science 2021-11-05 Toshimasa Ishii , Jun Kawahara , Kazuhisa Makino , Hirotaka Ono

The method of choice for parameter aggregation in Deep Neural Network (DNN) training, a network-intensive task, is shifting from the Parameter Server model to decentralized aggregation schemes (AllReduce) inspired by theoretical guarantees…

Networking and Internet Architecture · Computer Science 2020-04-30 Sayed Hadi Hashemi , Sangeetha Abdu Jyothi , Brighten Godfrey , Roy Campbell

Recently, deep neural network (DNN) has been widely adopted in the design of intelligent communication systems thanks to its strong learning ability and low testing complexity. However, most current offline DNN-based methods still suffer…

Information Theory · Computer Science 2022-02-08 Jiabao Gao , Caijun Zhong , Geoffrey Ye Li , Zhaoyang Zhang

We study class-incremental learning, a training setup in which new classes of data are observed over time for the model to learn from. Despite the straightforward problem formulation, the naive application of classification models to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Ahmet Iscen , Thomas Bird , Mathilde Caron , Alireza Fathi , Cordelia Schmid

Conventional DNN training paradigms typically rely on one training set and one validation set, obtained by partitioning an annotated dataset used for training, namely gross training set, in a certain way. The training set is used for…

Neural and Evolutionary Computing · Computer Science 2020-07-03 Boyu Zhang , A. K. Qin , Hong Pan , Timos Sellis

Recent work in the matrix completion literature has shown that prior knowledge of a matrix's row and column spaces can be successfully incorporated into reconstruction programs to substantially benefit matrix recovery. This paper proposes a…

Information Theory · Computer Science 2025-09-10 Oscar López

Increasingly complex and diverse deep neural network (DNN) models necessitate distributing the execution across multiple devices for training and inference tasks, and also require carefully planned schedules for performance. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-28 Zhiqi Lin , Youshan Miao , Guanbin Xu , Cheng Li , Olli Saarikivi , Saeed Maleki , Fan Yang

Finetuning on domain-specific data is a well-established method for enhancing LLM performance on downstream tasks. Training on each dataset produces a new set of model weights, resulting in a multitude of checkpoints saved in-house or on…

Machine Learning · Computer Science 2026-03-12 Sofia Maria Lo Cicero Vaina , Artem Chumachenko , Max Ryabinin

This work presents a novel method for task optimization in industrial plants using quantum-inspired tensor network technology. This method obtains the best possible combination of tasks on a set of machines with directed constraints while…

Deep Neural Networks (DNNs) have obtained impressive performance across tasks, however they still remain as black boxes, e.g., hard to theoretically analyze. At the same time, Polynomial Networks (PNs) have emerged as an alternative method…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Grigorios G Chrysos , Bohan Wang , Jiankang Deng , Volkan Cevher

The biggest challenge for the deployment of Deep Neural Networks (DNNs) close to the generated data on edge devices is their size, i.e., memory footprint and computational complexity. Both are significantly reduced with quantization. With…

Machine Learning · Computer Science 2022-10-17 Cecilia Latotzke , Batuhan Balim , Tobias Gemmeke

Improving the performance of deep neural networks (DNNs) is important to both the compiler and neural architecture search (NAS) communities. Compilers apply program transformations in order to exploit hardware parallelism and memory…

Machine Learning · Computer Science 2021-02-15 Jack Turner , Elliot J. Crowley , Michael O'Boyle

State-of-the-art performance for many edge applications is achieved by deep neural networks (DNNs). Often, these DNNs are location- and time-sensitive, and must be delivered over a wireless channel rapidly and efficiently. In this paper, we…

Networking and Internet Architecture · Computer Science 2023-07-21 Mikolaj Jankowski , Deniz Gunduz , Krystian Mikolajczyk

A key problem in network theory is how to reconfigure a graph in order to optimize a quantifiable objective. Given the ubiquity of networked systems, such work has broad practical applications in a variety of situations, ranging from drug…

Machine Learning · Computer Science 2023-01-31 Christoffel Doorman , Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

Current state-of-the-art methods solve spatiotemporal action localisation by extending 2D anchors to 3D-cuboid proposals on stacks of frames, to generate sets of temporally connected bounding boxes called \textit{action micro-tubes}.…

Image and Video Processing · Electrical Eng. & Systems 2018-08-02 Gurkirt Singh , Suman Saha , Fabio Cuzzolin

Modern buildings encompass complex dynamics of multiple electrical, mechanical, and control systems. One of the biggest hurdles in applying conventional model-based optimization and control methods to building energy management is the huge…

Optimization and Control · Mathematics 2017-11-08 Yize Chen , Yuanyuan Shi , Baosen Zhang