English
Related papers

Related papers: Optimal Pruning for Multi-Step Sensor Scheduling

200 papers

Deep learning's success has been attributed to the training of large, overparameterized models on massive amounts of data. As this trend continues, model training has become prohibitively costly, requiring access to powerful computing…

Machine Learning · Computer Science 2021-11-25 Ravi S Raju , Kyle Daruwalla , Mikko Lipasti

This paper investigates the problem of informative path planning for a mobile robotic sensor network in spatially temporally distributed mapping. The robots are able to gather noisy measurements from an area of interest during their…

In this paper, the sparse sensor placement problem for least-squares estimation is considered, and the previous novel approach of the sparse sensor selection algorithm is extended. The maximization of the determinant of the matrix which…

Signal Processing · Electrical Eng. & Systems 2021-05-18 Yuji Saito , Taku Nonomura , Keigo Yamada , Kumi Nakai , Takayuki Nagata , Keisuke Asai , Yasuo Sasaki , Daisuke Tsubakino

Pruning coupled with learning aims to optimize the neural network (NN) structure for solving specific problems. This optimization can be used for various purposes: to prevent overfitting, to save resources for implementation and training,…

Machine Learning · Computer Science 2023-01-24 Alexander N. Gorban , Evgeny M. Mirkes

Learning-based techniques are increasingly effective at controlling complex systems using data-driven models. However, most work done so far has focused on learning individual tasks or control laws. Hence, it is still a largely unaddressed…

Systems and Control · Electrical Eng. & Systems 2020-05-08 Alexandre Capone , Armin Lederer , Jonas Umlauft , Sandra Hirche

It is well known that opportunistic scheduling algorithms are throughput optimal under dynamic channel and network conditions. However, these algorithms achieve a hypothetical rate region which does not take into account the overhead…

Networking and Internet Architecture · Computer Science 2019-11-12 Mehmet Karaca , Tansu Alpcan , Ozgur Ercetin

In this paper, we examine a multi-sensor system where each sensor monitors multiple dynamic information processes and transmits updates over a shared communication channel. These updates may include correlated information across the various…

Information Theory · Computer Science 2025-02-13 Egemen Erbayat , Ali Maatouk , Peng Zou , Suresh Subramaniam

Finding Minimal Unsatisfiable Subsets (MUSes) of binary constraints is a common problem in infeasibility analysis of over-constrained systems. However, because of the exponential search space of the problem, enumerating MUSes is extremely…

Artificial Intelligence · Computer Science 2024-02-27 Panagiotis Lymperopoulos , Liping Liu

Machine learning algorithms are very sensitive to the hyperparameters, and their evaluations are generally expensive. Users desperately need intelligent methods to quickly optimize hyperparameter settings according to known evaluation…

Machine Learning · Computer Science 2020-05-05 Chunnan Wang , Hongzhi Wang , Chang Zhou , Hanxiao Chen

We introduce a pruning algorithm that provably sparsifies the parameters of a trained model in a way that approximately preserves the model's predictive accuracy. Our algorithm uses a small batch of input points to construct a data-informed…

Machine Learning · Computer Science 2021-03-16 Cenk Baykal , Lucas Liebenwein , Igor Gilitschenski , Dan Feldman , Daniela Rus

We consider a sensor scheduling and remote estimation problem with one sensor and one estimator. At each time step, the sensor makes an observation on the state of a source, and then decides whether to transmit its observation to the…

Systems and Control · Computer Science 2015-10-02 Xiaobin Gao , Emrah Akyol , Tamer Basar

Filter pruning has drawn more attention since resource constrained platform requires more compact model for deployment. However, current pruning methods suffer either from the inferior performance of one-shot methods, or the expensive time…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Dong Li , Sitong Chen , Xudong Liu , Yunda Sun , Li Zhang

A greedy algorithm is proposed for sparse-sensor selection in reduced-order sensing that contains correlated noise in measurement. The sensor selection is carried out by maximizing the determinant of the Fisher information matrix in a…

Optimization and Control · Mathematics 2021-04-28 Keigo Yamada , Yuji Saito , Koki Nankai , Taku Nonomura , Keisuke Asai , Daisuke Tsubakino

System identification is normally involved in augmenting time series data by time shifting and nonlinearisation (e.g., polynomial basis), both of which introduce redundancy in features and samples. Many research works focus on reducing…

Machine Learning · Computer Science 2025-09-05 Tingna Wang , Sikai Zhang , Mingming Song , Limin Sun

Leveraging Large Language Models (LLMs) for recommendation has recently garnered considerable attention, where fine-tuning plays a key role in LLMs' adaptation. However, the cost of fine-tuning LLMs on rapidly expanding recommendation data…

Information Retrieval · Computer Science 2024-06-05 Xinyu Lin , Wenjie Wang , Yongqi Li , Shuo Yang , Fuli Feng , Yinwei Wei , Tat-Seng Chua

We investigate the problem of scanning and prediction ("scandiction", for short) of multidimensional data arrays. This problem arises in several aspects of image and video processing, such as predictive coding, for example, where an image…

Information Theory · Computer Science 2007-07-13 Asaf Cohen , Neri Merhav , Tsachy Weissman

Neural network pruning is a highly effective technique aimed at reducing the computational and memory demands of large neural networks. In this research paper, we present a novel approach to pruning neural networks utilizing Bayesian…

Machine Learning · Statistics 2023-08-07 Sunil Mathew , Daniel B. Rowe

We present a method to solve planning problems involving sequential decision making in unpredictable environments while accomplishing a high level task specification expressed using the formalism of linear temporal logic. Our method…

Robotics · Computer Science 2015-06-16 Seyedshams Feyzabadi , Stefano Carpin

Neural networks (NNs) are making a large impact both on research and industry. Nevertheless, as NNs' accuracy increases, it is followed by an expansion in their size, required number of compute operations and energy consumption. Increase in…

Machine Learning · Computer Science 2021-12-21 Martin Ferianc , Anush Sankaran , Olivier Mastropietro , Ehsan Saboori , Quentin Cappart

This paper proposes a novel algorithm to determine the optimal placement of redundant inertial sensors such as accelerometers and gyroscopes (gyros) for increasing the sensing accuracy. In this paper, we have proposed a novel iterative…

Signal Processing · Electrical Eng. & Systems 2020-02-19 Nitesh Sahu , Prabhu Babu , Arun Kumar , Rajendar Bahl