English
Related papers

Related papers: Structured Bayesian Compression for Deep models in…

200 papers

Modern mobile devices have access to a wealth of data suitable for learning models, which in turn can greatly improve the user experience on the device. For example, language models can improve speech recognition and text entry, and image…

Machine Learning · Computer Science 2023-01-30 H. Brendan McMahan , Eider Moore , Daniel Ramage , Seth Hampson , Blaise Agüera y Arcas

Continuous-time series is essential for different modern application areas, e.g. healthcare, automobile, energy, finance, Internet of things (IoT) and other related areas. Different application needs to process as well as analyse a massive…

Machine Learning · Computer Science 2024-09-17 Mansura Habiba , Barak A. Pearlmutter , Mehrdad Maleki

As deep nets are increasingly used in applications suited for mobile devices, a fundamental dilemma becomes apparent: the trend in deep learning is to grow models to absorb ever-increasing data set sizes; however mobile devices are designed…

Machine Learning · Computer Science 2015-04-21 Wenlin Chen , James T. Wilson , Stephen Tyree , Kilian Q. Weinberger , Yixin Chen

A broad spectrum of data from different modalities are generated in the healthcare domain every day, including scalar data (e.g., clinical measures collected at hospitals), tensor data (e.g., neuroimages analyzed by research institutes),…

Machine Learning · Computer Science 2018-03-28 Bokai Cao

A major challenge in sample-based inference (SBI) for Bayesian neural networks is the size and structure of the networks' parameter space. Our work shows that successful SBI is possible by embracing the characteristic relationship between…

Machine Learning · Computer Science 2024-05-29 Emanuel Sommer , Lisa Wimmer , Theodore Papamarkou , Ludwig Bothmann , Bernd Bischl , David Rügamer

Decision making algorithms are used in a multitude of different applications. Conventional approaches for designing decision algorithms employ principled and simplified modelling, based on which one can determine decisions via tractable…

Signal Processing · Electrical Eng. & Systems 2022-06-23 Nir Shlezinger , Yonina C. Eldar , Stephen P. Boyd

Signal processing traditionally relies on classical statistical modeling techniques. Such model-based methods utilize mathematical formulations that represent the underlying physics, prior information and additional domain knowledge. Simple…

Signal Processing · Electrical Eng. & Systems 2023-06-08 Nir Shlezinger , Yonina C. Eldar

In recent years Deep Neural Networks (DNNs) have been rapidly developed in various applications, together with increasingly complex architectures. The performance gain of these DNNs generally comes with high computational costs and large…

Machine Learning · Computer Science 2017-12-05 Yiren Zhou , Seyed-Mohsen Moosavi-Dezfooli , Ngai-Man Cheung , Pascal Frossard

Recently, an extensive amount of research has been focused on compressing and accelerating Deep Neural Networks (DNN). So far, high compression rate algorithms require part of the training dataset for a low precision calibration, or a…

Machine Learning · Computer Science 2020-04-08 Matan Haroush , Itay Hubara , Elad Hoffer , Daniel Soudry

Deep learning and other big data technologies have over time become very powerful and accurate. There are algorithms and models developed that have near human accuracy in their task. In health care, the amount of data available is massive…

Computers and Society · Computer Science 2019-09-09 Dinesh Samuel Sathia Raj , Vijayakumar V , Bharat Rawal , Longzhi Yang

Deep neural networks with lots of parameters are typically used for large-scale computer vision tasks such as image classification. This is a result of using dense matrix multiplications and convolutions. However, sparse computations are…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Suraj Srinivas , Akshayvarun Subramanya , R. Venkatesh Babu

The customizable nature of deep learning models have allowed them to be successful predictors in various disciplines. These models are often trained with respect to thousands or millions of instances for complicated problems, but the…

Machine Learning · Computer Science 2019-12-24 Drimik Roy Chowdhury , Muhammad Firmansyah Kasim

Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mackenzie J. Meni , Ryan T. White , Michael Mayo , Kevin Pilkiewicz

Mobile and embedded machine learning developers frequently have to compromise between two inferior on-device deployment strategies: sacrifice accuracy and aggressively shrink their models to run on dedicated low-power cores; or sacrifice…

Machine Learning · Computer Science 2023-03-17 Haiguang Li , Trausti Thormundsson , Ivan Poupyrev , Nicholas Gillian

Deep neural networks are the state-of-the-art methods for many real-world tasks, such as computer vision, natural language processing and speech recognition. For all its popularity, deep neural networks are also criticized for consuming a…

Machine Learning · Computer Science 2018-12-18 Yunhui Guo

Application for semantic segmentation models in areas such as autonomous vehicles and human computer interaction require real-time predictive capabilities. The challenges of addressing real-time application is amplified by the need to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Ethan Goan , Clinton Fookes

Deep neural networks currently demonstrate state-of-the-art performance in several domains. At the same time, models of this class are very demanding in terms of computational resources. In particular, a large amount of memory is required…

Machine Learning · Computer Science 2015-12-22 Alexander Novikov , Dmitry Podoprikhin , Anton Osokin , Dmitry Vetrov

Machine-learning-based interatomic potential energy surface (PES) models are revolutionizing the field of molecular modeling. However, although much faster than electronic structure schemes, these models suffer from costly computations via…

Computational Physics · Physics 2022-08-08 Denghui Lu , Wanrun Jiang , Yixiao Chen , Linfeng Zhang , Weile Jia , Han Wang , Mohan Chen

Signal processing, communications, and control have traditionally relied on classical statistical modeling techniques. Such model-based methods utilize mathematical formulations that represent the underlying physics, prior information and…

Signal Processing · Electrical Eng. & Systems 2022-09-13 Nir Shlezinger , Jay Whang , Yonina C. Eldar , Alexandros G. Dimakis

Joint models for longitudinal and time-to-event data are commonly used in longitudinal studies to forecast disease trajectories over time. While there are many advantages to joint modeling, the standard forms suffer from limitations that…

Machine Learning · Statistics 2019-09-09 Bryan Lim , Mihaela van der Schaar