English
Related papers

Related papers: Sensitivity-preserving of Fisher Information Matri…

200 papers

In phase retrieval, the goal is to recover a complex signal from the magnitude of its linear measurements. While many well-known algorithms guarantee deterministic recovery of the unknown signal using i.i.d. random measurement matrices,…

Information Theory · Computer Science 2017-03-24 Boshra Rajaei , Sylvain Gigan , Florent Krzakala , Laurent Daudet

The design of informatively rich input signals is essential for accurate system identification, yet classical Fisher-information-based methods are inherently local and often inadequate in the presence of significant model uncertainty and…

Statistics Theory · Mathematics 2025-12-15 Piotr Bania , Anna Wójcik

We consider a randomised implementation of the finite element method (FEM) for elliptic partial differential equations on high-dimensional models. This is motivated by applications where model predictions are essential for real-time process…

Numerical Analysis · Mathematics 2019-07-30 Yue Wu , Dimitris Kamilis , Nick Polydorides

Ethical and privacy issues inherent in artificial intelligence (AI) applications have been a growing concern with the rapid spread of deep learning. Machine unlearning (MU) is the research area that addresses these issues by making a…

Machine Learning · Computer Science 2024-09-26 Tomoya Yamashita , Masanori Yamada , Takashi Shibata

Discrete events alter how parameter influence propagates in hybrid systems. Prevailing Fisher information formulations assume that sensitivities evolve smoothly according to continuous-time variational equations and therefore neglect the…

Systems and Control · Electrical Eng. & Systems 2026-04-01 Bukunmi G. Odunlami , Marcos Netto , Hai Lin

Covariance matrix reconstruction is a topic of great significance in the field of one-bit signal processing and has numerous practical applications. Despite its importance, the conventional arcsine law with zero threshold is incapable of…

Signal Processing · Electrical Eng. & Systems 2023-03-30 Yu-Hang Xiao , Lei Huang , David Ramírez , Cheng Qian , Hing Cheung So

The random demodulator is a recent compressive sensing architecture providing efficient sub-Nyquist sampling of sparse band-limited signals. The compressive sensing paradigm requires an accurate model of the analog front-end to enable…

Information Theory · Computer Science 2013-03-26 Pawel Jerzy Pankiewicz , Thomas Arildsen , Torben Larsen

Compressed sensing (CS) has emerged to overcome the inefficiency of Nyquist sampling. However, traditional optimization-based reconstruction is slow and can not yield an exact image in practice. Deep learning-based reconstruction has been a…

Image and Video Processing · Electrical Eng. & Systems 2024-09-20 Seongmin Hong , Jaehyeok Bae , Jongho Lee , Se Young Chun

Sampling of signals belonging to a low-dimensional subspace has well-documented merits for dimensionality reduction, limited memory storage, and online processing of streaming network data. When the subspace is known, these signals can be…

Information Theory · Computer Science 2019-11-26 Fernando Gama , Antonio G. Marques , Gonzalo Mateos , Alejandro Ribeiro

The Fisher information matrix (FIM) is a fundamental quantity to represent the characteristics of a stochastic model, including deep neural networks (DNNs). The present study reveals novel statistics of FIM that are universal among a wide…

Machine Learning · Statistics 2019-10-10 Ryo Karakida , Shotaro Akaho , Shun-ichi Amari

Learning parameters from voluminous data can be prohibitive in terms of memory and computational requirements. We propose a "compressive learning" framework where we estimate model parameters from a sketch of the training data. This sketch…

Machine Learning · Computer Science 2017-05-08 Nicolas Keriven , Anthony Bourrier , Rémi Gribonval , Patrick Pérez

Magnetic Resonance Imaging (MRI) has become an important technique in the clinic for the visualization, detection, and diagnosis of various diseases. However, one bottleneck limitation of MRI is the relatively slow data acquisition process.…

Image and Video Processing · Electrical Eng. & Systems 2022-11-28 Xue Liu , Juan Zou , Xiawu Zheng , Cheng Li , Hairong Zheng , Shanshan Wang

The optimization of MRI data sampling and image reconstruction methods has been a priority for the MRI community since the very early days of the field. Designing an "optimal" method requires the definition of an optimality metric (i.e., a…

Image and Video Processing · Electrical Eng. & Systems 2019-11-22 Justin P. Haldar

Random sampling has become a critical tool in solving massive matrix problems. For linear regression, a small, manageable set of data rows can be randomly selected to approximate a tall, skinny data matrix, improving processing time…

Data Structures and Algorithms · Computer Science 2014-08-22 Michael B. Cohen , Yin Tat Lee , Cameron Musco , Christopher Musco , Richard Peng , Aaron Sidford

Fisher information provides a rigorous theoretical benchmark for evaluating quantum sensor sensitivity; however, a comprehensive framework for quantifying the fundamental limits of Rydberg-atom microwave electrometers remains lacking. In…

Optics · Physics 2026-03-04 Chen-Rong Liu , Runxia Tao , Xiang Lv , Ying Dong , Chuang Li , Binbin Wei , Mingti Zhou

This paper presents a stochastic sampling framework for privacy-aware data sharing, where a sensor observes a process correlated with private information. A sampler determines whether to retain or discard sensor observations, balancing the…

Systems and Control · Electrical Eng. & Systems 2025-05-22 Chuanghong Weng , Ehsan Nekouei

Modern radio and multi-instrument astrophysical datasets are increasingly assembled from surveys with different sensitivities and selection effects. In such heterogeneous datasets, published measurement uncertainties are often incomplete,…

Instrumentation and Methods for Astrophysics · Physics 2026-04-14 Marko Imbrišak , Krešimir Tisanić

This paper presents an adaptive and intelligent sparse model for digital image sampling and recovery. In the proposed sampler, we adaptively determine the number of required samples for retrieving image based on space-frequency-gradient…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Ali Taimori , Farokh Marvasti

This paper establishes a mathematical foundation for the Adam optimizer, elucidating its connection to natural gradient descent through Riemannian and information geometry. We provide an accessible and detailed analysis of the diagonal…

Machine Learning · Computer Science 2024-09-05 Dongseong Hwang

The problem of low-rank matrix reconstruction arises in various applications in communications and signal processing. The state of the art research largely focuses on the recovery techniques that utilize affine maps satisfying the…

Signal Processing · Electrical Eng. & Systems 2020-04-07 Wei Zhang , Taejoon Kim , Guojun Xiong , Shu-Hung Leung