English
Related papers

Related papers: Improving Accuracy and Efficiency of Implicit Neur…

200 papers

Learning from unlabeled and noisy data is one of the grand challenges of machine learning. As such, it has seen a flurry of research with new ideas proposed continuously. In this work, we revisit a classical idea: Stein's Unbiased Risk…

Machine Learning · Statistics 2020-07-24 Christopher A. Metzler , Ali Mousavi , Reinhard Heckel , Richard G. Baraniuk

Implicit neural representations (INRs) have recently emerged as a powerful tool that provides an accurate and resolution-independent encoding of data. Their robustness as general approximators has been shown in a wide variety of data…

Machine Learning · Computer Science 2022-08-12 Elizabeth Fons , Alejandro Sztrajman , Yousef El-laham , Alexandros Iosifidis , Svitlana Vyetrenko

The scanning time for a fully sampled MRI can be undesirably lengthy. Compressed sensing has been developed to minimize image artifacts in accelerated scans, but the required iterative reconstruction is computationally complex and difficult…

Image and Video Processing · Electrical Eng. & Systems 2025-03-10 Di Xu , Hengjie Liu , Xin Miao , Daniel O'Connor , Jessica E. Scholey , Wensha Yang , Mary Feng , Michael Ohliger , Hui Lin , Dan Ruan , Yang Yang , Ke Sheng

Ultra-low-precision inference can sharply reduce memory and latency but often degrades accuracy and relies on specialized hardware. We present SONIQ, a system-optimized, noise-injected quantization framework that learns per-channel mixed…

Hardware Architecture · Computer Science 2025-11-11 Cyrus Zhou , Pedro Savarese , Zack Hassman , Vaughn Richard , Michael DiBrino , Michael Maire , Yanjing Li

We present a psychoacoustically enhanced cost function to balance network complexity and perceptual performance of deep neural networks for speech denoising. While training the network, we utilize perceptual weights added to the ordinary…

Sound · Computer Science 2018-01-31 Kai Zhen , Aswin Sivaraman , Jongmo Sung , Minje Kim

Sequential interaction networks (SIN) have been commonly adopted in many applications such as recommendation systems, search engines and social networks to describe the mutual influence between users and items/products. Efforts on…

Machine Learning · Computer Science 2023-05-09 Junda Ye , Zhongbao Zhang , Li Sun , Yang Yan , Feiyang Wang , Fuxin Ren

Physics-informed neural networks (PINNs) have plateaued at errors of $10^{-3}$-$10^{-4}$ for fourth-order partial differential equations, creating a perceived precision ceiling that limits their adoption in engineering applications. We…

Machine Learning · Computer Science 2025-07-29 Wei Shan Lee , Chi Kiu Althina Chau , Kei Chon Sio , Kam Ian Leong

Accurate estimation of the speed-of-sound (SoS) is important for ultrasound (US) image reconstruction techniques and tissue characterization. Various approaches have been proposed to calculate SoS, ranging from tomography-inspired…

Machine Learning · Computer Science 2024-09-24 Michal Byra , Piotr Jarosik , Piotr Karwat , Ziemowit Klimonda , Marcin Lewandowski

Super-resolution of LiDAR range images is crucial to improving many downstream tasks such as object detection, recognition, and tracking. While deep learning has made a remarkable advances in super-resolution techniques, typical…

Robotics · Computer Science 2022-03-15 Youngsun Kwon , Minhyuk Sung , Sung-Eui Yoon

Incorporating prior knowledge on model unknowns of interest is essential when dealing with ill-posed inverse problems due to the nonuniqueness of the solution and data noise. Unfortunately, it is not trivial to fully describe our priors in…

Geophysics · Physics 2021-06-24 Ali Siahkoohi , Gabrio Rizzuti , Felix J. Herrmann

Deep neural networks (DNNs) form the backbone of almost every state-of-the-art technique in the fields such as computer vision, speech processing, and text analysis. The recent advances in computational technology have made the use of DNNs…

Machine Learning · Computer Science 2018-03-20 Saiprasad Koturwar , Shabbir Merchant

An accurate objective speech intelligibility prediction algorithms is of great interest for many applications such as speech enhancement for hearing aids. Most algorithms measures the signal-to-noise ratios or correlations between the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-07 Zehai Tu , Ning Ma , Jon Barker

Speaker verification is hampered by background noise, particularly at extremely low Signal-to-Noise Ratio (SNR) under 0 dB. It is difficult to suppress noise without introducing unwanted artifacts, which adversely affects speaker…

Sound · Computer Science 2024-01-08 Yi Ma , Kong Aik Lee , Ville Hautamäki , Meng Ge , Haizhou Li

We characterize and remedy a failure mode that may arise from multi-scale dynamics with scale imbalances during training of deep neural networks, such as Physics Informed Neural Networks (PINNs). PINNs are popular machine-learning templates…

Machine Learning · Computer Science 2021-07-05 Suryanarayana Maddu , Dominik Sturm , Christian L. Müller , Ivo F. Sbalzarini

Hypernetworks are meta neural networks that generate weights for a main neural network in an end-to-end differentiable manner. Despite extensive applications ranging from multi-task learning to Bayesian deep learning, the problem of…

Machine Learning · Computer Science 2023-12-15 Oscar Chang , Lampros Flokas , Hod Lipson

Implicit Neural Representations (INRs) have revolutionized continuous signal modeling, yet they struggle to recover fine-grained details within finite training budgets. While empirical techniques, such as positional encoding (PE),…

Machine Learning · Computer Science 2026-02-03 Jianqiao Zheng , Hemanth Saratchandran , Simon Lucey

Speech recognition in noisy and channel distorted scenarios is often challenging as the current acoustic modeling schemes are not adaptive to the changes in the signal distribution in the presence of noise. In this work, we develop a novel…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-03 Purvi Agrawal , Sriram Ganapathy

Simplicity bias is the concerning tendency of deep networks to over-depend on simple, weakly predictive features, to the exclusion of stronger, more complex features. This is exacerbated in real-world applications by limited training data…

Machine Learning · Computer Science 2023-06-07 Rishabh Tiwari , Pradeep Shenoy

Speech enhancement aims to improve speech quality and intelligibility, especially in noisy environments where background noise degrades speech signals. Currently, deep learning methods achieve great success in speech enhancement, e.g. the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-23 Changjiang Zhao , Shulin He , Xueliang Zhang

This paper addresses the problem of deriving the asymptotic performance of adaptive Low Rank (LR) filters used in target detection embedded in a disturbance composed of a LR Gaussian noise plus a white Gaussian noise. In this context, we…

Applications · Statistics 2015-03-19 Alice Combernoux , Frederic Pascal , Guillaume Ginolhac , Marc Lesturgie