中文
相关论文

相关论文: Gradient-free training of autoencoders for non-dif…

200 篇论文

The Kalman filter is an algorithm for the estimation of hidden variables in dynamical systems under linear Gauss-Markov assumptions with widespread applications across different fields. Recently, its Bayesian interpretation has received a…

神经元与认知 · 定量生物学 2021-11-23 Manuel Baltieri , Takuya Isomura

This report focuses on algorithms that perform single-channel speech enhancement. The author of this report uses modulation-domain Kalman filtering algorithms for speech enhancement, i.e. noise suppression and dereverberation, in [1], [2],…

声音 · 计算机科学 2018-11-02 Nikolaos Dionelis

Existing communication hardware is being exerted to its limits to accommodate for the ever increasing internet usage globally. This leads to non-linear distortion in the communication link that requires non-linear equalization techniques to…

信号处理 · 电气工程与系统科学 2024-10-22 Søren Føns Nielsen , Darko Zibar , Mikkel N. Schmidt

We present a single-channel phase-sensitive speech enhancement algorithm that is based on modulation-domain Kalman filtering and on tracking the speech phase using circular statistics. With Kalman filtering, using that speech and noise are…

声音 · 计算机科学 2017-08-08 Nikolaos Dionelis , Mike Brookes

Sparse auto-encoders are useful for extracting low-dimensional representations from high-dimensional data. However, their performance degrades sharply when the input noise at test time differs from the noise employed during training. This…

机器学习 · 计算机科学 2024-07-01 Nelson Goldenstein , Jeremias Sulam , Yaniv Romano

In this paper, an unsupervised machine learning method for geometric constellation shaping is investigated. By embedding a differentiable fiber channel model within two neural networks, the learning algorithm is optimizing for a geometric…

This study explores a novel approach to neural network pruning using evolutionary computation, focusing on simultaneously pruning the encoder and decoder of an autoencoder. We introduce two new mutation operators that use layer activations…

神经与进化计算 · 计算机科学 2025-05-09 Steven Jorgensen , Erik Hemberg , Jamal Toutouh , Una-May O'Reilly

Deep neural networks have emerged as effective tools for computational imaging including quantitative phase microscopy of transparent samples. To reconstruct phase from intensity, current approaches rely on supervised learning with training…

图像与视频处理 · 电气工程与系统科学 2020-01-28 Emrah Bostan , Reinhard Heckel , Michael Chen , Michael Kellman , Laura Waller

In computer-aided design (CAD) community, the point cloud data is pervasively applied in reverse engineering, where the point cloud analysis plays an important role. While a large number of supervised learning methods have been proposed to…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Cheng Zhang , Jian Shi , Xuan Deng , Zizhao Wu

Back propagation (BP) is the default solution for gradient computation in neural network training. However, implementing BP-based training on various edge devices such as FPGA, microcontrollers (MCUs), and analog computing platforms face…

机器学习 · 计算机科学 2024-11-12 Yequan Zhao , Hai Li , Ian Young , Zheng Zhang

Despite that deep learning has achieved state-of-the-art performance for medical image segmentation, its success relies on a large set of manually annotated images for training that are expensive to acquire. In this paper, we propose an…

图像与视频处理 · 电气工程与系统科学 2021-01-01 Lu Wang , Dong Guo , Guotai Wang , Shaoting Zhang

This paper presents a vision-based methodology which makes use of a stereo camera rig and a one dimension LiDAR to estimate free obstacle areas for quadrotor navigation. The presented approach fuses information provided by a depth map from…

机器人学 · 计算机科学 2019-05-16 Sergio Trejo , Karla Martinez , Gerardo Flores

In this paper, a gradient-free distributed algorithm is introduced to solve a set constrained optimization problem under a directed communication network. Specifically, at each time-step, the agents locally compute a so-called…

最优化与控制 · 数学 2021-09-06 Yipeng Pang , Guoqiang Hu

Second-order methods for neural network optimization have several advantages over methods based on first-order gradient descent, including better scaling to large mini-batch sizes and fewer updates needed for convergence. But they are…

机器学习 · 计算机科学 2017-12-21 Huishuai Zhang , Caiming Xiong , James Bradbury , Richard Socher

In this paper, we propose a noise-aware encoder-decoder framework to disentangle a clean saliency predictor from noisy training examples, where the noisy labels are generated by unsupervised handcrafted feature-based methods. The proposed…

计算机视觉与模式识别 · 计算机科学 2020-07-27 Jing Zhang , Jianwen Xie , Nick Barnes

Duality of control and estimation allows mapping recent advances in data-guided control to the estimation setup. This paper formalizes and utilizes such a mapping to consider learning the optimal (steady-state) Kalman gain when process and…

系统与控制 · 电气工程与系统科学 2023-03-08 Shahriar Talebi , Amirhossein Taghvaei , Mehran Mesbahi

We present a method for converting the voices between a set of speakers. Our method is based on training multiple autoencoder paths, where there is a single speaker-independent encoder and multiple speaker-dependent decoders. The…

音频与语音处理 · 电气工程与系统科学 2019-05-13 Orhan Ocal , Oguz H. Elibol , Gokce Keskin , Cory Stephenson , Anil Thomas , Kannan Ramchandran

Probabilistic models with discrete latent variables naturally capture datasets composed of discrete classes. However, they are difficult to train efficiently, since backpropagation through discrete variables is generally not possible. We…

机器学习 · 统计学 2017-04-25 Jason Tyler Rolfe

Embedding discrete solvers as differentiable layers has given modern deep learning architectures combinatorial expressivity and discrete reasoning capabilities. The derivative of these solvers is zero or undefined, therefore a meaningful…

机器学习 · 计算机科学 2024-12-16 Subham Sekhar Sahoo , Anselm Paulus , Marin Vlastelica , Vít Musil , Volodymyr Kuleshov , Georg Martius

Knowledge distillation has been widely used to produce portable and efficient neural networks which can be well applied on edge devices for computer vision tasks. However, almost all top-performing knowledge distillation methods need to…

计算机视觉与模式识别 · 计算机科学 2021-10-06 Haoran Zhao , Xin Sun , Junyu Dong , Hui Yu , Huiyu Zhou