中文
相关论文

相关论文: Eigendecomposition-Free Training of Deep Networks …

200 篇论文

We consider ill-posed inverse problems where the forward operator $T$ is unknown, and instead we have access to training data consisting of functions $f_i$ and their noisy images $Tf_i$. This is a practically relevant and challenging…

机器学习 · 统计学 2023-02-21 Miguel del Alamo

This work finds the analytical expression of the global minima of a deep linear network with weight decay and stochastic neurons, a fundamental model for understanding the landscape of neural networks. Our result implies that the origin is…

机器学习 · 统计学 2023-06-14 Liu Ziyin , Botao Li , Xiangming Meng

In image processing, classical methods minimize a suitable functional that balances between computational feasibility (convexity of the functional is ideal) and suitable penalties reflecting the desired image decomposition. The fact that…

计算机视觉与模式识别 · 计算机科学 2020-10-20 Robin Richter , Duy H. Thai , Stephan F. Huckemann

Link prediction is a fundamental challenge in network science. Among various methods, similarity-based algorithms are popular for their simplicity, interpretability, high efficiency and good performance. In this paper, we show that the most…

社会与信息网络 · 计算机科学 2021-08-27 Yan-Li Lee , Qiang Dong , Tao Zhou

Network embedding has attracted an increasing attention over the past few years. As an effective approach to solve graph mining problems, network embedding aims to learn a low-dimensional feature vector representation for each node of a…

社会与信息网络 · 计算机科学 2020-08-10 Xiao Shen , Fu-Lai Chung

To have a superior generalization, a deep learning neural network often involves a large size of training sample. With increase of hidden layers in order to increase learning ability, neural network has potential degradation in accuracy.…

机器学习 · 计算机科学 2019-01-01 Lianfa Li , Ying Fang , Jun Wu , Jinfeng Wang

Blind deconvolution is a classical yet challenging low-level vision problem with many real-world applications. Traditional maximum a posterior (MAP) based methods rely heavily on fixed and handcrafted priors that certainly are insufficient…

计算机视觉与模式识别 · 计算机科学 2020-03-19 Dongwei Ren , Kai Zhang , Qilong Wang , Qinghua Hu , Wangmeng Zuo

Assume you encounter an inverse problem that shall be solved for a large number of data, but no ground-truth data is available. To emulate this encounter, in this study, we assume it is unknown how to solve the imaging problem of Computed…

Many real-world solutions for image restoration are learning-free and based on handcrafted image priors such as self-similarity. Recently, deep-learning methods that use training data have achieved state-of-the-art results in various image…

图像与视频处理 · 电气工程与系统科学 2019-05-07 Indra Deep Mastan , Shanmuganathan Raman

In this paper, we propose a novel multi-task learning method based on the deep convolutional network. The proposed deep network has four convolutional layers, three max-pooling layers, and two parallel fully connected layers. To adjust the…

机器学习 · 计算机科学 2019-04-17 Fang Su , Hai-Yang Shang , Jing-Yan Wang

Deep-learning-based methods for different applications have been shown vulnerable to adversarial examples. These examples make deployment of such models in safety-critical tasks questionable. Use of deep neural networks as inverse problem…

机器学习 · 计算机科学 2020-02-28 Ankit Raj , Yoram Bresler , Bo Li

We present a Gaussian kernel loss function and training algorithm for convolutional neural networks that can be directly applied to both distance metric learning and image classification problems. Our method treats all training features…

计算机视觉与模式识别 · 计算机科学 2018-07-03 Benjamin J. Meyer , Ben Harwood , Tom Drummond

Deep Neural Networks (DNNs) have already become a crucial computational approach to revealing the spatial patterns in the human brain; however, there are three major shortcomings in utilizing DNNs to detect the spatial patterns in…

机器学习 · 计算机科学 2022-05-26 Wei Zhang , Yu Bao

The clear understanding of the non-convex landscape of neural network is a complex incomplete problem. This paper studies the landscape of linear (residual) network, the simplified version of the nonlinear network. By treating the gradient…

代数几何 · 数学 2021-02-09 Xiuyi Yang

This work proposes an autoencoder neural network as a non-linear generalization of projection-based methods for solving Partial Differential Equations (PDEs). The proposed deep learning architecture presented is capable of generating the…

计算物理 · 物理学 2020-06-25 Jaime Lopez Garcia , Angel Rivero Jimenez

We present a class of algorithms capable of directly training deep neural networks with respect to large families of task-specific performance measures such as the F-measure and the Kullback-Leibler divergence that are structured and…

机器学习 · 统计学 2021-09-22 Amartya Sanyal , Pawan Kumar , Purushottam Kar , Sanjay Chawla , Fabrizio Sebastiani

Deep neural networks can be trained in reciprocal space, by acting on the eigenvalues and eigenvectors of suitable transfer operators in direct space. Adjusting the eigenvalues, while freezing the eigenvectors, yields a substantial…

Supervised training of deep neural nets typically relies on minimizing cross-entropy. However, in many domains, we are interested in performing well on metrics specific to the application. In this paper we propose a direct loss minimization…

机器学习 · 计算机科学 2016-06-03 Yang Song , Alexander G. Schwing , Richard S. Zemel , Raquel Urtasun

An approach to incorporate deep learning within an iterative image reconstruction framework to reconstruct images from severely incomplete measurement data is presented. Specifically, we utilize a convolutional neural network (CNN) as a…

计算机视觉与模式识别 · 计算机科学 2017-09-05 Brendan Kelly , Thomas P. Matthews , Mark A. Anastasio

Bias field, which is caused by imperfect MR devices or imaged objects, introduces intensity inhomogeneity into MR images and degrades the performance of MR image analysis methods. Many retrospective algorithms were developed to facilitate…

图像与视频处理 · 电气工程与系统科学 2023-08-01 Dong Liang , Xingyu Qiu , Kuanquan Wang , Gongning Luo , Wei Wang , Yashu Liu