English
Related papers

Related papers: Weight Encode Reconstruction Network for Computed …

200 papers

The inputs and/or outputs of some neural nets are weight matrices of other neural nets. Indirect encodings or end-to-end compression of weight matrices could help to scale such approaches. Our goal is to open a discussion on this topic,…

Machine Learning · Computer Science 2022-01-03 Kazuki Irie , Jürgen Schmidhuber

This work presents our ongoing research of unsupervised pretraining in neural machine translation (NMT). In our method, we initialize the weights of the encoder and decoder with two language models that are trained with monolingual data and…

Computation and Language · Computer Science 2020-10-20 Dušan Variš , Ondřej Bojar

In this study, we developed deep learning-based method to classify the type of surgery performed for epiretinal membrane (ERM) removal, either internal limiting membrane (ILM) removal or ERM-alone removal. Our model, based on the ResNet18…

Image and Video Processing · Electrical Eng. & Systems 2025-07-02 An Le , Nehal Mehta , William Freeman , Ines Nagel , Melanie Tran , Anna Heinke , Akshay Agnihotri , Lingyun Cheng , Dirk-Uwe Bartsch , Hung Nguyen , Truong Nguyen , Cheolhong An

Electron tomography is a powerful tool for understanding the morphology of materials in three dimensions, but conventional reconstruction algorithms typically suffer from missing-wedge artifacts and data misalignment imposed by experimental…

Image and Video Processing · Electrical Eng. & Systems 2025-12-10 Cedric Lim , Corneel Casert , Arthur R. C. McCray , Serin Lee , Andrew Barnum , Jennifer Dionne , Colin Ophus

A successful class of image denoising methods is based on Bayesian approaches working in wavelet representations. However, analytical estimates can be obtained only for particular combinations of analytical models of signal and noise, thus…

Computer Vision and Pattern Recognition · Computer Science 2016-02-02 Valero Laparra , Juan Gutiérrez , Gustavo Camps-Valls , Jesús Malo

Tensor decomposition methods are popular tools for learning latent variables given only lower-order moments of the data. However, the standard assumption is that we have sufficient data to estimate these moments to high accuracy. In this…

Machine Learning · Statistics 2019-03-13 Omer Gottesman , Weiwei Pan , Finale Doshi-Velez

Currently, most deep learning methods cannot solve the problem of scarcity of industrial product defect samples and significant differences in characteristics. This paper proposes an unsupervised defect detection algorithm based on a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Chao Hu , Jian Yao , Weijie Wu , Weibin Qiu , Liqiang Zhu

Channel Attention reigns supreme as an effective technique in the field of computer vision. However, the proposed channel attention by SENet suffers from information loss in feature learning caused by the use of Global Average Pooling (GAP)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Hadi Salman , Caleb Parks , Shi Yin Hong , Justin Zhan

Wavefront reconstruction in lateral shearing interferometry typically assumes that the shear amount is an integer multiple of the sampling interval. When the shear is fractional, approximating it with the nearest integer value leads to…

In the setting of clinical imaging, differences in between vendors, hospitals and sequences can yield highly inhomogeneous imaging data. In MRI in particular, voxel dimension, slice spacing and acquisition plane can vary substantially. For…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Ivan Diaz , Florin Scherer , Yanik Berli , Roland Wiest , Helly Hammer , Robert Hoepner , Alejandro Leon Betancourt , Piotr Radojewski , Richard McKinley

Self-similarity learning has been recognized as a promising method for single image super-resolution (SR) to produce high-resolution (HR) image in recent years. The performance of learning based SR reconstruction, however, highly depends on…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Jiahe Shi , Chun Qi

Data-driven deep learning approaches to image registration can be less accurate than conventional iterative approaches, especially when training data is limited. To address this whilst retaining the fast inference speed of deep learning, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Xi Jia , Alexander Thorley , Wei Chen , Huaqi Qiu , Linlin Shen , Iain B Styles , Hyung Jin Chang , Ales Leonardis , Antonio de Marvao , Declan P. O'Regan , Daniel Rueckert , Jinming Duan

Computed tomography (CT) is a widely used non-invasive diagnostic method in various fields, and recent advances in deep learning have led to significant progress in CT image reconstruction. However, the lack of large-scale, open-access…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Maximilian B. Kiss , Ander Biguri , Zakhar Shumaylov , Ferdia Sherry , K. Joost Batenburg , Carola-Bibiane Schönlieb , Felix Lucka

Weak spectral responses in hyperspectral images are often obscured by dominant endmembers and sensor noise, resulting in inaccurate abundance estimation. This paper introduces WS-Net, a deep unmixing framework specifically designed to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Zekun Long , Ali Zia , Guanyiman Fu , Vivien Rolland , Jun Zhou

Convolutional neural networks typically encode an input image into a series of intermediate features with decreasing resolutions. While this structure is suited to classification tasks, it does not perform well for tasks requiring…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Xianzhi Du , Tsung-Yi Lin , Pengchong Jin , Golnaz Ghiasi , Mingxing Tan , Yin Cui , Quoc V. Le , Xiaodan Song

Adder Neural Network (AdderNet) provides a new way for developing energy-efficient neural networks by replacing the expensive multiplications in convolution with cheaper additions (i.e.l1-norm). To achieve higher hardware efficiency, it is…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Ying Nie , Kai Han , Haikang Diao , Chuanjian Liu , Enhua Wu , Yunhe Wang

Model based iterative reconstruction (MBIR) algorithms for low-dose X-ray CT are computationally complex because of the repeated use of the forward and backward projection. Inspired by this success of deep learning in computer vision…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Eunhee Kang , junhong Min , Jong Chul Ye

In this paper, we consider the problem to automatically reconstruct garment and body shapes from a single near-front view RGB image. To this end, we propose a layered garment representation on top of SMPL and novelly make the skinning…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Boyi Jiang , Juyong Zhang , Yang Hong , Jinhao Luo , Ligang Liu , Hujun Bao

Post-training, layer-wise quantization is preferable because it is free from retraining and is hardware-friendly. Nevertheless, accuracy degradation has occurred when a neural network model has a big difference of per-out-channel weight…

Machine Learning · Computer Science 2020-08-14 Jihun Oh , SangJeong Lee , Meejeong Park , Pooni Walagaurav , Kiseok Kwon

In this paper, we explore a novel method for tomographic image reconstruction in the field of SPECT imaging. Deep Learning methodologies and more specifically deep convolutional neural networks (CNN) are employed in the new reconstruction…

Machine Learning · Computer Science 2020-10-20 Charalambos Chrysostomou , Loizos Koutsantonis , Christos Lemesios , Costas N. Papanicolas