English
Related papers

Related papers: Direct Kernel Optimization: Efficient Design for O…

200 papers

We propose a novel second-order optimization framework for training the emerging deep continuous-time models, specifically the Neural Ordinary Differential Equations (Neural ODEs). Since their training already involves expensive gradient…

Machine Learning · Computer Science 2021-11-09 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou

Dual energy X-ray Computed Tomography (DECT) enables to automatically decompose materials in clinical images without the manual segmentation using the dependency of the X-ray linear attenuation with energy. In this work we propose a deep…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Jiandong Wang , Alessandro Perelli

In this paper, we introduce a novel algorithm, $\mathsf{CO}_3$, for communication-efficiency distributed Deep Neural Network (DNN) training. $\mathsf{CO}_3$ is a joint training/communication protocol, which encompasses three processing…

Machine Learning · Computer Science 2022-03-18 Zhong-Jing Chen , Eduin E. Hernandez , Yu-Chih Huang , Stefano Rini

On-device learning allows AI models to adapt to user data, thereby enhancing service quality on edge platforms. However, training AI on resource-limited devices poses significant challenges due to the demanding computing workload and the…

Hardware Architecture · Computer Science 2023-12-27 Sai Qian Zhang , Thierry Tambe , Nestor Cuevas , Gu-Yeon Wei , David Brooks

Recently, end-to-end learning-based methods based on deep neural network (DNN) have been proven effective for blind deblurring. Without human-made assumptions and numerical algorithms, they are able to restore images with fewer artifacts…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Junde Wu , Xiaoguang Di , Jiehao Huang , Yu Zhang

Depth of field is an important factor of imaging systems that highly affects the quality of the acquired spatial information. Extended depth of field (EDoF) imaging is a challenging ill-posed problem and has been extensively addressed in…

Image and Video Processing · Electrical Eng. & Systems 2020-05-27 Ugur Akpinar , Erdem Sahin , Monjurul Meem , Rajesh Menon , Atanas Gotchev

The paper aims to investigate relevant computational issues of deep neural network architectures with an eye to the interaction between the optimization algorithm and the classification performance. In particular, we aim to analyze the…

Optimization and Control · Mathematics 2024-05-06 Corrado Coppola , Lorenzo Papa , Marco Boresta , Irene Amerini , Laura Palagi

Purpose: Iterative Convolutional Neural Networks (CNNs) which resemble unrolled learned iterative schemes have shown to consistently deliver state-of-the-art results for image reconstruction problems across different imaging modalities.…

Machine Learning · Computer Science 2022-03-07 Andreas Kofler , Markus Haltmeier , Tobias Schaeffter , Christoph Kolbitsch

Deep-neural-network-based image reconstruction has demonstrated promising performance in medical imaging for under-sampled and low-dose scenarios. However, it requires large amount of memory and extensive time for the training. It is…

Computer Vision and Pattern Recognition · Computer Science 2019-06-12 Dufan Wu , Kyungsang Kim , Quanzheng Li

Recently, deep neural network (DNN) has been widely adopted in the design of intelligent communication systems thanks to its strong learning ability and low testing complexity. However, most current offline DNN-based methods still suffer…

Information Theory · Computer Science 2022-02-08 Jiabao Gao , Caijun Zhong , Geoffrey Ye Li , Zhaoyang Zhang

Accurate segmentation of retinal vessels is crucial for the clinical diagnosis of numerous ophthalmic and systemic diseases. However, traditional Convolutional Neural Network (CNN) methods exhibit inherent limitations, struggling to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Hongyu Xu , Panpan Meng , Meng Wang , Dayu Hu , Liming Liang , Xiaoqi Sheng

We propose TopoOpt, a novel direct-connect fabric for deep neural network (DNN) training workloads. TopoOpt co-optimizes the distributed training process across three dimensions: computation, communication, and network topology. We…

Networking and Internet Architecture · Computer Science 2022-10-03 Weiyang Wang , Moein Khazraee , Zhizhen Zhong , Manya Ghobadi , Zhihao Jia , Dheevatsa Mudigere , Ying Zhang , Anthony Kewitsch

In the rapidly evolving field of artificial intelligence, convolutional neural networks are essential for tackling complex challenges such as machine vision and medical diagnosis. Recently, to address the challenges in processing speed and…

Optics · Physics 2024-09-30 Ruiqi Liang , Shuai Wang , Yiying Dong , Liu Li , Ying Kuang , Bohan Zhang , Yuanmu Yang

Purpose: An end-to-end deep convolutional neural network (CNN) based on deep residual network (ResNet) was proposed to efficiently reconstruct reliable T2 mapping from single-shot OverLapping-Echo Detachment (OLED) planar imaging. Methods:…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Congbo Cai , Yiqing Zeng , Chao Wang , Shuhui Cai , Jun Zhang , Zhong Chen , Xinghao Ding , Jianhui Zhong

Depth estimation and 3D object detection are critical for scene understanding but remain challenging to perform with a single image due to the loss of 3D information during image capture. Recent models using deep neural networks have…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Julie Chang , Gordon Wetzstein

Regularization techniques are widely used to improve the generality, robustness, and efficiency of deep convolutional neural networks (DCNNs). In this paper, we propose a novel approach of regulating DCNN convolutional kernels by a…

Machine Learning · Computer Science 2019-11-28 Seyed Mehdi Ayyoubzadeh , Xiaolin Wu

Image reconstruction for positron emission tomography (PET) is challenging because of the ill-conditioned tomographic problem and low counting statistics. Kernel methods address this challenge by using kernel representation to incorporate…

Image and Video Processing · Electrical Eng. & Systems 2022-05-26 Siqi Li , Guobao Wang

Modern computer vision (CV) is often based on convolutional neural networks (CNNs) that excel at hierarchical feature extraction. The previous generation of CV approaches was often based on conditional random fields (CRFs) that excel at…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Shaofei Wang , Vishnu Lokhande , Maneesh Singh , Konrad Kording , Julian Yarkony

Deep neural networks have seen tremendous success for different modalities of data including images, videos, and speech. This success has led to their deployment in mobile and embedded systems for real-time applications. However, making…

Computer Vision and Pattern Recognition · Computer Science 2019-01-31 Nitthilan Kannappan Jayakodi , Anwesha Chatterjee , Wonje Choi , Janardhan Rao Doppa , Partha Pratim Pande

Intrinsic image decomposition is the process of separating the reflectance and shading layers of an image, which is a challenging and underdetermined problem. In this paper, we propose to systematically address this problem using a deep…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Sai Bi , Nima Khademi Kalantari , Ravi Ramamoorthi