English
Related papers

Related papers: Multi-Resolution Model Fusion for Accelerating the…

200 papers

Federated learning is a powerful distributed learning scheme that allows numerous edge devices to collaboratively train a model without sharing their data. However, training is resource-intensive for edge devices, and limited network…

Machine Learning · Computer Science 2024-10-25 Hui-Po Wang , Sebastian U. Stich , Yang He , Mario Fritz

Compared with conventional numerical approaches to solving partial differential equations (PDEs), physics-informed neural networks (PINN) have manifested the capability to save development effort and computational cost, especially in…

Machine Learning · Computer Science 2022-09-19 Shihong Zhang , Chi Zhang , Bosen Wang

Convolutional networks are one of the most widely employed architectures in computer vision and machine learning. In order to leverage their ability to learn complex functions, large amounts of data are required for training. Training a…

Computer Vision and Pattern Recognition · Computer Science 2015-06-09 Michael Mathieu , Mikael Henaff , Yann LeCun

Multi-modal learning is a fast growing area in artificial intelligence. It tries to help machines understand complex things by combining information from different sources, like images, text, and audio. By using the strengths of each…

Machine Learning · Computer Science 2025-12-22 Qihang Jin , Enze Ge , Yuhang Xie , Hongying Luo , Junhao Song , Ziqian Bi , Chia Xin Liang , Jibin Guan , Joe Yeong , Xinyuan Song , Junfeng Hao

Federated learning enables cooperative training among massively distributed clients by sharing their learned local model parameters. However, with increasing model size, deploying federated learning requires a large communication bandwidth,…

Machine Learning · Computer Science 2022-12-13 Rui Song , Liguo Zhou , Lingjuan Lyu , Andreas Festag , Alois Knoll

Federated Learning (FL) enables multiple resource-constrained edge devices with varying levels of heterogeneity to collaboratively train a global model. However, devices with limited capacity can create bottlenecks and slow down model…

Machine Learning · Computer Science 2025-04-08 Afsaneh Mahanipour , Hana Khamfroush

Compressed sensing MRI is a classic inverse problem in the field of computational imaging, accelerating the MR imaging by measuring less k-space data. The deep neural network models provide the stronger representation ability and faster…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Zhiwen Fan , Liyan Sun , Xinghao Ding , Yue Huang , Congbo Cai , John Paisley

In this paper, we aim to reduce the computational cost of spatio-temporal deep neural networks, making them run as fast as their 2D counterparts while preserving state-of-the-art accuracy on video recognition benchmarks. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2018-09-19 Yunpeng Chen , Yannis Kalantidis , Jianshu Li , Shuicheng Yan , Jiashi Feng

Fine-tuning pre-trained language models has become the prevalent paradigm for building downstream NLP models. Oftentimes fine-tuned models are readily available but their training data is not, due to data privacy or intellectual property…

Computation and Language · Computer Science 2025-05-23 Xisen Jin , Xiang Ren , Daniel Preotiuc-Pietro , Pengxiang Cheng

Single-model systems often suffer from deficiencies in tasks such as speaker verification (SV) and image classification, relying heavily on partial prior knowledge during decision-making, resulting in suboptimal performance. Although…

Machine Learning · Computer Science 2024-04-25 Zuheng Kang , Yayun He , Jianzong Wang , Junqing Peng , Jing Xiao

Multimodal federated learning (MFL) aims to enrich model training in FL settings where clients are collecting measurements across multiple modalities. However, key challenges to MFL remain unaddressed, particularly in heterogeneous network…

Machine Learning · Computer Science 2026-03-12 Liangqi Yuan , Dong-Jun Han , Su Wang , Devesh Upadhyay , Christopher G. Brinton

Beamforming (BF) is essential for enhancing system capacity in fifth generation (5G) and beyond wireless networks, yet exhaustive beam training in ultra-massive multiple-input multiple-output (MIMO) systems incurs substantial overhead. To…

Signal Processing · Electrical Eng. & Systems 2026-02-11 Yanliang Jin , Yunfan Li , Jiang Jun , Yuan Gao , Shengli Liu , Jianbo Du , Zhaohui Yang , Shugong Xu

Magnetic Resonance Fingerprinting (MRF) is an imaging technique acquiring unique time signals for different tissues. Although the acquisition is highly accelerated, the reconstruction time remains a problem, as the state-of-the-art template…

Image and Video Processing · Electrical Eng. & Systems 2019-09-17 Elisabeth Hoppe , Florian Thamm , Gregor Körzdörfer , Christopher Syben , Franziska Schirrmacher , Mathias Nittka , Josef Pfeuffer , Heiko Meyer , Andreas Maier

PURPOSE: Demonstrate a novel fast method for reconstruction of multi-dimensional MR Fingerprinting (MRF) data using Deep Learning methods. METHODS: A neural network (NN) is defined using the TensorFlow framework and trained on simulated MRF…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Ouri Cohen , Bo Zhu , Matthew S. Rosen

Recently, deep neural network (DNN) based time-frequency (T-F) mask estimation has shown remarkable effectiveness for speech enhancement. Typically, a single T-F mask is first estimated based on DNN and then used to mask the spectrogram of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-29 Liangchen Zhou , Wenbin Jiang , Jingyan Xu , Fei Wen , Peilin Liu

Neural Radiance Field (NeRF) has achieved remarkable success in creating immersive media representations through its exceptional reconstruction capabilities. However, the computational demands of dense forward passes and volume rendering…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Weixiang Zhang , Shuzhao Xie , Shijia Ge , Wei Yao , Chen Tang , Zhi Wang

Modern machine learning models often combine multiple input streams of data to more accurately capture the information that informs their decisions. In multimodal machine learning, choosing the strategy for fusing data together requires…

Machine Learning · Computer Science 2025-12-01 Regan Willis , Jason Bakos

This paper proposes to use Fast Fourier Transformation-based U-Net (a refined fully convolutional networks) and perform image convolution in neural networks. Leveraging the Fast Fourier Transformation, it reduces the image convolution costs…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Varsha Nair , Moitrayee Chatterjee , Neda Tavakoli , Akbar Siami Namin , Craig Snoeyink

Also recently, exciting strides forward have been made in the area of image restoration, particularly for image denoising and single image super-resolution. Deep learning techniques contributed to this significantly. The top methods differ…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Jiqing Wu , Radu Timofte , Luc Van Gool

3D style transfer aims to generate stylized views of 3D scenes with specified styles, which requires high-quality generating and keeping multi-view consistency. Existing methods still suffer the challenges of high-quality stylization with…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Zijiang Yang , Zhongwei Qiu , Chang Xu , Dongmei Fu