English
Related papers

Related papers: Balancing Efficiency and Quality: MoEISR for Arbit…

200 papers

Mixture-of-Experts (MoE) models scale large language models efficiently by sparsely activating experts, but once an expert is selected, it is executed fully. Hence, the trade-off between accuracy and computation in an MoE model typically…

Machine Learning · Computer Science 2026-02-09 Nurbek Tastan , Stefanos Laskaridis , Karthik Nandakumar , Samuel Horvath

The Mixture-of-Experts (MoE) architecture improves computational efficiency via sparse expert activation, but throughput-oriented inference faces substantial GPU memory pressure due to a significant parameter size and intermediate data.…

Machine Learning · Computer Science 2026-05-20 Muyoung Son , Yi Chen , Seungjae Yoo , Soongyu Choi , Joo-Young Kim

Arbitrary-scale super-resolution (ASSR) overcomes the limitation of traditional super-resolution (SR) methods that operate only at fixed scales (e.g., 4x), enabling a single model to handle arbitrary magnification. Most existing ASSR…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Xinning Chai , Zhengxue Cheng , Yuhong Zhang , Hengsheng Zhang , Yingsheng Qin , Yucai Yang , Rong Xie , Li Song

For collecting high-quality high-resolution (HR) MR image, we propose a novel image reconstruction network named IREM, which is trained on multiple low-resolution (LR) MR images and achieve an arbitrary up-sampling rate for HR image…

Image and Video Processing · Electrical Eng. & Systems 2021-06-30 Qing Wu , Yuwei Li , Lan Xu , Ruiming Feng , Hongjiang Wei , Qing Yang , Boliang Yu , Xiaozhao Liu , Jingyi Yu , Yuyao Zhang

Mixture-of-Experts (MoE) model architectures can significantly reduce the number of activated parameters per token, enabling computationally efficient training and inference. However, their large overall parameter counts and model sizes…

Machine Learning · Computer Science 2026-02-13 Arian Raje , Anupam Nayak , Gauri Joshi

Mixture of Experts (MoE) LLMs face significant obstacles due to their massive parameter scale, which imposes memory, storage, and deployment challenges. Although recent expert merging methods promise greater efficiency by consolidating…

Machine Learning · Computer Science 2025-07-01 Lujun Li , Zhu Qiyuan , Jiacheng Wang , Wei Li , Hao Gu , Sirui Han , Yike Guo

Diffusion-model-based text-guided image generation has recently made astounding progress, producing fascinating results in open-domain image manipulation tasks. Few models, however, currently have complete zero-shot capabilities for both…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Sijia Li , Chen Chen , Haonan Lu

Scale arbitrary super-resolution based on implicit image function gains increasing popularity since it can better represent the visual world in a continuous manner. However, existing scale arbitrary works are trained and evaluated on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Zhiheng Li , Muheng Li , Jixuan Fan , Lei Chen , Yansong Tang , Jiwen Lu , Jie Zhou

We propose a simple yet effective approach to enhance the performance of feed-forward 3D reconstruction models. Existing methods often struggle near depth discontinuities, where standard regression losses encourage spatial averaging and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Zichen Wang , Ang Cao , Liam J. Wang , Jeong Joon Park

Implicit neural representations (INRs) have emerged as a powerful tool for solving inverse problems in computer vision and computational imaging. INRs represent images as continuous domain functions realized by a neural network taking…

Image and Video Processing · Electrical Eng. & Systems 2025-06-12 Mahrokh Najaf , Gregory Ongie

Single-image super-resolution (SISR) remains challenging due to the inherent difficulty of recovering fine-grained details and preserving perceptual quality from low-resolution inputs. Existing methods often rely on limited image priors,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Kangfu Mei , Hossein Talebi , Mojtaba Ardakani , Vishal M. Patel , Peyman Milanfar , Mauricio Delbracio

Mixture-of-Experts (MoE) language models increase parameter capacity without proportional per-token compute, but the deployment still requires storing all experts, making expert pruning important for reducing memory and serving overhead.…

Machine Learning · Computer Science 2026-04-14 Zongfang Liu , Shengkun Tang , Yifan Shen , Huan Wang , Xin Yuan

Mixture-of-Experts (MoE) models are a promising way to scale up model capacity without significantly increasing computational cost. A key component of MoEs is the router, which decides which subset of parameters (experts) process which…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Tianlin Liu , Mathieu Blondel , Carlos Riquelme , Joan Puigcerver

In example-based super-resolution, the function relating low-resolution images to their high-resolution counterparts is learned from a given dataset. This data-driven approach to solving the inverse problem of increasing image resolution…

Image and Video Processing · Electrical Eng. & Systems 2018-12-05 Alexander Robey , Vidya Ganapati

Single-Photon Image Super-Resolution (SPISR) aims to recover a high-resolution volumetric photon counting cube from a noisy low-resolution one by computational imaging algorithms. In real-world scenarios, pairs of training samples are often…

Image and Video Processing · Electrical Eng. & Systems 2023-03-06 Yiwei Chen , Chen Jiang , Yu Pan

Recent attempts at Super-Resolution for medical images used deep learning techniques such as Generative Adversarial Networks (GANs) to achieve perceptually realistic single image Super-Resolution. Yet, they are constrained by their…

Image and Video Processing · Electrical Eng. & Systems 2020-06-05 Chuan Tan , Jin Zhu , Pietro Lio'

Recently, satellites with high temporal resolution have fostered wide attention in various practical applications. Due to limitations of bandwidth and hardware cost, however, the spatial resolution of such satellites is considerably low,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Jiaming Wang , Zhenfeng Shao , Tao Lu , Xiao Huang , Ruiqian Zhang , Yu Wang

This study presents a new image super-resolution (SR) technique based on diffusion inversion, aiming at harnessing the rich image priors encapsulated in large pre-trained diffusion models to improve SR performance. We design a Partial noise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zongsheng Yue , Kang Liao , Chen Change Loy

Mixture-of-Experts (MoE) models have shown strong potential in scaling language models efficiently by activating only a small subset of experts per input. However, their widespread deployment remains limited due to the high memory overhead…

Machine Learning · Computer Science 2025-11-10 Yushu Zhao , Zheng Wang , Minjia Zhang

Conventional super-resolution methods suffer from two drawbacks: substantial computational cost in upscaling an entire large image, and the introduction of extraneous or potentially detrimental information for downstream computer vision…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Tianyi Zhang , Kishore Kasichainula , Yaoxin Zhuo , Baoxin Li , Jae-sun Seo , Yu Cao