中文
相关论文

相关论文: MoEC: Mixture of Experts Implicit Neural Compressi…

200 篇论文

COMpression with Bayesian Implicit NEural Representations (COMBINER) is a recent data compression method that addresses a key inefficiency of previous Implicit Neural Representation (INR)-based approaches: it avoids quantization and enables…

机器学习 · 计算机科学 2024-03-08 Jiajun He , Gergely Flamich , Zongyu Guo , José Miguel Hernández-Lobato

Scaling large language models has driven remarkable advancements across various domains, yet the continual increase in model size presents significant challenges for real-world deployment. The Mixture of Experts (MoE) architecture offers a…

机器学习 · 计算机科学 2025-03-18 Shwai He , Daize Dong , Liang Ding , Ang Li

Implicit Neural Representations (INRs) are powerful to parameterize continuous signals in computer vision. However, almost all INRs methods are limited to low-level tasks, e.g., image/video compression, super-resolution, and image…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Yiran Song , Qianyu Zhou , Lizhuang Ma

Mixture-of-Experts (MoE) has emerged as a promising architecture for modern large language models (LLMs). However, massive parameters impose heavy GPU memory (i.e., VRAM) demands, hindering the widespread adoption of MoE LLMs. Offloading…

机器学习 · 计算机科学 2025-09-11 Jiaming Yan , Jianchun Liu , Hongli Xu , Liusheng Huang

With the widespread application of Mixture of Experts (MoE) reasoning models in the field of LLM learning, efficiently serving MoE models under limited GPU memory constraints has emerged as a significant challenge. Offloading the…

机器学习 · 计算机科学 2025-09-10 Songkai Ma , Zhaorui Zhang , Sheng Di , Benben Liu , Xiaodong Yu , Xiaoyi Lu , Dan Wang

Implicit neural representations (INRs) mark a fundamental shift in signal modeling, moving from discrete sampled data to continuous functional representations. By parameterizing signals as neural networks, INRs provide a unified framework…

计算机视觉与模式识别 · 计算机科学 2026-04-17 Dhananjaya Jayasundara , Vishal M. Patel

Supervised Deep-Learning (DL)-based reconstruction algorithms have shown state-of-the-art results for highly-undersampled dynamic Magnetic Resonance Imaging (MRI) reconstruction. However, the requirement of excessive high-quality…

图像与视频处理 · 电气工程与系统科学 2025-11-11 Jie Feng , Ruimin Feng , Qing Wu , Zhiyong Zhang , Yuyao Zhang , Hongjiang Wei

Implicit Neural Representations (INRs) have been demonstrated to achieve state-of-the-art compression of a broad range of modalities such as images, videos, 3D surfaces, and audio. Most studies have focused on building neural counterparts…

计算几何 · 计算机科学 2025-12-19 Sai Karthikey Pentapati , Gregoire Phillips , Alan Bovik

Recent work in Deep Learning has re-imagined the representation of data as functions mapping from a coordinate space to an underlying continuous signal. When such functions are approximated by neural networks this introduces a compelling…

机器学习 · 统计学 2022-08-09 Jonathan Richard Schwarz , Yee Whye Teh

Implicit neural representations (INRs, also known as neural fields) have recently emerged as a powerful framework for knowledge representation, synthesis, and compression. By encoding fields as continuous functions within the weights and…

机器学习 · 计算机科学 2025-10-27 Jubilee Lee , Daniele E. Schiavazzi

Implicit Neural Representations (INRs) have recently advanced the field of deep learning due to their ability to learn continuous representations of signals without the need for large training datasets. Although INR methods have been…

图像与视频处理 · 电气工程与系统科学 2024-09-04 Mevan Ekanayake , Zhifeng Chen , Gary Egan , Mehrtash Harandi , Zhaolin Chen

$\textit{Implicit neural representations}$ (INRs) aim to learn a $\textit{continuous function}$ (i.e., a neural network) to represent an image, where the input and output of the function are pixel coordinates and RGB/Gray values,…

计算机视觉与模式识别 · 计算机科学 2023-10-24 Ke Liu , Feng Liu , Haishuai Wang , Ning Ma , Jiajun Bu , Bo Han

The Mixture-of-Experts (MoE) model uses a set of expert networks that specialize on subsets of a dataset under the supervision of a gating network. A common issue in MoE architectures is ``expert collapse'' where overlapping class…

神经与进化计算 · 计算机科学 2026-03-31 Abien Fred Agarap , Arnulfo P. Azcarraga

Implicit Neural Representations (INRs) encoding continuous multi-media data via multi-layer perceptrons has shown undebatable promise in various computer vision tasks. Despite many successful applications, editing and processing an INR…

计算机视觉与模式识别 · 计算机科学 2022-12-16 Dejia Xu , Peihao Wang , Yifan Jiang , Zhiwen Fan , Zhangyang Wang

Implicit Neural Representations (INRs), characterized by neural network-encoded signed distance fields, provide a powerful means to represent complex geometries continuously and efficiently. While successful in computer vision and…

计算工程、金融与科学 · 计算机科学 2025-07-09 Samundra Karki , Ming-Chen Hsu , Adarsh Krishnamurthy , Baskar Ganapathysubramanian

Implicit Neural Representations (INRs) are increasingly recognized as a versatile data modality for representing discretized signals, offering benefits such as infinite query resolution and reduced storage requirements. Existing signal…

Magnetic resonance (MR) images collected in 2D clinical protocols typically have large inter-slice spacing, resulting in high in-plane resolution and reduced through-plane resolution. Super-resolution technique can enhance the through-plane…

图像与视频处理 · 电气工程与系统科学 2023-03-21 Xin Wang , Sheng Wang , Honglin Xiong , Kai Xuan , Zixu Zhuang , Mengjun Liu , Zhenrong Shen , Xiangyu Zhao , Lichi Zhang , Qian Wang

Implicit Neural Representations (INRs) have garnered significant attention for their ability to model complex signals in various domains. Recently, INR-based frameworks have shown promise in neural video compression by embedding video…

图像与视频处理 · 电气工程与系统科学 2025-07-25 Taiga Hayami , Kakeru Koizumi , Hiroshi Watanabe

Implicit neural representation (INR) has proven to be accurate and efficient in various domains. In this work, we explore how different neural networks can be designed as a new texture INR, which operates in a continuous manner rather than…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Albert Kwok , Zheyuan Hu , Dounia Hammou

Steganography is the process of embedding secret data into another message or data, in such a way that it is not easily noticeable. With the advancement of deep learning, Deep Neural Networks (DNNs) have recently been utilized in…

密码学与安全 · 计算机科学 2023-10-10 Gyojin Han , Dong-Jae Lee , Jiwan Hur , Jaehyun Choi , Junmo Kim