中文
相关论文

相关论文: A Parameter-Efficient Mixture-of-Experts Framework…

200 篇论文

Mixture-of-Experts (MoE) approaches have recently gained traction in robotics applications due to their ability to dynamically allocate computational resources and specialize sub-networks for distinct tasks or environmental contexts,…

机器人学 · 计算机科学 2026-02-18 Dmytro Kuzmenko , Nadiya Shvai

Federated cross-modal retrieval faces severe challenges from heterogeneous client data, particularly non-IID semantic distributions and missing modalities. Under such heterogeneity, a single global model is often insufficient to capture…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Hefeng Zhou , Xuan Liu , Sicheng Chen , Wutong Zhang , Wu Yan , Jiong Lou , Chentao Wu , Guangtao Xue , Wei Zhao , Jie Li

News image captioning aims to produce journalistically informative descriptions by combining visual content with contextual cues from associated articles. Despite recent advances, existing methods struggle with three key challenges: (1)…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Xiaoxing You , Qiang Huang , Lingyu Li , Chi Zhang , Xiaopeng Liu , Min Zhang , Jun Yu

Mixture-of-Experts (MoE) has become a prominent paradigm for scaling Large Language Models (LLMs). Parameter-efficient fine-tuning methods, such as LoRA, are widely adopted to adapt pretrained MoE LLMs to downstream tasks. However, existing…

人工智能 · 计算机科学 2026-04-03 Guanzhi Deng , Bo Li , Ronghao Chen , Xiujin Liu , Zhuo Han , Huacan Wang , Lijie Wen , Linqi Song

Grounding referring expressions in images aims to locate the object instance in an image described by a referring expression. It involves a joint understanding of natural language and image content, and is essential for a range of visual…

计算机视觉与模式识别 · 计算机科学 2020-04-21 Sibei Yang , Guanbin Li , Yizhou Yu

Cross-View Geo-Localization (CVGL) involves determining the localization of drone images by retrieving the most similar GPS-tagged satellite images. However, the imaging gaps between platforms are often significant and the variations in…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Zhongwei Chen , Zhao-Xu Yang , Hai-Jun Rong

Mixture-of-Experts (MoE) architectures expand model capacity by sparsely activating experts but face two core challenges: misalignment between router logits and each expert's internal structure leads to unstable routing and expert…

Mixture of Experts (MoE) offers remarkable performance and computational efficiency by selectively activating subsets of model parameters. Traditionally, MoE models use homogeneous experts, each with identical capacity. However, varying…

Recent advances in Earth Observation have focused on large-scale foundation models. However, these models are computationally expensive, limiting their accessibility and reuse for downstream tasks. In this work, we investigate compact…

计算机视觉与模式识别 · 计算机科学 2025-09-16 Mohanad Albughdadi

Solving multi-objective optimization problems for large deep neural networks is a challenging task due to the complexity of the loss landscape and the expensive computational cost of training and evaluating models. Efficient Pareto front…

机器学习 · 计算机科学 2024-06-17 Anke Tang , Li Shen , Yong Luo , Shiwei Liu , Han Hu , Bo Du

Mixture-of-Experts (MoE) models embody the divide-and-conquer concept and are a promising approach for increasing model capacity, demonstrating excellent scalability across multiple domains. In this paper, we integrate the MoE structure…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Xumeng Han , Longhui Wei , Zhiyang Dou , Zipeng Wang , Chenhui Qiang , Xin He , Yingfei Sun , Zhenjun Han , Qi Tian

Cross-view geo-localization aims at establishing location correspondences between different viewpoints. Existing approaches typically learn cross-view correlations through direct feature similarity matching, often overlooking semantic…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Hongyang Zhang , Yinhao Liu , Zhenyu Kuang

Multi-Domain Continual Learning (MDCL) acquires knowledge from sequential tasks with shifting class sets and distribution. Despite the Parameter-Efficient Fine-Tuning (PEFT) methods can adapt for this dual heterogeneity, they still suffer…

机器学习 · 计算机科学 2025-08-12 Jialu Zhou , Dianxi Shi , Shaowu Yang , Xinyu Wei , Mingyue Yang , Leqian Li , Mengzhu Wang , Chunping Qiu

The Mixture of Experts (MoE) architecture is an important method for scaling Large Language Models (LLMs). It increases model capacity while keeping computation cost low. However, the ultra-large MoE models still have hundreds of billions…

人工智能 · 计算机科学 2025-10-01 Yixiao Chen , Yanyue Xie , Ruining Yang , Wei Jiang , Wei Wang , Yong He , Yue Chen , Pu Zhao , Yanzhi Wang

Previous multi-task dense prediction methods based on the Mixture of Experts (MoE) have received great performance but they neglect the importance of explicitly modeling the global relations among all tasks. In this paper, we present a…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Yuqi Yang , Peng-Tao Jiang , Qibin Hou , Hao Zhang , Jinwei Chen , Bo Li

Existing approaches to drone visual geo-localization predominantly adopt the image-based setting, where a single drone-view snapshot is matched with images from other platforms. Such task formulation, however, underutilizes the inherent…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Hao Ju , Shaofei Huang , Si Liu , Zhedong Zheng

The Mixture-of-Experts (MoE) model uses a set of expert networks that specialize on subsets of a dataset under the supervision of a gating network. A common issue in MoE architectures is ``expert collapse'' where overlapping class…

神经与进化计算 · 计算机科学 2026-03-31 Abien Fred Agarap , Arnulfo P. Azcarraga

Aerial-ground localization is difficult due to large viewpoint and modality gaps between ground-level LiDAR and overhead imagery. We propose TransLocNet, a cross-modal attention framework that fuses LiDAR geometry with aerial semantic…

计算机视觉与模式识别 · 计算机科学 2025-12-12 Phu Pham , Damon Conover , Aniket Bera

This technical report represents the award-winning solution to the Cross-platform 3D Object Detection task in the RoboSense2025 Challenge. Our approach is built upon PVRCNN++, an efficient 3D object detection framework that effectively…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Xiyan Feng , Wenbo Zhang , Lu Zhang , Yunzhi Zhuge , Huchuan Lu , You He

We report on the application of a high-capacity semantic segmentation pipeline to the GOOSE 2D Semantic Segmentation Challenge for unstructured off-road environments. Using a FlashInternImage-B backbone together with a UPerNet decoder, we…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Wonjune Kim , Lae-kyoung Lee , Su-Yong An