English
Related papers

Related papers: A Parameter-Efficient Mixture-of-Experts Framework…

200 papers

Mixture-of-Experts (MoE) approaches have recently gained traction in robotics applications due to their ability to dynamically allocate computational resources and specialize sub-networks for distinct tasks or environmental contexts,…

Robotics · Computer Science 2026-02-18 Dmytro Kuzmenko , Nadiya Shvai

Federated cross-modal retrieval faces severe challenges from heterogeneous client data, particularly non-IID semantic distributions and missing modalities. Under such heterogeneity, a single global model is often insufficient to capture…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Hefeng Zhou , Xuan Liu , Sicheng Chen , Wutong Zhang , Wu Yan , Jiong Lou , Chentao Wu , Guangtao Xue , Wei Zhao , Jie Li

News image captioning aims to produce journalistically informative descriptions by combining visual content with contextual cues from associated articles. Despite recent advances, existing methods struggle with three key challenges: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Xiaoxing You , Qiang Huang , Lingyu Li , Chi Zhang , Xiaopeng Liu , Min Zhang , Jun Yu

Mixture-of-Experts (MoE) has become a prominent paradigm for scaling Large Language Models (LLMs). Parameter-efficient fine-tuning methods, such as LoRA, are widely adopted to adapt pretrained MoE LLMs to downstream tasks. However, existing…

Artificial Intelligence · Computer Science 2026-04-03 Guanzhi Deng , Bo Li , Ronghao Chen , Xiujin Liu , Zhuo Han , Huacan Wang , Lijie Wen , Linqi Song

Grounding referring expressions in images aims to locate the object instance in an image described by a referring expression. It involves a joint understanding of natural language and image content, and is essential for a range of visual…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Sibei Yang , Guanbin Li , Yizhou Yu

Cross-View Geo-Localization (CVGL) involves determining the localization of drone images by retrieving the most similar GPS-tagged satellite images. However, the imaging gaps between platforms are often significant and the variations in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Zhongwei Chen , Zhao-Xu Yang , Hai-Jun Rong

Mixture-of-Experts (MoE) architectures expand model capacity by sparsely activating experts but face two core challenges: misalignment between router logits and each expert's internal structure leads to unstable routing and expert…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Anzhe Cheng , Shukai Duan , Shixuan Li , Chenzhong Yin , Mingxi Cheng , Heng Ping , Tamoghna Chattopadhyay , Sophia I Thomopoulos , Shahin Nazarian , Paul Thompson , Paul Bogdan

Mixture of Experts (MoE) offers remarkable performance and computational efficiency by selectively activating subsets of model parameters. Traditionally, MoE models use homogeneous experts, each with identical capacity. However, varying…

Computation and Language · Computer Science 2024-08-21 An Wang , Xingwu Sun , Ruobing Xie , Shuaipeng Li , Jiaqi Zhu , Zhen Yang , Pinxue Zhao , J. N. Han , Zhanhui Kang , Di Wang , Naoaki Okazaki , Cheng-zhong Xu

Recent advances in Earth Observation have focused on large-scale foundation models. However, these models are computationally expensive, limiting their accessibility and reuse for downstream tasks. In this work, we investigate compact…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Mohanad Albughdadi

Solving multi-objective optimization problems for large deep neural networks is a challenging task due to the complexity of the loss landscape and the expensive computational cost of training and evaluating models. Efficient Pareto front…

Machine Learning · Computer Science 2024-06-17 Anke Tang , Li Shen , Yong Luo , Shiwei Liu , Han Hu , Bo Du

Mixture-of-Experts (MoE) models embody the divide-and-conquer concept and are a promising approach for increasing model capacity, demonstrating excellent scalability across multiple domains. In this paper, we integrate the MoE structure…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Xumeng Han , Longhui Wei , Zhiyang Dou , Zipeng Wang , Chenhui Qiang , Xin He , Yingfei Sun , Zhenjun Han , Qi Tian

Cross-view geo-localization aims at establishing location correspondences between different viewpoints. Existing approaches typically learn cross-view correlations through direct feature similarity matching, often overlooking semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Hongyang Zhang , Yinhao Liu , Zhenyu Kuang

Multi-Domain Continual Learning (MDCL) acquires knowledge from sequential tasks with shifting class sets and distribution. Despite the Parameter-Efficient Fine-Tuning (PEFT) methods can adapt for this dual heterogeneity, they still suffer…

Machine Learning · Computer Science 2025-08-12 Jialu Zhou , Dianxi Shi , Shaowu Yang , Xinyu Wei , Mingyue Yang , Leqian Li , Mengzhu Wang , Chunping Qiu

The Mixture of Experts (MoE) architecture is an important method for scaling Large Language Models (LLMs). It increases model capacity while keeping computation cost low. However, the ultra-large MoE models still have hundreds of billions…

Artificial Intelligence · Computer Science 2025-10-01 Yixiao Chen , Yanyue Xie , Ruining Yang , Wei Jiang , Wei Wang , Yong He , Yue Chen , Pu Zhao , Yanzhi Wang

Previous multi-task dense prediction methods based on the Mixture of Experts (MoE) have received great performance but they neglect the importance of explicitly modeling the global relations among all tasks. In this paper, we present a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yuqi Yang , Peng-Tao Jiang , Qibin Hou , Hao Zhang , Jinwei Chen , Bo Li

Existing approaches to drone visual geo-localization predominantly adopt the image-based setting, where a single drone-view snapshot is matched with images from other platforms. Such task formulation, however, underutilizes the inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Hao Ju , Shaofei Huang , Si Liu , Zhedong Zheng

The Mixture-of-Experts (MoE) model uses a set of expert networks that specialize on subsets of a dataset under the supervision of a gating network. A common issue in MoE architectures is ``expert collapse'' where overlapping class…

Neural and Evolutionary Computing · Computer Science 2026-03-31 Abien Fred Agarap , Arnulfo P. Azcarraga

Aerial-ground localization is difficult due to large viewpoint and modality gaps between ground-level LiDAR and overhead imagery. We propose TransLocNet, a cross-modal attention framework that fuses LiDAR geometry with aerial semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Phu Pham , Damon Conover , Aniket Bera

This technical report represents the award-winning solution to the Cross-platform 3D Object Detection task in the RoboSense2025 Challenge. Our approach is built upon PVRCNN++, an efficient 3D object detection framework that effectively…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Xiyan Feng , Wenbo Zhang , Lu Zhang , Yunzhi Zhuge , Huchuan Lu , You He

We report on the application of a high-capacity semantic segmentation pipeline to the GOOSE 2D Semantic Segmentation Challenge for unstructured off-road environments. Using a FlashInternImage-B backbone together with a UPerNet decoder, we…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Wonjune Kim , Lae-kyoung Lee , Su-Yong An