English
Related papers

Related papers: A Parameter-Efficient Mixture-of-Experts Framework…

200 papers

Parameter-efficient fine-tuning has demonstrated promising results across various visual adaptation tasks, such as classification and segmentation. Typically, prompt tuning techniques have harnessed knowledge from a single pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Shentong Mo , Xufang Luo , Dongsheng Li

Mixture-of-Experts (MoE) Large Language Models (LLMs) face a trilemma of load imbalance, parameter redundancy, and communication overhead. We introduce a unified framework based on dynamic expert clustering and structured compression to…

Computation and Language · Computer Science 2026-02-06 Peijun Zhu , Ning Yang , Baoliang Tian , Jiayu Wei , Weihao Zhang , Haijun Zhang , Pin Lv

Recent progress in two-view geometry increasingly emphasizes enforcing smoothness and global consistency priors when estimating motion fields between pairs of images. However, in complex real-world scenes, characterized by extreme viewpoint…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Jiajun Le , Jiayi Ma

The Mixture of Experts (MoE) has emerged as a highly successful technique in deep learning, based on the principle of divide-and-conquer to maximize model capacity without significant additional computational cost. Even in the era of…

Computation and Language · Computer Science 2024-09-02 Boan Liu , Liang Ding , Li Shen , Keqin Peng , Yu Cao , Dazhao Cheng , Dacheng Tao

Navigating drones through natural language commands remains challenging due to the dearth of accessible multi-modal datasets and the stringent precision requirements for aligning visual and textual data. To address this pressing need, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Meng Chu , Zhedong Zheng , Wei Ji , Tingyu Wang , Tat-Seng Chua

Achieving both accurate and consistent predictive performance across spatial nodes is crucial for ensuring the validity and reliability of outcomes in fair spatial-temporal forecasting tasks. However, existing training methods treat…

Machine Learning · Computer Science 2025-05-27 Shaohan Yu , Pan Deng , Yu Zhao , Junting Liu , Zi'ang Wang

Mixture-of-Experts (MoE) has emerged as a powerful paradigm for scaling model capacity while preserving computational efficiency. Despite its notable success in large language models (LLMs), existing attempts to apply MoE to Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yujie Wei , Shiwei Zhang , Hangjie Yuan , Yujin Han , Zhekai Chen , Jiayu Wang , Difan Zou , Xihui Liu , Yingya Zhang , Yu Liu , Hongming Shan

Despite advances in object detection, aerial imagery remains a challenging domain, as models often fail to generalize across variations in spatial resolution, scene composition, and semantic label coverage. Differences in geographic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Pourya Shamsolmoali , Masoumeh Zareapoor , Michael Felsberg , Nick Pears , Yue Lu

Land use and land cover mapping from Earth Observation (EO) data is a critical tool for sustainable land and resource management. While advanced machine learning and deep learning algorithms excel at analyzing EO imagery data, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Babak Ghassemi , Cassio Fraga-Dantas , Raffaele Gaetano , Dino Ienco , Omid Ghorbanzadeh , Emma Izquierdo-Verdiguier , Francesco Vuolo

Infrared and visible image fusion aims to integrate comprehensive information from multiple sources to achieve superior performances on various practical tasks, such as detection, over that of a single modality. However, most existing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yiming Sun , Bing Cao , Pengfei Zhu , Qinghua Hu

Single domain generalization (SDG) has recently attracted growing attention in medical image segmentation. One promising strategy for SDG is to leverage consistent semantic shape priors across different imaging protocols, scanner vendors,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Jia Wei , Xiaoqi Zhao , Jonghye Woo , Jinsong Ouyang , Georges El Fakhri , Qingyu Chen , Xiaofeng Liu

Deep learning on an edge device requires energy efficient operation due to ever diminishing power budget. Intentional low quality data during the data acquisition for longer battery life, and natural noise from the low cost sensor degrade…

Machine Learning · Computer Science 2019-04-30 Taesik Na , Minah Lee , Burhan A. Mudassar , Priyabrata Saha , Jong Hwan Ko , Saibal Mukhopadhyay

The large variation of viewpoint and irrelevant content around the target always hinder accurate image retrieval and its subsequent tasks. In this paper, we investigate an extremely challenging task: given a ground-view image of a landmark,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Zelong Zeng , Zheng Wang , Fan Yang , Shin'ichi Satoh

Accurate precipitation forecasting is indispensable in agriculture, disaster management, and sustainable strategies. However, predicting rainfall has been challenging due to the complexity of climate systems and the heterogeneous nature of…

Artificial Intelligence · Computer Science 2025-09-16 Chen Jiang , Kofi Osei , Sai Deepthi Yeddula , Dongji Feng , Wei-Shinn Ku

Establishing reliable correspondences between image pairs is a fundamental task in computer vision, underpinning applications such as 3D reconstruction and visual localization. Although recent methods have made progress in pruning outliers…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Peiwen Xia , Tangfei Liao , Wei Zhu , Danhuai Zhao , Jianjun Ke , Kaihao Zhang , Tong Lu , Tao Wang

Multi-modal 3D understanding is a fundamental task in computer vision. Previous multi-modal fusion methods typically employ a single, dense fusion network, struggling to handle the significant heterogeneity and complexity across modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yu Li , Yuenan Hou , Yingmei Wei , Xinge Zhu , Yuexin Ma , Wenqi Shao , Yanming Guo

The volume of unlabelled Earth observation (EO) data is huge, but many important applications lack labelled training data. However, EO data offers the unique opportunity to pair data from different modalities and sensors automatically based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Vishal Nedungadi , Ankit Kariryaa , Stefan Oehmcke , Serge Belongie , Christian Igel , Nico Lang

Mixture-of-Experts (MoE) presents a naturally compatible and scalable framework for multimodal learning, demonstrating strong adaptability across diverse modalities and tasks. Despite its growing success, a comprehensive and systematic…

Machine Learning · Computer Science 2026-05-28 Liangwei Nathan Zheng , Wei Emma Zhang , Olaf Maennel , Lin Yue , Weitong Chen

Modern applications increasingly involve many heterogeneous input streams, such as clinical sensors, wearable device data, imaging, and text, each with distinct measurement models, sampling rates, and noise characteristics. We define this…

Machine Learning · Computer Science 2026-03-03 Xing Han , Hsing-Huan Chung , Joydeep Ghosh , Paul Pu Liang , Suchi Saria

Multimodal remote sensing classification often suffers from missing modalities caused by sensor failures and environmental interference, leading to severe performance degradation. In this work, we rethink missing-modality learning from a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Qinghao Gao , Jiahui Qu , Wenqian Dong