English
Related papers

Related papers: Reinforcement Learning-based Mixture of Vision Tra…

200 papers

Mixture-of-Experts (MoE) architectures have emerged as a cornerstone of modern AI systems. In particular, MoEs route inputs dynamically to specialized experts whose outputs are aggregated through weighted summation. Despite their widespread…

Machine Learning · Computer Science 2025-10-09 Fangshuo Liao , Anastasios Kyrillidis

Video-based behavior recognition is essential in fields such as public safety, intelligent surveillance, and human-computer interaction. Traditional 3D Convolutional Neural Network (3D CNN) effectively capture local spatiotemporal features…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xiuliang Zhang , Tadiwa Elisha Nyamasvisva , Chuntao Liu

Sparsely-gated Mixture of Experts networks (MoEs) have demonstrated excellent scalability in Natural Language Processing. In Computer Vision, however, almost all performant networks are "dense", that is, every input is processed by every…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Carlos Riquelme , Joan Puigcerver , Basil Mustafa , Maxim Neumann , Rodolphe Jenatton , André Susano Pinto , Daniel Keysers , Neil Houlsby

Recent advances in attention-based networks have shown that Vision Transformers can achieve state-of-the-art or near state-of-the-art results on many image classification tasks. This puts transformers in the unique position of being a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Kaleel Mahmood , Rigel Mahmood , Marten van Dijk

We propose a novel deep convolutional neural network (CNN) based multi-task learning approach for open-set visual recognition. We combine a classifier network and a decoder network with a shared feature extractor network within a multi-task…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Poojan Oza , Vishal M. Patel

Modern vision-based reinforcement learning techniques often use convolutional neural networks (CNN) as universal function approximators to choose which action to take for a given visual input. Until recently, CNNs have been treated like…

Machine Learning · Computer Science 2018-09-28 Jieliang Luo , Sam Green , Peter Feghali , George Legrady , Çetin Kaya Koç

Learning high-quality video representation has shown significant applications in computer vision and remains challenging. Previous work based on mask autoencoders such as ImageMAE and VideoMAE has proven the effectiveness of learning…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Xingjian Diao , Ming Cheng , Shitong Cheng

Thermal weapon segmentation is crucial for surveillance and security applications, enabling robust detection under lowlight and visually obscured conditions where RGB-based systems fail. While convolutional neural networks (CNNs) dominate…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Akhila Kambhatla , Ahmed R Khaled

Mixture-of-Experts (MoE) models provide a structured approach to combining specialized neural networks and offer greater interpretability than conventional ensembles. While MoEs have been successfully applied to image classification and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Svetlana Pavlitska , Malte Stüven , Beyza Keskin , J. Marius Zöllner

Mixture-of-Experts (MoE) models are a promising way to scale up model capacity without significantly increasing computational cost. A key component of MoEs is the router, which decides which subset of parameters (experts) process which…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Tianlin Liu , Mathieu Blondel , Carlos Riquelme , Joan Puigcerver

In recent years, the scientific community has focused on the development of CAD tools that could improve bone fractures' classification, mostly based on Convolutional Neural Network (CNN). However, the discerning accuracy of fractures'…

Artificial Intelligence · Computer Science 2021-10-27 Leonardo Tanzi , Andrea Audisio , Giansalvo Cirrincione , Alessandro Aprato , Enrico Vezzetti

Convolution Neural Networks (CNNs) are widely used in medical image analysis, but their performance degrade when the magnification of testing images differ from the training images. The inability of CNNs to generalize across magnification…

Image and Video Processing · Electrical Eng. & Systems 2023-02-23 Pranav Jeevan , Nikhil Cherian Kurian , Amit Sethi

Effective recognition of acute and difficult-to-heal wounds is a necessary step in wound diagnosis. An efficient classification model can help wound specialists classify wound types with less financial and time costs and also help in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Ramin Mousa , Hadis Taherinia , Khabiba Abdiyeva , Amir Ali Bengari , Mohammadmahdi Vahediahmar

Mixture-of-Experts (MoE) models embody the divide-and-conquer concept and are a promising approach for increasing model capacity, demonstrating excellent scalability across multiple domains. In this paper, we integrate the MoE structure…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Xumeng Han , Longhui Wei , Zhiyang Dou , Zipeng Wang , Chenhui Qiang , Xin He , Yingfei Sun , Zhenjun Han , Qi Tian

AI-based models for histopathology whole slide image (WSI) analysis are increasingly common, but unsharp or blurred areas within WSI can significantly reduce prediction performance. In this study, we investigated the effect of image blur on…

Image and Video Processing · Electrical Eng. & Systems 2025-07-21 Yujie Xiang , Bojing Liu , Mattias Rantalainen

Mixture-of-Experts (MoE) models improve transformer efficiency but lack a unified theoretical explanation, especially when both feed-forward and attention layers are allowed to specialize. To this end, we study the Mixture-of-Transformers…

Machine Learning · Computer Science 2025-11-03 Hongbo Li , Qinhang Wu , Sen Lin , Yingbin Liang , Ness B. Shroff

Continued advances in self-supervised learning have led to significant progress in video representation learning, offering a scalable alternative to supervised approaches by removing the need for manual annotations. Despite strong…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Fida Mohammad Thoker , Letian Jiang , Chen Zhao , Piyush Bagad , Hazel Doughty , Bernard Ghanem , Cees G. M. Snoek

The Mixture-of-Experts (MoE) model uses a set of expert networks that specialize on subsets of a dataset under the supervision of a gating network. A common issue in MoE architectures is ``expert collapse'' where overlapping class…

Neural and Evolutionary Computing · Computer Science 2026-03-31 Abien Fred Agarap , Arnulfo P. Azcarraga

Learning discriminative image feature embeddings is of great importance to visual recognition. To achieve better feature embeddings, most current methods focus on designing different network structures or loss functions, and the estimated…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Suichan Li , Dapeng Chen , Bin Liu , Nenghai Yu , Rui Zhao

Vision Transformers (ViT) become widely-adopted architectures for various vision tasks. Masked auto-encoding for feature pretraining and multi-scale hybrid convolution-transformer architectures can further unleash the potentials of ViT,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Peng Gao , Teli Ma , Hongsheng Li , Ziyi Lin , Jifeng Dai , Yu Qiao