English
Related papers

Related papers: Video Relationship Detection Using Mixture of Expe…

200 papers

Recent advances in language and vision have demonstrated that scaling up model capacity consistently improves performance across diverse tasks. In 3D visual geometry reconstruction, large-scale training has likewise proven effective for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Jingnan Gao , Zhe Wang , Xianze Fang , Xingyu Ren , Zhuo Chen , Shengqi Liu , Yuhao Cheng , Jiangjing Lyu , Xiaokang Yang , Yichao Yan

Recent advances in dynamic scene reconstruction have significantly benefited from 3D Gaussian Splatting, yet existing methods show inconsistent performance across diverse scenes, indicating no single approach effectively handles all dynamic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 In-Hwan Jin , Hyeongju Mun , Joonsoo Kim , Kugjin Yun , Kyeongbo Kong

The rapid growth of video on the internet has made searching for video content using natural language queries a significant challenge. Human-generated queries for video datasets `in the wild' vary a lot in terms of degree of specificity,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-17 Yang Liu , Samuel Albanie , Arsha Nagrani , Andrew Zisserman

Mixture-of-Experts (MoE) models improve transformer efficiency but lack a unified theoretical explanation, especially when both feed-forward and attention layers are allowed to specialize. To this end, we study the Mixture-of-Transformers…

Machine Learning · Computer Science 2025-11-03 Hongbo Li , Qinhang Wu , Sen Lin , Yingbin Liang , Ness B. Shroff

Pretrained vision-language models, such as CLIP, have demonstrated strong generalization capabilities, making them promising tools in the realm of zero-shot visual recognition. Visual relation detection (VRD) is a typical task that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Lin Li , Jun Xiao , Guikun Chen , Jian Shao , Yueting Zhuang , Long Chen

Different medical imaging modalities capture diagnostic information at varying spatial resolutions, from coarse global patterns to fine-grained localized structures. However, most existing vision-language frameworks in the medical domain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Shivang Chopra , Gabriela Sanchez-Rodriguez , Lingchao Mao , Andrew J Feola , Jing Li , Zsolt Kira

Modeling feature interactions is essential for accurate click-through rate (CTR) prediction in advertising systems. Recent studies have adopted the Mixture-of-Experts (MoE) approach to improve performance by ensembling multiple feature…

Information Retrieval · Computer Science 2025-09-16 Jiancheng Wang , Mingjia Yin , Hao Wang , Enhong Chen

Visual relations, such as "person ride bike" and "bike next to car", offer a comprehensive scene understanding of an image, and have already shown their great utility in connecting computer vision and natural language. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2017-02-28 Hanwang Zhang , Zawlin Kyaw , Shih-Fu Chang , Tat-Seng Chua

The Meta Video Dataset (MetaVD) provides annotated relations between action classes in major datasets for human action recognition in videos. Although these annotated relations enable dataset augmentation, it is only applicable to those…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yuya Yoshikawa , Yutaro Shigeto , Masashi Shimbo , Akikazu Takeuchi

Composed video retrieval (CoVR) is a challenging problem in computer vision which has recently highlighted the integration of modification text with visual queries for more sophisticated video search in large databases. Existing works…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Omkar Thawakar , Muzammal Naseer , Rao Muhammad Anwer , Salman Khan , Michael Felsberg , Mubarak Shah , Fahad Shahbaz Khan

We propose a novel mixture-of-experts class to optimize computer vision models in accordance with data transfer limitations at test time. Our approach postulates that the minimum acceptable amount of data allowing for highly-accurate…

Machine Learning · Computer Science 2020-09-02 Alhabib Abbas , Yiannis Andreopoulos

To accurately understand engineering drawings, it is essential to establish the correspondence between images and their description tables within the drawings. Existing document understanding methods predominantly focus on text as the main…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Chao Gu , Ke Lin , Yiyang Luo , Jiahui Hou , Xiang-Yang Li

Recent deep learning-based multi-view people detection (MVD) methods have shown promising results on existing datasets. However, current methods are mainly trained and evaluated on small, single scenes with a limited number of multi-view…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Qi Zhang , Yunfei Gong , Daijie Chen , Antoni B. Chan , Hui Huang

Adverse weather removal tasks like deraining, desnowing, and dehazing are usually treated as separate tasks. However, in practical autonomous driving scenarios, the type, intensity,and mixing degree of weather are unknown, so handling each…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Yulin Luo , Rui Zhao , Xiaobao Wei , Jinwei Chen , Yijie Lu , Shenghao Xie , Tianyu Wang , Ruiqin Xiong , Ming Lu , Shanghang Zhang

Robust 3D object detection under adverse weather conditions is crucial for autonomous driving. However, most existing methods simply combine all weather samples for training while overlooking data distribution discrepancies across different…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Hongwei Lin , Xun Huang , Chenglu Wen , Cheng Wang

This paper presents a comprehensive review of the Mixture-of-Experts (MoE) architecture in large language models, highlighting its ability to significantly enhance model performance while maintaining minimal computational overhead. Through…

Machine Learning · Computer Science 2025-12-24 Danyang Zhang , Junhao Song , Ziqian Bi , Xinyuan Song , Yingfang Yuan , Tianyang Wang , Joe Yeong , Junfeng Hao

Video-based person Re-Identification (V-ReID) aims to retrieve specific persons from raw videos captured by non-overlapped cameras. As a fundamental task, it spreads many multimedia and computer vision applications. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Xuehu Liu , Pingping Zhang , Huchuan Lu

Computer vision researchers are embracing two promising paradigms: Vision Transformers (ViTs) and Multi-task Learning (MTL), which both show great performance but are computation-intensive, given the quadratic complexity of self-attention…

Hardware Architecture · Computer Science 2023-09-14 Rishov Sarkar , Hanxue Liang , Zhiwen Fan , Zhangyang Wang , Cong Hao

While Fourier-based neural operators are best suited to learning mappings between functions on periodic domains, several works have introduced techniques for incorporating non trivial boundary conditions. However, all previously introduced…

Machine Learning · Computer Science 2025-02-10 Dwyer Deighan , Jonas A. Actor , Ravi G. Patel

This paper presents Edge-based Mixture of Experts (MoE) Collaborative Computing (EMC2), an optimal computing system designed for autonomous vehicles (AVs) that simultaneously achieves low-latency and high-accuracy 3D object detection.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Linshen Liu , Boyan Su , Junyue Jiang , Guanlin Wu , Cong Guo , Ceyu Xu , Hao Frank Yang