English
Related papers

Related papers: Spatial-Temporal Mixture-of-Graph-Experts for Mult…

200 papers

Spatio-temporal machine learning is critically needed for a variety of societal applications, such as agricultural monitoring, hydrological forecast, and traffic management. These applications greatly rely on regional features that…

Machine Learning · Computer Science 2023-03-09 Zhexiong Liu , Licheng Liu , Yiqun Xie , Zhenong Jin , Xiaowei Jia

Multiple Instance Learning (MIL) is the dominant framework for gigapixel whole-slide image (WSI) classification in computational pathology. However, current MIL aggregators route all instances through a shared pathway, constraining their…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Xin Tian , Jiuliu Lu , Ephraim Tsalik , Bart Wanders , Colleen Knoth , Julian Knight

Mixture-of-experts (MoE) models provide a flexible statistical framework for modeling heterogeneity and nonlinear relationships. In many modern applications, however, datasets are naturally distributed across multiple machines due to…

Machine Learning · Computer Science 2026-03-12 Faïcel Chamroukhi , Nhat Thien Pham

Adverse weather removal tasks like deraining, desnowing, and dehazing are usually treated as separate tasks. However, in practical autonomous driving scenarios, the type, intensity,and mixing degree of weather are unknown, so handling each…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Yulin Luo , Rui Zhao , Xiaobao Wei , Jinwei Chen , Yijie Lu , Shenghao Xie , Tianyu Wang , Ruiqin Xiong , Ming Lu , Shanghang Zhang

Predicting road traffic speed is a challenging task due to different types of roads, abrupt speed change and spatial dependencies between roads; it requires the modeling of dynamically changing spatial dependencies among roads and temporal…

Machine Learning · Computer Science 2020-10-21 Cheonbok Park , Chunggi Lee , Hyojin Bahng , Yunwon Tae , Kihwan Kim , Seungmin Jin , Sungahn Ko , Jaegul Choo

In this paper, we propose a novel Multi-Modal Scene Graph with Kolmogorov-Arnold Expert Network for Audio-Visual Question Answering (SHRIKE). The task aims to mimic human reasoning by extracting and fusing information from audio-visual…

Artificial Intelligence · Computer Science 2025-12-01 Zijian Fu , Changsheng Lv , Mengshi Qi , Huadong Ma

Traffic forecasting is essential for the traffic construction of smart cities in the new era. However, traffic data's complex spatial and temporal dependencies make traffic forecasting extremely challenging. Most existing traffic…

Machine Learning · Computer Science 2022-10-03 Wei Zhao , Shiqi Zhang , Bing Zhou , Bei Wang

Transformer models face scalability challenges in causal language modeling (CLM) due to inefficient memory allocation for growing key-value (KV) caches, which strains compute and storage resources. Existing methods like Grouped Query…

Computation and Language · Computer Science 2025-06-17 Guanghui Song , Dongping Liao , Yiren Zhao , Kejiang Ye , Cheng-zhong Xu , Xitong Gao

A crime is a punishable offence that is harmful for an individual and his society. It is obvious to comprehend the patterns of criminal activity to prevent them. Research can help society to prevent and solve crime activates. Study shows…

Machine Learning · Computer Science 2020-03-23 Sohrab Hossain , Ahmed Abtahee , Imran Kashem , Mohammed Moshiul Hoque , Iqbal H. Sarker

Continual learning (CL) has garnered significant attention because of its ability to adapt to new tasks that arrive over time. Catastrophic forgetting (of old tasks) has been identified as a major issue in CL, as the model adapts to new…

Machine Learning · Computer Science 2025-02-20 Hongbo Li , Sen Lin , Lingjie Duan , Yingbin Liang , Ness B. Shroff

Assigning consistent temporal identifiers to multiple moving objects in a video sequence is a challenging problem. A solution to that problem would have immediate ramifications in multiple object tracking and segmentation problems. We…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Abubakar Siddique , Reza Jalil Mozhdehi , Henry Medeiros

Mixture of Experts (MoE) is a popular framework for modeling heterogeneity in data for regression, classification and clustering. For continuous data which we consider here in the context of regression and cluster analysis, MoE usually use…

Methodology · Statistics 2015-06-30 Faicel Chamroukhi

Machine learning based traffic forecasting models leverage sophisticated spatiotemporal auto-correlations to provide accurate predictions of city-wide traffic states. However, existing methods assume a reliable and unbiased forecasting…

Machine Learning · Computer Science 2022-10-07 Fan Liu , Hao Liu , Wenzhao Jiang

Time series forecasting models are increasingly scaled through large Transformer backbones, yet most existing approaches process all series through a shared dense computation path despite substantial heterogeneity in temporal structure.…

Machine Learning · Computer Science 2026-05-26 Rui Wang , Renhao Xue , Ray Razi , Huan Song , Hannah R. Marlowe

The development of a cross-city accident prevention system is particularly challenging due to the heterogeneity, inconsistent reporting, and inherently clustered, sparse, cyclical, and noisy nature of urban accident data. These intrinsic…

Machine Learning · Computer Science 2026-01-12 Jiayu Fang , Zhiqi Shao , Haoning Xi , Boris Choy , Junbin Gao

Mixture of experts (MoE) are a popular class of statistical and machine learning models that have gained attention over the years due to their flexibility and efficiency. In this work, we consider Gaussian-gated localized MoE (GLoME) and…

Statistics Theory · Mathematics 2022-09-29 TrungTin Nguyen , Hien Duy Nguyen , Faicel Chamroukhi , Florence Forbes

Predicting risk map of traffic accidents is vital for accident prevention and early planning of emergency response. Here, the challenge lies in the multimodal nature of urban big data. We propose a compact neural ensemble model to alleviate…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Wenshan Wang , Su Yang , Weishan Zhang

Multimodal Generative Models (MGMs) have rapidly evolved beyond text generation, now spanning diverse output modalities including images, music, video, human motion, and 3D objects, by integrating language with other sensory modalities…

Multimedia · Computer Science 2025-11-25 Longzhen Han , Awes Mubarak , Almas Baimagambetov , Nikolaos Polatidis , Thar Baker

Encryption has been commonly used in network traffic to secure transmission, but it also brings challenges for malicious traffic detection, due to the invisibility of the packet payload. Graph-based methods are emerging as promising…

Cryptography and Security · Computer Science 2026-02-12 Yunpeng Tan , Qingyang Li , Mingxin Yang , Yannan Hu , Lei Zhang , Xinggong Zhang

As a prominent data modality task, time series forecasting plays a pivotal role in diverse applications. With the remarkable advancements in Large Language Models (LLMs), the adoption of LLMs as the foundational architecture for time series…

Machine Learning · Computer Science 2025-07-10 Yiwen Liu , Chenyu Zhang , Junjie Song , Siqi Chen , Sun Yin , Zihan Wang , Lingming Zeng , Yuji Cao , Junming Jiao