English
Related papers

Related papers: Spatial Ensemble: a Novel Model Smoothing Mechanis…

200 papers

While recent test-time adaptations exhibit efficacy by adjusting batch normalization to narrow domain disparities, their effectiveness diminishes with realistic mini-batches due to inaccurate target estimation. As previous attempts merely…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zixian Su , Jingwei Guo , Kai Yao , Xi Yang , Qiufeng Wang , Kaizhu Huang

Compared with image scene parsing, video scene parsing introduces temporal information, which can effectively improve the consistency and accuracy of prediction. In this paper, we propose a Spatial-Temporal Semantic Consistency method to…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Xingjian He , Weining Wang , Zhiyong Xu , Hao Wang , Jie Jiang , Jing Liu

Spatiotemporal forecasting tasks, such as traffic flow, combustion dynamics, and weather forecasting, often require complex models that suffer from low training efficiency and high memory consumption. This paper proposes a lightweight…

Machine Learning · Computer Science 2025-07-22 Yuqi Li , Chuanguang Yang , Hansheng Zeng , Zeyu Dong , Zhulin An , Yongjun Xu , Yingli Tian , Hao Wu

Vision Transformer models have shown impressive effectiveness in the surgical video understanding tasks through long-range dependency modeling. However, current methods suffer from prohibitive computational costs due to processing massive…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xixi Jiang , Chen Yang , Dong Zhang , Pingcheng Dong , Xin Yang , Kwang-Ting Cheng

Modern one-stage video instance segmentation networks suffer from two limitations. First, convolutional features are neither aligned with anchor boxes nor with ground-truth bounding boxes, reducing the mask sensitivity to spatial location.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Minghan Li , Shuai Li , Lida Li , Lei Zhang

Simulator imperfection, often known as model error, is ubiquitous in practical data assimilation problems. Despite the enormous efforts dedicated to addressing this problem, properly handling simulator imperfection in data assimilation…

Optimization and Control · Mathematics 2019-08-06 Xiaodong Luo

In traditional models of supervised learning, the goal of a learner -- given examples from an arbitrary joint distribution on $\mathbb{R}^d \times \{\pm 1\}$ -- is to output a hypothesis that is competitive (to within $\epsilon$) of the…

Machine Learning · Computer Science 2025-05-02 Gautam Chandrasekaran , Adam Klivans , Vasilis Kontonis , Raghu Meka , Konstantinos Stavropoulos

This paper presents a novel fixation prediction and saliency modeling framework based on inter-image similarities and ensemble of Extreme Learning Machines (ELM). The proposed framework is inspired by two observations, 1) the contextual…

Computer Vision and Pattern Recognition · Computer Science 2017-05-31 Hamed R. -Tavakoli , Ali Borji , Jorma Laaksonen , Esa Rahtu

Model merging enables the combination of multiple specialized expert models into a single model capable of performing multiple tasks. However, the benefits of merging an increasing amount of specialized experts generally lead to diminishing…

Machine Learning · Computer Science 2025-12-23 Ronald Skorobogat , Karsten Roth , Mariana-Iuliana Georgescu

Despite the great success of state-of-the-art deep neural networks, several studies have reported models to be over-confident in predictions, indicating miscalibration. Label Smoothing has been proposed as a solution to the over-confidence…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Shuang Ao , Stefan Rueger , Advaith Siddharthan

In medical risk modeling, typical data are "scarce": they have relatively small number of training instances (N), censoring, and high dimensionality (M). We show that the problem may be effectively simplified by reducing it to bipartite…

Machine Learning · Computer Science 2012-01-31 Marina Sapir

Due to the high annotation cost of large-scale facial landmark detection tasks in videos, a semi-supervised paradigm that uses self-training for mining high-quality pseudo-labels to participate in training has been proposed by researchers.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Rongye Meng , Sanping Zhou , Xingyu Wan , Mengliu Li , Jinjun Wang

Recurrent neural networks are widely used for modeling spatio-temporal sequences in both nature language processing and neural population dynamics. However, understanding the temporal credit assignment is hard. Here, we propose that each…

Disordered Systems and Neural Networks · Physics 2023-02-20 Wenxuan Zou , Chan Li , Haiping Huang

In Domain Generalization (DG) settings, models trained independently on a given set of training domains have notoriously chaotic performance on distribution shifted test domains, and stochasticity in optimization (e.g. seed) plays a big…

Machine Learning · Computer Science 2022-10-14 Devansh Arpit , Huan Wang , Yingbo Zhou , Caiming Xiong

Deep model training on extensive datasets is increasingly becoming cost-prohibitive, prompting the widespread adoption of deep model fusion techniques to leverage knowledge from pre-existing models. From simple weight averaging to more…

Machine Learning · Computer Science 2024-08-27 Anke Tang , Li Shen , Yong Luo , Shuai Xie , Han Hu , Lefei Zhang , Bo Du , Dacheng Tao

In data assimilation, an ensemble provides a way to propagate the probability density of a system described by a nonlinear prediction model. Although a large ensemble size is required for statistical accuracy, the ensemble size is typically…

Numerical Analysis · Mathematics 2024-11-12 Bosu Choi , Yoonsang Lee

Ensembles of neural networks are known to be much more robust and accurate than individual networks. However, training multiple deep networks for model averaging is computationally expensive. In this paper, we propose a method to obtain the…

Machine Learning · Computer Science 2017-04-04 Gao Huang , Yixuan Li , Geoff Pleiss , Zhuang Liu , John E. Hopcroft , Kilian Q. Weinberger

Cross-modal alignment aims to map heterogeneous modalities into a shared latent space, as exemplified by models like CLIP, which benefit from large-scale image-text pretraining for strong recognition capabilities. However, when operating in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Jiaxiang Liu , Yuan Wang , Jiawei Du , Joey Tianyi Zhou , Mingkun Xu , Zuozhu Liu

We introduce Spatial-Temporal Memory Networks for video object detection. At its core, a novel Spatial-Temporal Memory module (STMM) serves as the recurrent computation unit to model long-term temporal appearance and motion dynamics. The…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Fanyi Xiao , Yong Jae Lee

Unlike static documents, version controlled documents are continuously edited by one or more authors. Such collaborative revision process makes traditional modeling and visualization techniques inappropriate. In this paper we propose a new…

Graphics · Computer Science 2013-08-09 Seungyeon Kim , Guy Lebanon