English
Related papers

Related papers: Functionally Modular and Interpretable Temporal Fi…

200 papers

Most existing transformer based video instance segmentation methods extract per frame features independently, hence it is challenging to solve the appearance deformation problem. In this paper, we observe the temporal information is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Zhenghao Zhang , Fangtao Shao , Zuozhuo Dai , Siyu Zhu

Video data is with complex temporal dynamics due to various factors such as camera motion, speed variation, and different activities. To effectively capture this diverse motion pattern, this paper presents a new temporal adaptive module…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Zhaoyang Liu , Limin Wang , Wayne Wu , Chen Qian , Tong Lu

Understanding the mechanisms underlying deep neural networks remains a fundamental challenge in machine learning and computer vision. One promising, yet only preliminarily explored approach, is feature inversion, which attempts to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Jan Rathjens , Shirin Reyhanian , David Kappel , Laurenz Wiskott

High-dimensional time series are common in many domains. Since human cognition is not optimized to work well in high-dimensional spaces, these areas could benefit from interpretable low-dimensional representations. However, most…

Machine Learning · Computer Science 2019-01-07 Vincent Fortuin , Matthias Hüser , Francesco Locatello , Heiko Strathmann , Gunnar Rätsch

Multivariate time series forecasting is crucial across various industries, where accurate extraction of complex periodic and trend components can significantly enhance prediction performance. However, existing models often struggle to…

Machine Learning · Computer Science 2025-05-08 Yulong Wang , Yushuo Liu , Xiaoyi Duan , Kai Wang

Robust visual recognition under adverse weather conditions is of great importance in real-world applications. In this context, we propose a new method for learning semantic segmentation models robust against fog. Its key idea is to consider…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Sohyun Lee , Taeyoung Son , Suha Kwak

Image decomposition aims to analyze an image into elementary components, which is essential for numerous downstream tasks and also by nature provides certain interpretability to the analysis. Deep learning can be powerful for such tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Sihan Wang , Shangqi Gao , Fuping Wu , Xiahai Zhuang

Spatial-temporal data modeling aims to mine the underlying spatial relationships and temporal dependencies of objects in a system. However, most existing methods focus on the modeling of spatial-temporal data in a single mode, lacking the…

Machine Learning · Computer Science 2023-08-23 Zihang Liu , Le Yu , Tongyu Zhu , Leiei Sun

This paper introduces versatile filters to construct efficient convolutional neural networks that are widely used in various visual recognition tasks. Considering the demands of efficient deep learning techniques running on cost-effective…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Kai Han , Yunhe Wang , Chang Xu , Chunjing Xu , Enhua Wu , Dacheng Tao

Existing conformal prediction algorithms estimate prediction intervals at target confidence levels to characterize the performance of a regression model on new test samples. However, considering an autonomous system consisting of multiple…

Machine Learning · Computer Science 2023-09-25 Yunye Gong , Yi Yao , Xiao Lin , Ajay Divakaran , Melinda Gervasio

Prototypical part learning is emerging as a promising approach for making semantic segmentation interpretable. The model selects real patches seen during training as prototypes and constructs the dense prediction map based on the similarity…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hugo Porta , Emanuele Dalsasso , Diego Marcos , Devis Tuia

Data-driven convective parameterization aims to accurately represent convective adjustments to large-scale forcings in a computationally economic manner. While previous studies have demonstrated success using various model architectures,…

Atmospheric and Oceanic Physics · Physics 2025-06-02 Qiyu Song , Zhiming Kuang

Video temporal dynamics is conventionally modeled with 3D spatial-temporal kernel or its factorized version comprised of 2D spatial kernel and 1D temporal kernel. The modeling power, nevertheless, is limited by the fixed window size and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Fuchen Long , Zhaofan Qiu , Yingwei Pan , Ting Yao , Chong-Wah Ngo , Tao Mei

Feed-forward neural networks consist of a sequence of layers, in which each layer performs some processing on the information from the previous layer. A downside to this approach is that each layer (or module, as multiple modules can…

Machine Learning · Computer Science 2020-10-19 Alex Lamb , Anirudh Goyal , Agnieszka Słowik , Michael Mozer , Philippe Beaudoin , Yoshua Bengio

Interpretability is a pressing issue for machine learning. Common approaches to interpretable machine learning constrain interactions between features of the input, rendering the effects of those features on a model's output comprehensible…

Machine Learning · Computer Science 2023-05-11 Kieran A. Murphy , Dani S. Bassett

Interpretability has arisen as a key desideratum of machine learning models alongside performance. Approaches so far have been primarily concerned with fixed dimensional inputs emphasizing feature relevance or selection. In contrast, we…

Machine Learning · Computer Science 2018-07-03 Guang-He Lee , David Alvarez-Melis , Tommi S. Jaakkola

Rapid progress in machine learning and deep learning has enabled a wide range of applications in the electricity load forecasting of power systems, for instance, univariate and multivariate short-term load forecasting. Though the strong…

Machine Learning · Computer Science 2024-02-20 Yuqi Jiang , Yan Li , Yize Chen

Molecular-scale computation is crucial for smart materials and nanoscale devices, yet creating single-molecule systems capable of complex computations remains challenging. We present a theoretical framework for a single-molecule computer…

Statistical Mechanics · Physics 2024-10-01 Zhongmin Zhang , Zhiyue Lu

Most existing real-time deep models trained with each frame independently may produce inconsistent results across the temporal axis when tested on a video sequence. A few methods take the correlations in the video sequence into…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Yifan Liu , Chunhua Shen , Changqian Yu , Jingdong Wang

While numerous forecasters have been proposed using different network architectures, the Transformer-based models have state-of-the-art performance in time series forecasting. However, forecasters based on Transformers are still suffering…

Machine Learning · Computer Science 2024-11-06 Kun Yi , Jingru Fei , Qi Zhang , Hui He , Shufeng Hao , Defu Lian , Wei Fan