English
Related papers

Related papers: TemporalPaD: a reinforcement-learning framework fo…

200 papers

The recent success in deep learning has lead to various effective representation learning methods for videos. However, the current approaches for video representation require large amount of human labeled datasets for effective learning. We…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Shruti Vyas , Yogesh S Rawat , Mubarak Shah

Encouraged by the success of Convolutional Neural Networks (CNNs) in image classification, recently much effort is spent on applying CNNs to video based action recognition problems. One challenge is that video contains a varying number of…

Computer Vision and Pattern Recognition · Computer Science 2015-04-17 Peng Wang , Yuanzhouhan Cao , Chunhua Shen , Lingqiao Liu , Heng Tao Shen

Temporal difference (TD) learning is a fundamental technique in reinforcement learning that updates value estimates for states or state-action pairs using a TD target. This target represents an improved estimate of the true value by…

Machine Learning · Computer Science 2024-08-05 Wuhao Wang , Zhiyong Chen , Lepeng Zhang

Recent advancements in deep learning have shown impressive results in image and video denoising, leveraging extensive pairs of noisy and noise-free data for supervision. However, the challenge of acquiring paired videos for dynamic scenes…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Zixuan Fu , Lanqing Guo , Chong Wang , Yufei Wang , Zhihao Li , Bihan Wen

Recent advances in deep learning have significantly elevated weather prediction models. However, these models often falter in real-world scenarios due to their sensitivity to spatial-temporal shifts. This issue is particularly acute in…

Machine Learning · Computer Science 2023-12-04 Lu Han , Xu-Yang Chen , Han-Jia Ye , De-Chuan Zhan

Reinforcement learning algorithms have been widely used in dynamic and control systems. However, interpreting their internal learning behavior remains a challenge. In the authors' previous work, a critic match loss landscape visualization…

Machine Learning · Computer Science 2026-03-17 Jingyi Liu , Jian Guo , Eberhard Gill

High-dimensional multivariate spatial-temporal data arise frequently in a wide range of applications; however, there are relatively few statistical methods that can simultaneously deal with spatial, temporal and variable-wise dependencies…

Methodology · Statistics 2020-02-05 Elynn Y. Chen , Xin Yun , Rong Chen , Qiwei Yao

As the role played by statistical and computational sciences in climate and environmental modelling and prediction becomes more important, Machine Learning researchers are becoming more aware of the relevance of their work to help tackle…

Machine Learning · Statistics 2020-12-23 Federico Amato , Fabian Guignard , Sylvain Robert , Mikhail Kanevski

Temporal Action Detection (TAD) requires precise localization of action boundaries within long, untrimmed video sequences. While current high-performing methods achieve strong accuracy, they are often characterized by excessive parameter…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zepeng Sun , Naichuan Zheng , Hailun Xia , Junjie Wu , Liwei Bao , Xiaotai Zhang

Unsupervised domain adaptation (UDA) aims at learning a machine learning model using a labeled source domain that performs well on a similar yet different, unlabeled target domain. UDA is important in many applications such as medicine,…

Machine Learning · Computer Science 2023-02-08 Yilmazcan Ozyurt , Stefan Feuerriegel , Ce Zhang

Recent works in Task and Motion Planning (TAMP) show that training control policies on language-supervised robot trajectories with quality labeled data markedly improves agent task success rates. However, the scarcity of such data presents…

Robotics · Computer Science 2025-04-02 Jonathan Salfity , Selma Wanna , Minkyu Choi , Mitch Pryor

Unsupervised domain adaptation (UDA) of time series aims to teach models to identify consistent patterns across various temporal scenarios, disregarding domain-specific differences, which can maintain their predictive accuracy and…

Machine Learning · Computer Science 2024-09-19 Huanyu Zhang , Yi-Fan Zhang , Zhang Zhang , Qingsong Wen , Liang Wang

Deep learning models can achieve high accuracy when trained on large amounts of labeled data. However, real-world scenarios often involve several challenges: Training data may become available in installments, may originate from multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Boqi Chen , Kevin Thandiackal , Pushpak Pati , Orcun Goksel

Drug repurposing is an effective strategy to identify new uses for existing drugs, providing the quickest possible transition from bench to bedside. Existing methods for drug repurposing that mainly focus on pre-clinical information may…

Applications · Statistics 2021-04-14 Ruoqi Liu , Lai Wei , Ping Zhang

Analyzing temporal developments is crucial for the accurate prognosis of many medical conditions. Temporal changes that occur over short time scales are key to assessing the health of physiological functions, such as the cardiac cycle.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Chengzhi Shen , Martin J. Menten , Hrvoje Bogunović , Ursula Schmidt-Erfurth , Hendrik Scholl , Sobha Sivaprasad , Andrew Lotery , Daniel Rueckert , Paul Hager , Robbie Holland

Video Large Language Models (Video LLMs) have achieved significant success by adopting the paradigm of large-scale pre-training followed by supervised fine-tuning (SFT). However, existing approaches struggle with temporal reasoning due to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Shicheng Li , Lei Li , Kun Ouyang , Shuhuai Ren , Yuanxin Liu , Yuanxing Zhang , Fuzheng Zhang , Lingpeng Kong , Qi Liu , Xu Sun

Deploying the idea of long-term cumulative return, reinforcement learning has shown remarkable performance in various fields. We propose a formulation of the landmark localization in 3D medical images as a reinforcement learning problem.…

Computer Vision and Pattern Recognition · Computer Science 2019-01-03 Walid Abdullah Al , Il Dong Yun

Federated reinforcement learning (FedRL) enables multiple agents to collaboratively learn a policy without sharing their local trajectories collected during agent-environment interactions. However, in practice, the environments faced by…

Machine Learning · Computer Science 2025-07-18 Guojun Xiong , Shufan Wang , Daniel Jiang , Jian Li

Recent advances in deep learning have driven rapid progress in time series forecasting, yet many state-of-the-art models continue to struggle with robust performance in real-world applications, even when they achieve strong results on…

Machine Learning · Computer Science 2025-10-24 Qitai Tan , Yiyun Chen , Mo Li , Ruiwen Gu , Yilin Su , Xiao-Ping Zhang

Balancing between computational efficiency and sample efficiency is an important goal in reinforcement learning. Temporal difference (TD) learning algorithms stochastically update the value function, with a linear time complexity in the…

Machine Learning · Computer Science 2016-11-21 Clement Gehring , Yangchen Pan , Martha White