English
Related papers

Related papers: Transformer Causality Regularization for Dynamic I…

200 papers

Inverse Problems in medical imaging and computer vision are traditionally solved using purely model-based methods. Among those variational regularization models are one of the most popular approaches. We propose a new framework for applying…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Sebastian Lunz , Ozan Öktem , Carola-Bibiane Schönlieb

Questions in causality, control, and reinforcement learning go beyond the classical machine learning task of prediction under i.i.d. observations. Instead, these fields consider the problem of learning how to actively perturb a system to…

Many large-scale applications can be elegantly represented using graph structures. Their scalability, however, is often limited by the domain knowledge required to apply them. To address this problem, we propose a novel Causal Temporal…

Machine Learning · Computer Science 2023-03-20 Abigail Langbridge , Fearghal O'Donncha , Amadou Ba , Fabio Lorenzi , Christopher Lohse , Joern Ploennigs

We propose a variational regularization approach based on a multiscale representation called cylindrical shearlets aimed at dynamic imaging problems, especially dynamic tomography. The intuitive idea of our approach is to integrate a…

Numerical Analysis · Mathematics 2025-08-05 Tatiana A. Bubba , Tommi Heikkilä , Demetrio Labate , Luca Ratti

Anomaly detection in multi-variate time series (MVTS) data is a huge challenge as it requires simultaneous representation of long term temporal dependencies and correlations across multiple variables. More often, this is solved by breaking…

Machine Learning · Computer Science 2022-02-09 Theivendiram Pranavan , Terence Sim , Arulmurugan Ambikapathi , Savitha Ramasamy

In order to model the evolution of user preference, we should learn user/item embeddings based on time-ordered item purchasing sequences, which is defined as Sequential Recommendation (SR) problem. Existing methods leverage sequential…

Information Retrieval · Computer Science 2021-08-24 Ziwei Fan , Zhiwei Liu , Jiawei Zhang , Yun Xiong , Lei Zheng , Philip S. Yu

Time series domain adaptation aims to transfer the complex temporal dependence from the labeled source domain to the unlabeled target domain. Recent advances leverage the stable causal mechanism over observed variables to model the…

Machine Learning · Computer Science 2025-02-25 Ruichu Cai , Junxian Huang , Zhenhui Yang , Zijian Li , Emadeldeen Eldele , Min Wu , Fuchun Sun

Regularization techniques are widely employed in optimization-based approaches for solving ill-posed inverse problems in data analysis and scientific computing. These methods are based on augmenting the objective with a penalty function,…

Optimization and Control · Mathematics 2021-06-08 Yong Sheng Soh , Venkat Chandrasekaran

Recurrent Neural Network, Long Short-Term Memory, and Transformer have made great progress in predicting the trajectories of moving objects. Although the trajectory element with the surrounding scene features has been merged to improve…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Wendong Zhang , Qingjie Chai , Quanqi Zhang , Chengwei Wu

We propose to meta-learn causal structures based on how fast a learner adapts to new distributions arising from sparse distributional changes, e.g. due to interventions, actions of agents and other sources of non-stationarities. We show…

In text classification tasks, models often rely on spurious correlations for predictions, incorrectly associating irrelevant features with the target labels. This issue limits the robustness and generalization of models, especially when…

Machine Learning · Computer Science 2025-02-04 Yuqing Zhou , Ziwei Zhu

There are various inverse problems -- including reconstruction problems arising in medical imaging -- where one is often aware of the forward operator that maps variables of interest to the observations. It is therefore natural to ask…

Image and Video Processing · Electrical Eng. & Systems 2020-06-23 Jaweria Amjad , Zhaoyan Lyu , Miguel R. D. Rodrigues

It's well-known that inverse problems are ill-posed and to solve them meaningfully one has to employ regularization methods. Traditionally, popular regularization methods have been the penalized Variational approaches. In recent years, the…

Machine Learning · Computer Science 2022-02-17 Abinash Nayak

Temporal causal analysis means understanding the underlying causes behind observed variables over time. Deep learning based methods such as transformers are increasingly used to capture temporal dynamics and causal relationships beyond mere…

Machine Learning · Computer Science 2024-11-21 Riya Mahesh , Rahul Vashisht , Chandrashekar Lakshminarayanan

In this paper we consider new regularization methods for linear inverse problems of dynamic type. These methods are based on dynamic programming techniques for linear quadratic optimal control problems. Two different approaches are…

Numerical Analysis · Mathematics 2021-01-26 S. Kindermann , A. Leitao

Multivariate time series forecasting focuses on predicting future values based on historical context. State-of-the-art sequence-to-sequence models rely on neural attention between timesteps, which allows for temporal learning but fails to…

Machine Learning · Computer Science 2023-03-21 Jake Grigsby , Zhe Wang , Nam Nguyen , Yanjun Qi

Performing driving behaviors based on causal reasoning is essential to ensure driving safety. In this work, we investigated how state-of-the-art 3D Convolutional Neural Networks (CNNs) perform on classifying driving behaviors based on…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Yi-Chieh Liu , Yung-An Hsieh , Min-Hung Chen , Chao-Han Huck Yang , Jesper Tegner , Yi-Chang James Tsai

This paper explores the potential of the transformer models for learning Granger causality in networks with complex nonlinear dynamics at every node, as in neurobiological and biophysical networks. Our study primarily focuses on a…

Machine Learning · Computer Science 2025-10-21 Ziyu Lu , Anika Tabassum , Shruti Kulkarni , Lu Mi , J. Nathan Kutz , Eric Shea-Brown , Seung-Hwan Lim

Traditionally, reinforcement learning (RL) agents learn to solve new tasks by updating their neural network parameters through interactions with the task environment. However, recent works demonstrate that some RL agents, after certain…

Machine Learning · Computer Science 2025-02-26 Jiuqi Wang , Ethan Blaser , Hadi Daneshmand , Shangtong Zhang

Knowledge tracing is one of the key research areas for empowering personalized education. It is a task to model students' mastery level of a knowledge component (KC) based on their historical learning trajectories. In recent years, a…

Artificial Intelligence · Computer Science 2018-06-07 Chun-Kit Yeung , Dit-Yan Yeung
‹ Prev 1 4 5 6 7 8 10 Next ›