English
Related papers

Related papers: Causally-Guided Pairwise Transformer -- Towards Fo…

200 papers

Research on Poisson regression analysis for dependent data has been developed rapidly in the last decade. One of difficult problems in a multivariate case is how to construct a cross-correlation structure and at the meantime make sure that…

Methodology · Statistics 2017-10-05 A'yunin Sofro , Jian Qing Shi , Chunzheng Cao

Data-driven models are becoming essential parts in modern mechanical systems, commonly used to capture the behavior of various equipment and varying environmental characteristics. Despite the advantages of these data-driven models on…

Evidence-based Prescriptive Analytics (EbPA) is necessary to determine optimal operational set-points that will improve business productivity. EbPA results from what-if analysis and counterfactual experimentation on CAUSAL Digital Twins…

Systems and Control · Electrical Eng. & Systems 2021-04-14 PG Madhavan

Treating data from each sensor in an IoT installation on its own separately is wasteful. This article shows how to treat them as a multi-channel time series and introduces the State-space model formulation of Structural Vector…

Signal Processing · Electrical Eng. & Systems 2021-06-07 PG Madhavan

Multivariate time series forecasting tasks are usually conducted in a channel-dependent (CD) way since it can incorporate more variable-relevant information. However, it may also involve a lot of irrelevant variables, and this even leads to…

Machine Learning · Computer Science 2024-05-15 Qinshuo Liu , Yanwen Fang , Pengtao Jiang , Guodong Li

Explaining artificial intelligence or machine learning models is increasingly important. To use such data-driven systems wisely we must understand how they interact with the world, including how they depend causally on data inputs. In this…

Machine Learning · Computer Science 2023-07-06 Joshua R. Loftus , Lucius E. J. Bynum , Sakina Hansen

Standard transformer-based language models, while powerful for general text, often struggle with the fine-grained syntax and entity relationships in complex technical, engineering documents. To address this, we propose the Contextual Graph…

Computation and Language · Computer Science 2025-08-05 Karan Reddy , Mayukha Pal

Motivation: Sparse autoencoders (SAEs) decompose foundation model activations into interpretable features, but causal feature-to-feature interactions across network depth remain unknown for biological foundation models. Results: We…

Machine Learning · Computer Science 2026-03-05 Ihor Kendiukhov

Many multivariate time series anomaly detection frameworks have been proposed and widely applied. However, most of these frameworks do not consider intrinsic relationships between variables in multivariate time series data, thus ignoring…

Machine Learning · Computer Science 2025-08-11 Falih Gozi Febrinanto , Kristen Moore , Chandra Thapa , Mujie Liu , Vidya Saikrishna , Jiangang Ma , Feng Xia

Traffic forecasting is an important application of spatiotemporal series prediction. Among different methods, graph neural networks have achieved so far the most promising results, learning relations between graph nodes then becomes a…

Machine Learning · Computer Science 2024-09-05 Ting Gao , Rodrigo Kappes Marques , Lei Yu

Recently there has been an increasing interest in the multivariate Gaussian process (MGP) which extends the Gaussian process (GP) to deal with multiple outputs. One approach to construct the MGP and account for non-trivial commonalities…

Machine Learning · Statistics 2023-07-04 Raed Kontar , Garvesh Raskutti , Shiyu Zhou

Time series forecasting is essential for a wide range of real-world applications. Recent studies have shown the superiority of Transformer in dealing with such problems, especially long sequence time series input(LSTI) and long sequence…

Machine Learning · Computer Science 2022-02-15 Li Shen , Yangzhu Wang

Causal relationships are commonly examined in manufacturing processes to support faults investigations, perform interventions, and make strategic decisions. Industry 4.0 has made available an increasing amount of data that enable…

Machine Learning · Computer Science 2022-08-03 Giovanni Menegozzo , Diego Dall'Alba , Paolo Fiorini

To mitigate unfair and unethical discrimination over sensitive features (e.g., gender, age, or race), fairness testing plays an integral role in engineering systems that leverage AI models to handle tabular data. A key challenge therein is…

Software Engineering · Computer Science 2025-10-22 Chengwen Du , Tao Chen

The formalism of causal dynamical triangulations (CDT) provides us with a non-perturbatively defined model of quantum gravity, where the sum over histories includes only causal space-time histories. Path integrals of CDT and their continuum…

General Relativity and Quantum Cosmology · Physics 2008-11-26 J. Ambjorn , R. Loll , W. Westra , S. Zohren

Real-world processes often generate data that are a mix of categorical and numeric values that are recorded at irregular and informative intervals. Discrete token-based approaches are limited in numeric representation capacity while methods…

Machine Learning · Computer Science 2025-06-02 Andrew J. Loza , Jun Yup Kim , Shangzheng Song , Yihang Liu , Joseph J. Y. Sung , R Andrew Taylor , Dennis L. Shung

Real-world problems, for example in climate applications, often require causal reasoning on spatially gridded time series data or data with comparable structure. While the underlying system is often believed to behave similarly at different…

Machine Learning · Computer Science 2026-02-16 Martin Rabel , Jakob Runge

Classical machine learning techniques often struggle with overfitting and unreliable predictions when exposed to novel conditions. Introducing causality into the modelling process offers a promising way to mitigate these challenges by…

Computational Engineering, Finance, and Science · Computer Science 2025-05-28 David Zapata Gonzalez , Marcel Meyer , Oliver Mueller

CI/CD pipelines are central to DevOps practices, yet their growing complexity makes them increasingly difficult to interpret, analyze, and systematically evolve. Existing tooling primarily offers execution logs and static graph…

Software Engineering · Computer Science 2026-04-03 Achref Samoud , Sara Aissat , Francis Bordeleau

The increasing scale of graph datasets has significantly improved the performance of graph representation learning methods, but it has also introduced substantial training challenges. Graph dataset condensation techniques have emerged to…

Machine Learning · Computer Science 2026-05-28 Huaming Du , Yijie Huang , Su Yao , Yiying Wang , Yueyang Zhou , Jingwen Yang , Jinshi Zhang , Han Ji , Yu Zhao , Guisong Liu , Hegui Zhang , Carl Yang , Gang Kou