English
Related papers

Related papers: Multivariate Time-series Transformer Embeddings fo…

200 papers

Multivariate Time Series (MTS) forecasting involves modeling temporal dependencies within historical records. Transformers have demonstrated remarkable performance in MTS forecasting due to their capability to capture long-term…

Machine Learning · Computer Science 2024-07-17 Yifan Zhang , Rui Wu , Sergiu M. Dascalu , Frederick C. Harris

Photonic time crystals are electromagnetic media with periodically time-varying parameters, enabling momentum band gaps, parametric amplification, and frequency conversion beyond what is possible in time-invariant systems. So far, they have…

Optics · Physics 2026-05-15 Z. Li , M. S. Mirmoosa , V. Asadchy , X. Wang

This paper designs hybrid analog-digital channel estimation and beamforming techniques for multiuser massive multiple input multiple output (MIMO) systems with limited number of radio frequency (RF) chains. For these systems, first we…

Information Theory · Computer Science 2016-11-15 Tadilo Endeshaw Bogale , Long Bao , Xianbin Wang

Solar spectropolarimetric inversion -- inferring atmospheric conditions from the Stokes vector -- is a key diagnostic tool for understanding solar magnetism, but traditional inversion methods are computationally expensive and sensitive to…

Solar and Stellar Astrophysics · Physics 2025-11-17 Ryan James Campbell , Mihalis Mathioudakis , Carlos Quintero Noda

Modelling multivariate spatio-temporal data with complex dependency structures is a challenging task but can be simplified by assuming that the original variables are generated from independent latent components. If these components are…

Methodology · Statistics 2024-11-04 Mika Sipilä , Claudia Cappello , Sandra De Iaco , Klaus Nordhausen , Sara Taskinen

Unsupervised pre-training methods for large vision models have shown to enhance performance on downstream supervised tasks. Developing similar techniques for satellite imagery presents significant opportunities as unlabelled data is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yezhen Cong , Samar Khanna , Chenlin Meng , Patrick Liu , Erik Rozi , Yutong He , Marshall Burke , David B. Lobell , Stefano Ermon

Although pre-trained transformers and reprogrammed text-based LLMs have shown strong performance on time series tasks, the best-performing architectures vary widely across tasks, with most models narrowly focused on specific areas, such as…

Machine Learning · Computer Science 2024-11-27 Shanghua Gao , Teddy Koker , Owen Queen , Thomas Hartvigsen , Theodoros Tsiligkaridis , Marinka Zitnik

Machine learning has been widely applied to clearly defined problems of astronomy and astrophysics. However, deep learning and its conceptual differences to classical machine learning have been largely overlooked in these fields. The broad…

Instrumentation and Methods for Astrophysics · Physics 2024-10-15 Nima Sedaghat , Martino Romaniello , Jonathan E. Carrick , François-Xavier Pineau

In this paper we revisit the classical problem of estimating a signal as it impinges on a multi-sensor array. We focus on the case where the impinging signal's bandwidth is appreciable and is operating in a broadband regime. Estimating…

Signal Processing · Electrical Eng. & Systems 2023-12-08 Coleman DeLude , Mark A. Davenport , Justin Romberg

We consider a distributed sensor network in which the single antenna sensor nodes observe a deterministic unknown parameter and after encoding the observed signal with a phase parameter, the sensor nodes transmit it simultaneously to a…

Information Theory · Computer Science 2012-01-04 Feng Jiang , Jie Chen , A. Lee Swindlehurst

Precoding for multibeam satellite systems with full frequency reuse in a multi-user multiple-input multiple-output (MU-MIMO) downlink scenario is addressed. A testbed is developed to perform an over-the-air field trial of zero forcing…

Signal Processing · Electrical Eng. & Systems 2020-04-24 Kai-Uwe Storek , Robert T. Schwarz , Andreas Knopp

In this work, we focus on outdoor lighting estimation by aggregating individual noisy estimates from images, exploiting the rich image information from wide-angle cameras and/or temporal image sequences. Photographs inherently encode…

Computer Vision and Pattern Recognition · Computer Science 2022-02-21 Haebom Lee , Christian Homeyer , Robert Herzog , Jan Rexilius , Carsten Rother

Multispectral cameras capture images in multiple wavelengths in narrow spectral bands. They offer advanced sensing well beyond normal cameras and many single sensor based multispectral cameras have been commercialized aimed at a broad range…

In this paper, a combination of Space Time Block Coded Spatial Modulation with Hybrid Analog-Digital Beamforming (STBC-SM-HBF) for Millimeter-wave (mmWave) communications is proposed in order to take advantage of the merits of Spatial…

Information Theory · Computer Science 2018-07-31 Taissir Y. Elganimi , Ali A. Elghariani

Recent state-of-the-art forecasting methods are trained on collections of time series. These methods, often referred to as global models, can capture common patterns in different time series to improve their generalization performance.…

Machine Learning · Computer Science 2024-04-30 Vitor Cerqueira , Nuno Moniz , Ricardo Inácio , Carlos Soares

We present a methodology for training foundational transformer models capable of processing collider data with diverse kinematic signatures. Our universal foundation model is designed for simultaneous analysis of all processes involving…

High Energy Physics - Phenomenology · Physics 2025-11-13 E. Abasov , L. Dudko , E. Iudin , A. Markina , P. Volkov , M. Perfilov , A. Zaborenko

We consider a spectral sharing problem in which a statistical (or widely distributed) multiple-input multiple-output (MIMO) radar and an in-band full-duplex (IBFD) multi-user MIMO (MU-MIMO) communications system concurrently operate within…

Signal Processing · Electrical Eng. & Systems 2024-03-29 Jiawei Liu , Kumar Vijay Mishra , Mohammad Saquib

Fully digital massive MIMO systems with large numbers (1000+) of antennas offer dramatically increased capacity gains from spatial multiplexing and beamforming. Designing digital receivers that can scale to these array dimensions presents…

Signal Processing · Electrical Eng. & Systems 2026-04-23 Ali Rasteh , Amirreza Kiani , Marco Mezzavilla , Sundeep Rangan

Imaging in radio astronomy is usually carried out with a single-dish radio telescope doing a raster scan of a region of the sky or with an interferometer that samples the visibility function of the sky brightness. Mosaic observations are…

Instrumentation and Methods for Astrophysics · Physics 2019-06-12 Urvashi Rau , Nikhil Naik , Timothy Braun

With the advent of powerful telescopes such as the Square Kilometer Array and the Vera C. Rubin Observatory, we are entering an era of multiwavelength transient astronomy that will lead to a dramatic increase in data volume. Machine…

Instrumentation and Methods for Astrophysics · Physics 2021-03-09 K. Sooknunan , M. Lochner , Bruce A. Bassett , H. V. Peiris , R. Fender , A. J. Stewart , M. Pietka , P. A. Woudt , J. D. McEwen , O. Lahav