English
Related papers

Related papers: PAITS: Pretraining and Augmentation for Irregularl…

200 papers

Time series forecasting uses historical data to predict future trends, leveraging the relationships between past observations and available features. In this paper, we propose RAFT, a retrieval-augmented time series forecasting method to…

Machine Learning · Computer Science 2025-05-08 Sungwon Han , Seungeon Lee , Meeyoung Cha , Sercan O Arik , Jinsung Yoon

Imbalanced datasets present a significant challenge for machine learning models, often leading to biased predictions. To address this issue, data augmentation techniques are widely used in natural language processing (NLP) to generate new…

Computation and Language · Computer Science 2023-04-21 Gabriel O. Assunção , Rafael Izbicki , Marcos O. Prates

Forecasting irregularly sampled time series with missing values is a crucial task for numerous real-world applications such as healthcare, astronomy, and climate sciences. State-of-the-art approaches to this problem rely on Ordinary…

In order to reduce overfitting, neural networks are typically trained with data augmentation, the practice of artificially generating additional training data via label-preserving transformations of existing training examples. While these…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Cecilia Summers , Michael J. Dinneen

Probabilistic forecasting of multivariate time series is essential for various downstream tasks. Most existing approaches rely on the sequences being uniformly spaced and aligned across all variables. However, real-world multivariate time…

Machine Learning · Computer Science 2025-02-18 Yijun Li , Cheuk Hang Leung , Qi Wu

Iterative data generation and model re-training can effectively align large language models(LLMs) to human preferences. The process of data sampling is crucial, as it significantly influences the success of policy improvement. Repeated…

Computation and Language · Computer Science 2024-10-07 Hai Ye , Hwee Tou Ng

Energy systems modeling frequently relies on time series data, whether observed or forecast. This is particularly the case, for example, in capacity planning models that use hourly production and load data forecast to occur over the coming…

Computation · Statistics 2025-02-13 Kelly Wang , Steven O. Kimbrough

Artificial neural networks (ANNs) require tremendous amount of data to train on. However, in classification models, most data features are often similar which can lead to increase in training time without significant improvement in the…

Machine Learning · Computer Science 2023-03-03 Sreelekha Guggilam , Varun Chandola , Abani Patra

Despite the eminent successes of deep neural networks, many architectures are often hard to transfer to irregularly-sampled and asynchronous time series that commonly occur in real-world datasets, especially in healthcare applications. This…

Machine Learning · Computer Science 2020-09-16 Max Horn , Michael Moor , Christian Bock , Bastian Rieck , Karsten Borgwardt

Self-supervised contrastive learning has become a key technique in deep learning, particularly in time series analysis, due to its ability to learn meaningful representations without explicit supervision. Augmentation is a critical…

Machine Learning · Computer Science 2024-07-15 Ziyu Liu , Azadeh Alavi , Minyi Li , Xiang Zhang

Domain adaptation on time series data is an important but challenging task. Most of the existing works in this area are based on the learning of the domain-invariant representation of the data with the help of restrictions like MMD.…

Machine Learning · Computer Science 2021-06-18 Ruichu Cai , Jiawei Chen , Zijian Li , Wei Chen , Keli Zhang , Junjian Ye , Zhuozhang Li , Xiaoyan Yang , Zhenjie Zhang

Fine-tuning large pre-trained models with task-specific data has achieved great success in NLP. However, it has been demonstrated that the majority of information within the self-attention networks is redundant and not utilized effectively…

Computation and Language · Computer Science 2021-06-02 Jiaao Chen , Dinghan Shen , Weizhu Chen , Diyi Yang

The rapid evolution of large language models (LLMs) has intensified the demand for effective personalization techniques that can adapt model behavior to individual user preferences. Despite the non-parametric methods utilizing the…

Artificial Intelligence · Computer Science 2025-11-03 Kounianhua Du , Jianxing Liu , Kangning Zhang , Wenxiang Jiao , Yuan Lu , Jiarui Jin , Weiwen Liu , Yong Yu , Weinan Zhang

Automated sports skill assessment requires capturing fundamental movement patterns that distinguish expert from novice performance, yet current video sampling methods disrupt the temporal continuity essential for proficiency evaluation. To…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Edoardo Bianchi , Antonio Liotta

Many forms of sensitive data, such as web traffic, mobility data, or hospital occupancy, are inherently sequential. The standard method for training machine learning models while ensuring privacy for units of sensitive information, such as…

Efficient time series forecasting has become critical for real-world applications, particularly with deep neural networks (DNNs). Efficiency in DNNs can be achieved through sparse connectivity and reducing the model size. However, finding…

Machine Learning · Computer Science 2024-06-13 Zahra Atashgahi , Mykola Pechenizkiy , Raymond Veldhuis , Decebal Constantin Mocanu

Many applications require efficient management of large sets of intervals because many objects are associated with intervals (e.g., time and price intervals). In such interval management systems, range search is a primitive operator for…

Databases · Computer Science 2024-05-24 Daichi Amagata

Adequate sampling space coverage is the keystone to effectively train trustworthy Machine Learning models. Unfortunately, real data do carry several inherent risks due to the many potential biases they exhibit when gathered without a proper…

Machine Learning · Computer Science 2025-03-27 Antonio Maratea , Rita Perna

Multivariate time series data, collected across various fields such as manufacturing and wearable technology, exhibit states at multiple levels of granularity, from coarse-grained system behaviors to fine-grained, detailed events.…

Machine Learning · Computer Science 2025-08-15 Ching Chang , Ming-Chih Lo , Wen-Chih Peng , Tien-Fu Chen

Models that generate natural language explanations (NLEs) for their predictions have recently gained increasing interest. However, this approach usually demands large datasets of human-written NLEs for the ground-truth answers at training…

Computation and Language · Computer Science 2024-08-13 Jesus Solano , Mardhiyah Sanni , Oana-Maria Camburu , Pasquale Minervini