English
Related papers

Related papers: Mask the Redundancy: Evolving Masking Representati…

200 papers

In the field of psychopathology, Ecological Momentary Assessment (EMA) studies offer rich individual data on psychopathology-relevant variables (e.g., affect, behavior, etc) in real-time. EMA data is collected dynamically, represented as…

Machine Learning · Computer Science 2024-05-09 Mandani Ntekouli , Gerasimos Spanakis , Lourens Waldorp , Anne Roefs

In visual Reinforcement Learning (RL), learning from pixel-based observations poses significant challenges on sample efficiency, primarily due to the complexity of extracting informative state representations from high-dimensional data.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Jiarui Sun , M. Ugur Akcal , Wei Zhang , Girish Chowdhary

Spatial clustering techniques can achieve significant multi-channel noise reduction across relatively arbitrary microphone configurations, but have difficulty incorporating a detailed speech/noise model. In contrast, LSTM neural networks…

Sound · Computer Science 2020-12-07 Zhaoheng Ni , Felix Grezes , Viet Anh Trinh , Michael I. Mandel

Text clustering is an important method for organising the increasing volume of digital content, aiding in the structuring and discovery of hidden patterns in uncategorised data. The effectiveness of text clustering largely depends on the…

Computation and Language · Computer Science 2024-12-06 Alina Petukhova , João P. Matos-Carvalho , Nuno Fachada

Multi-Task Learning (MTL) aims to boost predictive performance by sharing information across related tasks, yet conventional methods often suffer from negative transfer when unrelated or noisy tasks are forced to share representations. We…

Machine Learning · Computer Science 2026-02-17 Seyedsaman Emami , Daniel Hernández-Lobato , Gonzalo Martínez-Muñoz

Representation learning aims to extract meaningful lower-dimensional embeddings from data, known as representations. Despite its widespread application, there is no established definition of a ``good'' representation. Typically, the…

Machine Learning · Computer Science 2024-12-05 Mahalakshmi Sabanayagam , Omar Al-Dabooni , Pascal Esser

Continual Test-Time Adaptation (CTTA) is proposed to migrate a source pre-trained model to continually changing target distributions, addressing real-world dynamism. Existing CTTA methods mainly rely on entropy minimization or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jiaming Liu , Ran Xu , Senqiao Yang , Renrui Zhang , Qizhe Zhang , Zehui Chen , Yandong Guo , Shanghang Zhang

Multivariate time series forecasting plays a crucial role in various real-world applications. Significant efforts have been made to integrate advanced network architectures and training strategies that enhance the capture of temporal…

Machine Learning · Computer Science 2024-10-31 Zhiding Liu , Jiqian Yang , Qingyang Mao , Yuze Zhao , Mingyue Cheng , Zhi Li , Qi Liu , Enhong Chen

Any clustering algorithm must synchronously learn to model the clusters and allocate data to those clusters in the absence of labels. Mixture model-based methods model clusters with pre-defined statistical distributions and allocate data to…

Machine Learning · Computer Science 2022-10-04 Dumindu Tissera , Kasun Vithanage , Rukshan Wijesinghe , Alex Xavier , Sanath Jayasena , Subha Fernando , Ranga Rodrigo

Many natural and physical processes can be understood by analyzing multiple system variables evolving, forming a multivariate time series. Predicting such time series is challenging due to the inherent noise and interdependencies among…

Chaotic Dynamics · Physics 2025-12-11 S. Hariharan , R. Suresh , V. K. Chandrasekar

Time-series classification is one of the most frequently performed tasks in industrial data science, and one of the most widely used data representation in the industrial setting is tabular representation. In this work, we propose a novel…

Machine Learning · Computer Science 2021-10-06 Sharath M Shankaranarayana , Davor Runje

In the real world, the class of a time series is usually labeled at the final time, but many applications require to classify time series at every time point. e.g. the outcome of a critical patient is only determined at the end, but he…

Machine Learning · Computer Science 2022-08-16 Chenxi Sun , Moxian Song , Derun Can , Baofeng Zhang , Shenda Hong , Hongyan Li

Multi-view clustering (MVC) has had significant implications in cross-modal representation learning and data-driven decision-making in recent years. It accomplishes this by leveraging the consistency and complementary information among…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Jiatai Wang , Zhiwei Xu , Xuewen Yang , Hailong Li , Bo Li , Xuying Meng

Multivariate longitudinal data of mixed-type are increasingly collected in many science domains. However, algorithms to cluster this kind of data remain scarce, due to the challenge to simultaneously model the within- and between-time…

Machine Learning · Statistics 2025-09-16 Francesco Amato , Julien Jacques

Automatic sleep staging plays a vital role in assessing sleep quality and diagnosing sleep disorders. Most existing methods rely heavily on long and continuous EEG recordings, which poses significant challenges for data acquisition in…

Machine Learning · Computer Science 2025-11-19 Lejun Ai , Yulong Li , Haodong Yi , Jixuan Xie , Yue Wang , Jia Liu , Min Chen , Rui Wang

Learning meaningful representations from medical time series (MedTS) such as ECG or EEG signals is a critical challenge. These signals are often high-dimensional, variable-length and rife with noise. Existing self-supervised approaches,…

Machine Learning · Computer Science 2026-05-04 Huayu Li , ZhengXiao He , Xiwen Chen , Jingjing Wang , Siyuan Tian , Jinghao Wen , Ao Li

We present Mask CTC, a novel non-autoregressive end-to-end automatic speech recognition (ASR) framework, which generates a sequence by refining outputs of the connectionist temporal classification (CTC). Neural sequence-to-sequence models…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-18 Yosuke Higuchi , Shinji Watanabe , Nanxin Chen , Tetsuji Ogawa , Tetsunori Kobayashi

Time series, as one of the most fundamental representations of sequential data, has been extensively studied across diverse disciplines, including computer science, biology, geology, astronomy, and environmental sciences. The advent of…

Machine Learning · Computer Science 2024-12-31 John Paparrizos , Fan Yang , Haojun Li

Multivariate Time Series (MTS) data capture temporal behaviors to provide invaluable insights into various physical dynamic phenomena. In smart mobility, MTS plays a crucial role in providing temporal dynamics of behaviors such as maneuver…

Machine Learning · Computer Science 2024-09-12 Thabang Lebese

Time-series representation learning is a fundamental task for time-series analysis. While significant progress has been made to achieve accurate representations for downstream applications, the learned representations often lack…

Machine Learning · Computer Science 2021-05-24 Yuening Li , Zhengzhang Chen , Daochen Zha , Mengnan Du , Denghui Zhang , Haifeng Chen , Xia Hu