English
Related papers

Related papers: Sensor-Specific Transformer (PatchTST) Ensembles w…

200 papers

In this work, we address music representation learning using convolution-free transformers. We build on top of existing spectrogram-based audio transformers such as AST and train our models on a supervised task using patchout training…

Sound · Computer Science 2023-09-29 Pablo Alonso-Jiménez , Xavier Serra , Dmitry Bogdanov

While recent Transformer-based approaches have shown impressive performances on event-based object detection tasks, their high computational costs still diminish the low power consumption advantage of event cameras. Image-based works…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Yansong Peng , Hebei Li , Yueyi Zhang , Xiaoyan Sun , Feng Wu

Transformers have excelled in natural language processing and computer vision, paving their way to sensor-based Human Activity Recognition (HAR). Previous studies show that transformers outperform their counterparts exclusively when they…

Machine Learning · Computer Science 2024-10-18 Clayton Souza Leite , Henry Mauranen , Aziza Zhanabatyrova , Yu Xiao

In this paper, a novel architecture for speaker recognition is proposed by cascading speech enhancement and speaker processing. Its aim is to improve speaker recognition performance when speech signals are corrupted by noise. Instead of…

Computation and Language · Computer Science 2020-05-25 Yanpei Shi , Qiang Huang , Thomas Hain

Multispectral pedestrian detection has attracted increasing attention from the research community due to its crucial competence for many around-the-clock applications (e.g., video surveillance and autonomous driving), especially under…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Chengyang Li , Dan Song , Ruofeng Tong , Min Tang

Imperfect labels are ubiquitous in real-world datasets. Several recent successful methods for training deep neural networks (DNNs) robust to label noise have used two primary techniques: filtering samples based on loss during a warm-up…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Kento Nishi , Yi Ding , Alex Rich , Tobias Höllerer

Unsupervised user adaptation aligns the feature distributions of the data from training users and the new user, so a well-trained wearable human activity recognition (WHAR) model can be well adapted to the new user. With the development of…

Signal Processing · Electrical Eng. & Systems 2022-04-28 Ling Chen , Yi Zhang , Shenghuan Miao , Sirou Zhu , Rong Hu , Liangying Peng , Mingqi Lv

Continuous stress forecasting could potentially contribute to lifestyle interventions. This paper presents a novel, explainable, and individualized approach for stress prediction using physiological data from consumer-grade smartwatches. We…

Machine Learning · Computer Science 2026-02-24 Xueyi Wang , Claudine J. C. Lamoth , Elisabeth Wilhelm

Anomaly detection plays a crucial role in industrial settings, particularly in maintaining the reliability and optimal performance of cooling systems. Traditional anomaly detection methods often face challenges in handling diverse data…

Machine Learning · Computer Science 2024-04-26 Sarala Naidu , Ning Xiong

Transformers have become state-of-the-art (SOTA) for time-series classification, with models like PatchTST demonstrating exceptional performance. These models rely on patching the time series and learning relationships between raw temporal…

Signal Processing · Electrical Eng. & Systems 2025-11-04 Huseyin Goksu

Enabled by multi-head self-attention, Transformer has exhibited remarkable results in speech emotion recognition (SER). Compared to the original full attention mechanism, window-based attention is more effective in learning fine-grained…

Sound · Computer Science 2023-02-28 Weidong Chen , Xiaofen Xing , Xiangmin Xu , Jianxin Pang , Lan Du

We address the well-known wearable activity recognition problem of having to work with sensors that are non-optimal in terms of information they provide but have to be used due to wearability/usability concerns (e.g. the need to work with…

Machine Learning · Computer Science 2022-10-05 Vitor Fortes Rey , Sungho Suh , Paul Lukowicz

Single-channel speech enhancement approaches do not always improve automatic recognition rates in the presence of noise, because they can introduce distortions unhelpful for recognition. Following a trend towards end-to-end training of…

Sound · Computer Science 2021-12-14 Peter Plantinga , Deblin Bagchi , Eric Fosler-Lussier

Robustness is a crucial factor for the successful deployment of robots in unstructured environments, particularly in the domain of Simultaneous Localization and Mapping (SLAM). Simulation-based benchmarks have emerged as a highly scalable…

We propose an algorithm to enhance certified robustness of a deep model ensemble by optimally weighting each base model. Unlike previous works on using ensembles to empirically improve robustness, our algorithm is based on optimizing a…

Machine Learning · Statistics 2019-11-01 Huan Zhang , Minhao Cheng , Cho-Jui Hsieh

Wearable sensor based human activity recognition is a challenging problem due to difficulty in modeling spatial and temporal dependencies of sensor signals. Recognition models in closed-set assumption are forced to yield members of known…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 M Tanjid Hasan Tonmoy , Saif Mahmud , A K M Mahbubur Rahman , M Ashraful Amin , Amin Ahsan Ali

With the rapid development of AI technology in recent years, there have been many studies with deep learning models in soft sensing area. However, the models have become more complex, yet, the data sets remain limited: researchers are…

Machine Learning · Computer Science 2022-01-25 Chao Zhang , Jaswanth Yella , Yu Huang , Xiaoye Qian , Sergei Petrov , Andrey Rzhetsky , Sthitie Bom

Incremental learning aims to adapt to new sets of categories over time with minimal computational overhead. Prior work often addresses this task by training efficient task-specific adaptors that modify frozen layer weights or features to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Nazia Tasnim , Bryan A. Plummer

Recent advances in unsupervised speech representation learning discover new approaches and provide new state-of-the-art for diverse types of speech processing tasks. This paper presents an investigation of using wav2vec 2.0 deep speech…

Speech emotion recognition (SER) plays a critical role in building emotion-aware speech systems, but its performance degrades significantly under noisy conditions. Although speech enhancement (SE) can improve robustness, it often introduces…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-29 Jing-Tong Tzeng , Carlos Busso , Chi-Chun Lee