English
Related papers

Related papers: Should we Reload Time Series Classification Perfor…

200 papers

Test case prioritisation (TCP) is a critical task in regression testing to ensure quality as software evolves. Machine learning has become a common way to achieve it. In particular, learning-to-rank (LTR) algorithms provide an effective…

Software Engineering · Computer Science 2024-05-24 Aurora Ramírez , Mario Berrios , José Raúl Romero , Robert Feldt

Mining Time Series data has a tremendous growth of interest in today's world. To provide an indication various implementations are studied and summarized to identify the different problems in existing applications. Clustering time series is…

Information Retrieval · Computer Science 2010-05-25 V. Kavitha , M. Punithavalli

Recent work has questioned the reliability of graph learning benchmarks, citing concerns around task design, methodological rigor, and data suitability. In this extended abstract, we contribute to this discussion by focusing on evaluation…

Machine Learning · Computer Science 2025-06-17 Filip Cornell , Oleg Smirnov , Gabriela Zarzar Gandler , Lele Cao

Recommendation has become a prominent area of research in the field of Information Retrieval (IR). Evaluation is also a traditional research topic in this community. Motivated by a few counter-intuitive observations reported in recent…

Information Retrieval · Computer Science 2023-08-22 Aixin Sun

While machine learning has witnessed significant advancements, the emphasis has largely been on data acquisition and model creation. However, achieving a comprehensive assessment of machine learning solutions in real-world settings…

I would like to share recommendations on how to do performance benchmarks for the purpose of computer science research evaluation. Research in my field (programming language research) often involves performance considerations, but it is…

Programming Languages · Computer Science 2026-05-05 Gabriel Scherer

Large language models (LLMs) have demonstrated their effectiveness in multivariate time series classification (MTSC). Effective adaptation of LLMs for MTSC necessitates informative data representations. Existing LLM-based methods directly…

Artificial Intelligence · Computer Science 2025-10-29 Jiahao Wang , Mingyue Cheng , Qingyang Mao , Yitong Zhou , Daoyu Wang , Qi Liu , Feiyang Xu , Xin Li

Time series research has gathered lots of interests in the last decade, especially for Time Series Classification (TSC) and Time Series Forecasting (TSF). Research in TSC has greatly benefited from the University of California Riverside and…

Machine Learning · Computer Science 2020-10-21 Chang Wei Tan , Christoph Bergmeir , Francois Petitjean , Geoffrey I. Webb

The rapid adoption of deep learning has increasingly led to data-driven models replacing classical model-based algorithms, even in domains governed by well-understood physical laws. While data-driven models, such as long short-term memory…

Machine Learning · Computer Science 2026-05-20 Sooraj Sunil , Balakumar Balasingam

Over the past decade, Time Series Classification (TSC) has gained an increasing attention. While various methods were explored, deep learning - particularly through Convolutional Neural Networks (CNNs)-stands out as an effective approach.…

Machine Learning · Computer Science 2024-02-29 Ali Ismail-Fawaz , Maxime Devanne , Stefano Berretti , Jonathan Weber , Germain Forestier

We address the problem of incremental sequence classification, where predictions are updated as new elements in the sequence are revealed. Drawing on temporal-difference learning from reinforcement learning, we identify a…

In recent years, there has been an exponential growth in the number of complex documents and texts that require a deeper understanding of machine learning methods to be able to accurately classify texts in many applications. Many machine…

Machine Learning · Computer Science 2020-05-21 Kamran Kowsari , Kiana Jafari Meimandi , Mojtaba Heidarysafa , Sanjana Mendu , Laura E. Barnes , Donald E. Brown

Recent progress in recommender system research has shown the importance of including temporal representations to improve interpretability and performance. Here, we incorporate temporal representations in continuous time via recurrent point…

Machine Learning · Computer Science 2020-01-16 Kostadin Cvejoski , Ramses J. Sanchez , Bogdan Georgiev , Jannis Schuecker , Christian Bauckhage , Cesar Ojeda

Multiclass classification (MCC) is a fundamental machine learning problem of classifying each instance into one of a predefined set of classes. In the deep learning era, extensive efforts have been spent on developing more powerful neural…

Machine Learning · Computer Science 2022-12-22 Nan Wang , Zhen Qin , Le Yan , Honglei Zhuang , Xuanhui Wang , Michael Bendersky , Marc Najork

Time series classification is of significant importance in monitoring structural systems. In this work, we investigate the use of supervised machine learning classification algorithms on simulated data based on a physical system with two…

Machine Learning · Computer Science 2024-03-14 Ergys Çokaj , Halvor Snersrud Gustad , Andrea Leone , Per Thomas Moe , Lasse Moldestad

Research into time series classification has tended to focus on the case of series of uniform length. However, it is common for real-world time series data to have unequal lengths. Differing time series lengths may arise from a number of…

Machine Learning · Computer Science 2019-10-11 Chang Wei Tan , Francois Petitjean , Eamonn Keogh , Geoffrey I. Webb

The problem of ranking is a multi-billion dollar problem. In this paper we present an overview of several production quality ranking systems. We show that due to conflicting goals of employing the most effective machine learning models and…

Information Retrieval · Computer Science 2019-07-30 Murium Iqbal , Nishan Subedi , Kamelia Aryafar

The ROC curve is the gold standard for measuring the performance of a test/scoring statistic regarding its capacity to discriminate between two statistical populations in a wide variety of applications, ranging from anomaly detection in…

Statistics Theory · Mathematics 2023-01-25 Stéphan Clémençon , Myrto Limnios , Nicolas Vayatis

Designing useful person re-identification systems for real-world applications requires attention to operational aspects not typically considered in academic research. Here, we focus on the temporal aspect of re-identification; that is,…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Srikrishna Karanam , Eric Lam , Richard J. Radke

Saliency methods are used extensively to highlight the importance of input features in model predictions. These methods are mostly used in vision and language tasks, and their applications to time series data is relatively unexplored. In…

Machine Learning · Computer Science 2020-10-28 Aya Abdelsalam Ismail , Mohamed Gunady , Héctor Corrada Bravo , Soheil Feizi