English
Related papers

Related papers: METL: a modern ETL pipeline with a dynamic mapping…

200 papers

In data warehousing, Extract-Transform-Load (ETL) extracts the data from data sources into a central data warehouse regularly for the support of business decision-makings. The data from transaction processing systems are featured with the…

Databases · Computer Science 2014-09-16 Xiufeng Liu

The exponential growth of data storage demands has necessitated the evolution of hierarchical storage management strategies [1]. This study explores the application of streaming machine learning [3] to revolutionize data prefetching within…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-30 Chiyu Cheng , Chang Zhou , Yang Zhao , Jin Cao

Healthcare data are generated in many different formats, which makes it difficult to integrate and reuse across institutions and studies. Standardisation is required to enable consistent large-scale analysis. The OMOP-CDM, developed by the…

Quantitative Methods · Quantitative Biology 2025-11-13 Jacob Desmond , Ryan Wartmann , Chng Wei Lau , Steven Thomas , Paul M. Middleton , Jeewani Anupama Ginige

Machine Learning (ML) and Artificial Intelligence (AI) have a dependency on data sources to train, improve and make predictions through their algorithms. With the digital revolution and current paradigms like the Internet of Things, this…

Machine Learning · Computer Science 2020-07-17 Cristian Martín , Peter Langendoerfer , Pouya Soltani Zarrin , Manuel Díaz , Bartolomé Rubio

Scanning Transmission Electron Microscopy (STEM) coupled with Electron Energy Loss Spectroscopy (EELS) presents a powerful platform for detailed material characterization via rich imaging and spectroscopic data. Modern electron microscopes…

Instrumentation and Detectors · Physics 2024-06-18 Utkarsh Pratiush , Austin Houston , Sergei V Kalinin , Gerd Duscher

Deep Learning (DL) algorithms have become the {\em de facto} choice for data analysis. Several DL implementations -- primarily limited to a single compute node -- such as Caffe, TensorFlow, Theano and Torch have become readily available.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-18 Abhinav Vishnu , Joseph Manzano , Charles Siegel , Jeff Daily

Large multimodal models (LMMs) have demonstrated excellent capabilities in both understanding and generation tasks with various modalities. While these models can accept flexible combinations of input data, their training efficiency suffers…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-24 Zhenliang Xue , Hanpeng Hu , Xing Chen , Yimin Jiang , Yixin Song , Zeyu Mi , Yibo Zhu , Daxin Jiang , Yubin Xia , Haibo Chen

Manifold learning (ML) aims to seek low-dimensional embedding from high-dimensional data. The problem is challenging on real-world datasets, especially with under-sampling data, and we find that previous methods perform poorly in this case.…

Machine Learning · Computer Science 2022-07-27 Zelin Zang , Siyuan Li , Di Wu , Ge Wang , Lei Shang , Baigui Sun , Hao Li , Stan Z. Li

Computation offloading has become a popular solution to support computationally intensive and latency-sensitive applications by transferring computing tasks to mobile edge servers (MESs) for execution, which is known as mobile/multi-access…

Signal Processing · Electrical Eng. & Systems 2023-09-06 Ruihuai Liang , Bo Yang , Zhiwen Yu , Xuelin Cao , Derrick Wing Kwan Ng , Chau Yuen

In an era defined by rapid data evolution, traditional Machine Learning (ML) models often struggle to adapt to dynamic environments. Evolving Machine Learning (EML) has emerged as a pivotal paradigm, enabling continuous learning and…

Modern in-orbit satellites and other available remote sensing tools have generated a huge availability of public data waiting to be exploited in different formats hosted on different servers. In this context, ETL formalism becomes relevant…

Databases · Computer Science 2023-06-21 Paula V. Romero Jure , Juan Bautista Cabral , Sergio Masuelli

Automating machine learning has achieved remarkable technological developments in recent years, and building an automated machine learning pipeline is now an essential task. The model ensemble is the technique of combining multiple models…

Machine Learning · Computer Science 2022-07-21 Yunpu Zhao , Rui Zhang , Xiaqing Li

This work addresses the challenge of democratizing advanced Large Language Models (LLMs) by compressing their mathematical reasoning capabilities into sub-billion parameter Small Language Models (SLMs) without compromising performance. We…

Computation and Language · Computer Science 2024-08-02 Xunyu Zhu , Jian Li , Yong Liu , Can Ma , Weiping Wang

With the rapid expansion of the Internet of Things (IoT), sensors, smartphones, and wearables have become integral to daily life, powering smart applications in home automation, healthcare, and intelligent transportation. However, these…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-18 Habib Larian , Faramarz Safi-Esfahani

Classical machine learning (CML) occupies nearly half of machine learning pipelines in production applications. Unfortunately, it fails to utilize the state-of-the-practice devices fully and performs poorly. Without a unified framework, the…

Machine Learning · Computer Science 2023-05-01 Xu Wen , Wanling Gao , Anzheng Li , Lei Wang , Zihan Jiang , Jianfeng Zhan

Massive Multiple Input Multiple Output (MIMO) is critical for boosting 6G wireless network capacity. Nevertheless, high dimensional Channel State Information (CSI) acquisition becomes the bottleneck of 6G massive MIMO system. Recently,…

Signal Processing · Electrical Eng. & Systems 2026-02-09 Haoyu Wang , Zhi Sun , Shuangfeng Han , Xiaoyun Wang , Shidong Zhou , Zhaocheng Wang

With the increasing frequency and sophistication of Distributed Denial of Service (DDoS) attacks, it has become critical to develop more efficient and interpretable detection methods. Traditional detection systems often struggle with…

Cryptography and Security · Computer Science 2025-11-07 Paul Badu Yakubu , Lesther Santana , Mohamed Rahouti , Yufeng Xin , Abdellah Chehri , Mohammed Aledhari

Accurate forecasts of macroeconomic and financial data, such as GDP, CPI, unemployment rates, and stock indices, are crucial for the success of countries, businesses, and investors, resulting in a constant demand for reliable forecasting…

Methodology · Statistics 2025-10-27 Tomasz M. Łapiński , Krzysztof Ziółkowski

Effective query-item relevance modeling is pivotal for enhancing user experience and safeguarding user satisfaction in e-commerce search systems. Recently, benefiting from the vast inherent knowledge, Large Language Model (LLM) approach…

Information Retrieval · Computer Science 2025-02-11 Gang Zhao , Ximing Zhang , Chenji Lu , Hui Zhao , Tianshu Wu , Pengjie Wang , Jian Xu , Bo Zheng

Transformer-based Diffusion Probabilistic Models (DPMs) have shown more potential than CNN-based DPMs, yet their extensive computational requirements hinder widespread practical applications. To reduce the computation budget of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Xinwang Chen , Ning Liu , Yichen Zhu , Feifei Feng , Jian Tang