English
Related papers

Related papers: Using Spark Machine Learning Models to Perform Pre…

200 papers

Efficient resource allocation is a key challenge in modern cloud computing. Over-provisioning leads to unnecessary costs, while under-provisioning risks performance degradation and SLA violations. This work presents an artificial…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-08 Harshit Goyal

General real-time runway occupancy time prediction modelling for multiple airports is a current research gap. An attempt to generalize a real-time prediction model for Arrival Runway Occupancy Time (AROT) is presented in this paper by…

Machine Learning · Computer Science 2022-01-28 An-Dan Nguyen , Duc-Thinh Pham , Nimrod Lilith , Sameer Alam

Standard Bayesian retrievals for exoplanet atmospheric parameters from transmission spectroscopy, while well understood and widely used, are generally computationally expensive. In the era of the JWST and other upcoming observatories,…

Earth and Planetary Astrophysics · Physics 2025-08-08 Roy T. Forestano , Konstantin T. Matchev , Katia Matcheva , Eyup B. Unlu

Bond prices are a reflection of extremely complex market interactions and policies, making prediction of future prices difficult. This task becomes even more challenging due to the dearth of relevant information, and accuracy is not the…

Statistical Finance · Quantitative Finance 2017-05-04 Swetava Ganguli , Jared Dunnmon

The unpredictability and volatility of the stock market render it challenging to make a substantial profit using any generalised scheme. Many previous studies tried different techniques to build a machine learning model, which can make a…

Trading and Market Microstructure · Quantitative Finance 2023-08-14 A. K. M. Amanat Ullah , Fahim Imtiaz , Miftah Uddin Md Ihsan , Md. Golam Rabiul Alam , Mahbub Majumdar

The rapid growth of the travel industry has increased the need for real-time optimization in reservation systems that could take care of huge data and transaction volumes. This study proposes a hybrid framework that ut folds an Artificial…

Software Engineering · Computer Science 2024-12-11 Biman Barua , M. Shamim Kaiser

We propose a fast and efficient strategy, called the representative approach, for big data analysis with generalized linear models, especially for distributed data with localization requirements or limited network bandwidth. With a given…

Methodology · Statistics 2021-12-16 Keren Li , Jie Yang

Large batch jobs such as Deep Learning, HPC and Spark require far more computational resources and higher cost than conventional online service. Like the processing of other time series data, these jobs possess a variety of characteristics…

Machine Learning · Computer Science 2020-10-13 Peng Gao

Predictive modeling in healthcare continues to be an active actuarial research topic as more insurance companies aim to maximize the potential of Machine Learning approaches to increase their productivity and efficiency. In this paper, the…

Machine Learning · Computer Science 2023-11-27 Ugochukwu Orji , Elochukwu Ukwandu

Accurate travel time estimation is essential for navigation and itinerary planning. While existing research employs probabilistic modeling to assess travel time uncertainty and account for correlations between multiple trips, modeling the…

Machine Learning · Computer Science 2024-11-28 Chen Xu , Qiang Wang , Lijun Sun

In this paper we explore the performance limits of Apache Spark for machine learning applications. We begin by analyzing the characteristics of a state-of-the-art distributed machine learning algorithm implemented in Spark and compare it to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-21 Celestine Dünner , Thomas Parnell , Kubilay Atasu , Manolis Sifalakis , Haralampos Pozidis

This paper presents a model based on an hybrid system to numerically simulate the climbing phase of an aircraft. This model is then used within a trajectory prediction tool. Finally, the Covariance Matrix Adaptation Evolution Strategy…

Artificial Intelligence · Computer Science 2012-12-18 Areski Hadjaz , Gaétan Marceau , Pierre Savéant , Marc Schoenauer

Using Reinforcement Learning with Verifiable Rewards (RLVR) to optimize Large Language Models (LLMs) can be conceptualized as progressively editing a query's `Reasoning Tree'. This process involves exploring nodes (tokens) and dynamically…

Artificial Intelligence · Computer Science 2026-04-28 Hong Wang , Zhezheng Hao , Jian Luo , Chenxing Wei , Yao Shu , Lei Liu , Qiang Lin , Hande Dong , Jiawei Chen

Predicting the price of used vehicles is a more interesting and needed problem by many users. Vehicle price prediction can be a challenging task due to the high number of attributes that should be considered for accurate prediction. The…

Machine Learning · Computer Science 2023-08-22 Auwal Tijjani Amshi

Predictive autoscaling (autoscaling with workload forecasting) is an important mechanism that supports autonomous adjustment of computing resources in accordance with fluctuating workload demands in the Cloud. In recent works, Reinforcement…

For predictive maintenance, we examine one of the largest public datasets for machine failures derived along with their corresponding precursors as error rates, historical part replacements, and sensor inputs. To simplify the time and…

Machine Learning · Computer Science 2018-12-12 David Noever

Flight delays impose cascading operational and financial burdens across the aviation network, costing the U.S. economy billions of dollars annually by disrupting interconnected aircraft rotation systems. While prior machine learning…

Machine Learning · Computer Science 2026-05-19 Aditi J. Shelke , Renuka J. Shelke , Yash M. Kamerkar , Nitin P. Hazarani

As the sheer amount of computer generated data continues to grow exponentially, new bottlenecks are unveiled that require rethinking our traditional software and hardware architectures. In this paper we present five algorithms and data…

Networking and Internet Architecture · Computer Science 2017-11-21 Jordi Ros-Giralt , Alan Commike , Peter Cullen , Richard Lethin

The 2002 Trading Agent Competition (TAC) presented a challenging market game in the domain of travel shopping. One of the pivotal issues in this domain is uncertainty about hotel prices, which have a significant influence on the relative…

Artificial Intelligence · Computer Science 2011-07-04 K. M. Lochner , D. M. Reeves , Y. Vorobeychik , M. P. Wellman

This paper proposes nowcasting of high-frequency financial datasets in real-time with a 5-minute interval using the streaming analytics feature of Apache Spark. The proposed 2 stage method consists of modelling chaos in the first stage and…

Machine Learning · Computer Science 2022-02-25 Mohammad Arafat Ali Khan , Chandra Bhushan , Vadlamani Ravi , Vangala Sarveswara Rao , Shiva Shankar Orsu