English
Related papers

Related papers: Algorithm and approaches to handle large Data- A S…

200 papers

Recently, we have been witnessing huge advancements in the scale of data we routinely generate and collect in pretty much everything we do, as well as our ability to exploit modern technologies to process, analyze and understand this data.…

Databases · Computer Science 2017-09-25 Radwa Elshawi , Sherif Sakr

Social network has gained remarkable attention in the last decade. Accessing social network sites such as Twitter, Facebook LinkedIn and Google+ through the internet and the web 2.0 technologies has become more affordable. People are…

Social and Information Networks · Computer Science 2023-06-22 Mariam Adedoyin-Olowe , Mohamed Medhat Gaber , Frederic Stahl

The rapid growth of large-scale radio surveys, generating over 100 petabytes of data annually, has created a pressing need for automated data analysis methods. Recent research has explored the application of machine learning techniques to…

Instrumentation and Methods for Astrophysics · Physics 2025-10-14 Nikhel Gupta

Data Grids have been adopted as the platform for scientific communities that need to share, access, transport, process and manage large data collections distributed worldwide. They combine high-end computing technologies with…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Srikumar Venugopal , Rajkumar Buyya , Kotagiri Ramamohanarao

The field of astronomy has arrived at a turning point in terms of size and complexity of both datasets and scientific collaboration. Commensurately, algorithms and statistical models have begun to adapt --- e.g., via the onset of artificial…

While manufacturers have been generating highly distributed data from various systems, devices and applications, a number of challenges in both data management and data analysis require new approaches to support the big data era. These…

Databases · Computer Science 2018-12-14 JunPing Wang , WenSheng Zhang , YouKang Shi , ShiHui Duan , Jin Liu

The article deals with the problem which led to Big Data. Big Data information technology is the set of methods and means of processing different types of structured and unstructured dynamic large amounts of data for their analysis and use…

Databases · Computer Science 2019-05-07 Nataliya Shakhovska , Uyrii Bolubash , Oleh Veres

Data visualization and analytics are nowadays one of the corner-stones of Data Science, turning the abundance of Big Data being produced through modern systems into actionable knowledge. Indeed, the Big Data era has realized the…

Databases · Computer Science 2023-11-21 Nikos Bikakis

The area of online machine learning in big data streams covers algorithms that are (1) distributed and (2) work from data streams with only a limited possibility to store past data. The first requirement mostly concerns software…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-19 András A. Benczúr , Levente Kocsis , Róbert Pálovics

Big data, both in its structured and unstructured formats, have brought in unforeseen challenges in economics and business. How to organize, classify, and then analyze such data to obtain meaningful insights are the ever-going research…

General Economics · Economics 2025-02-04 Viet Trinh

Steve Jobs, one of the greatest visionaries of our time was quoted in 1996 saying "a lot of times, people do not know what they want until you show it to them" [38] indicating he advocated products to be developed based on human intuition…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-19 Kevin Taylor-Sakyi

Life finds a way. For sessile organisms like plants, the need to adapt to changes in the environment is even more poignant. For humanity, the need to develop crops that can grow in diverse environments and feed our growing population is an…

Quantitative Methods · Quantitative Biology 2024-08-15 Eugene Koh , Rohan Shawn Sunil , Hilbert Yuen In Lam , Marek Mutwil

Data mining is about obtaining new knowledge from existing datasets. However, the data in the existing datasets can be scattered, noisy, and even incomplete. Although lots of effort is spent on developing or fine-tuning data mining models…

Machine Learning · Computer Science 2019-06-21 Canchen Li

Many key problems in machine learning and data science are routinely modeled as optimization problems and solved via optimization algorithms. With the increase of the volume of data and the size and complexity of the statistical models used…

Optimization and Control · Mathematics 2020-08-28 Filip Hanzely

Data Mining deals extracting hidden knowledge, unexpected pattern and new rules from large database. Various customized data mining tools have been developed for domain specific applications such as Biomedicine, DNA analysis and…

Databases · Computer Science 2010-03-11 Sabyasachi Pattanaik , Partha Pratim Ghosh

The rapid evolution of information systems managing more and more voluminous data has caused profound paradigm shifts in the job of statistician, becoming successively data miner, bioinformatician and now data scientist. Without the sake of…

Statistics Theory · Mathematics 2014-05-22 Philippe Besse , Aurélien Garivier , Jean-Michel Loubes

The increasing volumes of data produced by high-throughput instruments coupled with advanced computational infrastructures for scientific computing have enabled what is often called a {\em Fourth Paradigm} for scientific research based on…

An array of large observational programs using ground-based and space-borne telescopes is planned in the next decade. The forthcoming wide-field sky surveys are expected to deliver a sheer volume of data exceeding an exabyte. Processing the…

Instrumentation and Methods for Astrophysics · Physics 2023-05-26 Kana Moriwaki , Takahiro Nishimichi , Naoki Yoshida

Networks have attracted a burst of attention in the last decade, with applications to natural, social, and technological systems. While networks provide a powerful abstraction for investigating relationships and interactions, the…

Physics and Society · Physics 2010-04-09 Michael J. Barber , Manfred Paier , Thomas Scherngell

The wide proliferation of various wireless communication systems and wireless devices has led to the arrival of big data era in large scale wireless networks. Big data of large scale wireless networks has the key features of wide variety,…

Networking and Internet Architecture · Computer Science 2019-09-30 Hong-Ning Dai , Raymond Chi-Wing Wong , Hao Wang , Zibin Zheng , Athanasios V. Vasilakos