English
Related papers

Related papers: Big Data Dimensional Analysis

200 papers

Topological methods can provide a way of proposing new metrics and methods of scrutinising data, that otherwise may be overlooked. In this work, a method of quantifying the shape of data, via a topic called topological data analysis will be…

Machine Learning · Statistics 2022-09-25 Tristan Gowdridge , Nikolaos Dervilis , Keith Worden

An analysis of high-dimensional data can offer a detailed description of a system but is often challenged by the curse of dimensionality. General dimensionality reduction techniques can alleviate such difficulty by extracting a few…

Methodology · Statistics 2021-09-28 Di Bo , Hoon Hwangbo , Vinit Sharma , Corey Arndt , Stephanie C. TerMaath

Detecting anomalies in data is a vital task, with numerous high-impact applications in areas such as security, finance, health care, and law enforcement. While numerous techniques have been developed in past years for spotting outliers and…

Social and Information Networks · Computer Science 2014-04-29 Leman Akoglu , Hanghang Tong , Danai Koutra

Within the dynamic world of Big Data, traditional systems typically operate in a passive mode, processing and responding to user queries by returning the requested data. However, this methodology falls short of meeting the evolving demands…

Databases · Computer Science 2024-12-24 Shahrzad Haji Amin Shirazi , Xikui Wang , Michael J. Carey , Vassilis J. Tsotras

Many research questions can be answered quickly and efficiently using data already collected for previous research. This practice is called secondary data analysis (SDA), and has gained popularity due to lower costs and improved research…

Digital Libraries · Computer Science 2020-04-07 Yasith Jayawardana , Sampath Jayarathna

Many scientific areas are faced with the challenge of extracting information from large, complex, and highly structured data sets. A great deal of modern statistical work focuses on developing tools for handling such data. This paper…

Methodology · Statistics 2017-10-05 Hyun Bin Kang , Matthew Reimherr , Mark Shriver , Peter Claes

Dimensionality reduction is a common method for analyzing and visualizing high-dimensional data. However, reasoning dynamically about the results of a dimensionality reduction is difficult. Dimensionality-reduction algorithms use complex…

Human-Computer Interaction · Computer Science 2018-11-30 Marco Cavallo , Çağatay Demiralp

Topological Data Analysis (TDA) is a recent approach to analyze data sets from the perspective of their topological structure. Its use for time series data has been limited to the field of financial time series primarily and as a method for…

Machine Learning · Computer Science 2019-06-18 Rodrigo Rivera-Castro , Polina Pilyugina , Alexander Pletnev , Ivan Maksimov , Wanyi Wyz , Evgeny Burnaev

Nowadays, the explosion of unstructured data presents immense analytical value. Leveraging the remarkable capability of large language models (LLMs) in extracting attributes of structured tables from unstructured data, researchers are…

Topological Data Analysis (TDA) is an approach to handle with big data by studying its shape. A main tool of TDA is the persistence diagram, and one can use it to compare data sets. One approach to learn on the similarity between two…

Applications · Statistics 2020-03-04 Sarit Agami

With the rapid adoption of machine learning techniques for large-scale applications in science and engineering comes the convergence of two grand challenges in visualization. First, the utilization of black box models (e.g., deep neural…

The Big Data management is a problem right now. The Big Data growth is very high. It is very difficult to manage due to various characteristics. This manuscript focuses on Big Data analytics in cloud environment using Hadoop. We have…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-10-17 Mansaf Alam , Kashish Ara Shakil

Big Data is reforming many industrial domains by providing decision support through analyzing large data volumes. Big Data testing aims to ensure that Big Data systems run smoothly and error-free while maintaining the performance and…

Artificial Intelligence · Computer Science 2022-07-15 Iram Arshad , Saeed Hamood Alsamhi , Wasif Afzal

As the fundamental phrase of collecting and analyzing data, data integration is used in many applications, such as data cleaning, bioinformatics and pattern recognition. In big data era, one of the major problems of data integration is to…

Databases · Computer Science 2018-08-07 Tianbao Lia , Hongzhi Wang , Jianzhong Li , Hong Gao

Recent technological advancements in data acquisition tools allowed life scientists to acquire multimodal data from different biological application domains. Broadly categorized in three types (i.e., sequences, images, and signals), these…

Quantitative Methods · Quantitative Biology 2020-03-03 Mufti Mahmud , M Shamim Kaiser , Amir Hussain

The popularity of deep learning has led to the curation of a vast number of massive and multifarious datasets. Despite having close-to-human performance on individual tasks, training parameter-hungry models on large datasets poses…

Machine Learning · Computer Science 2023-09-27 Noveen Sachdeva , Julian McAuley

The development of modern information technologies permits to collect and to analyze huge amounts of statistical data in different spheres of life. The main problem is not to only to collect but to process all relevant information. The…

Information Retrieval · Computer Science 2010-07-08 O. Mryglod , Yu. Holovatch

The growth of large, programatically accessible bibliometrics databases presents new opportunities for complex analyses of publication metadata. In addition to providing a wealth of information about authors and institutions, databases such…

Digital Libraries · Computer Science 2023-01-26 Michele Pasin , Richard Abdill

Objective. We propose an approach to reason about goals, obstacles, and to select suitable big data solution architecture that satisfy quality goal preferences and constraints of stakeholders at the presence of the decision outcome…

Software Engineering · Computer Science 2020-04-20 Mahdi Fahmideh , Ghassan Beydoun

Materials science workflows rely on structured and unstructured data from the vast body of available scientific literature. However, most of the experimental details remain buried in text, tables, graphs and figures. Thus, constructing…

Computation and Language · Computer Science 2026-05-07 Achuth Chandrasekhar , Omid Barati Farimani , Radheesh Sharma Meda , Amir Barati Farimani