English
Related papers

Related papers: Fuzzy Integration of Data Lake Tables

200 papers

Data fusion describes the method of combining data from (at least) two initially independent data sources to allow for joint analysis of variables which are not jointly observed. The fundamental idea is to base inference on identifying…

Methodology · Statistics 2020-12-02 Florian Meinfelder , Jannik Schaller

In semi-supervised fuzzy clustering, this paper extends the traditional pairwise constraint (i.e., must-link or cannot-link) to fuzzy pairwise constraint. The fuzzy pairwise constraint allows a supervisor to provide the grade of similarity…

Machine Learning · Computer Science 2021-11-23 Zhen Wang , Shan-Shan Wang , Lan Bai , Wen-Si Wang , Yuan-Hai Shao

Due to the usefulness in data enrichment for data analysis tasks, joinable table discovery has become an important operation in data lake management. Existing approaches target equi-joins, the most common way of combining tables for…

Databases · Computer Science 2023-06-26 Yuyang Dong , Chuan Xiao , Takuma Nozawa , Masafumi Enomoto , Masafumi Oyamada

Most, if not all, modern deep learning systems restrict themselves to a single dataset for neural network training and inference. In this article, we are interested in systematic ways to join datasets that are made of similar purposes.…

Machine Learning · Computer Science 2021-06-18 Jake Zhao , Mingfeng Ou , Linji Xue , Yunkai Cui , Sai Wu , Gang Chen

The conventional clustering algorithms have difficulties in handling the challenges posed by the collection of natural data which is often vague and uncertain. Fuzzy clustering methods have the potential to manage such situations…

Information Retrieval · Computer Science 2014-06-09 Satendra kumar , Mamta kathuria , Alok Kumar Gupta , Monika Rani

Linked Data have emerged as a successful publication format and one of its main strengths is its fitness for integration of data from multiple sources. This gives them a great potential both for semantic applications and the enterprise…

Databases · Computer Science 2014-10-30 Jan Michelfeit , Tomáš Knap , Martin Nečaský

With the membership function being strictly positive, the conventional fuzzy c-means clustering method sometimes causes imbalanced influence when clusters of vastly different sizes exist. That is, an outstandingly large cluster drags to its…

Machine Learning · Statistics 2023-03-28 Akira R. Kinjo , Daphne Teck Ching Lai

In this paper, we propose an improved version of an agglomerative hierarchical clustering algorithm that performs disjoint community detection in large-scale complex networks. The improved algorithm is achieved after replacing the local…

Social and Information Networks · Computer Science 2018-06-01 Eduar Castrillo , Elizabeth León , Jonatan Gómez

Fuzzy optimization deals with the problem of determining 'optimal'solutions of an optimization problem when some of the elements that appear in the problem are not precise. In real situations it is usual to have information, in systems…

Optimization and Control · Mathematics 2009-08-27 Victor Blanco , Justo Puerto

Machine-learning from a disparate set of tables, a data lake, requires assembling features by merging and aggregating tables. Data discovery can extend autoML to data tables by automating these steps. We present an in-depth analysis of such…

Databases · Computer Science 2025-05-20 Riccardo Cappuzzo , Aimee Coelho , Felix Lefebvre , Paolo Papotti , Gael Varoquaux

In dealing with veracity of data analytics, fuzzy methods are more and more relying on probabilistic and statistical techniques to underpin their applicability. Conversely, standard statistical models usually disregard to take into account…

Statistics Theory · Mathematics 2019-12-23 Elvira Di Nardo , Rosaria Simone

Data mining is a widely used technology for various real-life applications of data analytics and is important to discover valuable association rules in transaction databases. Interesting itemset mining plays an important role in many…

Databases · Computer Science 2021-03-12 Yanling Cui , Wensheng Gan , Hong Lin , Weimin Zheng

Fuzzy systems have achieved great success in numerous applications. However, there are still many challenges in designing an optimal fuzzy system, e.g., how to efficiently optimize its parameters, how to balance the trade-off between…

Machine Learning · Computer Science 2019-07-16 Dongrui Wu , Chin-Teng Lin , Jian Huang , Zhigang Zeng

For decades, the join operator over fast data streams has always drawn much attention from the database community, due to its wide spectrum of real-world applications, such as online clustering, intrusion detection, sensor data monitoring,…

Databases · Computer Science 2019-08-26 Weilong Ren , Xiang Lian , Kambiz Ghazinour

The combination of higher-order theories and fuzzy logic can be useful in decision-making tasks that involve reasoning across abstract functions and predicates, where exact matches are often rare or unnecessary. Developing efficient…

Artificial Intelligence · Computer Science 2025-07-18 Besik Dundua , Temur Kutsia

Regression analysis is employed to examine and quantify the relationships between input variables and a dependent and continuous output variable. It is widely used for predictive modelling in fields such as finance, healthcare, and…

Machine Learning · Computer Science 2025-10-16 Ashish Bhatia , Renato Cordeiro de Amorim , Vito De Feo

The AI community is increasingly focused on merging logic with deep learning to create Neuro-Symbolic (NeSy) paradigms and assist neural approaches with symbolic knowledge. A significant trend in the literature involves integrating axioms…

Artificial Intelligence · Computer Science 2023-06-27 Samy Badreddine , Luciano Serafini , Michael Spranger

Collocations are important for many tasks of Natural language processing such as information retrieval, machine translation, computational lexicography etc. So far many statistical methods have been used for collocation extraction. Almost…

Computation and Language · Computer Science 2008-11-11 Raj Kishor Bisht , H. S. Dhami

Many data we collect today are in tabular form, with rows as records and columns as attributes associated with each record. Understanding the structural relationship in tabular data can greatly facilitate the data science process.…

Data Structures and Algorithms · Computer Science 2020-09-09 Jin Cao , Yibo Zhao , Linjun Zhang , Jason Li

Scholars studying organizations often work with multiple datasets lacking shared identifiers or covariates. In such situations, researchers usually use approximate string ("fuzzy") matching methods to combine datasets. String matching,…

Social and Information Networks · Computer Science 2025-09-24 Brian Libgober , Connor T. Jerzak