English
Related papers

Related papers: Data Lake Organization

200 papers

A search engine's ability to retrieve desirable datasets is important for data sharing and reuse. Existing dataset search engines typically rely on matching queries to dataset descriptions. However, a user may not have enough prior…

Information Retrieval · Computer Science 2020-01-29 Zhiyu Chen , Haiyan Jia , Jeff Heflin , Brian D. Davison

Visualization of the adjacency matrix enables us to capture macroscopic features of a network when the matrix elements are aligned properly. Community structure, a network consisting of several densely connected components, is a…

Physics and Society · Physics 2023-07-11 Masaki Ochi , Tatsuro Kawamoto

We study the problem of set discovery where given a few example tuples of a desired set, we want to find the set in a collection of sets. A challenge is that the example tuples may not uniquely identify a set, and a large number of…

Databases · Computer Science 2022-10-05 Arif Hasnat , Davood Rafiei

How are people able to plan so efficiently despite limited cognitive resources? We aimed to answer this question by extending an existing model of human task decomposition that can explain a wide range of simple planning problems by adding…

Machine Learning · Computer Science 2023-10-04 Ruiqi He , Carlos G. Correa , Thomas L. Griffiths , Mark K. Ho

We present a framework for creating small, informative sub-tables of large data tables to facilitate the first step of data science: data exploration. Given a large data table table T, the goal is to create a sub-table of small, fixed…

Databases · Computer Science 2022-03-08 Kathy Razmadze , Yael Amsterdamer , Amit Somech , Susan B. Davidson , Tova Milo

Data Lake (DL) is a Big Data analysis solution which ingests raw data in their native format and allows users to process these data upon usage. Data ingestion is not a simple copy and paste of data, it is a complicated and important phase…

Databases · Computer Science 2021-07-08 Yan Zhao , Imen Megdiche , Franck Ravat

Developers perform online sensemaking on a daily basis, such as researching and choosing libraries and APIs. Prior research has introduced tools that help developers capture information from various sources and organize it into structures…

Software Engineering · Computer Science 2022-02-07 Michael Xieyang Liu , Aniket Kittur , Brad A. Myers

The Deep Web is constituted by data that are accessible through Web pages, but not readily indexable by search engines as they are returned in dynamic pages. In this paper we propose a conceptual framework for answering keyword queries on…

Databases · Computer Science 2025-01-09 Andrea Calì , Davide Martinenghi , Riccardo Torlone

Authors compare different ways of selecting change agents within network analysis paradigm and propose a new algorithm of doing so. All methods are evaluated against network coverage measure that calculates how many network members can be…

Social and Information Networks · Computer Science 2014-12-02 Blazej Zak , Anita Zbieg

Meaning may arise from an element's role or interactions within a larger system. For example, hitting nails is more central to people's concept of a hammer than its particular material composition or other intrinsic features. Likewise, the…

Artificial Intelligence · Computer Science 2020-09-18 Adam N. Hornsby , Thomas Evans , Peter Riefer , Rosie Prior , Bradley C. Love

Finding data is a necessary precursor to being able to reuse data, although relatively little large-scale empirical evidence exists about how researchers discover, make sense of and (re)use data for research. This study presents evidence…

Digital Libraries · Computer Science 2020-06-30 Kathleen Gregory , Paul Groth , Andrea Scharnhorst , Sally Wyatt

Organizational structure of corporations has potential to provide implications for dynamics and performance of corporate operations. However, this subject has remained unexplored because of the lack of readily available organization network…

Social and Information Networks · Computer Science 2023-11-07 Hiroki Sayama , Junichi Yamanoi

Database systems have to cater to the growing demands of the information age. The growth of the new age information retrieval powerhouses like search engines has thrown a challenge to the data management community to come up with novel…

Databases · Computer Science 2012-08-21 Gowri Shankar Ramaswamy , F Sagayaraj Francis

The development of a company often entails the emergence of autonomous data sources with different structural and technological organization. This can lead to the inability of data analysis at a high level and a violation of the integrity…

Information Retrieval · Computer Science 2022-01-14 A. Kalinin , E. Shikov , D. Vaganov , A. Lysenko

The investigation of community structures in networks is an important issue in many domains and disciplines. This problem is relevant for social tasks (objective analysis of relationships on the web), biological inquiries (functional…

Statistical Mechanics · Physics 2009-11-10 Filippo Radicchi , Claudio Castellano , Federico Cecconi , Vittorio Loreto , Domenico Parisi

In data lakes, information on the same subject is often fragmented across multiple tables. Table union search aims to find the top-k tables that can be unioned with a query table to extend it with more rows, without relying on metadata or…

Databases · Computer Science 2026-03-19 Yongkang Sun , Zhihao Ding , Huiqiang Wang , Reynold Cheng , Jieming Shi

We posit that striving for distributed systems that provide "single system image" semantics is fundamentally flawed and at odds with how systems operate in the physical world. We realize the database as an optimization of this system: a…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-09 Christopher S. Meiklejohn

Mature social networking services are one of the greatest assets of today's organizations. This valuable asset, however, can also be a threat to an organization's confidentiality. Members of social networking websites expose not only their…

Social and Information Networks · Computer Science 2013-09-03 Michael Fire , Rami Puzis , Yuval Elovici

Enterprises often maintain multiple databases for storing critical business data in siloed systems, resulting in inefficiencies and challenges with data interoperability. A key to overcoming these challenges lies in integrating disparate…

Databases · Computer Science 2025-11-11 Milena Trajanoska , Riste Stojanov , Dimitar Trajanov

Tables are an extremely powerful visual and interactive tool for structuring and manipulating data, making spreadsheet programs one of the most popular computer applications. In this paper we introduce and address the task of recommending…

Information Retrieval · Computer Science 2019-07-26 Shuo Zhang , Krisztian Balog