Integrate the data
Integrate the data#
Explore virtual database#
Most of the metadata stored in Querona can be modified. Your metadata changes affect only virtual databases and do not proliferate to data sources. In essence, data sources are read-only in terms of metadata changes in Querona.
The main tasks normally done to virtual database metadata serve the following purposes:
Schema normalization by introducing common naming, converting data types, adding and modifying primary and foreign key relationships
Managing statistics that allow query optimizer to calculate the optimal execution plan
Tagging metadata for better searchability in the catalog
Setting up database and object-level security
Setting up data security
Examining the data lineage (dependency graph)
Create integration view(s)#
The following demo video shows how to explore and modify metadata, integrate data from disparate sources:
Materialize the data (cache)#
Querona comes with a pre-configured connection to the built-in Apache Spark that can be used for data caching. Its name by default starts with ‘Local Spark’ postfixed with a version number.
The following demo video shows how to cache data from the selected view(s):