Integrate the data

Explore virtual database

Most of the metadata stored in Querona can be modified. Your metadata changes affect only virtual databases and do not proliferate to data sources. In essence, data sources are read-only in terms of metadata changes in Querona.

Note

Detailed description of table and view management is available in the User’s Guide Managing tables, Managing views and Primary and Foreign Keys articles.

The main tasks normally done to virtual database metadata serve the following purposes:

  • Schema normalization by introducing common naming, converting data types, adding and modifying primary and foreign key relationships
  • Managing statistics that allow query optimizer to calculate the optimal execution plan
  • Tagging metadata for better searchability in the catalog
  • Setting up database and object-level security
  • Setting up data security
  • Examining the data lineage (dependency graph)

Create integration view(s)

The following demo video shows how to explore and modify metadata, integrate data from disparate sources:

Cache the data

Note

Querona comes with a pre-configured connection to the built-in Apache Spark that can be used for data caching. It’s name by default starts with ‘Local Spark’ postfixed with version number.

The following demo video shows how to cache data from the selected view(s):