Post on 09-Jan-2017
transcript
www.syntrixconsulting.com
QVD Metadata Profile App
In Qlik Sense®
www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749)
About Syntrix
2
Syntrix Consulting Group specializes in data reporting and business
analytics for healthcare organizations.
We provide tools, processes, and expertise to accelerate the production and adoption of analytic applications
in healthcare.
We are a Qlik Implementation Partner with expertise in multiple EMR
systems including Epic.
877-SYNTRIX (796-8749)BIAdvisors@syntrixconsulting.com
www.syntrixconsulting.com
www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749)
Importance of MetadataQVD Environment OverviewStep 1: Create Qlik Sense AppStep 2: Retrieve QVD MetadataStep 3: Store Metadata into QVDsStep 4: Create Field Level Business DefinitionsStep 5: Create Qlik Sense Metadata QVD
Profile App
Overview
3
www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 4
What is metadata?• It is the detail about the data in your environment. • It provides insight about what the data stands for
and where it came from• It can be considered the encyclopedia about your
dataWhy is it important?
• Data Linage – the metadata can provide the details on where the data was sourced and how it was curated
• Data Impacts – the metadata can provide details on how changes made in a source system will affect downstream artifacts
Importance of Metadata
www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 5
The QVD Environment has a directory for each data source
Each directory has numerous QVDs stored in them
QVDs stored in here are created with extract applications
QVD Environment Overview
www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 6
From the Qlik Sense hub create new app called QVD Metadata
Open AppOpen Data Load Editor
Step 1: Create Qlik Sense App
www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 7
Create a script to read the metadata from each QVD in a specified directory and then store that information into a QVD.
The following two Qlik Load features will be used• XMLSimple-QVDTableHeader – this will read the QVD
table information
• XMLSimple-QVDFieldHeader – this will read the QVD field information
Step 2: Retrieve QVD Metadata
www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 8
2A. Define location and variables for script
Step 2: Retrieve the QVD Metadata
This line defines where the QVDs are located and the file types you
want to iterate through
This line creates a variable that stores the name of the QVD file
for each iteration
This line defines the name from where the QVD was sourced.
www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 9
2B. Read the table header information from the QVDs
Step 2: Retrieve QVD Metadata
This will create a table and load table-level metadata from the QVD into it
www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 10
2C. Read the field information from the QVDs and Iterate through the directory for the next QVDs
Step 2: Retrieve QVD Metadata
This will create a table and load field-level metadata from the QVD into it
Next will iterate back to the for each statement and
retrieve the next QVD
www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 11
Create a directory location and store the tables in step 2 in this location
Use the Store command to create the metadata QVDs
Step 3: Store Metadata into QVDs
The last two statements will Store table data into QVDs in the
00.QVDProfile folder
www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 12
To add value for your business teams it is useful to create field definitions and associate them to the QVD field definitions
You can capture these definitions where you please (xls, Access, Database…), but will need to linked them to vFileName – FieldName Dictionary_id created in steps 2 and 3
Below is an example of a field dictionary in Excel It is recommended to create a QVD of the
dictionary
Step 4: Create Field Level Business Definitions
www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 13
Now you have all of the components to create a QVD Profile Application
Go to the Qlik Sense HubLoad the three QVDs and your Data Model will
look like this:
Step 5: Create Qlik Sense QVD Profile App
www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 14
Now you can start creating dashboards about your data which will provide insight and confidence for your end users.
Step 5: Create Qlik Sense QVD Profile App
www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 15
With this concept you can profile many QVD directories with minor script changes
You can read in the INFORMATION_SCHEMA from SQL Server and Oracle and add rich metadata into your QVD environment
If you have many levels to your data environment your can create linage scripts to create a robust metadata rich Qlik Sense environment
Additional Notes
www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 16
To learn more, contact us at:877-SYNTRIX (796-8749)
BIAdvisors@syntrixconsulting.comwww.syntrixconsulting.com
Syntrix Consulting Group