FME Lightning Talk - Inline Querier

Post on 20-Jun-2015

2,852 views 2 download

Tags:

transcript

InlineQuerier: A Mid-Stream FME Database

April 2012

InlineQuerier: Motivation

Cascading FeatureMergers = BAD

InlineQuerier: Motivation

Cascading FeatureMergers = BAD Each FeatureMerger causes features to be

Blocked up Reindexed Re-cached to disk

Joins between features are limited to a single key No sophisticated ability to compute additional

values or configure the join FeatureMergers join only two streams at a time

InlineQuerier: Introduction

Fully configurable multi-stream join Brings SQL power to all datasources

Cache and index once Query many times

Extract, Join, & Computeinformation via SQL Query

Tidier workspaces Improved performance

InlineQuerier: Before And After

Task: Put each egg on the map, with its species

Egg Information (CAT)NEST_ID EGG_ID DATE_LAID DATE_HATCHED INCUBATION_DAYS NEST_X_OFFSET NEST_Y_OFFSET 20 0 20040819 20040826 7 -0.14 -0.15 20 1 20040823 20040829 6 -0.05 0.18 20 2 20040818 20040826 8 -0.23 -0.00…

Nest Locations (ArcGen)20,3144330,1008911721,3144481.5,10089238…

Species (CSV)NestId,Species100,Blue Jay101,American Goldfinch…

InlineQuerier: Before And After

Cascading Feature Mergers

InlineQuerier: Before And After

With Inline Querier

InlineQuerier: 4 Way Joins

Heritage

Taxes

Neighborhood

Neighbourhood Code

PID

Address

InlineQuerier: 4 Way Joins

Addresses

Heritage

Taxes

Neighborhood

InlineQuerier: Summary

New for 2012 Brings power of SQL to FME data streams Extract, Join, & Compute information via SQL Query

Tidier workspaces Improved performance http://fmeevangelist.com/fmeevangelist97