14
BEST PRACTICES FOR DEVELOPING GEOSPATIAL BIG DATA APPS FOR THE CLOUD Nick Salem - Distinguished Engineer David Tatar - Principal Software Engineer
BEST PRACTICES FOR
DEVELOPING GEOSPATIAL BIG
DATA APPS FOR THE CLOUD
Nick Salem - Distinguished Engineer
David Tatar - Principal Software Engineer
SPEAKER BIO – NICK SALEM
18 Oracle Certified Professional / Expert / Specialist credentials
(DBA, RAC, Performance Tuning, Spatial, Security, DW, SQL &
PLSQL Development) with 17 years experience developing
enterprise geospatial analytical applications
Technical Chair of Oracle Spatial & Graph SIG
17 years experience in Web architecture, Java and Oracle
database technologies with emphasis on GIS mapping and spatial
enterprise applications.
SPEAKER BIO – DAVID TATAR
AGENDA
Neustar – Quick Intro
Geospatial Analytics in the Cloud - ElementOne
Order by Spatial Proximity
Switching between Multiple Projections
Miscellaneous Best Practice Tips
12c Spatial Vector Acceleration Benchmarks
Live Demo
ABOUT NEUSTAR
NYSE: NSR
$964 Million in Revenue
1500+ Employees
14,000+ Customers
20 Billion Requests Per Day
Marketing Services
IT/Security Services
Data Services
CUSTOMER INTERACTION
MANAGEMENT
TARGETING
MEDIA PLANNING
CUSTOMER & PROSPECT
ANALYSIS
SITE & MARKET ANALYSIS
NEUSTAR’S ELEMENTONE PLATFORM
Highly flexible and high performance
mapping
Rich market and trade area capability
Road network / drive time analysis
Heat themes
GeoRaster images
Aerials / terrain map overlays
Centralized secure data repository
Copyright © 2016 Neustar, Inc. All Rights Reserved
ORDER BY SPATIAL PROXIMITY
Rows are stored in Oracle blocks
Blocks are stored on disk and in memory
Clustering Factor
– Order of data compared to index
Use md.hhencode_by_level function to
return a order by value
– See S&G blog for more details
Achieved 20x better performance using a
16M business table
Compression, pctfree & sdo_rtr_pctfree
Copyright © 2016 Neustar, Inc. All Rights Reserved
SWITCHING BETWEEN MULTIPLE
PROJECTIONS On the fly dynamic transformation vs
process once and store (see S&G blog)
Join user_segments & user_lobs to see
space consumption of sdo_ordinates
Layer (SRID) M Bytes
ZIP Codes (8307) 120
ZIP Codes (3785) no rounding 216
ZIP Codes (3785) round 0 120
ZIP Codes (3785) round 1 136
Copyright © 2016 Neustar, Inc. All Rights Reserved
MISCELLANEOUS BEST PRACTICE TIPS
Geometry simplification
– Minimum vertices needed
Topology and geometry relationships
– Build topologically smart processes
Partitioning
– Query pruning
– Efficient data management
12c Point-in-Polygon function
– Does not need spatial index
– Use on global temp + external tables
– Parallel enabled
Copyright © 2016 Neustar, Inc. All Rights Reserved
12C SPATIAL VECTOR ACCELERATION
300x faster SDO_AGGR_UNION
8x faster SDO_TOUCH
6x faster SDO_WITHIN_DISTANCE
6.5x faster SDO_JOIN
10x faster SDO_CS.TRANSFORM
3x faster SDO_GEOM.RELATE
2.6 faster SDO_GEOM.DISTANCE
Copyright © 2016 Neustar, Inc. All Rights Reserved
BUILT FOR THE CLOUD
Oracle Database 12c Enterprise
Edition
Oracle Real Application Clusters
Oracle Advanced Security Option
Oracle Partitioning Option
Oracle Data Guard / RMAN /
Flashback Database
Oracle Cloud Control
Oracle Weblogic 12c
Copyright © 2016 Neustar, Inc. All Rights Reserved
ELEMENTONE – SECURITY
Network and data fine grained
access controls
Function role based security
Login trigger checks
Auditing
Wallet transparent data encryption
Virtual Private Database
Object Permissions
Copyright © 2016 Neustar, Inc. All Rights Reserved
LIVE DEMO ElementOne in Action
Copyright © 2016 Neustar, Inc. All Rights Reserved
The Spatial & Graph SIG User Community
The SIG connects and exchanges
knowledge via online communities
and at conferences and events
• Chat & Coffee at OOW Join us & chat with other S&G users about your
experiences! Bring your own coffee
Wednesday at 8:00 am
Meet in front of Oracle Bookstore – Moscone
South Lobby
• Join us online
tinyurl.com/oraclespatialcommu
nity
LinkedIn , Google+ & IOUG SIG groups
@oraspatialsig | [email protected]
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |
Upcoming Events
• Oracle Spatial Summit at BIWA 2017 Oracle HQ, Redwood Shores, CA Jan. 31-Feb. 2, 2017 www.biwasummit.org *Call for speakers now open!
14
