Best Practices for Developing Geospatial Big Data ... - Oracle€¦ · 18 Oracle Certified...

transcript

BEST PRACTICES FOR

DEVELOPING GEOSPATIAL BIG

DATA APPS FOR THE CLOUD

Nick Salem - Distinguished Engineer

David Tatar - Principal Software Engineer

SPEAKER BIO – NICK SALEM

18 Oracle Certified Professional / Expert / Specialist credentials

(DBA, RAC, Performance Tuning, Spatial, Security, DW, SQL &

PLSQL Development) with 17 years experience developing

enterprise geospatial analytical applications

Technical Chair of Oracle Spatial & Graph SIG

17 years experience in Web architecture, Java and Oracle

database technologies with emphasis on GIS mapping and spatial

enterprise applications.

SPEAKER BIO – DAVID TATAR

AGENDA

Neustar – Quick Intro

Geospatial Analytics in the Cloud - ElementOne

Order by Spatial Proximity

Switching between Multiple Projections

Miscellaneous Best Practice Tips

12c Spatial Vector Acceleration Benchmarks

Live Demo

ABOUT NEUSTAR

NYSE: NSR

$964 Million in Revenue

1500+ Employees

14,000+ Customers

20 Billion Requests Per Day

Marketing Services

IT/Security Services

Data Services

CUSTOMER INTERACTION

MANAGEMENT

TARGETING

MEDIA PLANNING

CUSTOMER & PROSPECT

ANALYSIS

SITE & MARKET ANALYSIS

NEUSTAR’S ELEMENTONE PLATFORM

Highly flexible and high performance

mapping

Rich market and trade area capability

Road network / drive time analysis

Heat themes

GeoRaster images

Aerials / terrain map overlays

Centralized secure data repository

ORDER BY SPATIAL PROXIMITY

Rows are stored in Oracle blocks

Blocks are stored on disk and in memory

Clustering Factor

– Order of data compared to index

Use md.hhencode_by_level function to

return a order by value

– See S&G blog for more details

Achieved 20x better performance using a

16M business table

Compression, pctfree & sdo_rtr_pctfree

SWITCHING BETWEEN MULTIPLE

PROJECTIONS On the fly dynamic transformation vs

process once and store (see S&G blog)

Join user_segments & user_lobs to see

space consumption of sdo_ordinates

Layer (SRID) M Bytes

ZIP Codes (8307) 120

ZIP Codes (3785) no rounding 216

ZIP Codes (3785) round 0 120

ZIP Codes (3785) round 1 136

MISCELLANEOUS BEST PRACTICE TIPS

Geometry simplification

– Minimum vertices needed

Topology and geometry relationships

– Build topologically smart processes

Partitioning

– Query pruning

– Efficient data management

12c Point-in-Polygon function

– Does not need spatial index

– Use on global temp + external tables

– Parallel enabled

12C SPATIAL VECTOR ACCELERATION

300x faster SDO_AGGR_UNION

8x faster SDO_TOUCH

6x faster SDO_WITHIN_DISTANCE

6.5x faster SDO_JOIN

10x faster SDO_CS.TRANSFORM

3x faster SDO_GEOM.RELATE

2.6 faster SDO_GEOM.DISTANCE

BUILT FOR THE CLOUD

Oracle Database 12c Enterprise

Edition

Oracle Real Application Clusters

Oracle Advanced Security Option

Oracle Partitioning Option

Oracle Data Guard / RMAN /

Flashback Database

Oracle Cloud Control

Oracle Weblogic 12c

ELEMENTONE – SECURITY

Network and data fine grained

access controls

Function role based security

Login trigger checks

Auditing

Wallet transparent data encryption

Virtual Private Database

Object Permissions

LIVE DEMO ElementOne in Action

The Spatial & Graph SIG User Community

The SIG connects and exchanges

knowledge via online communities

and at conferences and events

• Chat & Coffee at OOW Join us & chat with other S&G users about your

experiences! Bring your own coffee

Wednesday at 8:00 am

Meet in front of Oracle Bookstore – Moscone

South Lobby

• Join us online

tinyurl.com/oraclespatialcommu

LinkedIn , Google+ & IOUG SIG groups

@oraspatialsig | oraclespatialsig@gmail.com

Upcoming Events

• Oracle Spatial Summit at BIWA 2017 Oracle HQ, Redwood Shores, CA Jan. 31-Feb. 2, 2017 www.biwasummit.org *Call for speakers now open!

Best Practices for Developing Geospatial Big Data ... - Oracle€¦ · 18 Oracle Certified...

Documents