Date post: | 25-May-2015 |
Category: |
Technology |
Upload: | thierry-badard |
View: | 2,897 times |
Download: | 2 times |
Dr. Thierry Badard, CTOSpatialytics Solutions Inc.
Quebec, Canada
Spatially enabled open source BI (GeoBI) with GeoKettle,
GeoMondrian & SOLAPLayers
Injecting “GEOSPATIAL” in BI
OSBI leaderOpen Source (CE & EE)
- Faculté de foresterie, de géographie et de géomatique - Département des sciences géomatiques
- Équipe de recherche GeoSOA - Dr. Thierry Badard
R&D leaderGeomatics/GIS/Geospatial
OLAP DashboardReportsETL
Why merge BI and geospatial software?● Because “About 80% of all data stored in corporate databases has a
spatial component” [Franklin 1992]
● Enable the exploration of spatial relations between data − To definitely take into account all aspects (spatial, temporal, desc.) of data
− And then take more informed decisions
● Some phenomena can only be effectively observed and interpreted by representing them on a map!− Spatial distribution,
− Spatiotemporal evolution,
− etc.
● But we need to go beyond simple push-pins on a Google Maps!– Need for complex spatial analysis and transformations
– Advanced and cool thematic map representations
– Extend the query language with geospatial capabilities
– Easy navigation via drill-down and roll-up operators applied to maps
Open Source Projects
SpatialOLAP
Geo-analyticalDashboardReports
SpatialETL
● GeoKettle is a "spatially-enabled" version of Pentaho Data Integration (Kettle)
● GeoKettle provides a true and consistent integration of the spatial component− All steps provided by Kettle are able to deal with geospatial data types− Some geospatial dedicated steps have been added
● First release in May 2008: 2.5.2-20080531● Current stable version: 3.2.0-r188-20090706● To be released very shortly: GeoKettle 2.0 with many new
features!● Released under LGPL at http://www.geokettle.org ● Used in different organizations and countries● A growing community of users and developers
GeoKettle
● Version 2.0 provides support for:− Handling geometry data types (based on JTS)− Accessing Geometry objects in JavaScript− Definition of custom transformation steps by the user (“Modified
JavaScript Value” step)− Spatial analysis through topological predicates (intersects, crosses,
etc.) and aggregation operators (envelope, union, geometry collection, ...)− SRS definition and transformations− Input / Output with some spatial DBMS
- Native support for Oracle, PostGIS and MySQL- MS SQL Server 2008 and IBM DB2 (requires some tricks)
− GIS file Input / Output: Shapefile, GML 3, KML 2.2 and OGR support (~33 vector data formats and spatial DBMS)
− Cartographic preview− Sensor Observation Service (OGC)− Advanced vector geo-processing (Sextante plugin)
GeoKettle
GeoKettle - Spoon
GeoMondrian
● GeoMondrian is a "spatially-enabled" version of Pentaho Analysis Services (Mondrian)
● GeoMondrian brings to the Mondrian OLAP server what PostGIS brings to the PostgreSQL DBMS– i.e. a consistent and powerful support for geospatial
data.
● Licensed under the EPL
● http://www.geo-mondrian.org
GeoMondrian● As far as we know, it is the first implementation of a true
Spatial OLAP (SOLAP) Server− And it is an open source project! ;-)
● Provides a consistent integration of spatial objects into the OLAP data cube structure− Instead of fetching them from an external spatial DBMS, web
service or a GIS file
● Implements a native Geometry data type
● Provides first spatial extensions to the MDX language− Add spatial analysis capabilities to the analytical queries
● At present, it only supports PostGIS datawarehouses− But other DBMS will be supported in the next version!
SOLAPLayers● SOLAPLayers is a lightweight cartographic component
(framework) which enables navigation in geospatial (Spatial OLAP or SOLAP) data cubes, such as those handled by GeoMondrian.
● It aims to be integrated into existing dashboard frameworks in order to produce interactive geo-analytical dashboards.
● But could be used standalone to produce geo-enabled dashboards and reports
● Version 2.0 (to be released in Feb./March 2011) will be based on the ExtJS/GeoExt frameworks
● Licensed under BSD (client part) and EPL (server part).
● http://www.solaplayers.org
SOLAPLayers 2.0 – Architecture
MDX
OLA
P4J
SOLAPJSON
Client
Authentication
Built-in or LDAPServer
Server
Native or XML/A
SOLAP Server
Native or XML/A
Geospatial data source(WFS, DBMS, ...)
OLAP Server
Geospatial data source(WFS, DBMS, ...)
1
2
3
SOLAPLayers 2.0
SOLAPLayers 2.0
SOLAPLayers 2.0
Questions?● Thanks for your attention and do not hesitate to ask for demos
and to contact us for possible collaborations!
● Contact:Dr. Thierry Badard, CTO
Spatialytics inc.
Quebec, Canada
Email: [email protected]
Web: http://www.spatialytics.org
http://www.spatialytics.com
Twitter: tbadard & spatialytics
http://www.geokettle.org Twitter : geokettle
http://www.geo-mondrian.org Twitter : geomondrian
http://www.solaplayers.org Twitter : solaplayers
Spatially enabled MDX
● Goal: bring to Mondrian and MDX what SQL spatial extensions do for relational DBMS (i.e. Simple Features for SQL and implementations such as PostGIS).
● Example query: filter spatial dimension members based on distance from a feature− SELECT
{[Measures].[Population]} on columns, Filter( {[Unite geographique].[Region economique].members}, ST_Distance([Unitegeographique].CurrentMember.Properties("geom"), [Unite geographique].[Province].[Ontario].Properties("geom")) < 2.0 ) on rows FROM [Recensements] WHERE [Temps].[Rencensement 2001 (2001-2003)].[2001]
SOLAPLayers 2.0 – Geo-dashboard made easy!
Define the template of the dashboard in a HTML file1
SOLAPLayers 2.0 – Geo-dashboard made easy!
Define the template of the dashboard in a HTML file1
Define your dashboard components in a JS file and map it to the div in the HTML file2
SOLAPLayers 2.0 – Geo-dashboard made easy!
Enjoy! ;-)
3
SOLAPLayers
● As GeoExt which provides Geospatial extensions to ExtJS, SOLAPLayers provides GeoBI extensions to ExtJS
● So, to make it simple: SOLAPLayers = GeoBIExt!
● At present, it provides the main components for creating geo-analytical dashboards
– Map, crosstab, column chart, line chart, ...
– But, many more to come and to develop! ● Cube explorer, query builder, time slider/navigator, gauges, score cards, social graphs, ...
– Advanced interaction capabilities and settings will be added to each components!
– Additional thematic mapping capabilities are also required: multi-maps, ...
● We anticipate to have a first stable of version 2.0 in February/March 2011