Home > Software > Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS,...

Load testing of HELIDEM geo-portal: an OGC open standards interoperability example integrating WMS,...

Date post: 27-Aug-2014
Category:
Author: cannata
View: 107 times
Download: 0 times
Share this document with a friend
Description:
This paper presents a load testing of the HELIDEM geo-portal, which is an example of interoperability between a numbers of standard geospatial services as defined by the Open Geospatial Consortium. The portal was developed within the European project HELIDEM (www.helidem.eu) with the aim of valorizing the main project output which is a cross-border digital terrain model. The portal aims at fostering its diffusion and usage trough easily accessible tools. The DTM covers the alpine area located between Southern Switzerland (Canton Ticino) and Northern Italy (Lombardy and Piedmont Regions). From a technological point of view, the server-side component of the portal is based on a Service Oriented Architecture implemented using the open source software Zoo-Project, GRASS GIS and Geoserver; the client-side component is a Web interface based on CSS3 and HTML5 trough the usage of the ExtJS framework and the OpenLayers software. The presented solution is a mix of technologies and software, some of which are considered, within the open source for geospatial community, mature and robust while others are considered promising but not sufficiently tested yet. For this reason this research conducted a load test over concurrent users in order to verify the robustness, quality and performance of the system and to identify eventual bottlenecks. Test results didn’t register any exception confirming the good quality of the implemented system and underlying software. Nevertheless, performance and response time exponentially degrades with increasing number of concurrent users, area of analysis and process complexity. Finally, the test confirms that system is robust, in fact no system failure was recorded during the analysis.
Embed Size (px)
Popular Tags:
of 24 /24
HELI-DEM portal for geo-processing services: overview and load testing Massimiliano Cannata, Milan Antonovic, Monia Molinari
Transcript
  • HELI-DEM portal for geo-processing services: overview and load testing Massimiliano Cannata, Milan Antonovic, Monia Molinari
  • DACD / IST / HELI-DEM geo-portal HELI-DEM projects goals Creation of a unified digital terrain model, for the Alpine and Sub-Alpine area on the border between Italy and Switzerland, correctly geo-referenced in the three dimensions Administrative areas: Piemonte, Lombardia, Canton Ticino, Canton Grigioni DTM elaboration by coordination and fusion of available information + Correction of DTM with LiDAR HR DTM + Cross-border GNSS network experiments + Cross-border geoid calculation (IT-CH) + Experimentation, diffusion and valorization of DTM
  • DACD / IST / HELI-DEM geo-portal HELI-DEM geo-portal architecture (OWS / SOA) 3
  • DACD / IST / HELI-DEM geo-portal FOSS4G stacks 4 SERVER SIDE STACK CLIENT SIDE STACK
  • DACD / IST / HELI-DEM geo-portal Operation sequence disgramm 5 WCS WMS WFS FSWPS process DTM area Publish results Publish results Publish results Links to results
  • DACD / IST / HELI-DEM geo-portal 6 HELI-DEM geo-portal
  • DACD / IST / HELI-DEM geo-portal 7
  • DACD / IST / HELI-DEM geo-portal 8 17/07/2014
  • DACD / IST / HELI-DEM geo-portal 17/07/2014 9
  • DACD / IST / HELI-DEM geo-portal 10
  • DACD / IST / HELI-DEM geo-portal PDF report or CSV parameters 17/07/2014 11
  • DACD / IST / HELI-DEM geo-portal 17/07/2014 12
  • DACD / IST / HELI-DEM geo-portal Load testing 13 2.1 MB 7.5 MB 17.3 MB 29.2 MB
  • DACD / IST / HELI-DEM geo-portal Load testing procedure 7 test sessions with 1, 2, 4, 8, 16, 32, 64 concurrent users 14 Contour lines Altimetric profiles Watershed analysis Elevation derivatives Maggia - Large Varzasca - medium Breggia - small Cama very small Equallybalanced Randomlyselected
  • DACD / IST / HELI-DEM geo-portal System configuration parameter WPS / WMS / WFS server WCS server OS Ubuntu server version 12.04, 32 bit (VM) Ubuntu server version 12.04, 32 bit (VM) RAM 4GB 4GB CPU Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz N of processors 6 4 Disk size * 100GB 100GB 15 * Increased from 50GB after some test configuration
  • DACD / IST / HELI-DEM geo-portal Load testing results: the system No exception recorded Response time exponentially grows after 16 concurrent users 16 1 2 4 8 16 32 64 Average 28326 31705 29732 42239 52193 128932 303406 Exceptions 0 0 0 0 0 0 0 0 50000 100000 150000 200000 250000 300000 350000 Averageresposnsetime[milliseconds] General statistics 350k 300k 250k 200k 150k 100k 50k
  • DACD / IST / HELI-DEM geo-portal Load testing results: the processes 17 Min = 2.5 sec. Max = 2 min. Avg = 18 sec. Min = 8.4 sec. Max = 17.4 min. Avg =2.2 min. Min = 3.6 sec. Max = 3 min. Avg =26.9 sec. Min = 24 sec. Max = 23.5 min. Avg = 3.15 min. 80 % CPUs 100 % CPUs
  • DACD / IST / HELI-DEM geo-portal Where is the bottleneck ? 18 WCS WMS WFS FSWPS process DTM area Publish results Publish results Publish results Links to results
  • DACD / IST / HELI-DEM geo-portal Load testing results: data retrieval More smoothed behavior suggests it isnt the real weak point, at least for this amount of data (ranging from 3 MB to 30 MB) 19 1 2 4 8 16 32 64 Very small 808 854 861 890 774 839 1444 Small 1624 1663 1668 1862 1546 1677 2424 Medium 2831 2957 3070 3222 2865 3019 3800 Big 5538 5662 6004 6198 5717 6252 9093 0 1000 2000 3000 4000 5000 6000 7000 8000 9000 10000 AVGresponsetime(milliseconds) WCS
  • DACD / IST / HELI-DEM geo-portal WCS impact over offered processes 1. The data retrieval impacts more the fast processes (-) 2. Increasing concurrent user lead to longer response time and minor relative cost for data retival (-) 20
  • DACD / IST / HELI-DEM geo-portal Conclusions: the good Proven quality of the HELI-DEM portal and thus of the FOSS4G/OWS stack it relies on: good robustness having (no system failure even when exceptions raised in load testing setting) good application quality (no exception response registered) average good performances (compared with desktop processing) Serve dynamic analyses to non GIS experts for better planning ! 21
  • DACD / IST / HELI-DEM geo-portal Conclusions : the bad Scalability issues: Scalability: response time exponentially degrades with increasing number of user Increase hardware infrastructure (more CPUs, load balancing, scalable cloud computing service, etc..) Optimize processing (asynchronous programming, parallelization, etc.) Patience is a rare virtues in Web users 22
  • DACD / IST / HELI-DEM geo-portal Conclusions : the ugly Open questions to be investigated: Impact of WPS service (overhead to GRASS processing) Behaviour under different hardware settings (what if you increase the CPUs?) What under larger concurrency? Any other hints or suggestions? 23
  • 24 Thanks to: - FOSS4G developers - project partners - the audience

Recommended