Post on 27-Mar-2015
transcript
11
How to build and use a Cloud GIS
Redlands, CaliforniaRedlands, CaliforniaMarch 8March 8thth – 9 – 9thth, 2010, 2010
Web Mapping for Conservation Organizations WorkshopWeb Mapping for Conservation Organizations Workshop
Why Cloud Computing?Why Cloud Computing?
• CheaperCheaper– Only pay for what you use when you need itOnly pay for what you use when you need it
– Based on hourly rate Based on hourly rate
– Terminate machines when they’re not needed anymoreTerminate machines when they’re not needed anymore
• Time to market is shorter than traditional cycleTime to market is shorter than traditional cycle– Procure hardwareProcure hardware
– Hardware setupHardware setup
– IT setupIT setup
– Software setupSoftware setup
– Application and Data loadingApplication and Data loading
– TestingTesting
Gov 2.0Gov 2.0 22
Ready to use in the cloudReady to use in the cloud
33Web Mapping for Conservation Organizations Workshop
Cloud Computing Types
Infrastructure As A Service
(IAAS)
Infrastructure As A Service
(IAAS)
Platform As A Service
(PAAS)
Platform As A Service
(PAAS)
Software As A Service
(SAAS)
Software As A Service
(SAAS)
Framework API (ex: Azure, Google App Engine)Framework API (ex: Azure, Google App Engine)
Web Services API (ex: Amazon)Web Services API (ex: Amazon)
Web Browser (ex: YouTube, SalesForce)Web Browser (ex: YouTube, SalesForce)
Amazon Web site tourAmazon Web site tour
Gov 2.0Gov 2.0 44
ArcGIS For Amazon AMI ArcGIS For Amazon AMI DemoDemo
Gov 2.0Gov 2.0 55
Emerging Usage PatternsEmerging Usage Patterns
• Based on Amazon Machine Based on Amazon Machine Image (AMI), launch a ready to Image (AMI), launch a ready to use Amazon Instanceuse Amazon Instance
• Publish ServicesPublish Services
• Small loadSmall load
• Single point of failure Single point of failure
Gov 2.0Gov 2.0 66
Emerging Usage PatternEmerging Usage Pattern
• Publish large number of Publish large number of servicesservices
• High LoadHigh Load
• High Availability High Availability
Gov 2.0Gov 2.0 77
Emerging Usage PatternsEmerging Usage Patterns
• On Premise system for daily On Premise system for daily use and editinguse and editing
• Cloud is used for publishing Cloud is used for publishing
Gov 2.0Gov 2.0 88
GeodatabaseGeodatabase replicationreplication
Over http/sOver http/s
Amazon Use CaseAmazon Use CaseHigh-Performance ComputingHigh-Performance Computing
Other Other Costs?Costs?
Amazon Use CaseAmazon Use CaseWeb Hosting with Occasional Traffic Spikes Web Hosting with Occasional Traffic Spikes
Gov 2.0Gov 2.0 1010
Other Other Costs?Costs?
Setup CostsSetup Costs
• Before the system is considered up and running for use.Before the system is considered up and running for use.
• Configuration and VerificationConfiguration and Verification– SoftwareSoftware
– DataData
• Data uploadData upload– Time Vs CostTime Vs Cost
– EC2 Vs S3EC2 Vs S3
Gov 2.0Gov 2.0 1111
Operating CostsOperating Costs
• Staging EnvironmentStaging Environment
• Testing Testing – FunctionalFunctional
– Load testingLoad testing
• Monitoring Monitoring
• TroubleshootingTroubleshooting
Gov 2.0Gov 2.0 1212
Maintenance CostsMaintenance Costs
• Data updatesData updates– Data upload costsData upload costs
– Data Testing and Data Testing and VerificationVerification
• Configuration ChangesConfiguration Changes– System capacitySystem capacity
– System featuresSystem features
• Managing load changesManaging load changes
Gov 2.0Gov 2.0 1313
Example ApplicationExample ApplicationDeployment in the Amazon CloudDeployment in the Amazon Cloud
• Hosted componentsHosted components– AGS Server w/ 3 servicesAGS Server w/ 3 services– Web ApplicationWeb Application
• Hosting requirementsHosting requirements– High AvailabilityHigh Availability– Data updatesData updates
Gov 2.0Gov 2.0 1414
Example ApplicationExample ApplicationDeployment ArchitectureDeployment Architecture
Gov 2.0Gov 2.0 1515
Elastic Load BalancerElastic Load Balancer Amazon S3Amazon S3
Example ApplicationExample ApplicationDeployment Cost ListDeployment Cost List
Gov 2.0Gov 2.0 1616
Amazon Service Cost model
3 Instances2 production1 staging
Hourly rate / instanceData In - out / GB
Elastic Load Balancer Data In – out / GB
2 EBS drives Hourly rate / GBData In – out / GB
S3 account Hourly rate / GBIn - out / GB
Project Use CasesProject Use CasesDataBasin Cloud Deployment ArchitectureDataBasin Cloud Deployment Architecture
Gov 2.0Gov 2.0 1717
ArcGIS ServersArcGIS Servers
Database Database ServersServers
Web ServersWeb Servers
Project Use CasesProject Use CasesAmazon S3 Deployment - Disconnected CacheAmazon S3 Deployment - Disconnected Cache
• User ArcGIS Server to create your own CacheUser ArcGIS Server to create your own Cache
• Upload to S3 as filesUpload to S3 as files
• Use AGS Server Flex, JS, or Silverlight APIs to point to the cache Use AGS Server Flex, JS, or Silverlight APIs to point to the cache filesfiles
• Pros:Pros:– CheaperCheaper
• Cons:Cons:– No query on this cache, setup another location for queriesNo query on this cache, setup another location for queries
– Cache completely cooked Cache completely cooked
• Example:Example:– http://marwa.s3.amazonaws.com/s3cache/s3cache.htmlhttp://marwa.s3.amazonaws.com/s3cache/s3cache.html
Gov 2.0Gov 2.0 1818
ArcGIS Server for Amazon JumpstartArcGIS Server for Amazon JumpstartA Professional Services PackageA Professional Services Package
• Available for users nowAvailable for users now
• Users bring their own ArcGIS Server licenses, and their own Amazon Users bring their own ArcGIS Server licenses, and their own Amazon account account
• Includes AMIsIncludes AMIs– ArcGIS Server .Net 9.3.1 sp1ArcGIS Server .Net 9.3.1 sp1– PosGres 8.3.8 GeoDatabasePosGres 8.3.8 GeoDatabase
• Includes 4 days of onsite consultingIncludes 4 days of onsite consulting– Amazon Web Services (AWS) orientationAmazon Web Services (AWS) orientation– Create and validate sample ArcGIS Server services Create and validate sample ArcGIS Server services – Create custom AMI based on supported configurationsCreate custom AMI based on supported configurations– High Availability and Scalability Architecture & more…High Availability and Scalability Architecture & more…
Gov 2.0Gov 2.0 1919