11
Atmospheric Science Data Center Update CERES Science Team Meeting May 16, 2017
Atmospheric Science Data Center Update
CERES Science Team Meeting May 16, 2017
CERES and FLASHFlux Archive Volume
By Data Date Through March 2017
2
Total Volume Archived ~ 1,461 TB NPP Volume Archived ~ 63.0 TB
0
10
20
30
40
50
60
70
80
2000 2002 2004 2006 2008 2010 2012 2014 2016
Volu
me
(TB
)
TERRA AQUA NPP FLASH
CERES Data Orders (June 2010 – March 2017)
3
Total Orders: 48,272
0
2000
4000
6000
8000
10000
12000
2010 2011 2012 2013 2014 2015 2016 2017
Num
ber o
f Ord
ers
CERES Data Distribution (June 2010 – March 2017)
4
0
20
40
60
80
100
120
140
2010 2011 2012 2013 2014 2015 2016 2017
volu
me
( TB
)
Total data distributed • ~653 TB • 3,042,835 data months • ~ 7,688 users
User Affiliations
5
10%
45% 27%
18%
Commercial Education Government Other
Users by Country (June 2010 – March 2017)
6
Current Storage Configuration
ECS Holdings - MISR - SAGE III - TES - MOPPITT
ASDC Publicly Available Data
ANGe Holdings - CERES - CALIPSO - SRB - Field Campaigns
Campus Network Public
Data pushed via specific orders and subscriptions to customers
Data pushed via specific orders and subscriptions to customers
Limited ftp access to data
Center Firewall
7
Planned Storage Configuration
ECS Holdings - MISR - SAGE III - TES - MOPITT
ASDC Publicly Available Data
ANGe Holdings - CERES - CALIPSO - SRB - Field Campaigns
Center Firewall
Campus Network Public
GridFTP ASDC Holdings - CERES - CALIPSO - SRB - Field Campaigns - MISR - SAGE III - TES - MOPITT
OPeNDAP
ArcGIS
Other web services
DMZ
8
ASDC Cloud Pilot
9
OpenStack: - Open Source IaaS (Infrastructure as a Service)
- Storage, Networking, & Compute resources - Dense utilization of compute resources - Potential for Hybrid Cloud Current Status: - DMZ deployment has been completed - Hardening/testing of platform is ongoing
Upcoming work: - Deployment of internal OpenStack - Migration of compute workloads - Integration with CloudForms
ASDC Cloud Pilot
10
OpenShift: - Open Source PaaS (Platform as a Service)
- Built on Docker & Kubernetes - Container based “microservices” - Rapid Application Development - Easy Application deployment & scaling Current Status: - Internal AMI dev/test & production are now live - Dev sandbox is available
Upcoming work: - Deployment to DMZ for external production - Migration of WebRA applications - Integration with CloudForms
