Atmospheric Science Data Center Update
CERES Science Team Meeting May 16, 2017
CERES and FLASHFlux Archive Volume
By Data Date Through March 2017
2
Total Volume Archived ~ 1,461 TB NPP Volume Archived ~ 63.0 TB
0
10
20
30
40
50
60
70
80
2000 2002 2004 2006 2008 2010 2012 2014 2016
Volu
me
(TB
)
TERRA AQUA NPP FLASH
CERES Data Orders (June 2010 – March 2017)
3
Total Orders: 48,272
0
2000
4000
6000
8000
10000
12000
2010 2011 2012 2013 2014 2015 2016 2017
Num
ber o
f Ord
ers
CERES Data Distribution (June 2010 – March 2017)
4
0
20
40
60
80
100
120
140
2010 2011 2012 2013 2014 2015 2016 2017
volu
me
( TB
)
Total data distributed • ~653 TB • 3,042,835 data months • ~ 7,688 users
User Affiliations
5
10%
45% 27%
18%
Commercial Education Government Other
Users by Country (June 2010 – March 2017)
6
Current Storage Configuration
ECS Holdings - MISR - SAGE III - TES - MOPPITT
ASDC Publicly Available Data
ANGe Holdings - CERES - CALIPSO - SRB - Field Campaigns
Campus Network Public
Data pushed via specific orders and subscriptions to customers
Data pushed via specific orders and subscriptions to customers
Limited ftp access to data
Center Firewall
7
Planned Storage Configuration
ECS Holdings - MISR - SAGE III - TES - MOPITT
ASDC Publicly Available Data
ANGe Holdings - CERES - CALIPSO - SRB - Field Campaigns
Center Firewall
Campus Network Public
GridFTP ASDC Holdings - CERES - CALIPSO - SRB - Field Campaigns - MISR - SAGE III - TES - MOPITT
OPeNDAP
ArcGIS
Other web services
DMZ
8
ASDC Cloud Pilot
9
OpenStack: - Open Source IaaS (Infrastructure as a Service)
- Storage, Networking, & Compute resources - Dense utilization of compute resources - Potential for Hybrid Cloud Current Status: - DMZ deployment has been completed - Hardening/testing of platform is ongoing
Upcoming work: - Deployment of internal OpenStack - Migration of compute workloads - Integration with CloudForms
ASDC Cloud Pilot
10
OpenShift: - Open Source PaaS (Platform as a Service)
- Built on Docker & Kubernetes - Container based “microservices” - Rapid Application Development - Easy Application deployment & scaling Current Status: - Internal AMI dev/test & production are now live - Dev sandbox is available
Upcoming work: - Deployment to DMZ for external production - Migration of WebRA applications - Integration with CloudForms