Use Puppet to Manage your NetApp Storage Infrastructure Dave Cain & Amit Borulkar Converged Infrastructure Engineering NetApp
© 2015 NetApp, Inc. All rights reserved. 1
Puppet Camp Charlotte Monday December 7th , 2015 11:45am EST
Are you…
§ Tired of the § Complexity of modern-day storage deployment and
daily administration? § Manual steps for common operations across your
environment?
§ Ready for § Consistent and repeatable automation that fits into
the DevOps mentality across the enterprise? § Using Puppet: an industry leading automation
framework?
§ On best-in-class and trusted storage platforms that you can depend on? § 99.9999% availability
© 2015 NetApp, Inc. All rights reserved. 2
§ Dave Cain § B.S. in Computer Science @ NC State
University § 10+ years of datacenter experience § Restores vintage machinery in his spare time
About Us
§ Amit Borulkar § Masters in Computer Science @ NC State
University § Research interests at school: Distributed
systems and cloud computing § Enjoys hiking and cooking
© 2015 NetApp, Inc. All rights reserved. 3
@thedavecain
Agenda
1) About NetApp § About our company § Data ONTAP
2) Solution Architecture § About NetApp Data ONTAP device module § Flow diagram
3) Live Demos § Cluster scoped operation § Storage Virtual Machine scoped operation § Role-based Access Control demonstration
4) Call to Action and Wrap-Up § Q&A
© 2015 NetApp, Inc. All rights reserved. 4
About NetApp Dave Cain
© 2015 NetApp, Inc. All rights reserved. 5
NetApp is a global provider of software, systems and services to manage and store data
From FORTUNE Magazine, February 3, 2014 © 2014 Time Inc. FORTUNE and FORTUNE 100 Best Companies to Work For are registered trademarks of Time Inc. and are used under license. FORTUNE and Time Inc. are not affiliated with, and do not endorse products or services of, NetApp.
US $6.3B revenue FORTUNE 500® NASDAQ: NTAP
Our Team: 12,000+ employees
150+ countries 3,200 patents
Founded in 1992
13 Years in a Row: FORTUNE 100 “Best Companies to Work
For®”
© 2015 NetApp, Inc. All rights reserved. 6
Clustered Data ONTAP Architecture
7
§ Nondisruptive operations
§ Rich storage efficiency and data management
§ On-demand scale out
§ Unified SAN and NAS
§ Secure multi-tenancy
§ Multi-hypervisor optimized
§ Efficient data transport: flash to disk to cloud
Flash, hybrid, SAN, NAS, DAS, Cloud, Next-Gen Media
Always-On Infrastructure Scale-Out Architecture Flash Ready Cloud Integrated
© 2015 NetApp, Inc. All rights reserved.
E
FCP FCoE iSCSI CIFS/SMB NFS
Workloads & Users
A B C D
A
B D A B C
E
Clustered Data ONTAP Terminology
© 2015 NetApp, Inc. All rights reserved. 8
HA HA
Node: A single storage controller running one instance of Data ONTAP® and its attached storage
HA pair: Equals 2-nodes; HA interconnect for heartbeat and resiliency
Cluster interconnect: 10GbE network connection for data communication across nodes
Storage virtual machine (SVM): Logical abstraction of resources through which data is accessed; contains volumes and LIFs
Logical network interface (LIF): Logical element that maps an IP address or WWPN to a physical network port on a node
Cluster: Logical grouping of storage systems composed of nodes, disks, and a cluster network
LIF4 LIF3 LIF2 LIF1
HA Pair HA Pair
Cluster
SVM
Solution Architecture Amit Borulkar
© 2015 NetApp, Inc. All rights reserved. 9
NetApp Data ONTAP Device module
§ First Puppet module for managing storage infrastructure
§ State driven approach for storage automation
§ Augments DevOps model by facilitating quick and reliable transitions between different storage configurations
§ Enables creation of storage catalogs for common storage operations (E.g. provisioning of a Logical Unit Volume to a client from NetApp storage)
§ Infrastructure as Code
10 © 2015 NetApp, Inc. All rights reserved.
Solution Architecture NetApp Data ONTAP Device Module
© 2015 NetApp, Inc. All rights reserved. 11
Puppet Master
Puppet Agent (proxy device)
FAS system Storage Virtual Machine
1. Retrieves catalog
2. cluster scoped
operations
2. SVM scoped
operations
facts facts
3. Report success/failure
Contains manifests
Contains device config
Flow Diagram
© 2015 NetApp, Inc. All rights reserved. 12
Puppet Master
Cluster/SVM
Puppet Agent (proxy device)
Connect to device in
“device.conf”
Compile the manifests
corresponding to the device
Catalog
Device
Query Initial state
Defined system state
Query status
Enforce defined
state
Report
2. Basic node info
7. Compare states
3. Request catalog
4. Node catalog
5. Request resource
state
6.Resource state
Device information
1. Connect to the device
8. Apply config
9. Report results
Live Demos! Amit Borulkar
© 2015 NetApp, Inc. All rights reserved. 13
Demo
§ Provision a LUN from NetApp FAS storage for a Windows client to perform NTFS operations.
© 2015 NetApp, Inc. All rights reserved. 14
Standard Workflow
storage aggregate create -aggregate aggr01_node03 -chksumstyle block -diskcount 6 -node puppet-dev-01 -raidtype raid-dp
vserver create -vserver vserver01 -rootvolume rootdir -language c -security-style unix -aggregate aggr01_node03
network interface create -vserver vserver01 -lif mgmt -role data -home-node puppet-dev-01 -home-port e0d -netmask 255.255.255.0 -address 172.21.10.127 -status-admin up -failover-policy disabled -firewall-policy mgmt
network interface create -vserver vserver01 -lif iscsi_data -role data -home-node puppet-dev-01 -home-port e0d -netmask 255.255.255.0 -address 172.21.10.128 -status-admin up -failover-policy disabled –data-protocol iscsi
© 2015 NetApp, Inc. All rights reserved. 15
Standard Workflow (2):
export-policy create -vserver vserver01 -policyname lab01_policy
export-policy rule create -vserver vserver01 -policyname lab01_policy -clientmatch 0.0.0.0/0 -rorule any -rwrule any
volume create -vserver vserver01 -volume client01_vol01 -aggregate aggr01_node03 -size 1g -state online -policy lab01_policy
lun create -vserver vserver01 -path /vol/client01_vol01/vserver01_lun -size 300m -ostype windows -space-reserve disabled
igroup create vserver01_iscsi -vserver vserver01 -protocol iscsi -ostype windows -initiator iqn.1991-05.com.microsoft:cis-jump85.cis.netapp.com
lun map -vserver vserver01 -path vol/client01_vol01/vserver01_lun
© 2015 NetApp, Inc. All rights reserved. 16
Puppet Automation
© 2015 NetApp, Inc. All rights reserved. 17
puppet device --verbose
© 2015 NetApp, Inc. All rights reserved. 18
Demo
• Cluster scoped operations • SVM scoped operations • Role Based operations
https://www.youtube.com/watch?v=cGz04EztP5A
Wrapping Up Dave Cain
© 2015 NetApp, Inc. All rights reserved. 19
Not a commitment, but merely a statement of direction Things we’re looking into as next steps…
§ Absorbing user feedback from initial module
§ NetApp Clustered Data ONTAP § CIFS Support § Job Scheduler
§ NetApp E-Series § SSD Read Cache § Consistency Groups For Snapshots § Scan and update the Web Services Proxy
20 © 2015 NetApp, Inc. All rights reserved.
Conclusion
© 2015 NetApp, Inc. All rights reserved. 21
§ NetApp is a Fortune 500 company that sells data management and storage solutions
§ NetApp has partnered with Puppet to make our storage platforms configurable in the same manner as most other components of your datacenter
§ The Network Device functionality leveraged by the co-developed Apache 2 licensed Puppet module provides § A declarative (tell me what you want) style configuration template that reduces
complexity and time to value § Provides consistency in common administration operations and tasks using
repeatable automation § Multi-tenancy operations that leverage the power of Data ONTAP for cluster-
scoped or SVM scoped operations that suit whatever your needs
Call to Action
§ Module available today from the Forge: § https://forge.puppetlabs.com/puppetlabs/netapp § Report issues:
https://github.com/puppetlabs/puppetlabs-netapp/issues
§ NetApp E-Series Puppet module also available: § https://github.com/NetApp/puppet-eseries
§ NetApp Technical Report § www.netapp.com/us/media/tr-4477.pdf
This means you!
© 2015 NetApp, Inc. All rights reserved. 22
Q&A
23 © 2015 NetApp, Inc. All rights reserved.