Spinnaker Networks
SC 2003
11/19/2003
Spinnaker Proprietary and Confidential
2
Spinnaker Networks
• Founded December 1999• 83 Employees• $51 Million in two funding rounds• Began shipping product in Q4 2002• Agreed to be acquired by Network Appliance
on 11-4-2003• http://www.netapp.com/news/press/2003/news_rel_20031104.html• http://investors.netapp.com/MediaRegister.cfm?MediaID=9758 • http://investors.netapp.com/downloads/transcript81903.pdf
Spinnaker Proprietary and Confidential
3
Spinnaker SpinFS Advantages
• Clustering• scale to hundreds of servers• location transparency• dynamic online data reconfiguration• scales like a SAN
• Performance• single box performance• cluster performance scales with number of servers
• Open storage • support for most industry leading storage arrays
and switches
Spinnaker Proprietary and Confidential
4
SpinFS Storage Hierarchy
RAID 5
RAID 5
STORAGE POOL 2
RAID 1
STORAGE POOL 1VFS A
VFS B
VFS D
VFS C
• Single Storage Space subdivided into one or more STORAGE POOLS
• Each storage pool is a collection of one or more RAID sets
• One or more VIRTUAL FILE SYSTEMS (VFS) created in each storage pool.
• Each VFS may be placed in a storage pool with attributes to meet business requirements
Spinnaker Proprietary and Confidential
5
Clustering – Global Name Space
Location independence
Atomic move Class of service Performance scaling Mirrors, snapshots
Unix workstation
Windowsdesktop
UNIXworkstation
Windowsdesktop
SpinServer 1
SpinServer2
SpinServer3 acct
Q1 Q2 random
P1 P2
Q1 Q2 acct random P1 P2
Spinnaker Proprietary and Confidential
6
Spinnaker Performance – SPEC
• Spec SFS97_R1 results• SpinServer 3300
• 23,000 ops/sec NFSv3/TCP – dual Intel Xeon PIII
• SpinServer 4100• 35,000 ops/sec NFSv3/TCP – dual Intel Xeon P4
• NTAP 960• 25,000 ops/sec NFSv3/TCP
Spinnaker Proprietary and Confidential
7
Spinnaker Performance
• Cluster results (SpinServer 3300)• 117K ops/sec NFSv3/TCP 6 way cluster
• 12 total Intel CPUs• clients distributed evenly among servers
• 5/6 of workload entering any one server goes across cluster link
• linear scaling with 12-20% switching cost• much better than SAN file systems
Spinnaker Proprietary and Confidential
8
Scaling - SpinnakerSpinServer Spec/Ops in Uniform Cluster
0
50000
100000
150000
200000
250000
1 6 11
SpecOps
Spinnaker Proprietary and Confidential
9
Spinnaker Performance - Streaming
• Aggregate IO Performance (4100)• Read from drives (9K MTU) – two GigE ports
• 235 MB/sec• Read from cache (9K MTU) - two GigE ports
• 236 MB/sec• Write to drives (9K MTU) - two GigE ports
• 195 MB/sec
SpinServer Architectural Details
Spinnaker Proprietary and Confidential
11
Architecture Detail
Fibre Channel
Client Access
Gigabit Ethernet
Fibre Channel
Disk Function• Caching• Locking
XGigabit EthernetSwitch
Spinnaker SpinFS: 2-Stage Distributed File System1. Any data access request
“switched” to appropriate disk back end
2. Standard GigE cluster fabric
3. No client code changesrequired for distributed cluster capability
4. 2-stage architecture –separate N and D functions interconnected via SpinFSprotocol – enables scaling in performance and capacity while eliminating file locking issues associated with other architectures
Network Function• TCP termination• VLDB lookup• Protocol translation to SpinFS
SpinFS Protocol
Network Function• TCP termination• VLDB lookup• Protocol translation to SpinFS
Disk Function• Caching• Locking
12
Client Access
Gigabit Ethernet
Spinnaker Networks
ArchitecturalComparison
Spinnaker Proprietary and Confidential
13
Clustering Architectures
• Three architectures• Classical appliance (no real clustering)• Clustering over SAN (distributed locking)• Clustering via NAS switching (Spinnaker)
Spinnaker Proprietary and Confidential
14
Classical NAS–Automounter
Automounted name
Appliance1
Appliance2
Appliance3
proj
A B
B1 B2 B3 A1 A2 A3
A
proj B C
C
B3A2B1
Spinnaker Proprietary and Confidential
15
Classical NASStrengths & Weaknesses
• Strengths• simple, if growth is very low
• Weaknesses• hard to manage growth past 5-10 servers• no real CoS management
• because no transparent data movement• no performance scaling to single export
Spinnaker Proprietary and Confidential
16
Distributed Locking – Cluster via SAN
DistServer 1
DistServer2
DistServer 3
proj
A B
DistServer4
B1 B2 B3A1 A2 A3
XLock Server
Spinnaker Proprietary and Confidential
17
Distributed Locking Strengths and Weaknesses
• Strengths• works best when you need > 400 MB/sec R/W BW
• to small set of very large files• handles online growth very easily
• add more space to existing storage pool (only)
• Weaknesses• performance typically poor for “normal” sized files
• multi-megabyte before locking overhead amortized• don’t scale more than 4-8 machines in a cluster
• locking overhead increases as servers increase• no real CoS management
• ever-growing storage pool has single CoS
Spinnaker Proprietary and Confidential
18
Spinnaker NAS Switch – NAS Clustering
Location independence Class of service Atomic move Mirrors, snapshots
Unix workstation
Windowsdesktop
UNIXworkstation
Windowsdesktop
SpinServer 1
SpinServer2
SpinServer 3 acct
Q1 Q2 random
P1 P2
Q1 Q2 acct random P1 P2
Spinnaker Proprietary and Confidential
19
Spinnaker NAS SwitchStrengths and Weaknesses
• Strengths• scales to hundreds of machines
• scales like a switch (fixed costs for going remote)• no global lock contention• move VFSes easily between SPs with differing CoS• allows differentiation on
• RAID level, drive abilities• failover status• server expected load, speed
• flexible data management• entire configuration can change online, transparently
• Weaknesses• bounded performance to single file
Spinnaker Proprietary and Confidential
20
Sales Slide (Caution: Colors!)
• Faster than competition• SpinServer 4100 is 1.4X NetApp F960
• Lower TCO than competition• Less than ½ the price of NetApp F960
• both acquisition and 3 year TCO costs.
• More features than competition• NAS switching cluster implementation• 1000s of snapshots• Works as NAS gateway
• to third-party storage arrays and SANs• Select mirror, snapshot granularity on VFS basis• Dynamic, online data movement within cluster