1© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Service Oriented Data Center(SODC)
Sidney MorganManager, IT
2© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Agenda
IT Goals
Cisco Current Data Center View
Q & A
Technology Areas of Focus
Service Oriented Data Center
3© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Cisco IT Goals
Enable Cisco Business Strategy• Deliver services rapidly using an on-
demand utility computing model
Drive Productivity• Drive automation by removing the
complexity out of the Infrastructure
Showcase Cisco Technology• Share Cisco’s IT experience with
Customers
4© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Cisco Data Center Goals
Optimize TCO• Consolidate Data Centers
• Life Cycle Management
• Data Center Standards
Business Agility• On Demand Utility
• Rapid Delivery of Services
• Enabler of Business Goals
Business Continuance• Security
• Active-Active Architecture
• Virtual OS and Application Layers
5© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Current Data Center Overview
6© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Cisco Production Data Centers
SJ-12SJ-CLinksys
RTP 5
Amsterdam
Sydney
Production Data CenterData Centers Development Data Center
7© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Cisco Data Center Trends
FutureTodayStandards Based EnvironmentHeterogeneous Environment
Rigid User Environment Flexible User Environment
Self-Defending Data CenterApplication Specific Security
Intelligent Network ServicesMulti-Services Network
Network Virtualized StorageSAN and NAS Storage
Dynamic Compute ResourcesDedicated Compute Resources
Policy Based ManagementApplication Specific Management
8© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Cisco Data Center Landscape
• Overall population of 7,000 servers
• Cisco currently has one SA for every 80 servers
• Server environment and ratio will continue to grow
• Heterogeneous environment with multiple hardware vendors
• Multiple OS environments
Solaris 2,52636%
Windows1,756 25%
Linux 2,538 37%
HPUX166 2%
Source: Cisco IT, October 2005
9© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Cisco Data Center Storage Landscape
• Currently, Cisco IT supports nearly 3.9 PB of “raw” storage
• Roughly split between SAN (EMC) and NAS (NetApp)
• Growth Rates: FY’02=69%, FY’03=32%, FY’04=28%, FY’05=86%
• Managed storage per FTE (constant): ~200 TB
0
500
1000
1500
2000
2500
FY'01 FY'02 FY'03 FY'04 FY'05
DAS
NAS
SAN
10© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Service Oriented Data CenterOverview
11© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Service Oriented Data Center (SODC)
ServiceOriented
Data CenterVision
Vision EnablersSoftwareTechnology
BusinessProcessesPeople Hardware
Technology
SODC Target StateA Highly Automated, Services Based, Secure, Virtual Environment Where Resources Are Allocated Through an Intelligent Network Fabric Founded on Structured Policies That Enable Tight Alignment With Cisco’s Business Goals
12© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Service Oriented Data Center Roadmap
20052004 2006 2008
• Infrastructure Consolidation
• SAN Virtualization
• Centralized Resources
• OS• Improve
Utilization• Centralize DC
• Infrastructure aligned to BU
• Storage Silos• Manual Patches• Heterogeneous
OS• Low Utilization• Element
Management• Distributed DC
• Infrastructure aligned to application
• Active SAN/NAS Virtualization
• Virtual• Common OS• Automated
Purposing• Fabric
Management
• Infrastructure aligned to Service
• Automated Application
• Policy Based• Utility model• Policy Based
Management• Self Purposing• Optimized TCO
LegacyData Center
VirtualData Center
Service OrientedData Center
CurrentData Center
Consolidation Phase Virtualization Phase Automation Phase
13© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Service Oriented Data Center Model
SODC Utility Pool
SODC
Demand
Supply
Business Goals
SODC Intelligent
Management Fabric
(IME/VFrame 4.0)
SODC Vision:• Highly Automated Virtual
Environment
Main Objectives:• Drive Productivity• Enable Cisco Business• Optimize TCO• Show case Cisco
Main Requirements:• Availability• Scalability• Flexibility• Business Continuance• Security
14© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Physical SODC Architecture
Site Backbone Router
Data Center Distribution GW
Access Switches
Blade Server with Cisco SFS Module or Ethernet Switch
MDS9509
SANStorage
NASGateways
1RU Servers
A1 2
A1 2
A1 2
FibreChannel
6500 Series
65xx
FibreChannel
MDS9509
iSCSI
iSCSI
Intelligent SAN withVirtualization,Replication,Serverless BackupFCIP SAN Extension
A
12
A1 2
Backup Master Server(s)
Backup Media Server(s)TapeLibrary
NAS Filer(s)
Shared Network Services (CSM, SSL, FWSM, AONS)
6500 Series
6500 Series
15© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Service Oriented Data CenterSystems
16© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Systems Architecture Summary
• Data Center PODs are a way to reduce TCO by reducing cost and complexity in Data Center server environments
• Data Center PODs will improved productivity and agility to respond to the business environment
• Cisco is working to Standardizeon commodity server racks and Blade Technology
• Cisco is committed to maximize ROI on the infrastructure investment in the Data Center
17© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Logical SODC Systems Architecture
Current StateMultiple Managed Environments
Future StateSingle Managed Environment
Inconsistent Processes (Automated And Manual) And Silo’d Physical Infrastructures
Consistent AutomatedProcesses
11i
EIR
CCI/CCX
SODCVirtualization
18© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Systems Purposing
• Specific resources selected from pools• VLANs are configured• Macros are played• SAN is zoned• Servers get booted with assigned image• Application(s) are started• Traffic into logical network turned “on”
Phys
ical
PO
DVi
rtua
l PO
D
19© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Physical SODC Systems ArchitectureData Center Distribution GW
Shared Network Services (CSM, SSL, FWSM, AONS)
SODC Service POD
Data Center Distribution GW
6500Series
10 Gig10 Gig
30 1RU 30 1RU 30 1RU 30 1RUCAT 4948 CAT 4948
CAT 4948 Out of Band
Management
CAT 4948 Out of Band
Management
CAT 4948 CAT 4948
6500Series
6500Series
6500Series
20© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Service Oriented Data CenterVirtualization
21© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Virtualization Architecture Summary
• Virtual Environments provide ServicesClients consume ServicesVirtual Environments consume physical infrastructureService Level Objectives determine Virtual Environments (performance and availability)
• Virtual Environments can consume different numbers of resources
Storage, Processor, Network, Databases, ApplicationsMultiple physical servers (scale-out or high availability) “Transparent Workload Distribution”A fraction of a single server (Software Partitioning, Emulation) “VMware, Xen, and Server Virtual Partitioning”
• Virtual Environments will optimize over timeChanges are transparent to clientsPerformance and availability requirements are achievedThe efficiency of the environment is increased dramatically
22© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Logical SODC Virtual Architecture
SOD
C M
anag
emen
t Fab
ric
SOD
C M
anag
emen
t Fab
ric
Storage Architecture
Intelligent Network Fabric
Physical Data Center
Operating System Architecture
Business Application Services
Infrastructure Services
OS Workflow Management
23© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Virtualization Vision
SODC Management
Fabric
Server Fabric
Network Fabric
Storage Fabric
Applications
Security
Security
Security
Security
Security
SODC FabricResources• Processor
Virtualization
• Storage Virtualization
• Network Virtualization
• Shared Services Virtualization
• File Virtualization
24© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Virtual Environment
Defines:
• Everything required for complete/correct operation
• Everything needed for optimal resource selection
Includes:
• References to the O.S. and application images
• Service Level Objectives including high availability and performance objectives
• Dependencies on other entities; for example:Storage and Network (connectivity and locality)
Processors (utility grid)
Infrastructure Services (Databases)
25© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Infrastructure Virtualization
WANMAN
Silver Servers
Platinum Servers
Bronze Servers
SilverStorage
Platinum Storage
BronzeStorage
SODC NetworkFabric
SODC, SAN, Fabric
SODC Systems FabricVFrame 4.0
IntelligentManagement
Fabric
GoldStorage
Server Virtualization
Low Latency RDMA and DAPL Services
Virtual I/O
Clustering
Grid/Utility Computing
Fabric Routing
Data Replication
Storage Virtualization
Virtual Fabrics (VSANs)
SSL TerminationVPN Termination
Firewall ServicesIntrusion Detection
Server Balancing
GoldServers
Internet
26© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Service Oriented Data CenterNetwork
27© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Network Architecture Summary
• Enhance IP Network Security and its Integration into a Self-Defending Infrastructure
• Maximize Network Effect Multiplier for the Service Oriented Network Architecture
• Simplify, Standardize and Converge Infrastructure, Applications and Services
• Drive Autonomous and Virtual Infrastructure Architecture
• Provide Greater Business Agility for New Technologies and Applications
28© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Network Components
Services Virtualization
Automated Purposing
Routing and Switching
Low Latency Switching
Low Latency Ethernet
Integrated Security
High Availability
Application Aware
29© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC n-tier Datacenter Network
Physical Logical
Web Servers
DatabaseServers
Storage
AppServersEdge
Core
30© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Network Physical Layout
• Any subnet/VLAN, any switch
• Enables L4–L7 deployments with full redundancy
• Layer 2 interfaces on gateways result in 30-second spanning-tree outages during gateway upgrade
Hosts Requiring Redundant NIC
Host Not Requiring Redundant NIC
Standby Link for Redundant Interface
SW3SW2SW1
L3 LAN CORE
1/1 1/1 3/13/1
1/2,3/2 1/2,3/2Service
Switch with CSM
Service Switch with
CSM
L3 Distribution
GW1
L3 Distribution
GW1
Access Layer (L2 STP)
31© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC SFS Architecture
SODCSAN
Fabric
SODCInn
Fabric
SFS 3012 SFS 3012
10 Gig
SFS 700020 HCAHosts
CAT4948Out of Band Management20 HCA Hosts
SFS 7000
CAT4948Out of Band Management20 HCA Hosts
SFS 7000
CAT4948Out of Band
Management20 HCA Hosts
20 HCAHosts
SFS 700020 HCA
Hosts
SFS 7008 SFS 7008
10 Gig
32© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Service Oriented Data CenterStorage
33© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Storage Architecture Summary
• Disk is relatively cheap, but storage and storage management is expensive
• Growth is still rampant; datacenter space is at a premium
• Poor storage utilization is a serious problem at Cisco, creating an enormous ROI potential
• Cisco IT is focusing on creating a consolidated storage utility using Cisco’s own end-to-end storage networking solutions
• The consolidated storage utility allows a company to significantly lower overall TCO by providing storage when needed, as needed and at appropriate service and cost levels
34© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC MDS SAN Switch Benefits
Availability• More ports to support multiple paths between servers
and storage • Non-disruptive upgrades• Advanced troubleshooting and diagnostics• VSANs to segregate traffic and management
Data center crowding• Multi-protocol support allows primary storage to be
located in remote data centers
Cost reduction• SAN consolidation using VSANs to increase storage
utilization by sharing each storage frame among many servers and business units
Intelligent SAN fabric services• Virtualization, Continuous Data Protection, Replication
Improved performance• A fully non-blocking architecture• Intelligent traffic management (QoS, FC congestion
control)
35© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Storage Architecture
IP WAN
Campus/Site (1) Wide Low Latency MDS FC SAN Fabric
Cisco IP LAN
NAS Gateways
DWDM, CWDMOr Dark Fibre
Datacenter 1 Datacenter n
PLATINUM GOLD SILVER BRONZECampus/Site (n) wide low latency
MDS FC SAN Fabric
Cisco FileEngines
FCIP
Cisco FileEngines
Small RemoteSite(s)
CIFSNFS
iSCSIFCWAFS
FCIP
A minimal Number of Large, Automated, Fully Networked, Tiered Storage Pool(s) with no Physical Ties Between Hosts, Applications and Storage(i.e., Virtualized)
36© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Service Oriented Data CenterManagement
37© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC ManagementSummary
• Standardized infrastructure components (network, server and storage)
• Utility computing model
• Spare pool resource management
• On-demand service purposing of all infrastructure and application components via an automated workflow
• Automated service assurance configuration
• VFrame and IME instances perDC for localized control
38© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Management Benefits
• Manage the data center from a service-oriented perspective• Reduce the number of layers/devices required to
be purposed• Data Center infrastructure is one manageable entity of
shared virtualized resources• Expose a single orchestration and purposing interface for
all data center infrastructure• Dramatically reduce TCO through Operational Excellence
39© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Provisioning Framework
SJC-KSJC-12
Brussels
Bangalore
Amsterdam Tokyo
Richardson
Boxborough
RTP
London
Singapore
HongKong
EMAN Database
Sydney
• Globally Consistent Infrastructure• Globally Managed Infrastructure State
40© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Management ArchitectureGUI APIs (XML, SOAP, etc.)GUI APIs (XML, SOAP, etc.)Access
Role Based Administrative ControlSecurity
Application Compute Storage SecurityNetworkDomains
VirtualizationProvisioning Performance Accounting SecurityAvailabilityServices
Orchestration
Net
wor
k I/O
Virt
ualiz
atio
n
Perf
orm
ance
M
anag
emen
t
P2V
Map
ping
Rep
ortin
g
Stor
age
Virt
ualiz
atio
n
Mon
itorin
g
Logi
cal
Net
wor
ks
Dis
aste
r R
ecov
ery
Virt
ual
Mac
hine
s
Imag
e M
anag
emen
t
Boo
t Se
rvic
es
Dis
cove
ry
Serv
ices
Serv
erVi
rtua
lizat
ion
Capabilities
SFS
Catalyst 6000MDS
Cisco Platforms Cisco Modules
Rack ServersBlade ServersLinux / Windows
Catalyst (CSM, FWSM, Trinity)
MDS (IPS, SSM)
SAN
Provisioning
Security
Compute TechnologyInfiniBandEthernetFibre Channel Security
Other
LAN/WANResources
41© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC ISM Integration
ISM Distributed SODCw/VFrame/IME
New Hosts and Network Device Configuration Discovery
Service Node Failover
Allocation of Spare Pool Servers for New Services
Image and Template Distribution
Service Provisioning
Service Monitoring and Alerting
Service Provisioning Applications
Monitoring, Data Collection, Change
Management
IPAM/DNS
Global Inventory, image and
template masters
42© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Service Oriented Data CenterSecurity
43© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC SecuritySummary
• End-to-end services accounting• User behavior understood• Data center modularized• Secure Compartmentalized
Information Center (SCIF)• Asset accounting• Standards and regulations
easier to support• AAA and intellectual property
data not mixed in with potentially unsecure services
44© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Cisco Infrastructure Security Guidelines
• Develop an integrated, active security infrastructure
• Set and manage SODC security standards
• Operate at a known and acceptable level of risk
• Manage your conformance to external regulations
• Implement security governance
• Create a security-aware culture
45© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Security Architecture
Network Storage
Unix Servers w/CSA
Call Managers w/CSA
Decru Datafort
Protego/nFSyslog
Collector
NetSonarNetRanger
VPN Users
Tripwire
IP ACL and NAC
Tripwire
Tripwire
DMZ
LAN
Dial-in Users
Infra Connect
WiFi users
ACS Servers
Win Servers w/CSA
46© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
SODC Security Architecture
Wan Connection
Secure Servers
IDS
NetForensics Agent
FSMPix
Syslog Collector
NetSonar
DMZ
LAN
DC
DC
FSM
Security SCIF
Event Server
Security Stds Server
IP Server
Repository
DCSS Security Lab
VulnTest Server
CertTest Server
PolicyTest Server
AuditTest Server
KMITest Server
SecReportTest
Server
47© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Q and A
48© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public
Further Data Center Resources
http://www.cisco.com/en/US/about/ciscoitatwork/case_studies.htmlCase Studies
Operational Practices and Design Guideshttp://www.cisco.com/en/US/about/ciscoitatwork/data_center_op.htmlhttp://www.cisco.com/en/US/netsol/ns340/ns394/ns165/ns391/networking_solutions_design_guidances_list.html
Call to Get Product, Solution and Financing Information1-800-745-8308 ext 4699
Order Resourceshttp://cisco.com/en/US/ordering/index.shtml
49© 2005 Cisco Systems, Inc. All rights reserved. Cisco Public