Grid Enabled Services Infrastructure
(GESI)
Transformation from the Global Information Grid (GIG) to Net-Centric Environment (NCE)
Background
Office of the Secretary of Defense for Networks & Information Integration (OSD NII) presented a roadmap for transformation of the Global Information Grid (GIG) to the Net-Centric Environment (NCE).
DoD NCE Grid Computing The Net-Centric Environment (NCE) “grid” is envisioned as a federation of distributed computing resources available over local and wide area networks that appear to an end user or application as one large virtual computing system.
NCE Grid Computing will be built on pervasive services oriented Internet standards which will allow the DoD to share computing and information resources across departmental and organizational boundaries in a secure, highly efficient manner.
source: John Daly Department of Defense Computing Infrastructure Brief NCOIC Stakeholder Outreach Working Group, 6 December 2007 http://colab.cim3.net/file/work/SICoP/Virtualization/2007-12-06/JDaly12062007.pdf
Technology Enablers of the NCE
Technology
NCE will be based on business approaches and technology solutions.
Clustering• Collection of computer, storage and application resources in a
fixed configuration designed to be operated and managed in a unified, high-performance manner.
Server Virtualization• Provides the ability to deploy a discrete number of “virtual
machines” on a single hardware platform.Network Virtualization
• Allows for the establishment of Virtual LANs (VLANs) between servers.
Storage Virtualization• Pooling of physical storage from multiple network storage
devices into what appears to be a single storage device that is managed from a central console
Agile Architectural Framework• Providing a very agile grid framework upon which to build a
Service Oriented Architecture (SOA)
An enterprise system:• 7-node Oracle Real Application Clusters (RAC)• 70TB total storage available, 30TB used for database and
content storage• High-Availability Clustered JBoss Application Servers
Recognized for its success and quality:• Recognized for Technical Achievement, noting superior
operational support• OCIO confirmed SOA implementation compliance, supporting
scalable, cost-effective architecture goalsDeployed Architecture continues to successfully demonstrate:
• Scalability – Increased workload from 18k documents per day in 3/06 to over 100k in 3/07.
• User Buy-In - A 600% increase in unique users since going operational
• Technology enhancement
Booz Allen Hamilton Has Proven Expertise in Document Management within Federal Government spaces
BackgroundIn April 2004, our Document Management pilot capability became an accredited and operational capability
Approaching power/AC/space limitations
Handling increasing data and growing user base
Inevitable system load spikes
Peak load can be orders of magnitude greater than the average load
Satisfying stability, availability, and agility requirements
Updating antiquated technology solutions
Paying unreasonable maintenance costs, which tie up budgets
IT professionals / expertise unavailable
What are your current technical challenges?
In 2006, humans created 161 exabytes of data, 3 million times the information in all
books ever written.- IDC US Green IT Survey
“”
The demand for computing, network and storage resources shows no signs of decreasing
Facts Individual components are not
expensive enough…yet:
Compute Power, Storage, Energy
Hardware used to compensate for poor software design
Demand for Information Technology is still growing
Effectiveness ≠ Efficiency
source: “Improving Data Center Energy Efficiency: A Holistic Approach”, Andrew Kurz, Burton Group (September 2007)
The significant problems we face cannot be solved by the same level of thinking that
created them.- Albert Einstein
“”
How did we get to this point?
Fallacies The network is reliable
Latency is zero
Bandwidth is infinite
The network is secure
Topology doesn’t change
There is one administrator
Transport cost is zero
The network is homogenousPeter Deutsch’s 8 Fallacies of Distributed Computing
Enterprise systems are struggling with the accidental complexity
Current Data Center Capacity Planning
Current Data Center development paradigms lead to large amounts of under-utilized siloed resources
5% UtilizationDedicated
Servers
DedicatedStorage
System A
Pre-Apportioned Storage
Operating Sys
Application 1
Application 27%
Utilization
DedicatedServers
DedicatedStorage
System B BIOS
Pre-Apportioned Storage
Application 3
Systems Hosted in Typical Data Center
Operating Sys
Application 1
Application 2
BIOS
Capacity Planning and GESI Architecture
Modular ArchitectureGESI allows servers and storage to be more efficiently utilized, reducing use of power and cooling resources
Operating Sys Dom 0
70% UtilizationShared Servers
Shared Storage
System ASystem B
BIOS
Systems Hosted on GESI Architechture
VM Node B1
Application BOperating Sys
VM B1
VM Node B2
Application BOperating Sys
VM B2
VM Node A1
Application AOperating Sys
VM A1
VM Node A2
Application AOperating Sys
VM A2
Node B1
Node B2
Node A1
Node A2
Operating Sys Dom 0
50% Utilization
BIOS
VM Node B3
Application BOperating Sys
VM B3
VM Node B4
Application BOperating Sys
VM B4
VM Node A3
Application AOperating Sys
VM A3
Node B4
Node B3
Node A3
Dynamically Allocated
Shared Storage
Task Centric Business Services
Entity Centric Business Services
Application Wrapper Services
Enterprise Services
SANs, Servers, Power, Cooling
Virtual Processing
Virtualization of Database
Virtual File System/Network
Storage, Processing, Throughput, Memory
Business Process Layer
Service Interface Layer
Applications Layer
Virtual Services Layer
Foundation Layer
Physical Layer
QO
S M
onito
ring/
Secu
rity
Complex heterogeneous entities can be decomposed Into simpler, individual components and responsibilities
How do you decouple the system components in your Enterprise Architecture?
First and foremost, a loosely coupled architecture allows you
to replace components, or change components, without
having to make reflective changes to other components in
the architecture/systems.- David Linthicum, SOA Magazine, October 2007
“
”
Commodity based approach
Low Start-Up and Maintenance Costs
Lower Technology Refresh Expenses
Open Source Promotes Faster Deployment
High Availability
Energy Efficient System Scaling – “Green”
Encourages Standardization
Open Standards = Business Process Agility
Reuse of Business Components
Agile Infrastructure
Virtualized Pools of Resources
Transparent Sharing of Distributed Resources by Multiple Clients
Realign current infrastructure
Reduce current footprint by powering down excess equipment
Reclaim previously wasted resources
Distributed Processing / Storage
“
An open architecture allows for the ability to add, upgrade and swap components
GESI Infrastructure
GESI is customizable to users’ initial requirements and scalable to users’ future requirements
An Integrated Architecture Solution
SOAOpen SourceOpen Standards InteroperabilityBusiness AgilityVirtualization –
Maximizing Resource Use
More SW across Less Hardware
High Availability
Extensible Load
Balancing Ability to Host
Multiple Databases and Legacy Databases
Remote Mgmt. Capability
Online Growth
Store File as a Globally Unique Identifier (Store once and only once)
Database StorageServices Integration
Architecture to Host:
Business Processes, Tools, Data Workflow
UI Components
Web Mash-Up (Ability to access multiple systems through single UI)
Multi-Tenants
Legacy Capabilities
Legacy Databases“By 2010, Enterprise Web Mash-Ups will be dominant (80%) for composite enterprise applications”
-Gartner Symposium, Orlando, October 2007
Cluster multiple physical servers to gain failover capabilities
source: “Automated failover and recovery of virtualized guests in Advanced Platform”, Rob Kenna, Redhat Magazine
What new challenges will server consolidation introduce?
Virtualization success depends on tight
cooperation between server, storage, network and
security teams.-Chris Wolf, Burton Group
CIO Magazine, “Virtualization in the Enterprise Survey”
“”
Share resources across physical servers
The combination of service, virtualization and grid techniques can reduce cost while also improving flexibility
GESI is part of a Service Oriented Architecture Foundation
Infrastructure Architecture is part of the SOA Alliance's SOA Foundation
As the Open Group Architecture Framework (TOGAF) states, good enterprise architecture brings important business benefits:
A more efficient IT operation: – Lower software development, support, and maintenance costs – Increased portability of applications – Improved interoperability and easier system and network management – Improved ability to address critical enterprise-wide issues like security – Easier upgrade and exchange of system components
Better return on existing investment, reduced risk for future investment: – Reduced complexity in IT infrastructure – Maximum return on investment in existing IT infrastructure – The flexibility to make, buy, or out-source IT solutions – Reduced risk overall in new investment, and the costs of IT ownership
Faster, simpler, and cheaper procurement: – Buying decisions are simpler, because the information governing
procurement is readily available in a coherent plan. – The procurement process is faster - maximizing procurement speed and
flexibility without sacrificing architectural coherence.
GESI provides the essential elements of a Service Oriented Infrastructure
SOI delivers bottom-line benefits to the enterprise. It
provides the basis for greater IT automation whichresults in higher IT
productivity and lower operational costs.
SOA Practitioner's Guide, part 2
“
”
Service Oriented InfrastructureMoving from a dedicated infrastructure to a dynamic infrastructure
Addresses all the aspects of the infrastructure– Networks, servers, data centers, and firewalls– Application infrastructure, security, monitoring,
middleware, etc.
Key elements – Life cycle support to manage the deployment of SOI
components– Virtualization of infrastructure resources to SOI users– Service management to assure the SOI solution provides
the required service characteristics
Combines architecture building blocks and role-based portals – High reuse of common services– Reuse of infrastructure and foundational components– Reduction in time needed to deliver capabilities
Benefits of the GESI Solution
Improve performance, availability, and cost-effectiveness of compute- and data-intensive applications
Run growing volume of complex, resource-intensive, high-performance computing jobs within existing distributed infrastructure
Provision additional capacity dynamically as it becomes available, and failover gracefully around unavailable capacity, without interrupting jobs in progress
Reduces total cost of ownership of ongoing information technology (IT) operations by making more efficient use of available computing , storage, and network capacity
Postpone the need for deployment of additional capacity to support growing transaction loads
Provision, scale, and reconfigure virtualized computing resources within a service-oriented environment
What are the benefits of a GESI solution?
Grids enable more flexible, dynamic resource sharing among diverse physical or
logical computing environments.
- Burton Group Grid Services, “Pooling Distributed Resources
for Virtual Supercomputing”
“”
GESI Physical LayerChristopher Dale [email protected]
Isaac Christoffersen [email protected]
Doug Johnson [email protected]
David Schillero [email protected]