Solving the Storage Capacity
Crisis – Tools And Practices
For Effective Management
Tony PearsonIBM Master Inventor and Senior Managing [email protected]
Interactivity Tips
1. Ask A Question
2. Download a PDF copy of today’s presentation
3. Social Networking Tools
About the Speaker
Mr. Tony Pearson
Master Inventor,
Senior Managing Consultant
IBM System Storage
Tony Pearson is a Master Inventor and Senior managing consultant for the IBM System Storage™ product line. Tony joined
IBM Corporation in 1986 in Tucson, Arizona, USA, and has lived there ever since. In his current role, Tony presents briefings on storage topics covering the entire System Storage product line, Tivoli storage software products, and topics related to Cloud
Computing. He interacts with clients, speaks at conferences and events, and leads client workshops to help clients with strategic planning for IBM’s integrated set of storage management software, hardware, and virtualization products.
Tony writes the “Inside System Storage” blog, which is read by hundreds of clients, IBM sales reps and IBM Business Partners every week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1
most read IBM blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume I through IV.
Over the past years, Tony has worked in development, marketing and customer care positions for various storage hardware and software products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in
Electrical Engineering, both from the University of Arizona. Tony holds 19 IBM patents for inventions on storage hardware and software products.
9000 S. Rita RoadBldg 9070 Mail 9070Tucson, AZ 85744
+1 520-799-4309 (Office)
Tony Pearson
Master Inventor, Senior Managing Consultant
IBM System Storage™
Marketing Promotion
• The problems that used to keep storage managers awa ke at night – power, cooling and physical footprint – are being successfu lly addressed by technology, but a more vexing issue still remains: How to get more out of the limited supply of skilled storage management pr ofessionals.
• Demand for storage capacity continues to grow far f aster than the pool of people to manage it. With no end in sight to data g rowth, businesses need to apply technology and practices that distribute m anagement responsibility to the people who need storage, and multiply the vo lumes of storage that skilled professionals can handle.
• In this presentation, IBM Master Inventor Tony Pearson b rings you up to speed on the best practices and new tools that are enabling leaps in productivity. He outlines a three-pronged approach to solving the storage capacity crisis:
– Abandon the Craftsman Approach. Storage administrat ors need to discard some long-held myths about storage management and adopt new ways of thinking that enable them to handle significantly greater capacit y.
– Adopt software tools. Computers can now provide unp recedented guidance on storage optimization so that people don’t have to. Policy-based management, smart provisioning and automated tiering are among t he innovations that are powering leaps in productivity.
– Consider self-service portals. Companies are now exp loring the self-service capabilities of private and public clouds. However, organizations need to adopt policies and limits in place to create an atmospher e of trust that enables efficient self-provisioning for storage.
Pharma
Telco
Government
Retail
Finance
…industries need to harness this data todeliver better and faster business outcomes
Digital Information is Driving
Exponential Growth in Data
Churn100K records/sec 9B/day10 ms/decision
Drug, TreatmentMillions of SNPs1000’s patientsFrom weeks to days
Risk, StabilityPBs of dataDeeper analysisNightly to hourly
Cyber Security600,000 docs/sec50B/day1-2 ms/decision
Consumer Insight100Ms documentsMillions of InfluencersDaily re-analysis
6
The Impact of Growth is Being Felt
� Structured data growing at 32%(databases for transactional workloads)
� Unstructured data growing at 63%(such as user files, medical images, web and rich media content)
� Replicated data growing at 49%(including backup, archive, discovery and business continuance)
Sources: IDC worldwide enterprise disk in Exabytes from “Changing Enterprise Data Profile”, December 2007
Replicated dataUnstructured dataTraditional Structured data
25.0
20.0
15.0
10.0
5.0
Exabyte
s
Information Infrastructure is doubling every 18 mon ths…
7
Source: TheInfoPro Storage Study (Q4 2009), n=186. *Note that due to multiple responses per interview, total exceeds100%. This is a partial list of responses received, showing only the top 5 issues.
Managing Complexity
Backup Administrationand Management
Managing Costs
Proper Capacity Forecastingand Storage Reporting
Managing Storage Growth
0% 20% 40% 60%
Top Issues for Storage Managers
Clients are Struggling to Keep Up
8
A Fundamental Shift in Costs
New IT Hardware Spend
IT Power and Cooling
Management and Administration
Hardware is cheaper…but administration isn’t
Source: IDC, 2012
9
Agenda
Abandon the Craftsman Approach
Leverage Software Tools for Automation
Consider Self-Service Portals
10
Long-held Myths of Storage
• End users should dictate which storage their data resides on
• Mission Critical apps must be hand placed on…
– Block storage, not NAS– RAID1, not RAID5/6– 15K RPM drives, not 10K or
7200 RPM drives– Outer edges of the rotating disk
• If Tier 1 storage is good enough for Mission Critical apps, it’s good for all other data also
11
Four Fundamental Truths Basis for Information Lifecycle Management
• All data, when created, does not have equal value
• Information changes in business value and in service level requirements over time
• IT resources should be allocated according to the value of data
• Information must be managed throughout its entire lifespan …data outlives media
0
20
40
60
80
100
1 w 2 w 3 w 4 w 3 m 6 m 9 m 1 yr 2 yr 5 yr 10 yr
Da
ta V
alu
e
Age of Data
Machine data
EMR
Database
Surveillance Video
12
Mission Critical
Business Critical
Business Operational
General Business
app/data type
Platinum Gold Silver Bronze
app/data type
app/data type
app/data type
app/data type
app/data type
Service Level Agreements
• Align business requirements to 3-5 Information Classes
• Establish policies to map Information Classes to Service Level Agreements
• Deploy well-differentiated Tiers of Storage that satisfy these Service Level Agreements
Tiers of Storage
13
Automate Data Placement and
MigrationIBM Active Cloud Engine™
Initial placement
SAS
NL-SAS
180 days
30 days
File creation
IBM SONAS orStorwize V7000 Unified
Optional TSM/HSMServer & Virtual or Physical Tape Pool
14
15
Automated Sub-Volume Tiering
� IBM Easy Tier– Automatic movement of sub-volume extents
between SSD, SAS and NL-SAS media
– Small amount of SSD can provide huge
performance gains
– Up and down tier
– Available on various IBM storage products
– DS8000
– SAN Volume Controller (SVC)
– Storwize V7000
– Transparent to applications
SSD RAID Array(s)
FC/SAS RAID Array(s)
SATA/NL RAID Array(s)
15
16
Application
Transactions
Easy Tier
Learning
Easy Tier
In Action
240% from
Original
brokerage
transaction
Easy Tier Application Transaction
Improvement
�No change to the database or application
�No work to identify active indexes
�No manual movement of files or volumes
� Just turn it on and let it work!
16
17
• I/O Priority Manager aligns service levels to separate workloads in the system–Administrators select from 4
Performance Groups (service levels) to assign to each workload
–System resources are dynamically allocated to higher priority volumes during resource contention
I/O Priority Manager (QoS)
Performance when and where you need it -- DS8000 and XIV Gen3
Performance when and where you need it -- DS8000 and XIV Gen3
17
Agenda
Abandon the Craftsman Approach
Leverage Software Tools for Automation
Consider Self-Service Portals
18
Embrace Automation
• How are you spending your time?
– Spreadsheets to track your storage assets?
– VISIO diagrams of storage fabric connections?
– Writing scripts that you run only once?
– Fighting fires?– Making reports pretty for
upper management?
19
Different Perspectives
Device Perspective:Looking at storage environment from the device level, for performance and replication functions
Data Perspective:Looking at storage environment from the host level, for data stored in file
systems and databases
Fabric Perspective:Looking at storage environment from the
fabric level, how it all gets connected together
20
IBM’s “Single Pane of Glass”
Strategy
Small CompanyNo formal IT dept� IT managed by
non-IT personnel� Manage a few
storage devices Medium-Size CompanyCentralized IT Dept� IT managers handle
servers, storage, networks, backups and perhaps even databases
Large EnterpriseData Center Ops� Server Admins� Network Admins� Storage Admins
Browser-based GUI for each
storage device
Storage Control Plug-in
IBM Tivoli Storage Productivity Center
21
Virtualize Your Infrastructure
22
Virtual Server
Infrastructure
Virtual Storage
InfrastructureStorage Hypervisor
Midrange
Storwize V7000Enterprise
SAN Volume ControllerTivoli Storage Productivity
Center
22
TPC 5.1 - Single dashboard for the SAN
Hover-over health status for individual components
Aggregated health status for all components in group
Hyperlinks for fast navigation
Bread-crumb trail navigation
Clear and simple to use hover-over menu items
NEW!
23
Performance at a Glance
Display resources associated with this data path
Icon based navigation
View backend device performance as part of your day to day dashboard
Quick access to alerts for devices
� Near real-time monitoring
� View performance data for all components
� Discover Bottlenecks
� Reduce time to problem isolation and resolution
24
Tivoli Common Reporting
Enhanced with Cognos
• Data Abstraction- Modeled Tivoli data makes report creation/customization simple for customers
• Simplified report editing- Run an out-of-the-box report, and launch the editor in context to make changes
• Ad-Hoc Reporting- Novice users can rapidly create reports with intuitive drag & drop function via the Query Studio
• Other capabilities- e-mailing of reports- Additional report formats (XML, CSV)- Greater granular data security- And more...
Brings industry leading reporting suite to Tivoli customers at no additional charge
25
Datacenter Tiering
� Policy-driven Information Lifecycle Management (ILM)
– Leveraging virtualization technology to provide recommendations for storage re-location
– Based on file system level data, performance and capacity utilization
– Developed by IBM Research and has been deployed by IBM GTS to manage storage assets
� Benefits– Ensures only highest performing
workloads are allocated to most expensive storage
– Enterprise wide datacenter storage tiering solution complementary to Easy Tier technology
High
Capacity
HDD
High
Performance
HDD
SSD
LUNs
Storage
pools Tier 1Tier 0 Tier 2
26
IBM Tivoli Storage Productivity Center family
• Gain comprehensive insights for improved service delivery
• Understand your environment from the device, fabric and host perspective
• Manage SAN through policy-driven recommendations
• Analyze your environment against SAN best practices
• Establish and achieve storage service level agreements
• Performance thresholds and fault alerting enable proactive management
• Optimize resource utilization for enhanced return on storage investments
• Intelligent migration of data to balance performance with costs
27
Agenda
Abandon the Craftsman Approach
Leverage Software Tools for Automation
Consider Self-Service Portals
28
What if IT were like a Vending
Machine?
• IT staff stocks the machine with standard offerings
– Based on information class and service level agreements
– Proactive management
• Business units choose the right offering based on their needs and budget
– Self-service– Pay-per-use
29
IBM’s Intelligent Storage Service
Catalog (ISSC)
• Unique demand-based approach to storage
– Analyze usage into 15-20 standard data types
– Define key performance indicators (KPI)
– Enable storage governance
• Client Benefits– Increases storage utilization – Simplifies storage allocation
processes– Implements enforceable
standards
30
IBM SmartCloud Enterprise
• Self-service access to storage
– Desktop, Laptop or Mobile
– Shared and Individual folders
• Use IBM’s public cloud storage, or your own storage on premises
IBM SmartCloudObject Storage
Windows, Mac,iPad, iPhone, Android
CIFS, NFS
Public Cloud
Private Cloud
31
Summary
• Cost associated with managing and administering storage has become the largest part of IT budgets
• IT staff need to abandon the craftsman approach, and leverage software automation to meet business requirements
• Consider self-service and pay-per-use delivery models to standardize offerings
32
Additional Resources
35
Email:[email protected]
Twitter:http://twitter.com/az99Øtony
Blog: http://ibm.co/brAeZØ
Books:http://www.lulu.com/spotlight/99Ø_tony
IBM Expert Network:http://www.slideshare.net/az99Øtony
35
Trademarks and disclaimersAdobe, the Adobe logo, PostScript, and the PostScri pt logo are either registered trademarks or tradema rks of Adobe Systems Incorporated in the United Sta tes, and/or other countries. IT Infrastructure Library is a register ed trademark of the Central Computer and Telecommun ications Agency which is now part of the Office of Government Commerce. Intel, Intel logo, Intel Inside, Intel I nside logo, Intel Centrino, Intel Centrino logo, Cel eron, Intel Xeon, Intel SpeedStep, Itanium, and Pen tium are trademarks or registered trademarks of Intel Corporation or its s ubsidiaries in the United States and other countrie s. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windo ws NT, and the Windows logo are trademarks of Micro soft Corporation in the United States, other countr ies, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Offi ce. UNIX is a registered trademark of The Open Group in the Unite d States and other countries. Java and all Java-bas ed trademarks and logos are trademarks or registere d trademarks of Oracle and/or its affiliates. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc . in the United States, other countries, or both an d is used under license therefrom. Linear Tape-Open, LTO, the LTO Logo, Ult rium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries.
Other product and service names might be trademarks of IBM or other companies. Information is provide d "AS IS" without warranty of any kind.
The customer examples described are presented as il lustrations of how those customers have used IBM pr oducts and the results they may have achieved. Actu al environmental costs and performance characteristics may vary by customer.
Information concerning non-IBM products was obtaine d from a supplier of these products, published anno uncement material, or other publicly available sour ces and does not constitute an endorsement of such products by IBM. Sources for non-IBM list prices and performance num bers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM h as not tested these products and cannot confirm the accuracy of performance, capability, or any other c laims related to non-IBM products. Questions on the capability of non-IBM products should be addressed to the suppli er of those products.
All statements regarding IBM future direction and i ntent are subject to change or withdrawal without n otice, and represent goals and objectives only.
Some information addresses anticipated future capab ilities. Such information is not intended as a defin itive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presen ted here to communicate IBM's current investment and developmen t activities as a good faith effort to help with ou r customers' future planning.
Performance is based on measurements and projection s using standard IBM benchmarks in a controlled env ironment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user' s job stream, the I/O configuration, the storage co nfiguration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve thro ughput or performance improvements equivalent to th e ratios stated here.
Prices are suggested U.S. list prices and are subje ct to change without notice. Starting price may not include a hard drive, operating system or other fe atures. Contact your IBM representative or Business Partner for the most current pricing in your geography.
Photographs shown may be engineering prototypes. Ch anges may be incorporated in production models.
© IBM Corporation 2012. All rights reserved.References in this document to IBM products or serv ices do not imply that IBM intends to make them ava ilable in every country.
Trademarks of International Business Machines Corpo ration in the United States, other countries, or bot h can be found on the World Wide Web at http://www.ibm.com/legal/copytrade.shtml .
ZSP03490-USEN-00
36