Presented By Jon Toigo

CEO, Toigo Partners InternationalChairman, Data Management Institute

CapacityDemand

POWERUTILIZATI

ON

SERVICEEFFICIEN

CY

I/OTHROUGHPUT

COST

Let’s Talk About the Infrastruggle

Infrastruggle?

A term describing the broad array of challengesconfronting IT planners who seek a strategy thatwill contain cost while delivering improved service levels to the organization…

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Key Trends and DriversTactical Thinking

Architectural and purchasingdecisions neither fact-based

nor strategic/systemic

Accelerating storage capacity requirements by 300-650%through 2014…

Server Virtualization

Wasting up to 70% of every disk drive deployed…

Unmanaged DataGrowth

“Disk Everywhere” DogmaUsing roughly half of our disk infrastructure capacity to replicatedata stored on the other half…

Storage Clouds(Outsourcing) Hype“Great disk drive in the

sky” appeals until you look

at the facts…

Hardware Vendor Practices

Value-add software accelerates cost of commodity wares…

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Unmanaged Data is Growing

30% Active40% Inert15% Dark Storage10% Orphan5% Contraband

Maybe it’s time to defrag…(Or do a little data hygiene and archiving)

Are we filling disk with theright data?

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Impact of Server Virtualization

300%650%

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

“Disk Everywhere” Dogma

Replicated

File

Block

SOURCE: IDC

2005

3

2006

4

2007

5

2008

6

2009

9

2010

15

2011

21 Total ExternalStorage Capacity(Exabytes)

Omnia in Orbis taking its toll…

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Oversubscribed, Underutilized, Overbuilt

• The deconstruction of the traditional storage hierarchy continues…increasing cost

• And increasing management complexity by creating isolated islands of value-add storage functionality…

Thin ProvisioningMirroringPerformance Acceleration

Heterogeneous StorageDifferent Vendors, Different Value-Add Features

On-Array TieringMirroringContinuous Data Protection

SnapshotReplicationCompression

On-Array TieringSnapshot

Performance AccelerationMirroring

De-duplicationReplication

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

• The goal of on-array compression, de-duplication, thin provisioning, auto-tiering and even storage virtualization is to squeeze bits more efficiently onto storage media…

• Focused on “Capacity Allocation Efficiency”

The Real Issue is Capacity Utilization Efficiency

Managing Capacity May Help Cope with Storage Costs…Temporarily

What is the Value of “Value-Add”?Co

pyrig

ht ©

201

3 by

Jon

Toig

o. A

ll Ri

ghts

Res

erve

d.

In-Stat, 451 Group, Tier 1

Meanwhile, Storage Cloud Hype is Deafening

“There has been an increase in adoption of over 326% since 2010.”

–Info-Tech Research Group

Yet, in their own report…– 51% somewhat/strongly agree “no cloud

storage meets our business requirements”– 70% somewhat/strongly agree “concerned

about availability of cloud storage services”– 84% somewhat/strongly agree “concerned

about cost”– 83% somewhat/strongly agree “concerned

about security of data stored in the cloud”

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

The Great Disk Drive In the Sky

In case of rain, ensure that the provider can return your data via

tape

No standard on-ramps, APIs, management protocols, etc.

Pricing models vary. Common fees include installation fees, “overage” fees, etc.

Legalities of data storage and back-end replication (backup) - especially transnational - not tested…

Service levels unpredictable, including restoral timeframe following an outage event…

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Storage CloudsPart of the Bigger Cloud Space – PaaS*

• Services tied to specific server virtualization or proprietary hardware stack…

• Setting stage for another front in the Infrastruggle in 2012…

• Stand by for “Battle Clouds” (maybe a topic for next Storage Expo)

88% of “Cloud Storage” Use is Storage Behind Cloud-based Servers*** Platform as a Service** Info-Tech Research Group

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Tactical Decision-Making Doesn’t Help• A Strategic and Systemic View is Needed…

– Balancing technology vision and business requirements

– Arguably, the outcome of the infrastruggle will be decided here…

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

What’s Holding Back Good Decisions?

• “Low information” voters going for the shiny new thing…

• Reporting and research/analysis work is often shoddy…

• Failure to consult internal advisors (IT) on technology acquisition decisions…

• Lack of resources for pre-purchase pilots and tests…

• Peer “bullying” (Why are you so stupid for not following my guidance? – by analysts, vendors, speakers at conferences, etc.)…

• Laziness and overwork…

“So, when are you guys down in IT going to unplug all of the servers and storage?”

Based on survey sample of 99 respondents…326%year over year growth!

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

More Research Examples• Sample Size = 17

4.08 persons 9.01 persons 1.06 persons

Last year, analysts were emphasizing leadership of VMware in server hypervisor market (~58%), but failed to note that only 17-20% of servers were running hypervisor technology…

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Low Information + Old/New Marketing + Bullying = Poor Choices

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Friction Also Plays a Role• As in the impact of transaction costs in a

financial market (per 2009 Nobel Prize-winning Economist Oliver Williamson’s usage)…– Internal transaction costs: expensive

warranty & maintenance agreements, expensive replacement parts, requirement to take supplier-defined upgrade path, monopolistic relationship…

– External transaction costs: cost of money, utility power costs and availability, regulatory mandates, natural forces, breakage, press and analyst views, taxes, etc.

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Sources of Friction in Disk Infrastructure

Internal Transaction Costs• Proprietary controllers and value add

software• Signed drives and trays• Razor/razorblade pricing of

maintenance agreements• Lack of backward compatibility• Value Add obfuscates unified

management

External Transaction Costs• Marketing around brand name gear• Supposed supply shortages of drives

and components• Consolidation in disk array industry• Server virtualization• Data burgeon• Slow economic growth and budget

austerity

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

A Couple of Truisms

When internal transaction costs appear to be greater than

external transaction costs… business downsizing, often via

outsourcing, aka “clouds,” [is the typical outcome.]

Lock-in technologies carry Internal transaction costs that

worsen over time. Limited rationality and opportunistic

behavior often determinedecision making and other

behavior…

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Bottom Line: These Drivers Must Be Addressed…Or the Infrastruggle might wreak havoc and lead to the kinds of

career-ending disasters we all want to avoid

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Outline of an Infrastruggle Strategy in Six Parts1. Capacity growth and space reclamation

strategies2. Cross-platform storage monitoring and

management: the real “unified storage”3. Storage virtualization to extend the service

life of installed gear4. Smarter storage pooling by service

requirement: capture storage versus retention storage

5. Energy-centric metrics in storage design6. Common-sense and business-savvy

selection, procurement and implementation approaches

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Bend The Capacity Growth Rate• Reduce the amount of input data

– Judicious use of compression, de-dupe– Get users to self-limit use of primary storage

• Reduce disk replication– Don’t use disk-to-disk replication for data that

doesn’t require it– Set continuous data replication processes to

shorter retention intervals• Cull out the dreck (see next slide)• Start archiving (see next slide)

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Practice Data Hygiene and Archive

Best.Get granular with data management. Work with senior management and business stakeholders to createa scheme for data classification and archive that everyonewill observe. Necessary for effective continuity, complianceand security.

Good.Run reports to identify files that haven’t been accessed or modified in 90 days. Provide lists to business unit managers for action.

Better.Implement file segregation schemes based on user roles and develop policies for handling files on a departmental level. Implement migration for older files, preferably to “NAS on Steroids” (TapeNAS – more on this later).

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Current Trends in Archive

Similar to dataprotection trends:use of disk on the rise…

Enterprise Strategy Group

Peta

byte

s Cap

acity

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Disk-Based Archive Makes No Economic Sense…

“The 12 year cost of energy for disk is greaterthan the entire TCO for tape over the same period:Disk is 500X more costly than tape, based on energy cost alone.”

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Think TapeCo

pyrig

ht ©

201

3 by

Jon

Toig

o. A

ll Ri

ghts

Res

erve

d.

Get to Real “Software-Defined” or “Private Cloud” Storage

Managed storage, that is…

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

SMS & HSM: Integrated Management

STORAGE GROUP

END USERS APPLICATIONS

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Then Came Distributed Systems Storage…Thin ProvisioningMirroringPerformance Acceleration

On-Array TieringMirroringContinuous Data Protection

SnapshotReplicationCompression

On-Array TieringSnapshotPerformance Acceleration

MirroringDe-duplication

Replication

SRM

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

So-Called SANs Didn’t Help

SRM

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

How do you improve on a world class server hypervisor?

Add a Storage Hypervisor!

Who needs ANSI?

Nine new SCSI

commands!

Latest Idea: Centralize Management in the Server Hypervisor

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Proprietary Hypervisors To Manage Storage? Really?

What if you have amix of hypervisorsand physical servers?

AGGREGATE, THEN SEGREGATE, THEN AGGRAVATE!

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Why Not an HW/SW-Agnostic Storage Hypervisor?Co

pyrig

ht ©

201

3 by

Jon

Toig

o. A

ll Ri

ghts

Res

erve

d.

Many Ways to Implement• Pool by Proxy is least disruptive

• Storage Hypervisor implemented on a generic server…

• Use array mount points already established with server OS…

• Aggregate storage capacity as desired into one or more virtual resource pools…

• Service I/O from server memory for 2X or more performance bump, regardless of back-end hardware…

• Manage capacity, performance and data protection in a unified way…

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Translates SRM into Services Management

Storage Resource Management (SRM)(hardware and plumbing configuration, monitoring and management)

Storage Services Management(data protection, capacity, performance)

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

And Smarter Storage ArchitectureDelivering Greater Efficiency…

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

CAPTURE STORAGEIOPS per Watt

Strategic Technologies- Virtualized storage- Arrays with SSD-assisted disk and sub-LUN tiering to replace drive short-stroking for high IOPS performance…

RETENTION STORAGECapacity per Watt

Strategic Technologies- Virtualized storage- “NAS on Steroids”: a cobble of NFS-mount server running a tape file system connected to a tape library…

Keyed to an Increasingly Important Metric: Power Efficiency

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

SSD Optimization for Performance StorageCo

pyrig

ht ©

201

3 by

Jon

Toig

o. A

ll Ri

ghts

Res

erve

d.

For Retention Storage

“CAPTURE STORAGE”

“RETENTION STORAGE”

TAPE LIBRARY

OLDER FILES

LTFSREQUESTS

NFS/CIFS/SMBACCESS

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Both Architectures Require Smart Thinking

IOPS per WattFlash SSD-aided diskreplacing massively parallelshort-stroking disk arrays…

Capacity per WattTapeNAS delivers less power-consuming mass storage for infrequently accessed files…

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Storage Dogmas Must End

(So must “loyalties” to equipment brands…)

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Requires Strategic Thinking: Are You Prepared?

1. How do you put a giraffe into a refrigerator?2. How do you put an elephant into a refrigerator?3. The Lion King is holding an animal conference. All

animals attend…except one. Which animal does not attend?

4. There is a river you must cross, but it is used by crocodiles, and you do not have a boat. How do you manage it?

A Test in 4 Questions

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Let’s Get Going!

Questions?Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.

Please Keep In Touch

jtoigo@toigopartners.com

@JonToigo

www.toigopartners.comwww.datainstitute.orgwww.drunkendata.com

Try not to become the tools of your tools.

Copy

right

© 2

013

by Jo

n To

igo.

All

Righ

ts R

eser

ved.