+ All Categories
Home > Documents > IBM Tape Strategy & Roadmap Seismic Aug 2017 - npd.no · Tape Challenge àSoftware stack ......

IBM Tape Strategy & Roadmap Seismic Aug 2017 - npd.no · Tape Challenge àSoftware stack ......

Date post: 17-Apr-2018
Category:
Upload: lyliem
View: 215 times
Download: 1 times
Share this document with a friend
32
IBM Tape Roadmap & Strategy August 2017 Ed Childers STSM, Manager Tape Development
Transcript

IBM Tape Roadmap & StrategyAugust 2017

Ed ChildersSTSM, Manager Tape Development

IBM SystemsIBM Tape StorageE Childers Aug 2017

Agenda

Storage Outlook – Tape Futures

IBM Tape Strategy And Products

2

IBM SystemsIBM Tape StorageE Childers Aug 2017

Agenda

Storage Outlook – Tape FuturesØ What Is Tape’s Place In Future Storage Systems?Ø The Storage Triple Whammy

IBM Tape Strategy and Products

3

IBM SystemsIBM Tape StorageE Childers Aug 2017 4

We all know that data is growing, demands on IT growing, but why is it such a problem?…

IBM SystemsIBM Tape StorageE Childers Aug 2017

Fundamentally – It’s a Storage Scaling Problem

5

© 2011 IBM Corporation3

• IBM logo must not be moved, added to, or altered inany way.

• Background shouldnot be modified,

• Title/subtitle/confidentiality line: 10pt Arial Regular, whiteMaximum length: 1 line

Information separated by vertical strokes,with two spaces on either side

• Slide heading:28pt Arial Regular, blue R120 | G137 | B251

Maximum length: 2 lines

• Slide body:18pt Arial Regular, black

Square bullet color:teal R045 | G182 | B179

Recommended maximum text length: 5 principal points

• Group name:14pt Arial Regular, white

Maximum length: 1 line

• Copyright: 10pt ArialRegular, white

Optional slide number: 10pt Arial Bold, white

Template release: Oct 02For the latest, go to http://w3.ibm.com/ibm/presentations

Indications in green = Live content

Indications in white = Edit in master

Indications in blue = Locked elements

Indications in black = Optional elements

IBM and BP Internal Use

Smarter Systems Are Creating an Information ExplosionEspecially in Media and Entertainment (M&E)

2005 2006 2007 2008 2009 2010 20110

200

400

600

800

1,000

1,200

1,400

1,600

1,800

Exa

byte

s RFID,Digital TV,

MP3 players,Digital cameras,

Camera phones, VoIP,Medical imaging, Laptops,

smart meters, multi-player games,Satellite images, GPS, ATMs, Scanners,

Sensors, Digital radio, DLP theaters, Telematics,Peer-to-peer, Email, Instant messaging, Videoconferencing,

CAD/CAM, Toys, Industrial machines, Security systems, Appliances

§ Storage requirements growing 20-40% per year

Source:: Semantics, “Linked Data” guidelines, 2006. The rate of data growth is greater than:Ø advances in HDD technology areal density (No increases in IT spend to offset imbalance)

HDDTechnology

CAGR

Data CAGR

“Before” (until late 2010’s)

“Now”

The rate of data growth approx the same as:Ø advances in HDD technology areal density

(ie. double every 2 years = 40% CAGR)

IBM SystemsIBM Tape StorageE Childers Aug 2017 | 6

CD (1982)

BluRay15% CAGR

6 layer300GB

33% CAGR

Tape

~ 10% CAGR

3 layer100GB

2015 Tape Technology Demo

DVD

HDD

Storage Technologies Areal Density Trends

IBM SystemsIBM Tape StorageE Childers Aug 2017

Engineers Solve Technology Problems but…

| 7

Market forces drive business models..

Volu

me

Mature technology, stable market & roadmap

High vol, ,low margin, consumer driven commodity

New technology, Low vol, high margin, special use

Cost, Cost, Cost,…High growth, large investment, many players

Technology companies lead

Consolidation, transition to post-consumer driven

design pointsO

ptical

High Vol mfgcompanies lead

Volu

me

Time

IBM SystemsIBM Tape StorageE Childers Aug 2017 | 8

IBM SystemsIBM Confidential

Engineers Solve Technology Problems but…

| 7

Market forces drive business models..

V

olume

Mature technology, stable market & roadmap

High vol, ,low margin, consumer driven commodity

New technology, Low vol, high margin, special use

Cost, Cost, Cost,…High growth, large investment, many players

Technology companies lead

Consolidation, transition to post-consumer driven

design points

Optical

High Vol mfgcompanies lead

Volu

me

Time

IBM SystemsIBM Confidential | 6

CD (1982)

BluRay15% CAGR

6 layer300GB

33% CAGR

Tape

~ 10% CAGR

3 layer100GB

2015 Tape Technology Demo

DVD

HDD

Storage Technologies Areal Density Trends

Technology Outlook

Fundamental Technology Trends

Consumer Market Trends

IBM SystemsIBM Tape StorageE Childers Aug 2017

HDD Challenges

Technology Scaling Limits$/TB Impacted By Increased Cost Of Brick

Declining Consumer Demand

If grains become too small, magnetic state is unstableà superparamagnetic effect

~10 nm

Technologies to go beyond the superparamagnetic limit = $$• HAMR• MAMR• BPM• BPM+HAMR High Perf & High Margin

Market Taken Away By Flash

13

M. Lantz IBM Zurich

IBM SystemsIBM Tape StorageE Childers Aug 2017

Optical Challenges

0

2000

4000

6000

8000

10000

12000

14000

1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014

Units

TotalWWOpticalMediaDemandJIRACompliation

BluRay DVD CD

"Comparison CD DVD HDDVD BD" by Cmglee - Own work. Licensed under CC BY-SA 3.0 via Wikimedia Commons -http://commons.wikimedia.org/wiki/File:Comparison_CD_DVD_HDDVD_BD.svg#/media/File:Comparison_CD_DVD_HDDVD_BD.svg

Semiconductor laser wavelength

limit

0.7 GB 4.7 GB 15 GB 25 GBMulti-layer

+Spot & track squeeze

ODA

Technology Scaling Limits $/TB not reduced with multi-layer Declining Mfg Media Demand

IBM SystemsIBM Tape StorageE Childers Aug 2017

IBM has Demonstrated a Tape Technology Pipeline1TB in 2002, 8TB in 2006, 35TB in 2010, 154TB in 2014, 220TB in 2015, and 330TB in 2017…

| 11

IBM SystemsIBM Tape StorageE Childers Aug 2017

Tape Outlook

No Technology Scaling Limits Increasing Demand

0

2,000

4,000

6,000

8,000

10,000

12,000

14,000

Q200

Q300

Q400

Q101

Q201

Q301

Q401

Q102

Q202

Q302

Q402

Q103

Q203

Q303

Q403

Q104

Q204

Q304

Q404

Q105

Q205

Q305

Q405

Q106

Q206

Q306

Q406

Q107

Q207

Q307

Q407

Q108

Q208

Q308

Q408

Q109

Q209

Q309

Q409

Q110

Q210

Q310

Q410

Q111

Q211

Q311

Q411

Q112

Q212

Q312

Q412

Q113

Q213

Q313

Q413

Q114

Q214

Q314

Q414

Q115

Q215

Q315

Q415

Q116

Q216

Q316

Q416

Q117

TotalPB

TotalPB

Tape Challenge à Software stack transition from backup to archive

IBM SystemsIBM Confidential

Storage Technologies Areal Density Trends

| 30

CD (1982)

BluRay15% CAGR

6 layer300GB

33% CAGR

~2025

~ 10% CAGR

3 layer100GB

2015 Tape Technology Demo

DVD

HDD

Tape

IBM SystemsIBM Tape StorageE Childers Aug 2017

The Storage Triple Whammy

| 13

2) Data is growing faster than previously

1) HDD technology scaling breaking down

3) Consumer market demand shifting focus

IBM SystemsIBM Confidential

Fundamentally – It’s a Storage Scaling Problem

19

© 2011 IBM Corporation3

• IBM logo must not be moved, added to, or altered inany way.

• Background shouldnot be modified,

• Title/subtitle/confidentiality line: 10pt Arial Regular, whiteMaximum length: 1 line

Information separated by vertical strokes,with two spaces on either side

• Slide heading:28pt Arial Regular, blue R120 | G137 | B251

Maximum length: 2 lines

• Slide body:18pt Arial Regular, black

Square bullet color:teal R045 | G182 | B179

Recommended maximum text length: 5 principal points

• Group name:14pt Arial Regular, white

Maximum length: 1 line

• Copyright: 10pt ArialRegular, white

Optional slide number: 10pt Arial Bold, white

Template release: Oct 02For the latest, go to http://w3.ibm.com/ibm/presentations

Indications in green = Live content

Indications in white = Edit in master

Indications in blue = Locked elements

Indications in black = Optional elements

IBM and BP Internal Use

Smarter Systems Are Creating an Information ExplosionEspecially in Media and Entertainment (M&E)

2005 2006 2007 2008 2009 2010 20110

200

400

600

800

1,000

1,200

1,400

1,600

1,800

Exa

byte

s RFID,Digital TV,

MP3 players,Digital cameras,

Camera phones, VoIP,Medical imaging, Laptops,

smart meters, multi-player games,Satellite images, GPS, ATMs, Scanners,

Sensors, Digital radio, DLP theaters, Telematics,Peer-to-peer, Email, Instant messaging, Videoconferencing,

CAD/CAM, Toys, Industrial machines, Security systems, Appliances

§ Storage requirements growing 20-40% per year

Source:: Semantics, “Linked Data” guidelines, 2006.

The rate of data growth is greater than:

Ø advances in HDD technology areal density

(No increases in IT spend to offset imbalance)

HDDTechnology CAGR

Data CAGR

“Before” (until late 2010’s)

“Now”

The rate of data growth approx the same as:

Ø advances in HDD technology areal density

(ie. double every 2 years = 40% CAGR)

IBM SystemsIBM Confidential

Engineers Solve Technology Problems but…

| 20

Market forces drive business models..

V

olume

Mature technology, stable market & roadmap

High vol, ,low margin, consumer driven commodity

New technology, Low vol, high margin, special use

Cost, Cost, Cost,…High growth, large investment, many players

Technology companies lead

Consolidation, transition to post-consumer driven

design points

Optical

High Vol mfgcompanies lead

Volu

me

Time

IBM SystemsIBM Confidential

Storage Technologies Areal Density Trends

7

DVDCD (1982)

BluRay15% CAGR

6 layer300GB

33% CAGRHDD

Tape

~ 10% CAGR

3 layer100GB

2015 Tape Technology Demo

IBM SystemsIBM Tape StorageE Childers Aug 2017

What are the options?

1) Increase the budget, build out more floorspace, spend more $ on disk

2) Pay someone else to deal with it – aka cloud servicesØ Cloud storage, including connectivity bandwidth/$

3) Hope for a storage technology breakthroughØ There is nothing on the horizon

4) Breakdown traditional storage islandsØ Tiered storage solution including flash, HDD, tape

Ø Spectrum Archive as part of the Spectrum Storage family

| 14

Tape Enables

IBM SystemsIBM Tape StorageE Childers Aug 2017

IBM tape storage for hyperscale computingTape is relevant in the place IT is moving…

| 15

How to store a zettabyte on a budget• Aaron Ogus, Microsoft Azure• Global IT Executive Summit - October,

2015• https://tapepower.fujifilmrmd.com/LA2015/vid

eo/id/presentation.5

How Google Backs up the Internet• Raymond Blum, Google Site Reliability• NYC Tech Talk Series - October, 2013• https://www.youtube.com/watch?v=eNliOm9Nt

CM

TS1155 – Ethernet interface and 15 TB tape cartridge

IBM SystemsIBM Tape StorageE Childers Aug 2017

Agenda

Storage Outlook – Tape Futures

IBM Tape Strategy and ProductsØ Investment in Tape TechnologyØ Investment in Tape Product LineupØ Investment in the Tape Software Stack

16

Mark Lantz – Future of Tape

Robert Haas

IBM SystemsIBM Tape StorageE Childers Aug 2017

Agenda

Storage Outlook – Tape Futures

IBM Tape Strategy and ProductsØ Investment in Tape TechnologyØ Investment in Tape Product LineupØ Investment in the Tape Software Stack – LTFS

17

IBM SystemsIBM Tape StorageE Childers Aug 2017

IBM Tape Strategy

| 18

Tape Technology Pipeline - IBM Development & IBM Research• Large research investment Zurich and Almaden laboratories • Technology demonstrations – 220 TB in 2015

ØSubstantiates roadmap thru 2025• Drive technology value into Enterprise, leverage into LTO when industry is

capable TS1150 Enterprise Tape product line

• Reliability, Performance and Function differentiation• Enterprise media cartridge with reuse• Enterprise Automation compatible

LTO Midrange product line• Open Tape Streaming product family• Full Automation Product support – 1U to HD Frames• TPC Consortium driven development/function

Software - LTFS• IBM invented, open source, open standard• Provides file system support, integration of tape into Spectrum Scale

IBM Systems

IBM Tape Solutions: A comprehensive PortfolioEntry Enterpris

e

LTO 7 FH

TS1150

TS3200TS3100 TS3310

Tape

au

tom

atio

nTa

pe

virt

ualiz

atio

n

TS4500 High Density

Tape

D

rives

LTO Media3592 Media

TS2900

LTO 7 HH

Mid-Range

SDS Spectrum Archive

Single Drive Library EditionEnterprise Edition

Grid Cloud

Replication

TS7620 Appliance TS7650G

Gateway

TS7760 VTL

IBM Systems

IBM Tape DrivesØ Enterprise Tape Products

| 20

IBM SystemsIBM Tape StorageE Childers Aug 2017

Format Compatibility – Past and FutureHow do you increase capacity and value?1. Make smaller things to magnetize2. Make a better magnetizer/reader (head)3. Get the head closer to the media (smoother media)4. Improve accuracy of placing bits on tape

| 21

Media Technology

Drive Technology

FeO2 CrO2 “MP” (Metal Particles) BaFe (Barium Ferrite)

Reel-Reel 3480/ 3590 3592 3592 Gen 4Format

Red Rust

A brief & approximate history of format changes

Cartridge Track Following

Better Track Following

Timing Based Servo

”Thin Film” heads GMR heads TMR headsAMR heads”wire wound”

heads

Complete format breaks

JC, JD, ..JA, JB

Forward/Backward compatibility changes

“dual coat” media

IBM SystemsIBM Tape StorageE Childers Aug 2017

TS1150 Tape Drive – Summary

| 22

Enhanced Capacity• New 10 TB Data/WORM Tape JD media • 7 TB Data Tape re-use / re-format of legacy JC media

Enhanced Performance • Dual, 8 Gb FC attachment with failover support • 360 MB/s max native data rate , 700 MB/s max compressed data rate• 2 GB main data buffer (2X Jag-4) – improved streaming • Improved file writing performance utilizing SkipSync and FastSync

automatic writing accelerators / tape mark virtualization Improved compression hardware and compatible encryption support

• Larger history buffer provides up to 20% improved compression in Jag-5 format versus Jag-4 compression ratios

• Support for all existing encryption methods at higher performance Oct 24 2014 General availability

IBM SystemsIBM Tape StorageE Childers Aug 2017

TS1155 Tape Drive – Summary

| 23

Extending the capacity and interface functionality on current TS1150/Jag-5 base

TS1155 Models • 3592 55F - Fibre Channel model

• Identical dual port 8Gb FC support as TS1150• 3592 55E – Host Ethernet attached model

• dual 10Ge optical SFP+ physical ports • Initial release target to ISER/RoCE v2 protocol variant

• Both models read and write 15 TB capacity on existing JD media • New J5A format supporting 15TB capacity on existing JD media• Automatic up-format support to the new 15TB format when writing from BOT• JD 10 TB format may be also be read and written by the TS1155• Media back-portable for re-formatting to TS1150 drive back to 10TB• TS1160 will read and write the JD formats(10 TB and 15TB)• JC media supported for read (4TB format) or read/write (7TB format), but no capacity increase

• Other attributes remain unchanged from TS1150• Native data rate remains unchanged at 360 MB/s • Load/ready, locate speeds, access times remain unchanged • Support for other functions such as Recommended Access Ordering remains unchanged

• Current support planned only on TS4500 library, but fibre model could be supported in TS3500 if demand

IBM Systems

IBM LTFS SolutionsØ Aka Spectrum Archive

| 24

IBM SystemsIBM Tape StorageE Childers Aug 2017

LTFS SDE on Windows

25

Video.mpg

Spectrum Scale™Single Global Name Space

NFS / CiFS Open Stack CloudPOSIX

Client workstationsUsers and applicationsCompute Farm

Spectrum Archive™

Flash

Spectrum Archive – How it works

Policy based Lifecycle Management

/Files

/Subdir1 One.txtVideo.mpgDatabase.db2

/Subdir2 Memo.txtcamera1.mpg

/Subdir3Medical.txtsonagram.mpgRecords.db2

/Files

/Subdir1

Database.db2/Subdir2

/Subdir3Records.db2

/Subdir1 One.txt

/Subdir2 Memo.txt

camera1.mpg/Subdir3

Medical.txtsonagram.mpg

/Subdir1

/Subdir2

/Subdir3

Policy Based MigrationEfficient use of performance tier

File access cools – File tiers

Policy Based MigrationCold data migrated after 60 days

Expand the lowest cost tier by adding media

Automatically recalled when accessed

Policy based Lifecycle Management$$$ ¢$

IBM Systems

IBM Tape Automation

| 27

IBM SystemsIBM Tape StorageE Childers Aug 2017

TS4500 Tape Library

| 28

§ Scales to over 175 PB native

§ Supports up to 128 tape drives

§ Next-generation storage density • 5.5 PB native in a single frame tape

library• Scales at up to 1 PB per square foot

§ Simplified management• Magazine I/O• Integrated management• Improved ease-of-use• Extensible platform

IBM SystemsIBM Tape StorageE Childers Aug 2017

What’s New with TS4500 R3?

| 29

§ High availability• Dual active accessors with >2X robotic

performance for mount/demount and insert/eject• Ability to grow left or right with <1 hour downtime• Integrated service bays to reduce inactive service

space by 40%• “Elastic Capacity” option to completely eliminate

inactive service space and/or provide temporary relief for temporary overflow conditions

• Flexible growth options with new flex track design§ Mainframe-ready

• Integrate TS7700 backend switches• Attach to TS7700 TSSC for centralized service• GUI support for preset TS7700 logical library

§ Other customer-requested enhancements• Next generation IMC• Up to 4 Library-Managed Encryption (LME) key

paths per logical library• Miscellaneous GUI enhancements

A B

IBM SystemsIBM Tape StorageE Childers Aug 2017

TS4500 HD2 base frame

| 30

TS3500 Tape Library TS4500 Tape LibraryModel Lx3 Model Lx5

Up to 12 Drives16 or 32 I/O

Up to 12 Drives36 I/O - LTO32 I/O - 3592

Licensed Slot Capacity Licensed Slot Capacity

Entry Interm Full Entry Interm Base HD

LTO 64 129 219-287100 200 400

730

3592 58 117 199-260 550

Up to 5.5 PB native capacity in a single frame tape library

Up to 3.3X the slot density of TS3500 with more standard features including:§ Advanced Library Management System (ALMS)

– Dynamic partitioning– Transparent Capacity on Demand– Virtual I/O (VIO)– Cartridge cache

§ Two I/O Stations§ System console capabilities e.g. broadband call home (formerly TSSC)

IBM SystemsIBM Tape StorageE Childers Aug 2017

High Density Frames – Up to 10PB in 10 sq.ft.

| 31

Tier 0 Slots

Tier 1 Slots

Tier 2 Slots

Tier 3 Slots

Tier 4 Slots

Tier 5 Slots

SideView

Nearline cartridge cache (application independent)

Least recently used

Load balancing of tiers to optimize access

CartridgeCache

IBM SystemsIBM Tape StorageE Childers Aug 2017

Self-contained Air Flow

| 32

Ambient Air Hot Air Exhaust

All library frame perforations to be blocked to create a controlled enclosure.

Design will minimize temperature and humidity excursions when any door is opened for service.

Air Conditioner

Hot aisle


Recommended