A H i g h D e n s i t y N V M eJ B O F S to rage i n 1 U C h a s s i s

Tommy/Director/Wiwynn

Lightning Overview

• 2U 30(U.2) or 60(M.2) NVMe SSDs

• Flexible Choice of Various SSDs Form Factors

• Tool-less and Modularized Design for Easy Maintenance

• Ultra-high IOPS and microsecond grade latency

Lightning (ST7200)

Evolution from Lightning

Thunder (ST300)Lightning (ST7200)

Physically designed as a 1U 19”

to Thunder

Thunder Key Features

• 1U 24 hot-pluggable U.2 NVMe with two x16 PCIe Gen3 Uplinks supported

• PSU & Cooling redundancy, tool-less drawer for Easy SSD Maintenance

• Flexible SSD resource reassignment

• Excellent system performance

Thunder (ST300)

IOM

RJ-45 / PCIe x16

I/O Modules (68.5 x 102mm)

(Front access SKU)

4056 Fan

4+1

Tool-less maintenance

Drive Plane Board

421 x 590 mm

DPB

2.5” U.2 NVMe SSD

24 pcs, with SSD carrier

FCB

Fan Control Board

135 x 363.56 mm

Chassis

446(W) x 800(D) mm

SSD drawer

Easier SSD maintenance

I/O Module

(Rear access SKU*)

IOM

PSU

1+1

System Architecture

Block Diagram

IOM

x 12

PCIe x4

x 12

PCIe x4

Internal

Cables U.2 SSD x 12

2.5” SSD2.5” SSDU.2 SSD

U.2 SSD x 12

2.5” SSD2.5” SSDU.2 SSD

IOM

DPB

BMC(AST2500)

PCIe Switch

96 lanes

PCIe Switch

96 lanes

I2C

I2C

I2C &

PowerFCB

PCIe x16

PCIe x16

I2C

Switch

I2C

Switch

I2C

Switch

I2C

Switch

I2C

I2C

I2C

I2C

PHYRJ45 RJ45 RJ45

x 8 x 8

x 12

PCIe x4

x 12

PCIe x4

U.2 SSD x 12

2.5” SSD2.5” SSDU.2 SSD

U.2 SSD x 12

2.5” SSD2.5” SSDU.2 SSD

PCIe Switch

96 lanes

PCIe Switch

96 lanes

I2C

I2C

I2C

Switch

I2C

Switch

I2C

Switch

I2C

Switch

I2C

I2C

I2C

I2C

External

Cables

Host#

1

PCIe x 16

PCIe x 16

DPB

BMC(AST2500)

PCIe x16

PCIe x16

PHYRJ45

Block Diagram with Dedicated Host

• 1 host access 24 NVMe SSDs through two PCIe x16 with two re-timer cards

With 1 Host

Internal

Cables

IOM

IOMRJ45 RJ45

x 8 x 8

• Each host accesses up to 24 NVMe SSDs by flexible NVMe SSD reassignment. The dynamic partitioning provides for uses to allocate SSD pools dynamically.

With 2 Hosts

x 12

PCIe x4

x 12

PCIe x4

U.2 SSD x 12

2.5” SSD2.5” SSDU.2 SSD

U.2 SSD x 12

2.5” SSD2.5” SSDU.2 SSD

PCIe Switch

96 lanes

PCIe Switch

96 lanes

I2C

I2C

I2C

Switch

I2C

Switch

I2C

Switch

I2C

Switch

I2C

I2C

I2C

I2CHost#

2

Host#

1

PCIe x 16

PCIe x 16

Block Diagram with 2 Hosts(Flexible Resource allocation among Hosts)

DPB

BMC(AST2500)

PCIe x16

PCIe x16

PHYRJ45

External

Cables

Internal

Cables

RJ45

IOM

IOMRJ45 RJ45

x 8 x 8

Manageability of BMC

Monitor• Temperature• Voltage• Power

Consumption

Control• Fan Speed• LED

USB, I2C, Ethernet OOB (Out-of-band)

Host #1

CPU

BMC

USB

I2C

Drive Plane Board

BMC

RJ

45

USB

I2C

NIC

PCIe

Switch

Cable

Flexible IOM for Front / Rear Cabling

IOM for Front cabling IOM for Rear cabling

Front View Rear View

Physical connection with Thunder

19”

OCP Server

IOMOut-band BMC

Management

External PCIe x16 Cable Standard low profile

OCP PCIe-retimer Card

19”

Generic ServerThunder

Standard low profile

OCP PCIe-retimer Card

IOM

External PCIe x16 cable

High Key Performance

VSJBOF**

12 NVMe SSD

JBOF*12 SATA SSD

JBOD*12 SAS HDD VS

* The measurement in SAS JBOD and SATA JBOF system were based on two miniSAS HD x4 connection

** The measurement in NVMe JBOF system was based on PCIex16 connection

• Disk IO Performance

Throughput, IOPS

• IO-Watt Performance (Performance/Price)

IOPS / Watt

5X Throughput + 854X IOPS

0

5000

10000

15000

Sequential Read Sequential WriteBa

nd

wid

th M

B/s

100% 32K Sequential

SAS12G HDD JBOD SATA SSD JBOF NVMe JBOF (Thunder)

- Actual Throughput- READ : GB/s

- WRITE : GB/s

Theoretical PCIe Gen3 x16 = 15.754GB/s (128b/130b)

Based on FIO 2.1.10 + CentOS 7.2

2x2x5x

0

500

1000

1500

2000

2500

Random Read Random Write

IOP

s K

100% 4K Random

SAS12G HDD JBOD SATA SSD JBOF NVMe JBOF (Thunder) - Actual IOPs- READ : IOPs

- WRITE : IOPs

294x169x

854x

338x

Significant IO-Watt Performance

0

2000

4000

6000

8000

10000

12000

SAS12G HDD JBOD SATA SSD JBOF NVMe JBOF (Thunder)

IOPS (per PCIe Switch) = 2329k

IO-Watt = (IOPS x 2) / (Power Consumption)

= 2329k x 2 / 450W

= 10351

NVMe JBOF <450w

IOPS/Watt

Wiwynn’s High Density NVMe Storage

Thunder (ST300)@ B3

• Service more CSPs with same Lightning DNA

• Flexible PCIe cabling for Cold/Hot aisle

• Tool-less drawer for Easy SSD Maintenance

• Redundant PSUs and Cooling design

• Flexible SSD resource reassignment

• Excellent System Performance 26GB/s Throughput 4,658K IOPS 10,351 IOPS/Watt