No-Fault Development: Building Rock Solid Solutions

with Industrial Computers

Keith Williamson

Manager Technical MarketingCompactPCI Product Organization

Motorola Computer Group

2

Agenda

• Why go standards-based for telco?

• The PICMG family of platforms

• Intrinsic HA features

• HA networking standards

• HA systems management standards

• The future of PICMG

3

Why Standards-based Industrial Computers?

• Ubiquitous Form Factor• Ruggedized• Wider Range of Payload • Scalability• Interoperability• Long Product Life• Improved Costs and Time to Market• Safety / EMC / EMI / Environmental• Universal Networking and Storage• Common System Management• Multi-member and Cross Industry Participation• Architected for High Availability!

4

Standards for Industrial Computers

SAFETY/EMC/EMIFCC

CE

ENVIRONMENTALNEBS - GR-GS-COREETSI – IEC / ETS / UL

MECHANICAL / ELECTRICAL /

FORM FACTORIEEEVITA

PICMG

NETWORKINGLayer 2/3 IP

VLANDiffServ

IPv6STORAGERAIDSCSI

FibreChannel

SYSTEM MANAGEMENT

OPENIPMISNMP

SAF

5

Agenda

• Why go standards-based for telco?

• The PICMG family of platforms

• Intrinsic HA features

• HA networking standards

• HA systems management standards

• The future of PICMG

6

What is PICMG?

• PCI Industrial Computer Manufacturers Group founded in 1994 and headquartered in Wakefield, MA.

• PICMG is a consortium, with over 600 members “who collaboratively develop open specifications for high performance telecommunications and industrial computing applications”

• PICMG is the standards body that, to date, manages two standards:– PCI-ISA Passive Backplane – PICMG 1.x– CompactPCI (6U Eurocard Form Factor) – PICMG 2.x

• PICMG has begun development of a new series of standards, AdvancedTCA™ -- PICMG 3.x

CompactPCI

7

A Family of PICMG Specifications

1994 2002 2003 2004 2005

CompactPCI (Industrial Control)

(Military Aerospace)

(Telecom)

A dvanced

T CA

TM

Specific to Telecom Market

CompactTCA ™

8

Agenda

• Why go standards-based for telco?

• The PICMG family of platforms

• Intrinsic HA features

• HA networking standards

• HA systems management standards

• The future of PICMG

9

Mechanical/Electrical/Form-factor

PICMG 2.0 R3.0 - CompactPCI Core Specification• Provide systems that are electrically compatible

with PCI systems • CompactPCI Features, per PICMG 2.0, include:

– 33 and 66Mhz PCI performance– 32- and 64-bit data transfers– 8 CompactPCI slots per bus segment at 33 MHz– 5 CompactPCI slots per bus segment at 66MHz– Industry standard software support– 3U small form factor (100 mm by 160 mm)– 6U form factor (233.35 mm by 160 mm)– IEEE Eurocard packaging– Wide variety of available I/O– System Management Bus

Intrinsic HA Features

10

• Environmental: Humidity, Temp, Earthquake, Noise, Fire Resistance, Vibration– NEBS : GR-63-CORE– IEC60068-2– ETS300– UL1950– ISO7779

• Safety/EMC/EMI– Safety: CSA C/US, VDE 0805– EMC/EMI: FCC Part 15, CE Mark

Intrinsic HA Features

11

Agenda

• Why go standards-based for telco?

• The PICMG family of platforms

• Intrinsic HA features

• HA networking standards

• HA systems management standards

• The future of PICMG

12

HA Networking

PICMG 2.16 R1.0 – CompactPCI Packet Switching Backplane Specification

• 802.3ab 10/100/1000BT auto-negotiating 8 wire point to point links

• Star Network Topology – Node Slots with two links per node on J3

– Fabric Slots support 20 or 24 nodes

• Larger Payload Systems have redundant fabric slots

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21

Sys Mgm

t

J1J2

J3J4

J5

Payload SlotsJ3

To Fabric Slot A

To Fabric Slot B

Node SlotsPICMG 2.16 Fabric Slot A

PICMG 2.16 Fabric Slot B

13

HA Networking

High Availability approaches:• Use redundant switches• IP and MAC addr failover for nodes

– Bonding Mode 1 for Linux nodes– Switch vendor supplied link failover

• Link Aggregation (802.3ad)

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21

Sys Mgm

t

J1J2

J3J4

J5

Payload SlotsJ3

To Fabric Slot A

To Fabric Slot B

Node SlotsPICMG 2.16 Fabric Slot A

PICMG 2.16 Fabric Slot B

14

HA Networking

PICMG 2.5 R1.0 – CompactPCI Computer Telephony• Extends CompactPCI to support Computer

Telephony applications.• Included is a hot-swappable backplane based TDM

bus (ECTF H.110) • Supports 4096 64Kbps time slots (2048 bi-directional

DS0s)

Sys Mgm

t

J1J2

J3J4

J5

Payload Slots

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21

PICMG 2.16 Fabric Slot A

PICMG 2.16 Fabric Slot B

H.110 Bus

Ethernet

IPMI

15

HA Networking

GR-253-CORE SONET/SDH Automatic Protection Switching

• ATM over SONET/SDH• Packet Over SONET/SDH

I.630 ATM Protection Switching

Working

Entity

Protection

EntityProtection Function

Bridge Selector

1+1 Linear APS

16

Agenda

• Why go standards-based for telco?

• The PICMG family of platforms

• Intrinsic HA features

• HA networking standards

• HA systems management standards

• The future of PICMG

17

HA Systems Management

PICMG 2.1 R2.0 – CompactPCI Hot Swap• Extends CompactPCI to hot swap

applications• Specifies the required features to allow

silicon, board and system vendors to develop Hot Swap capability

• Assigns a framework of terminology and overall architecture for Hot Swap systems

• This is not a “detailed” specification for a Hot Swap Compact system

• Specific implementation for Hot Swap software routines is not defined

18

HA Systems Management

PICMG 2.9 R1.0 – CompactPCI System Management• A standard method for managing CompactPCI Platforms• Based on Intel’s IPMI architecture• Significant third party hardware and software support improved device monitoring and diagnostic capabilities• Distributed nature of IPMI management removes necessity

for system management bus (CompactPCI)S

ys M

gm

t

J1J2

J3J4

J5

Fa

bri

c S

lot

Fa

bri

c S

lot

Payload Slots

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21

Redundant Radial IPMI and HSC Controls

Ethernet Channels

HSC Pins

IPMI Pins

PWR Pins

UnusedPCI Bus Pins

19

SAF Compliant Middleware• SAF AIS: Interface between an HA

application and the HA middleware– Cluster Management

– Checkpoint Service

– Event Service

– Message Service

– Global Lock Service

– Availability Management

• SAF HPI: Interface between the HA middleware and the hardware– Middleware interface to the IPMI subsystem

HA Systems Management

HA Application

SAF Middleware

Platform H/W

AIS

HPI

20

Agenda

• Why go standards-based for telco?

• The PICMG family of platforms

• Intrinsic HA features

• HA networking standards

• HA systems management standards

• The future of PICMG

21

CompactTCA

• CompactTCA is ... Interoperability• CompactTCA is ... A system specification• CompactTCA is ... A single specification for

combination of popular PICMG 2.x standards– 6U CPCI form factor, connectors, power,

cooling (PICMG 2.0)

– Hot Swap (PICMG 2.1)

– IPMI (PICMG 2.9)

– PSB (PICMG 2.16)

• Communication Architecture based on Ethernet/IP– No PCI bus to be maintained

– S/W architecture based on network nodes

• Planned Optional Interconnects– PICMG 2.5(H.110), 2.17(Starfabric) and 2.20(Mesh)

IPMI

Dual Star Ethernet

2.16 Switch Slots

Node Slots

H.110 or Mesh

22

cPCI vs ATCA

PICMG 2.xx

2002 2003

PICMG 3.xx

High Availability OS

PICMG 2.xx

• Serial Mesh Fabric (2.20)• Ethernet Fabric (2.16)• System Management (2.9)

• Modular Resources• General Purpose Processors• Network Processors• Packet Processors• Digital Signal Processors

AdvancedTCATM (PICMG 3.0)

• Serial Mesh Fabric (3.4?)• Ethernet Fabric (3.1)• System Management

• Larger, more functional modules• Higher Density, Power• Central Office in a box

23

Quick Comparison

6U x 160 mm0.8” pitch (20.32 mm)

57 in2 (368 cm2)50 Watts

CompactPCI®

8U x 280 mm1.2” pitch (30.48 mm140 in2 (903 cm2)150 Watts

AdvancedTCATM

24

CompactPCI - AdvancedTCATM

50W per board 150W per board

57 square in. 140 square in.

700Gb/s Fabric (2.20)(17 x 18 x 2.5Gb/s)

2.4Tb/s Fabric (15 x 16 x 10Gb/s)

OC3 / OC48 OC192 / OC768

300mm and 450mm chassis

600mm chassis

500W – 1.5KW per shelf

1KW – 3KW per shelf

25

12U533.4 mm

(21”)

437 mm (17.2”) 420 mm (16.5”)

-48 VCD Power Input

(Dual -48VDC Power Rails)

14 Slot Backplanein 19” Shelf

2 Switch Slots12 Payload Slots1.2” Board Pitch

150W – 200W per module

TelcoAlarm Board

92 mm Tandem Fans4 x 2 arrangement

~ 350 CFM simulated

Air Inlet

(open)

PICMG 3.0 – Advanced TCATM

26

ATCA Media Gateway on-a-card

IO

DSP

NPGP

DSP DSP

DSP DSP DSPFabric

SignalProcs

PacketProcs

NetworkProcs

GeneralProcs

PICMG 2.xx Modules

Vertical Integration simplifies HA