From ClearCase to Perforce Helix: Breakthroughs in Scalability at Intel

Post on 26-Jan-2017

836 views 1 download

transcript

From ClearCase to Perforce Helix: Breakthroughs in Scalability at IntelHaim MousanSenior DevOps Engineer

Introduction

Haim Mousan SCM & ALM/BI Tech Lead Intel Firmware Department (~600 people, 3 Geos)

Responsible for delivery most critical Intel Firmware IPsThose 2 IPs integrated in all Intel

PlatformsThe views expressed in this presentation are my own. I do not speak for Intel and do not represent Intel at any matter. I’m here to share my own private experience with SCM, Perforce usage and integration within our team in Jerusalem.

Introduction

Desktop

Mobile

Set-Top Box

IOTG

Servers

GoogleGlass

Sensors

Security

Problem Statement – 3 years ago…

Unstable coding environment with IBM ClearCase Unbearable Performance and Usability Issues Many dozens of methodologies Development productivity loss Zero integration with other ALM tools “Where is my data?” user complaints 3 people supporting ClearCase Massive increase in Intel’s Projects expected (X6)

SCM system is mission critical - cannot afford downtime

Solution – Today

Solution – Today

CI

Build

Security Scans

LegalScans

Perforce CI• Continuous Integration• Gated check-in• Full release proc.

automation

Solution – Today

ALMCI

Build

Security Scans

LegalScans

Arch

Perforce CI• Continuous Integration• Gated check-in• Full release proc.

automationPerforce ALM

• Code link with TFS workitems

• Full data traceability

Solution – Today- Perforce

ALM

BI

CI

Build

Security Scans

LegalScans

Arch

Perforce CI• Continuous Integration• Gated check-in• Full release proc.

automationPerforce ALM

• Code link with TFS workitems

• Full data traceability

Perforce BI• Decision support system• Code changes tracking

Solution – Today!X2 IPs

X4 Projects

Flat HC

2013

Security Sensors

Security

Kabylake

Broxton NextGen.1

GoldSand

NextGen.2

SofiaSkylake

Cannonlake

BroadwellHaswell

BU2

BU4 BU6

BU3BU1

BU42016

X2 BUs

No Compromise on Quality

X4 Releases

Desktop

MobileServer

2014 A 20151.50 3.47 3.17

Scope vs. HC

2014 20152.00 3.01 2.81

Scope vs. HC

Solution – Today!

Entire organization SCM is scaled up Unified methodologies ~253 core methodologies Supported by 0.2 people (was 3) 99.9% Stability Major Performance Increase

Solution - Details

Phase I: Migration IBM ClearCase to Perforce

Phase II: Perforce Continuous Integration (Jenkins/QB) Perforce ALM

(Microsoft TFS) Perforce OLAP Based BI (SharePoint BI)

Solution - Details

Phase I: Migration IBM ClearCase to Perforce

Phase II: Perforce Continuous Integration (Jenkins/QB) Perforce ALM

(Microsoft TFS) Perforce OLAP Based BI (SharePoint BI)

Solution – CCP4 Migration

12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment

• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment

Solution – CCP4 Migration

12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment

• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment

Solution – CCP4 Migration

12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment

• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment

Solution – CCP4 Migration

Migration scope – repositories, historical labels

Label 1.0.0.1 Label 1.0.0.10 Label 1.0.0.15 Latest Code

Changelist X Changelist Y Changelist Z #Head Revision

Solution – CCP4 Migration

12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment

• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment

Solution – CCP4 Migration

12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment

• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment

Solution – CCP4 Migration

12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment

• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment

Solution – CCP4 Migration

12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment

• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment

Solution – CCP4 Migration

12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment

• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment

Solution – CCP4 Migration

12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment

• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment

Solution – CCP4 Migration

Highlights• Performance cross geos• Training• Migration script development• Methodology enforcement

Lowlights• Methodologies consolidation• Symbolic links• Server charset mismatch

Solution - Details

Phase I: Migration IBM ClearCase to Perforce

Phase II: Perforce Continuous Integration (Jenkins/QB) Perforce ALM

(Microsoft TFS) Perforce OLAP Based BI (SharePoint BI)

Solution - Details

Phase I: Migration IBM ClearCase to Perforce

Phase II: Perforce Continuous Integration (Jenkins/QB) Perforce ALM

(Microsoft TFS) Perforce OLAP Based BI (SharePoint BI)

Solution – Perforce CI

Build/Scan Test

CI Orchestrators

PassedFailed

Deployment

Solution – Perforce TFS

Code Submission

Build/CI

Req

Story

Development PortalBug

Solution – Perforce TFS

DEMO

29

30

31

32

33

36

37

Solution – Perforce TFS

Code Submission

Req

Story

Development Portal

Bug

Test Coverage

Validation Portal

Full Data Traceability

Solution – Perforce BI

40

41

42

43

44

45

46

Key Messages

Scalable and usable solution for firmware/software is a major challenge

BI and full data traceability are breakthrough capabilities for any SW team

Robust Source Control Management tool integrated with ALM is no longer a theoretical concept

Can be easily adopted by any SW team within several weeks

Thank You!

Haim Mousanhaimmousan@yahoo.comhttps://www.linkedin.com/in/haim-mousan-260b3812