48
From ClearCase to Perforce Helix: Breakthroughs in Scalability at Intel Haim Mousan Senior DevOps Engineer
From ClearCase to Perforce Helix: Breakthroughs in Scalability at IntelHaim MousanSenior DevOps Engineer
Introduction
Haim Mousan SCM & ALM/BI Tech Lead Intel Firmware Department (~600 people, 3 Geos)
Responsible for delivery most critical Intel Firmware IPsThose 2 IPs integrated in all Intel
PlatformsThe views expressed in this presentation are my own. I do not speak for Intel and do not represent Intel at any matter. I’m here to share my own private experience with SCM, Perforce usage and integration within our team in Jerusalem.
Introduction
Desktop
Mobile
Set-Top Box
IOTG
Servers
GoogleGlass
Sensors
Security
Problem Statement – 3 years ago…
Unstable coding environment with IBM ClearCase Unbearable Performance and Usability Issues Many dozens of methodologies Development productivity loss Zero integration with other ALM tools “Where is my data?” user complaints 3 people supporting ClearCase Massive increase in Intel’s Projects expected (X6)
SCM system is mission critical - cannot afford downtime
Solution – Today
Solution – Today
CI
Build
Security Scans
LegalScans
Perforce CI• Continuous Integration• Gated check-in• Full release proc.
automation
Solution – Today
ALMCI
Build
Security Scans
LegalScans
Arch
Perforce CI• Continuous Integration• Gated check-in• Full release proc.
automationPerforce ALM
• Code link with TFS workitems
• Full data traceability
Solution – Today- Perforce
ALM
BI
CI
Build
Security Scans
LegalScans
Arch
Perforce CI• Continuous Integration• Gated check-in• Full release proc.
automationPerforce ALM
• Code link with TFS workitems
• Full data traceability
Perforce BI• Decision support system• Code changes tracking
Solution – Today!X2 IPs
X4 Projects
Flat HC
2013
Security Sensors
Security
Kabylake
Broxton NextGen.1
GoldSand
NextGen.2
SofiaSkylake
Cannonlake
BroadwellHaswell
BU2
BU4 BU6
BU3BU1
BU42016
X2 BUs
No Compromise on Quality
X4 Releases
Desktop
MobileServer
2014 A 20151.50 3.47 3.17
Scope vs. HC
2014 20152.00 3.01 2.81
Scope vs. HC
Solution – Today!
Entire organization SCM is scaled up Unified methodologies ~253 core methodologies Supported by 0.2 people (was 3) 99.9% Stability Major Performance Increase
Solution - Details
Phase I: Migration IBM ClearCase to Perforce
Phase II: Perforce Continuous Integration (Jenkins/QB) Perforce ALM
(Microsoft TFS) Perforce OLAP Based BI (SharePoint BI)
Solution - Details
Phase I: Migration IBM ClearCase to Perforce
Phase II: Perforce Continuous Integration (Jenkins/QB) Perforce ALM
(Microsoft TFS) Perforce OLAP Based BI (SharePoint BI)
Solution – CCP4 Migration
12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment
• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment
Solution – CCP4 Migration
12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment
• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment
Solution – CCP4 Migration
12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment
• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment
Solution – CCP4 Migration
Migration scope – repositories, historical labels
Label 1.0.0.1 Label 1.0.0.10 Label 1.0.0.15 Latest Code
Changelist X Changelist Y Changelist Z #Head Revision
Solution – CCP4 Migration
12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment
• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment
Solution – CCP4 Migration
12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment
• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment
Solution – CCP4 Migration
12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment
• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment
Solution – CCP4 Migration
12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment
• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment
Solution – CCP4 Migration
12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment
• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment
Solution – CCP4 Migration
12 Teams migrated (500 people) 8 weeks – from definitions stage to deployment
• Perforce depots setup• Migration scope – repositories, historical labels• Methodology consolidation• Migration script & preparations• Pilot• Training• Deployment
Solution – CCP4 Migration
Highlights• Performance cross geos• Training• Migration script development• Methodology enforcement
Lowlights• Methodologies consolidation• Symbolic links• Server charset mismatch
Solution - Details
Phase I: Migration IBM ClearCase to Perforce
Phase II: Perforce Continuous Integration (Jenkins/QB) Perforce ALM
(Microsoft TFS) Perforce OLAP Based BI (SharePoint BI)
Solution - Details
Phase I: Migration IBM ClearCase to Perforce
Phase II: Perforce Continuous Integration (Jenkins/QB) Perforce ALM
(Microsoft TFS) Perforce OLAP Based BI (SharePoint BI)
Solution – Perforce CI
Build/Scan Test
CI Orchestrators
PassedFailed
Deployment
Solution – Perforce TFS
Code Submission
Build/CI
Req
Story
Development PortalBug
Solution – Perforce TFS
DEMO
29
30
31
32
33
36
37
Solution – Perforce TFS
Code Submission
Req
Story
Development Portal
Bug
Test Coverage
Validation Portal
Full Data Traceability
Solution – Perforce BI
40
41
42
43
44
45
46
Key Messages
Scalable and usable solution for firmware/software is a major challenge
BI and full data traceability are breakthrough capabilities for any SW team
Robust Source Control Management tool integrated with ALM is no longer a theoretical concept
Can be easily adopted by any SW team within several weeks
![[Perforce] Component Based Development in Perforce](https://static.documents.pub/doc/80x56/548401935906b5ad158b46ee/perforce-component-based-development-in-perforce.jpg)
