PPROGRAMROGRAM M MANAGEMENTANAGEMENT O OFFICEFFICE (PMO) (PMO)
PPROJECTROJECT M MANAGEMENTANAGEMENT
MMETRICSETRICS G GUIDEBOOKUIDEBOOK
RREVISIONEVISION D DATEATE:: FFEBRUARYEBRUARY 23, 2001 23, 2001RREVISIONEVISION:: 1.01.0
PPRODUCTRODUCT C CODEODE:: GTA-PMO-GUI-002GTA-PMO-GUI-002
METRICS GUIDEBOOK I
TTABLEABLE OFOF C CONTENTSONTENTS
1.0 I1.0 INTRODUCTIONNTRODUCTION................................................................................................................................................................ 111.1 I1.1 IDENTIFICATIONDENTIFICATION O OFF D DOCUMENTOCUMENT................................................................................................................................ 111.2 S1.2 SCOPECOPE O OFF D DOCUMENTOCUMENT................................................................................................................................................................ 111.3 P1.3 PURPOSEURPOSE O OFF D DOCUMENTOCUMENT........................................................................................................................................................ 221.4 D1.4 DOCUMENTOCUMENT O ORGANIZATIONRGANIZATION.............................................................................................................................................. 221.5 G1.5 GUIDELINESUIDELINES F FOROR U USINGSING T THEHE D DOCUMENTOCUMENT..................................................................................................331.6 G1.6 GUIDELINESUIDELINES F FOROR U UPDATINGPDATING T THISHIS D DOCUMENTOCUMENT....................................................................................33
2.0 R2.0 RELATEDELATED D DOCUMENTATIONOCUMENTATION......................................................................................................................442.1 P2.1 PARENTARENT D DOCUMENTSOCUMENTS.................................................................................................................................................................... 442.2 A2.2 APPLICABLEPPLICABLE D DOCUMENTSOCUMENTS...................................................................................................................................................... 552.3 I2.3 INFORMATIONNFORMATION D DOCUMENTSOCUMENTS................................................................................................................................................ 55
3.0 F3.0 FOUNDATIONOUNDATION...................................................................................................................................................................... 663.1 T3.1 TERMINOLOGYERMINOLOGY........................................................................................................................................................................................ 773.2 B3.2 BASELINESASELINES...................................................................................................................................................................................................... 883.3 M3.3 METRICSETRICS L LIBRARYIBRARY........................................................................................................................................................................ 10103.4 M3.4 METRICSETRICS S STRATEGIESTRATEGIES FORFOR S SMALLMALL P PROJECTSROJECTS..................................................................................1010
4.0 M4.0 METRICSETRICS P PROCESSROCESS................................................................................................................................................ 11114.1 O4.1 OVERVIEWVERVIEW.................................................................................................................................................................................................. 11114.24.2 PPROJECTROJECT M MANAGEMENTANAGEMENT M METRICSETRICS................................................................................................................ 1212
4.2.1 COST METRICS........................................................................................................ 124.2.1.1 COST (PLANNED VS. ACTUAL)...........................................................................134.2.1.2 EARNED VALUE................................................................................................. 144.2.1.3 MARGIN............................................................................................................. 154.2.1.4 MANAGEMENT RESERVE BALANCE...................................................................16
4.2.2 STAFFING METRICS................................................................................................. 164.2.2.1 STAFFING (PLANNED VERSUS ACTUAL).............................................................174.2.2.2 STAFFING MIX (SALARY, HOURLY, CONTRACTUAL)..........................................184.2.2.3 EFFORT (PLANNED VS. ACTUAL)......................................................................19
4.2.3 QUALITY METRICS.................................................................................................. 204.2.3.1 DELIVERABLES (ON TIME VS. LATE).................................................................204.2.3.2 DELIVERABLES (ACCEPTED VS. REJECTED)......................................................21
4.2.4 SCHEDULE METRICS............................................................................................... 224.2.4.1 DELIVABLES (TOTAL NUMBER).........................................................................234.2.4.2 DELIVERABLES (COMPLETE/REMAINING/LATE)................................................244.2.4.3 DELIVERABLES (LATE/AGING)..........................................................................25
4.2.5 SIZE METRICS......................................................................................................... 25
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 I OF VI
METRICS GUIDEBOOK II
4.2.5.1 FUNCTION POINTS............................................................................................. 264.2.5.2 TOTAL NUMBER OF REQUIREMENTS.................................................................27
4.2.6 CHANGE REQUEST METRICS (CR).........................................................................284.2.6.1 STATUS (APPROVED, REJECTED, PENDING)......................................................284.2.6.2 COST IMPACT..................................................................................................... 29
4.2.7 RISKS METRICS....................................................................................................... 304.2.7.1 RISKS................................................................................................................. 314.2.7.2 ACTION ITEMS................................................................................................... 354.2.7.3 ISSUES............................................................................................................... 38
5.0 S5.0 STATUSTATUS A ACCOUNTINGCCOUNTING......................................................................................................................................41415.1 R5.1 REPORTSEPORTS........................................................................................................................................................................................................ 4141
5.1.1 WEEKLY STATUS MEETINGS..................................................................................415.1.2 PROGRAM REVIEWS................................................................................................ 435.1.3 FORMAL REVIEWS.................................................................................................. 44
5.2 C5.2 CHECKLISTSHECKLISTS............................................................................................................................................................................................ 4646
6.0 S6.0 SUPPORTINGUPPORTING R REVIEWSEVIEWS ANDAND A AUDITSUDITS..........................................................................................47476.1 R6.1 REVIEWSEVIEWS........................................................................................................................................................................................................ 47476.2 AUDITS....................................................................................................... 47
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 II OF VI
METRICS GUIDEBOOK III
LLISTIST OFOF F FIGURESIGURES
Figure 1: Document Organization................................................................................................ 1
Figure 2: Related Documentaiton-Section 2.................................................................................4
Figure 3: Foundation.................................................................................................................... 6
Figure 4: Components of Metrics Baseline..................................................................................7
Figure 5: Metrics Process........................................................................................................... 11
Figure 6: Cost (Planned vs. Actual)...........................................................................................13
Figure 7: Earned Value Management......................................................................................... 14
Figure 8: Margin........................................................................................................................ 15
Figure 9: Management Reserve Balance....................................................................................16
Figure 10: Staffing (Planned vs Actual).....................................................................................17
Figure 11: Staffing Mix............................................................................................................. 18
Figure 12: Effort (Planned vs. Actual).......................................................................................19
Figure 13: Deliverables (On Time vs. Late)...............................................................................20
Figure 14: Deliverables (Accepted vs. Rejected)........................................................................21
Figure 15: Deliverables (Planned vs. Actual).............................................................................23
Figure 16: Deliverables (Complete/Remaining/Late).................................................................24
Figure 17: Deliverables (Late/Aging)......................................................................................... 25
Figure 18: Number of Function Points.......................................................................................26
Figure 19: Number of Requirements.......................................................................................... 27
Figure 20: Change Requests (Approved/Rejected/Pending).......................................................28
Figure 21: Cost Impact (Change Request)..................................................................................29
Figure 22: Number of Risks....................................................................................................... 31
Figure 23: Risks (Distribution).................................................................................................. 32
Figure 24: Risk Aging................................................................................................................ 33
Figure 25: Number of Dollars at Risk........................................................................................34
Figure 26: Number of Action Items...........................................................................................35
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 III OF VI
METRICS GUIDEBOOK IV
Figure 27: Action Items (Distribution)....................................................................................... 36
Figure 28: Action Item Aging.................................................................................................... 37
Figure 29: Number of Issues...................................................................................................... 38
Figure 30: Issues (Distribution).................................................................................................. 39
Figure 31: Issue Aging............................................................................................................... 40
Figure 32: Status Accounting..................................................................................................... 41
Figure 33: Supporting Reviews and Audits................................................................................47
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 IV OF VI
METRICS GUIDEBOOK V
LLISTIST OFOF A APPENDICIESPPENDICIES
None
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 V OF VI
METRICS GUIDEBOOK VI
RREVISIONEVISION H HISTORYISTORY
RREVISIONEVISION N NUMBERUMBER DDATEATE CCOMMENTOMMENT
1.0 February 23, 2001 Original Scope1
1 This document is written and produced by the Georgia Technology Authority (GTA), Program Management Office (PMO) as part of the strategic Continuous Process Improvement initiative. Questions or recommendations for improvement to this document may be forwarded to any PMO member.
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 VI OF VI
METRICS GUIDEBOOK 1
1.0 I1.0 INTRODUCTIONNTRODUCTION
Figure 1: Document Organization
The following paragraphs provide reference to parent, applicable, and information documents relevant to Metrics Collection, Analysis, and Reporting. Figure 1 illustrates this section in the context of the entire guidebook.
1.1 I1.1 IDENTIFICATIONDENTIFICATION O OFF D DOCUMENTOCUMENT
This document is identified as the Metrics Guidebook, Product Code: GTA-PMO-GUI-002.
1.2 S1.2 SCOPECOPE O OFF D DOCUMENTOCUMENT
A. This guidebook contains Project Management Metrics procedures to be followed by all projects in accordance with corporate policies and procedures.
B. As referenced within this guidebook, metrics collection involves measuring specific items throughout the project life cycle from the perspective of project management metrics related to product quality and progress.
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 1 OF 47
MetricsMetricsGuidebookGuidebook
RelatedRelatedDocumentationDocumentation
ParentParentDocumentsDocuments
ApplicableApplicableDocumentsDocuments
InformationInformationDocumentsDocuments
SupportingSupportingReviews & Reviews &
AuditsAudits
ReviewsReviews
AuditsAudits
MetricsMetricsProcessProcess
OverviewOverview
ProjectProjectManagementManagement
MetricsMetrics
StatusStatusAccountingAccounting
ReportsReports
ChecklistsChecklists
IntroductionIntroduction
IdentificationIdentification
ScopeScope
PurposePurpose
OrganizationOrganization
Guidelines for Guidelines for UsingUsing
Guidelines for Guidelines for UpdatingUpdating
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects
MetricsMetricsGuidebookGuidebook
RelatedRelatedDocumentationDocumentation
ParentParentDocumentsDocuments
ApplicableApplicableDocumentsDocuments
InformationInformationDocumentsDocuments
RelatedRelatedDocumentationDocumentation
ParentParentDocumentsDocuments
ApplicableApplicableDocumentsDocuments
InformationInformationDocumentsDocuments
SupportingSupportingReviews & Reviews &
AuditsAudits
ReviewsReviews
AuditsAudits
SupportingSupportingReviews & Reviews &
AuditsAudits
ReviewsReviews
AuditsAudits
MetricsMetricsProcessProcess
OverviewOverview
ProjectProjectManagementManagement
MetricsMetrics
MetricsMetricsProcessProcess
OverviewOverview
ProjectProjectManagementManagement
MetricsMetrics
StatusStatusAccountingAccounting
ReportsReports
ChecklistsChecklists
StatusStatusAccountingAccounting
ReportsReports
ChecklistsChecklists
IntroductionIntroduction
IdentificationIdentification
ScopeScope
PurposePurpose
OrganizationOrganization
Guidelines for Guidelines for UsingUsing
Guidelines for Guidelines for UpdatingUpdating
IntroductionIntroduction
IdentificationIdentification
ScopeScope
PurposePurpose
OrganizationOrganization
Guidelines for Guidelines for UsingUsing
Guidelines for Guidelines for UpdatingUpdating
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects
METRICS GUIDEBOOK 2
1.3 P1.3 PURPOSEURPOSE O OFF D DOCUMENTOCUMENT
A. The purpose of this guidebook is to establish standard methods by which Metrics Collection, Reporting, and Analysis is accomplished. These methods indicate responsibilities for the various aspects of metrics collection, reporting and analysis and indicate which aspects must be documented and reported via other procedures.
B. Methods provided in this manual may be tailored for each program according to the Statement of Work (SOW), or Charter. Tailoring of the methods may be performed in conjunction with the proposal generation and requires no tailoring. The metrics strategy for individual projects will be reviewed by Quality Assurance (QA), Configuration Management (CM) and approved by the program/project manager(s) responsible for the proposed project.
C. The output from this procedure may be used to provide graphical respresentations of project performance analysis in conjunction with reviews, presentations, reports, and executive level dashboards.
1.4 D1.4 DOCUMENTOCUMENT O ORGANIZATIONRGANIZATION
The guidebook is organized as follows:
SSECTIONECTION TTITLEITLE DDESCRIPTIONESCRIPTION
1 Introduction Document identification, scope, purpose, volume organization, and guidelines for using and updating the guidebook.
2 Related Documentation Parent documents, applicable documents, and information documents.
3 Foundation Establishes the framework for metrics including basic terminology, baselines, categorization and content of metrics.
4 Metrics Process Identifies Metrics process by activities within phases and defines specific metrics and responsibility.
5 Status Accounting Identifies the type of reports that should be generated as well as checklists to determine if the appropriate measurements are being accomplished for a project.
6 Supporting Reviews and Audits Contains hints and/or guidelines for successful reviews (project and subcontracts) and Audits.
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 2 OF 47
METRICS GUIDEBOOK 3
1.5 G1.5 GUIDELINESUIDELINES F FOROR U USINGSING T THEHE D DOCUMENTOCUMENT
A. The Metrics Guidebook methods provide standards for the technical, objective approach to metrics and measurement. This methodology has evolved in a disciplined and controlled manner from Project Management practices that have been employed in a series of successful programs.
B. The resulting practices, standards, and methods identified for the project will be amplified in the PMP created for each project. Each project will need to have an established metrics program. Additionally, there will be an establish suite of metrics that will be consistent across all similar projects to faciliate comparitive performance assessment and executive level project performance reporting.
C. The sections of this guidebook apply to all projects. Information contained within the sections is not meant to duplicate information within the PMP but to be used in conjunction with the parent document which defines standards.
1.6 G1.6 GUIDELINESUIDELINES F FOROR U UPDATINGPDATING T THISHIS D DOCUMENTOCUMENT
This guidebook is intended to be a living document and will be maintained by the Georgia Technology Authority (GTA), Program Management Office (PMO) to continuously reflect the latest metrics and measurement practices. Recommendations to update this guidebook should be forwarded to the PMO, using the PILL form, for disposition. The PMO will review and approve changes before incorporation into this document.
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 3 OF 47
METRICS GUIDEBOOK 4
2.0 R2.0 RELATEDELATED D DOCUMENTATIONOCUMENTATION
Figure 2: Related Documentaiton-Section 2
The following paragraphs provide reference to parent, applicable, and information documents relevant to Metrics Collection, Reporting, and Measurement. Figure 2 illustrates this section in context to the entire guidebook.
2.1 P2.1 PARENTARENT D DOCUMENTSOCUMENTS
The Organizations’ Policies are parents to this document:
TTITLEITLE PPRODUCTRODUCT C CODEODE
Project Planning Policy GTA-PMO-POL-002
Project Tracking and Oversight Policy GTA-PMO-POL-003
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 4 OF 47
MetricsMetricsGuidebookGuidebook
RelatedRelatedDocumentationDocumentation
ParentParentDocumentsDocuments
ApplicableApplicableDocumentsDocuments
InformationInformationDocumentsDocuments
SupportingSupportingReviews & Reviews &
AuditsAudits
ReviewsReviews
AuditsAudits
MetricsMetricsProcessProcess
OverviewOverview
ProjectProjectManagementManagement
MetricsMetrics
StatusStatusAccountingAccounting
ReportsReports
ChecklistsChecklists
IntroductionIntroduction
IdentificationIdentification
ScopeScope
PurposePurpose
OrganizationOrganization
Guidelines for Guidelines for UsingUsing
Guidelines for Guidelines for UpdatingUpdating
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects
MetricsMetricsGuidebookGuidebook
RelatedRelatedDocumentationDocumentation
ParentParentDocumentsDocuments
ApplicableApplicableDocumentsDocuments
InformationInformationDocumentsDocuments
RelatedRelatedDocumentationDocumentation
ParentParentDocumentsDocuments
ApplicableApplicableDocumentsDocuments
InformationInformationDocumentsDocuments
SupportingSupportingReviews & Reviews &
AuditsAudits
ReviewsReviews
AuditsAudits
SupportingSupportingReviews & Reviews &
AuditsAudits
ReviewsReviews
AuditsAudits
MetricsMetricsProcessProcess
OverviewOverview
ProjectProjectManagementManagement
MetricsMetrics
MetricsMetricsProcessProcess
OverviewOverview
ProjectProjectManagementManagement
MetricsMetrics
StatusStatusAccountingAccounting
ReportsReports
ChecklistsChecklists
StatusStatusAccountingAccounting
ReportsReports
ChecklistsChecklists
IntroductionIntroduction
IdentificationIdentification
ScopeScope
PurposePurpose
OrganizationOrganization
Guidelines for Guidelines for UsingUsing
Guidelines for Guidelines for UpdatingUpdating
IntroductionIntroduction
IdentificationIdentification
ScopeScope
PurposePurpose
OrganizationOrganization
Guidelines for Guidelines for UsingUsing
Guidelines for Guidelines for UpdatingUpdating
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects
METRICS GUIDEBOOK 5
2.2 A2.2 APPLICABLEPPLICABLE D DOCUMENTSOCUMENTS
A. The following documents are referenced herein and are directly applicable to this document to the extent indicated within the text of this document.
B. Internet standards are available in the Process Asset Library (PAL). The standards may (optionally) be available through your department, division, agency, or the PMO.
C. Internal standards are listed below.
DDOCUMENTOCUMENT TTITLEITLE
GTA-PMO-PRO-500 Change Control
GTA-PMO-PRO-200 Program Reviews
GTA-PMO-PRO-101 PMP Development
GTA-PMO-PRO-102 Schedule Development
2.3 I2.3 INFORMATIONNFORMATION D DOCUMENTSOCUMENTS
The following documents amplify or clarify the information presented in this document but are not binding.
DDOCUMENTOCUMENT TTITLEITLE
CMU/SEI-91-TR-24
ESD-TR-91-24
Project Management Body of Knowledge Guidebook
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 5 OF 47
METRICS GUIDEBOOK 6
3.0 F3.0 FOUNDATIONOUNDATION
Figure 3: Foundation
A. Figure 3 illustrates the Foundation section in context to the entire guidebook.
B. An essential element in any metrics program is to have a baseline containing “planned” results, along with supporting Basis of Estimates (BOEs) to support those planned results. These baseline versions must not be lost during revisions of estimates when recording “actuals” and perhaps creating new planned versions. All versions from the first to the last, along with supporting BOEs must be kept and archived historically beyond the project to better aid future estimation. To accomplish this, Configuration Management (CM), Project Administration (PA), and Quality Assurance must be an integral part of project management processes across all phases of the life cycle.
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 6 OF 47
MetricsMetricsGuidebookGuidebook
RelatedRelatedDocumentationDocumentation
ParentParentDocumentsDocuments
ApplicableApplicableDocumentsDocuments
InformationInformationDocumentsDocuments
SupportingSupportingReviews & Reviews &
AuditsAudits
ReviewsReviews
AuditsAudits
MetricsMetricsProcessProcess
OverviewOverview
ProjectProjectManagementManagement
MetricsMetrics
StatusStatusAccountingAccounting
ReportsReports
ChecklistsChecklists
IntroductionIntroduction
IdentificationIdentification
ScopeScope
PurposePurpose
OrganizationOrganization
Guidelines for Guidelines for UsingUsing
Guidelines for Guidelines for UpdatingUpdating
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects
MetricsMetricsGuidebookGuidebook
RelatedRelatedDocumentationDocumentation
ParentParentDocumentsDocuments
ApplicableApplicableDocumentsDocuments
InformationInformationDocumentsDocuments
RelatedRelatedDocumentationDocumentation
ParentParentDocumentsDocuments
ApplicableApplicableDocumentsDocuments
InformationInformationDocumentsDocuments
SupportingSupportingReviews & Reviews &
AuditsAudits
ReviewsReviews
AuditsAudits
SupportingSupportingReviews & Reviews &
AuditsAudits
ReviewsReviews
AuditsAudits
MetricsMetricsProcessProcess
OverviewOverview
ProjectProjectManagementManagement
MetricsMetrics
MetricsMetricsProcessProcess
OverviewOverview
ProjectProjectManagementManagement
MetricsMetrics
StatusStatusAccountingAccounting
ReportsReports
ChecklistsChecklists
StatusStatusAccountingAccounting
ReportsReports
ChecklistsChecklists
IntroductionIntroduction
IdentificationIdentification
ScopeScope
PurposePurpose
OrganizationOrganization
Guidelines for Guidelines for UsingUsing
Guidelines for Guidelines for UpdatingUpdating
IntroductionIntroduction
IdentificationIdentification
ScopeScope
PurposePurpose
OrganizationOrganization
Guidelines for Guidelines for UsingUsing
Guidelines for Guidelines for UpdatingUpdating
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects
METRICS GUIDEBOOK 7
Figure 4: Components of Metrics Baseline
C. Metrics measurement and analysis functions are controlling disciplines enabling baselined projects to be maintained while actual results are measured. The key requirement for success of a good metrics program is the joint commitment of all levels of management, and the project team, to enforce its use throughout the project lifetime. Figure 4 graphically depicts key components to an effective metrics baseline.
D. Often, projects that are experiencing difficulty, abandon their metrics program, as robust metrics provide maximum visibility into categorical status, issues, and progress. Furthermore, metrics must be relevant both to the area in which it is focused, but also the level of the organization that will view that particular measure. Additionally, metrics measurement and reporting personnel must be cognizant of project management processes, and have attended the appropriate project management training courses.
3.1 T3.1 TERMINOLOGYERMINOLOGY
This paragraph contains an alphabetized sequence of Metrics Collection, Analysis, and Reporting terminology explanations.
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 7 OF 47
Basis of EstimateBasis of Estimate
Supporting BOE DataSupporting BOE Data
Project Management ToolsProject Management ToolsMS Products/Document Development MS Products/Document Development and Managementand Management
Scheduling SoftwareScheduling SoftwareConfiguration Management SoftwareConfiguration Management SoftwareTime Tracking SystemTime Tracking SystemUtilization ManagementUtilization ManagementCommunications/ECommunications/E--mailmailKnowledge Management (Web Site)Knowledge Management (Web Site)
ProjectionsProjectionsBasis of EstimateBasis of Estimate
Supporting BOE DataSupporting BOE Data
Project Management ToolsProject Management ToolsMS Products/Document Development MS Products/Document Development and Managementand Management
Scheduling SoftwareScheduling SoftwareConfiguration Management SoftwareConfiguration Management SoftwareTime Tracking SystemTime Tracking SystemUtilization ManagementUtilization ManagementCommunications/ECommunications/E--mailmailKnowledge Management (Web Site)Knowledge Management (Web Site)
ProjectionsProjections
METRICS GUIDEBOOK 8
TTERMERM DDESCRIPTIONESCRIPTION
Actual The measured value of the metric at the time point in time taken
BCAC Budgeted Cost at Completion – The budgeted cost for the project
BOE Basis of Estimate
CM Configuration Management
ECAC Estimated Cost at Completion – The projected cost to complete the project
GTA Georgia Technology Authority
Metric An objective measurement of a physical, standard, temporal or financial entity
PA Project Administrator
PC/A Project Consultant/Analyst
Planned The predicted value of the metric in question at the particular point in time it is measured.
PMO Program Management Office
QA Quality Assurance
Variance The difference Between the planned metric value and the actual metric value
3.2 B3.2 BASELINESASELINES
The following metrics are designated by category and product code for each baseline in the Project Life Cycle Functional, Allocated, Product, and Special are baselines associated with the Software Development Life Cycle (SDLC). Only Project Management metrics are listed in this docment, and are baselined at the Initial Requirements Review (IRR) along with the Project Management Plan (PMP). The following designators are used to measure the status of each metric at each baseline:
1. N = New Metric baseline. The metric and its BOE data are baselined under formal configuration management control.
2. NV - Next Version. The metric is bench-checked for performance, and perhaps a new baseline is created. If so, the original baseline data for the metric is still maintained, but a new baseline and its BOE data are baselined as a new formal version and progress then tracked against the new data.
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 8 OF 47
METRICS GUIDEBOOK 9
MMETRICETRIC CCATEGORYATEGORY PPRODUCTRODUCT CCODEODE
PMPM FFUNCTIONALUNCTIONAL AALLOCATELLOCATEDD
PPRODUCTRODUCT SSPECIAPECIALL
Cost (Planned Versus Actual)
Cost GP-MET-001 N NV NV NV N
Earned Value Cost GP-MET-002 N NV NV NV N
Margin Cost GP-MET-003 N NV NV NV N
Management Reserve Balance
Cost GP-MET-004 N NV NV NV N
Staffing (Planned Versus Actual)
Staffing GP-MET-005 N NV NV NV N
Staffing Mix Staffing GP-MET-006 N NV NV NV N
Effort Staffing GP-MET-007 N NV NV NV N
Deliverables (On Time Versus Late)
Quality GP-MET-008 N NV NV NV N
Deliverables (Accepted Versus Rejected)
Quality GP-MET-009 N NV NV NV N
Deliverables (Total Number)
Schedule GP-MET-010 N NV NV NV N
Deliverables (Complete/Remaining/
Late)
Schedule GP-MET-011 N NV NV NV N
Deliverables (Late/Aging) Schedule GP-MET-012 N NV NV NV N
Function Point Size Sizing GP-MET-013 N NV NV NV N
Total Number of Requirements
Sizing GP-MET-014 N NV NV NV N
CR Status (Approved, Rejected, Pending)
Change GP-MET-015 N NV NV NV N
Cost Impact Change GP-MET-016 N NV NV NV N
CR Categorization (Cost, Schedule, Quality)
Change GP-MET-017 N NV NV NV N
Risk Items Open Risk GP-MET-018 N NV NV NV N
Risk Item Distribution Risk GP-MET-019 N NV NV NV N
Risk Aging Risk GP-MET-020 N NV NV NV N
Risk Total Value Risk GP-MET-021 N NV NV NV N
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 9 OF 47
METRICS GUIDEBOOK 10
MMETRICETRIC CCATEGORYATEGORY PPRODUCTRODUCT CCODEODE
PMPM FFUNCTIONALUNCTIONAL AALLOCATELLOCATEDD
PPRODUCTRODUCT SSPECIAPECIALL
Issue Items Open Risk GP-MET-022 N NV NV NV N
Issue Item Distribution Risk GP-MET-023 N NV NV NV N
Issue Aging Risk GP-MET-024 N NV NV NV N
Action Items Open Risk GP-MET-025 N NV NV NV N
Action Item Item Distribution
Risk GP-MET-026 N NV NV NV N
Action Item Aging Risk GP-MET-027 N NV NV NV N
3.3 M3.3 METRICSETRICS L LIBRARYIBRARY
Maintain all metrics (both past and previous versions) as well as all historical versions of the estimation data, including source of data, classifications of data, assumptions, constraints, and estimation methods that support such data. These items should be version managed using the CM library tool for the project.
3.4 M3.4 METRICSETRICS S STRATEGIESTRATEGIES FORFOR S SMALLMALL P PROJECTSROJECTS
Projects using abbreviated life cycles, or operations projects should benchmark the standard metrics contained in this guide and provide tailoring out for items that will not be beneficial. For instance, function points for a four-week project may not be advantageous, as the project will complete before the first reporting period may arrive. Consider, however, that projects that are fast moving (time constrained) and high risk, may require the same metrics, but reported more frequently.
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 10 OF 47
METRICS GUIDEBOOK 11
4.0 M4.0 METRICSETRICS P PROCESSROCESS
Figure 5: Metrics Process
4.1 O4.1 OVERVIEWVERVIEW
A. Metrics are collected for measuring the progress of a project against its planned budget, schedule, resource usage, and error rates, and of establishing a historical database which will aid in planning and forecasting future projects. Figure 5 illustrates the Metrics Process in relation to the other sections in this guidebook.
B. Metrics are also used as an indication of model stability which signals the time to proceed into the next phase of the project life cycle.
C. Metrics collected and reported for projects include the following six categories:
1. Cost Metrics;
2. Staffing Metrics;
3. Quality Metrics;
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 11 OF 47
MetricsMetricsGuidebookGuidebook
RelatedRelatedDocumentationDocumentation
ParentParentDocumentsDocuments
ApplicableApplicableDocumentsDocuments
InformationInformationDocumentsDocuments
SupportingSupportingReviews & Reviews &
AuditsAudits
ReviewsReviews
AuditsAudits
MetricsMetricsProcessProcess
OverviewOverview
ProjectProjectManagementManagement
MetricsMetrics
StatusStatusAccountingAccounting
ReportsReports
ChecklistsChecklists
IntroductionIntroduction
IdentificationIdentification
ScopeScope
PurposePurpose
OrganizationOrganization
Guidelines for Guidelines for UsingUsing
Guidelines for Guidelines for UpdatingUpdating
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects
MetricsMetricsGuidebookGuidebook
RelatedRelatedDocumentationDocumentation
ParentParentDocumentsDocuments
ApplicableApplicableDocumentsDocuments
InformationInformationDocumentsDocuments
RelatedRelatedDocumentationDocumentation
ParentParentDocumentsDocuments
ApplicableApplicableDocumentsDocuments
InformationInformationDocumentsDocuments
SupportingSupportingReviews & Reviews &
AuditsAudits
ReviewsReviews
AuditsAudits
SupportingSupportingReviews & Reviews &
AuditsAudits
ReviewsReviews
AuditsAudits
MetricsMetricsProcessProcess
OverviewOverview
ProjectProjectManagementManagement
MetricsMetrics
MetricsMetricsProcessProcess
OverviewOverview
ProjectProjectManagementManagement
MetricsMetrics
StatusStatusAccountingAccounting
ReportsReports
ChecklistsChecklists
StatusStatusAccountingAccounting
ReportsReports
ChecklistsChecklists
IntroductionIntroduction
IdentificationIdentification
ScopeScope
PurposePurpose
OrganizationOrganization
Guidelines for Guidelines for UsingUsing
Guidelines for Guidelines for UpdatingUpdating
IntroductionIntroduction
IdentificationIdentification
ScopeScope
PurposePurpose
OrganizationOrganization
Guidelines for Guidelines for UsingUsing
Guidelines for Guidelines for UpdatingUpdating
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects
METRICS GUIDEBOOK 12
4. Schedule Metrics;
5. Size Metrics; and
6. Risk Metrics.
D. The following sections summarize the areas for collecting and reporting metrics.
4.24.2 PPROJECTROJECT M MANAGEMENTANAGEMENT M METRICSETRICS
The following sections reflect the range of Project Management Metrics along with illustrations depicting how the data could be represented for reporting purposes.
4.2.1 C4.2.1 COSTOST M METRICSETRICS
Cost metrics are used throughout the project life cycle, and are included each month in the Project Status Report (PSR), and are briefed at the Program Reviews.
CCOREORE MMETRICETRIC
WWHENHEN SSTARTTART
CCOLLECTOROLLECTOR MMETRICETRIC UUPDATEDPDATED BBRIEFEDRIEFED A ATT
Cost IRR PA Cost (Planned vs. Actual) Monthly Program Reviews & Formal Reviews
IRR PA Earned Value Monthly Program Reviews & Formal Reviews
IRR PA Margin Monthly Program Reviews & Formal Reviews
IRR PA Management Reserve Balance
Monthly Program Reviews & Formal Reviews
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 12 OF 47
METRICS GUIDEBOOK 13
4.2.1.1 COST (PLANNED VS. ACTUAL)
The purpose of this metric is to measure how well the project costs are performing according to plan. This metric illustrates the variance between the planned costs for the project and the actual cost for the project. An example of the graph is shown below in figure 6.
Figure 6: Cost (Planned vs. Actual)
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 13 OF 47
6565
Jan Feb Mar Apr
100
75
50
25
K$ BCAC $100KBCAC $100KECAC $110KECAC $110K
909090908080
Planned
Actual
BCACBCACECACECAC
METRICS GUIDEBOOK 14
4.2.1.2 EARNED VALUE
The purpose of the Earned Value Metric is to compare the amount of work accomplished and the value of that work, to current and projected cost. This is accomplished by comparing the planned cost; actual cost and the actual earned value of the deliverables accepted, then graphically representing the variance between the three. Earned value is earned in increments of 25% when the phase or deliverable is started and the remaining 75% when the phase or deliverable is completed. An example of the graph is shown below in figure 7.
Figure 7: Earned Value Management
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 14 OF 47
JanJan FebFeb MarMar AprApr
100100
7575
5050
2525
$K$KBCAC $100KBCAC $100KECAC $120KECAC $120K
Status Status ReportingReporting
DateDate
Planned Funds Planned Funds = $25K= $25K
Cost Actuals = $22KCost Actuals = $22KEarned Value = $20KEarned Value = $20K
BCACBCACECACECAC
METRICS GUIDEBOOK 15
4.2.1.3 MARGIN
The purpose of this metric is to measure the projected margin percentage compared to the actual margin percentage that is being realized on the project. Margin is the difference between the revenue for the project and the cost for the project. At the beginning of each project senior management sets the desired baseline margin percentage expectation and the actuals are then tracked. To illustrate this, the planned margin percentage is compared to the actual margin percentage. An example of the graph is shown below in figure 8.
Figure 8: Margin
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 15 OF 47
40%40%
JanJan FebFeb MarMar AprApr
100100
7575
5050
2525
%%Desired MarginDesired Margin40%40%
PlannedPlanned
ActualActual40%40% 40%40% 40%40%
METRICS GUIDEBOOK 16
4.2.1.4 MANAGEMENT RESERVE BALANCE
The purpose of this metric is to measure the balance and expenditure of management reserve. Management reserve is the portion of the contract budget that has been allocated to cover unforeseen program requirements. During Project Close Out, any management reserve left increases the final margin for the project. To illustrate this the graph shows the total amount of reserve left as well as the cumulative usage of the reserve on a monthly basis. An example of the graph is shown below in figure 9.
Figure 9: Management Reserve Balance
4.2.2 S4.2.2 STAFFINGTAFFING M METRICSETRICS
Staffing metrics are used throughout the life cycle of the project, included each month in the Project Status Report (PSR), and are briefed at the Program Reviews.
CCOREORE MMETRICETRIC
WWHENHEN SSTARTTART
CCOLLECTOROLLECTOR MMETRICETRIC UUPDATEDPDATED BBRIEFEDRIEFED A ATT
Staffing Start PA Staffing (Planned vs. Actual)
Monthly Program Reviews & Formal Reviews
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 16 OF 47
$50K$50K
JanJan FebFeb MarMar AprApr
100100
7575
5050
2525
KK
MR BudgetMR Budget$50,000 $50,000
AvailableAvailable
UsedUsed$45K$45K$45K$45K
$5K$5K
$42K$42K
$5K$5K $8K$8K
METRICS GUIDEBOOK 17
CCOREORE MMETRICETRIC
WWHENHEN SSTARTTART
CCOLLECTOROLLECTOR MMETRICETRIC UUPDATEDPDATED BBRIEFEDRIEFED A ATT
Start PA Staffing Mix (Salary, Hourly, Contractual)
Monthly Program Reviews & Formal Reviews
Start PA Effort (Planned vs. Actual) Monthly Program Reviews & Formal Reviews
4.2.2.1 STAFFING (PLANNED VERSUS ACTUAL)
The purpose of this metric is to measure how well the project is staffed according to plan. This is accomplished by illustrating the variance between the planned staffing vs. the actual staffing for the project on a monthly basis. An example of the graph is shown below in figure 10.
Figure 10: Staffing (Planned vs Actual)
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 17 OF 47
225225
JanJan FebFeb MarMar AprApr
400400
300300
200200
100100
StaffingStaffing
100100
300300225225
PlannedPlanned
ActualActual
METRICS GUIDEBOOK 18
4.2.2.2 STAFFING MIX (SALARY, HOURLY, CONTRACTUAL)
The purpose of the metric is to illustrate the staffing mix on the project. This is accomplished by showing the total number of people on the project categorized by salary, hourly and contractual employees. The total number of employees on this graph must equal the total number of actual staffing in the Staffing (planned vs. actual) graph. An example of the graph is shown below in figure 11.
Figure 11: Staffing Mix
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 18 OF 47
JanJan FebFeb MarMar AprApr
400400
300300
200200
100100
EmployeesEmployees
HourlyHourly
ContractualContractual
SalarySalary125125
2525
7575
125125
2525
7575
125125
2525
7575
125125
2525
7575
200200
2525
7575
200200
2525
7575
5050
2525
2525
5050
2525
2525
METRICS GUIDEBOOK 19
4.2.2.3 EFFORT (PLANNED VS. ACTUAL)
The purpose of the metric is to measure the amount of effort being spent on the project. This is accomplished by illustrating the amount of actual hours worked compared to the amount of planned hours and displaying their variance. All time (including all overtime) must be logged for the projects. An example of the graph is shown below in figure 12.
Figure 12: Effort (Planned vs. Actual)
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 19 OF 47
10251025
JanJan FebFeb MarMar AprApr
20002000
15001500
10001000
500500
HoursHours
1900190015001500
13001300PlannedPlanned
ActualActual
METRICS GUIDEBOOK 20
4.2.3 Q4.2.3 QUALITYUALITY M METRICSETRICS
Quality metrics are used throughout the life cycle of the project, included each month in the Project Status Report (PSR), and are briefed at the Program Reviews.
CCOREORE MMETRICETRIC
WWHENHEN SSTARTTART
CCOLLECTOROLLECTOR MMETRICETRIC UUPDATEDPDATED BBRIEFEDRIEFED A ATT
Quality Start SQA Deliverables (On Time vs. Late) Weekly Program Reviews & Formal Reviews
Start SQA Deliverables (Accepted vs. Rejected)
Weekly Program Reviews & Formal Reviews
4.2.3.1 DELIVERABLES (ON TIME VS. LATE)
The purpose of the metric is to illustrate the project’s promptness of the delivery according to the approved schedule. This is accomplished by showing the total number of deliverables that are on time compared to the ones that are late. An example of the graph is shown below in figure 13.
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 20 OF 47
METRICS GUIDEBOOK 21
Figure 13: Deliverables (On Time vs. Late)
4.2.3.2 DELIVERABLES (ACCEPTED VS. REJECTED)
The purpose of the metric is to measure the customer acceptance rate of the project deliverables. This is accomplished by displaying the total number of deliverables that are accepted compared to the ones that are rejected. An example of the graph is shown below in figure 14.
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 21 OF 47
1515
JanJan FebFeb MarMar AprApr
2020
1515
1010
55
DeliverablesDeliverables
5510101010
LateLate
On TimeOn Time
2255
METRICS GUIDEBOOK 22
Figure 14: Deliverables (Accepted vs. Rejected)
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 22 OF 47
1515
JanJan FebFeb MarMar AprApr
2020
1515
1010
55
DeliverablesDeliverables
5510101010
RejectedRejected
AcceptedAccepted
2255
METRICS GUIDEBOOK 23
4.2.4 S4.2.4 SCHEDULECHEDULE M METRICSETRICS
Schedule metrics are used throughout the life cycle of the project, included each month in the Project Status Report (PSR), and are briefed at the Program Reviews.
CCOREORE MMETRICETRIC
WWHENHEN SSTARTTART
CCOLLECTOROLLECTOR MMETRICETRIC UUPDATEDPDATED BBRIEFEDRIEFED A ATT
Schedule Start PA Deliverables (Total Number) Monthly Program Reviews & Formal Reviews
Start PA Deliverables (Complete/Remaining/Late)
Monthly Program Reviews & Formal Reviews
Start PA Deliverables (Late/Aging) Monthly Program Reviews & Formal Reviews
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 23 OF 47
METRICS GUIDEBOOK 24
4.2.4.1 DELIVABLES (TOTAL NUMBER)
The purpose of the metric is to give a running total of deliveries for the project to the customer. This is accomplished by showing the cumulative planned total number of deliveries (each time a deliverable flows to the customer for acceptance) vs. the actual number of deliveries that have acceptance letters. An example of the graph is shown below in figure 15.
Figure 15: Deliverables (Planned vs. Actual)
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 24 OF 47
10251025
JanJan FebFeb MarMar AprApr
20002000
15001500
10001000
500500
HoursHours
1900190015001500
13001300PlannedPlanned
ActualActual
METRICS GUIDEBOOK 25
4.2.4.2 DELIVERABLES (COMPLETE/REMAINING/LATE)
The purpose of this metric is to measure the distribution of status the project deliverables. This is accomplished by categorizing the deliverables into completed, remaining or late. An example of the graph is shown below in figure 16.
Figure 16: Deliverables (Complete/Remaining/Late)
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 25 OF 47
55
JanJan FebFeb MarMar AprApr
2020
1515
1010
55
DeliverablesDeliverables
2020
1515
1010
LateLate
RemainingRemaining
CompleteComplete
22
1313
1010
22
33
METRICS GUIDEBOOK 26
4.2.4.3 DELIVERABLES (LATE/AGING)
The purpose of this metric is to point out how many deliverables are late and the aging of those deliverables. This is accomplished by categorizing the late deliverables into the following categories: One, Two, Three or greater than Four weeks. An example of the graph is shown below in figure 17.
Figure 17: Deliverables (Late/Aging)
4.2.5 S4.2.5 SIZEIZE M METRICSETRICS
Size metrics are used throughout the life cycle of the project, included each month in the Project Status Report (PSR), and are briefed at the Program Reviews.
CCOREORE MMETRICETRIC
WWHENHEN SSTARTTART
CCOLLECTOROLLECTOR MMETRICETRIC UUPDATEDPDATED BBRIEFEDRIEFED A ATT
Size IRR SCM Function Points By Phase Formal Reviews
Size IRR SCM Total Number of Requirements By Phase Formal Reviews
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 26 OF 47
22
JanJan FebFeb MarMar AprApr
2020
1515
1010
55
DeliverablesDeliverables
1 week1 week
2 weeks2 weeks
3 weeks3 weeks
4 weeks or 4 weeks or greatergreater
1010
55
1010
55
44
2211
44
2211
1010
METRICS GUIDEBOOK 27
4.2.5.1 FUNCTION POINTS
The purpose of this metric is to track the project problem size throughout the life cycle. This is accomplished by tracking the total number of function points on a monthly basis. An example of the graph is shown below in figure 18.
Figure 18: Number of Function Points
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 27 OF 47
15001500
Phase Phase PhasePhase PhasePhase PhasePhase
20002000
15001500
10001000
500500
Function PointsFunction Points
AdditionalAdditional
OriginalOriginal
300300
15001500
300300
15001500 15001500
300300
15001500
300300
15001500
500500
15001500
500500
METRICS GUIDEBOOK 28
4.2.5.2 TOTAL NUMBER OF REQUIREMENTS
The purpose of this metric is to track the number of requirements throughout the life cycle of the project. This is accomplished by tracking the requirements initially documented, along with any additional ones added throughout the life of the project. An example of the graph is shown below in figure 19.
Figure 19: Number of Requirements
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 28 OF 47
15001500
Phase Phase Phase Phase
2000
1500
1000
500
Requirements
AdditionalAdditional
OriginalOriginal
300300
15001500
300300
15001500 15001500
300300
15001500
300300
15001500
500500
15001500
500500
METRICS GUIDEBOOK 29
4.2.6 C4.2.6 CHANGEHANGE R REQUESTEQUEST M METRICSETRICS (CR) (CR)
CCOREORE MMETRICETRIC
WWHENHEN SSTARTTART
CCOLLECTOROLLECTOR MMETRICETRIC UUPDATEDPDATED BBRIEFEDRIEFED A ATT
Change IRR SCM Status (Approved, Rejected, Pending )
Monthly Program Reviews
Change IRR SCM Cost Impact Monthly Program Reviews
Change IRR SCM Categorization (Cost, Schedule, Quality)
Monthly Program Reviews
4.2.6.1 STATUS (APPROVED, REJECTED, PENDING)
The purpose of the metric is to measure the status of all change requests. This is accomplished by categorizing the change request into approved, rejected and pending. An example of the graph is shown below in figure 20.
Figure 20: Change Requests (Approved/Rejected/Pending)
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 29 OF 47
JanJan FebFeb MarMar AprApr
2020
1515
1010
55
RequestsRequests
55
1515RejectedRejected
PendingPending
ApprovedApproved
1010
22
33
1010
22
33
55
11
66
55
11
66
METRICS GUIDEBOOK 30
4.2.6.2 COST IMPACT
The purpose of the metric is to measure the total cost impact of all the changes. This is accomplished by keeping a cumulative running total of all change requests and their associated cost. An example of the graph is shown below in figure 21.
Figure 21: Cost Impact (Change Request)
.
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 30 OF 47
$50K$50K
JanJan FebFeb MarMar AprApr
200200
150150
100100
5050
KK
$10K$10K
$50K$50K
$10K$10K
$50K$50K $60K$60K $60K$60K
$40K$40K
$60K$60K
$40K$40K Current MonthCurrent Month
PreviousPreviousImpactImpact
METRICS GUIDEBOOK 31
4.2.7 R4.2.7 RISKSISKS M METRICSETRICS
Risk metrics are used throughout the life cycle of the software development process, included each month in the Project Status Report (PSR), and are briefed at the Program Reviews.
CCOREORE MMETRICETRIC
WWHENHEN SSTARTTART
CCOLLECTOROLLECTOR MMETRICETRIC UUPDATEDPDATED BBRIEFEDRIEFED A ATT
Risk Start PA Risk
Open
Distribution
Aging
Total Value
Monthly Program Reviews
Risk Start PA Action Items
Open
Distribution
Aging
Monthly Program Reviews
Risk Start PA Issues
Open
Distribution
Aging
Monthly Program Reviews
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 31 OF 47
METRICS GUIDEBOOK 32
4.2.7.1 RISKS
4.2.7.1.1 OPEN
The purpose of the metric is to measure how many risks are currently open on the project. This is accomplished by showing the total number of open risk for each month. An example of the graph is shown below in figure 22.
Figure 22: Number of Risks
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 32 OF 47
JanJan FebFeb MarMar AprApr
2020
1515
1010
55
RiskRisk
Total Open Risks Total Open Risks 55
101088
1515
METRICS GUIDEBOOK 33
4.2.7.1.2 DISTRIBUTION
The purpose of the metric is to illustrate the number of risks by category. This is accomplished by assigning risks to one or more of the following areas: Size, Schedule, Quality, Staffing, and/or Cost. An example of the graph is shown below in figure 23.
Figure 23: Risks (Distribution)
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 33 OF 47
JanJan FebFeb MarMar AprApr
2020
1515
1010
55
RiskRisk
88
1515
SizeSize
ScheduleSchedule
Quality Quality
Staffing Staffing
Cost Cost
55
55
55
55
55
55
1010
55
1010
55
METRICS GUIDEBOOK 34
4.2.7.1.3 AGING
The purpose of the metric is to illustrate the age of the risk. This is accomplished by categorizing the risk into the following aging groups: One, Two, and > Three Months. An example of the graph is shown below in figure 24.
Figure 24: Risk Aging
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 34 OF 47
JanJan FebFeb MarMar AprApr
2020
1515
1010
55
RiskRisk
88
1515 1 Month1 Month
2 Months2 Months
> 3 Months> 3 Months55
55
55
55
55
55
1010
55
1010
55
METRICS GUIDEBOOK 35
4.2.7.1.4 TOTAL VALUE
The purpose of the metric is to put a total value on the Risk. This is accomplished by totaling the individual risk dollar amounts. The total amount becomes known as the # of Dollars at Risk for the project. An example of the graph is shown below in figure 25.
Figure 25: Number of Dollars at Risk
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 35 OF 47
$50K$50K
JanJan FebFeb MarMar AprApr
200200
150150
100100
5050
KK
$10K$10K
$50K$50K
$10K$10K
$50K$50K $60K$60K $60K$60K
$40K$40K
$60K$60K
$40K$40K
Current MonthCurrent Month
Prior MonthsPrior Months
METRICS GUIDEBOOK 36
4.2.7.2 ACTION ITEMS
4.2.7.2.1 OPEN
The purpose of the graph is to measure how many action items are open. This is accomplished by showing the total number of open action items by time period. An example of the graph is shown below in figure 26.
Figure 26: Number of Action Items
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 36 OF 47
JanJan FebFeb MarMar AprApr
2020
1515
1010
55
Action ItemsAction Items
551010
88
1515
Total Open ActionTotal Open ActionItemsItems
METRICS GUIDEBOOK 37
4.2.7.2.2 DISTRIBUTION
The purpose of the metric is to illustrate the number of action items by category. This is accomplished by assigning action items to one or more of the following areas: Size, Schedule, Quality, Staffing, and/or Cost. An example of the graph is shown below in figure 27.
Figure 27: Action Items (Distribution)
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 37 OF 47
JanJan FebFeb MarMar AprApr
2020
1515
1010
55
RiskRisk
88
1515
SizeSize
ScheduleSchedule
Quality Quality
Staffing Staffing
Cost Cost
55
55
55
55
55
55
1010
55
1010
55
METRICS GUIDEBOOK 38
4.2.7.2.3 AGING
The purpose of the metric is to illustrate the aging of the action items. This is accomplished by categorizing the action items into the following aging groups: One, Two, and > Three Months. An example of the graph is shown below in figure 28.
Figure 28: Action Item Aging
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 38 OF 47
JanJan FebFeb MarMar AprApr
2020
1515
1010
55
RiskRisk
88
1515 1 Month1 Month
2 Months2 Months
> 3 Months> 3 Months55
55
55
55
55
55
1010
55
1010
55
METRICS GUIDEBOOK 39
4.2.7.3 ISSUES
4.2.7.3.1 OPEN
The purpose of the graph is to measure how many Issues are open. This is accomplished by showing the total number of open issues by time period. An example of the graph is shown below in figure 29.
Figure 29: Number of Issues
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 39 OF 47
JanJan FebFeb MarMar AprApr
2020
1515
1010
55
Action ItemsAction Items
551010
88
1515
JanJan FebFeb MarMar AprApr
2020
1515
1010
55
Action ItemsAction Items
551010
88
1515
Total Open IssuesTotal Open Issues
METRICS GUIDEBOOK 40
4.2.7.3.2 DISTRIBUTION
The purpose of the metric is to illustrate the number of issues by category. This is accomplished by assigning issues to one or more of the following areas: Size, Schedule, Software Quality, Staffing, and/or Cost. An example of the graph is shown below in figure 30.
Figure 30: Issues (Distribution)
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 40 OF 47
JanJan FebFeb MarMar AprApr
2020
1515
1010
55
RiskRisk
88
1515
SizeSize
ScheduleSchedule
Quality Quality
Staffing Staffing
Cost Cost
55
55
55
55
55
55
1010
55
1010
55
METRICS GUIDEBOOK 41
4.2.7.3.3 AGING
The purpose of the metric is to illustrate the aging of the issues. This is accomplished by categorizing the issues into the following aging groups: One, Two, and > Three Months. An example of the graph is shown below.
Figure 31: Issue Aging
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 41 OF 47
JanJan FebFeb MarMar AprApr
2020
1515
1010
55
RiskRisk
88
1515 1 Month1 Month
2 Months2 Months
> 3 Months> 3 Months55
55
55
55
55
55
1010
55
1010
55
METRICS GUIDEBOOK 42
5.0 S5.0 STATUSTATUS A ACCOUNTINGCCOUNTING
Figure 32: Status Accounting
5.1 R5.1 REPORTSEPORTS
5.1.1 W5.1.1 WEEKLYEEKLY S STATUSTATUS M MEETINGSEETINGS
Weekly status meetings and their formats are predefined under procedures for Project Tracking and Oversight. The following metrics should be briefed using the Weekly Status Report (WSR) format with attachments for metric graphics. Project Managers may opt to use all or a mixture of the metrics. The following establishes a guideline for metrics to be reviewed during this review. Figure 32 illustrates this section in the context of the entire guidebook.
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 42 OF 47
MetricsMetricsGuidebookGuidebook
RelatedRelatedDocumentationDocumentation
ParentParentDocumentsDocuments
ApplicableApplicableDocumentsDocuments
InformationInformationDocumentsDocuments
SupportingSupportingReviews & Reviews &
AuditsAudits
ReviewsReviews
AuditsAudits
MetricsMetricsProcessProcess
OverviewOverview
ProjectProjectManagementManagement
MetricsMetrics
StatusStatusAccountingAccounting
ReportsReports
ChecklistsChecklists
IntroductionIntroduction
IdentificationIdentification
ScopeScope
PurposePurpose
OrganizationOrganization
Guidelines for Guidelines for UsingUsing
Guidelines for Guidelines for UpdatingUpdating
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects
METRICS GUIDEBOOK 43
MMETRICETRIC CCATEGORYATEGORY PPRODUCTRODUCT C CODEODE RREPORTEDEPORTED
Cost (Planned Versus Actual) Cost GP-MET-001 Y
Earned Value Cost GP-MET-002 Y
Margin Cost GP-MET-003 N
Management Reserve Balance Cost GP-MET-004 N
Staffing (Planned Versus Actual) Staffing GP-MET-005 Y
Staffing Mix Staffing GP-MET-006 Y
Effort Staffing GP-MET-007 Y
Deliverables (On Time Versus Late) Quality GP-MET-008 Y
Deliverables (Accepted Versus Rejected)
Quality GP-MET-009 Y
Deliverables (Total Number) Schedule GP-MET-010 Y
Deliverables (Complete/Remaining/Late)
Schedule GP-MET-011 Y
Deliverables (Late/Aging) Schedule GP-MET-012 Y
Function Point Size Sizing GP-MET-013 N
Total Number of Requirements Sizing GP-MET-014 N
CR Status (Approved, Rejected, Pending)
Change GP-MET-015 N
Cost Impact Change GP-MET-016 N
CR Categorization (Cost, Schedule, Quality)
Change GP-MET-017 N
Risk Items Open Risk GP-MET-018 Y
Risk Item Distribution Risk GP-MET-019 Y
Risk Aging Risk GP-MET-020 Y
Risk Total Value Risk GP-MET-021 N
Issue Items Open Risk GP-MET-022 Y
Issue Item Distribution Risk GP-MET-023 Y
Issue Aging Risk GP-MET-024 Y
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 43 OF 47
METRICS GUIDEBOOK 44
MMETRICETRIC CCATEGORYATEGORY PPRODUCTRODUCT C CODEODE RREPORTEDEPORTED
Action Item Items Open Risk GP-MET-025 Y
Action Item Item Distribution Risk GP-MET-026 Y
Action Item Aging Risk GP-MET-027 Y
5.1.2 P5.1.2 PROGRAMROGRAM R REVIEWSEVIEWS
Program Reviews are conducted monthly with the Program Manager in accordance with the Program Review procedure, Product Code: GP-PRC-200. Program Managers may opt to use all or a mixture of the metrics. The following establishes a guideline for metrics to be reviewed during this review.
MMETRICETRIC CCATEGORYATEGORY PPRODUCTRODUCT C CODEODE RREPORTEDEPORTED
Cost (Planned Versus Actual) Cost GP-MET-001 Y
Earned Value Cost GP-MET-002 Y
Margin Cost GP-MET-003 Y
Management Reserve Balance Cost GP-MET-004 Y
Staffing (Planned Versus Actual) Staffing GP-MET-005 Y
Staffing Mix Staffing GP-MET-006 Y
Effort Staffing GP-MET-007 Y
Deliverables (On Time Versus Late) Quality GP-MET-008 Y
Deliverables (Accepted Versus Rejected)
Quality GP-MET-009 Y
Deliverables (Total Number) Schedule GP-MET-010 Y
Deliverables (Complete/Remaining/Late)
Schedule GP-MET-011 Y
Deliverables (Late/Aging) Schedule GP-MET-012 Y
Function Point Size Sizing GP-MET-013 Y
Total Number of Requirements Sizing GP-MET-014 Y
CR Status (Approved, Rejected, Change GP-MET-015 Y
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 44 OF 47
METRICS GUIDEBOOK 45
MMETRICETRIC CCATEGORYATEGORY PPRODUCTRODUCT C CODEODE RREPORTEDEPORTED
Pending)
Cost Impact Change GP-MET-016 Y
CR Categorization (Cost, Schedule, Quality)
Change GP-MET-017 Y
Risk Items Open Risk GP-MET-018 Y
Risk Item Distribution Risk GP-MET-019 Y
Risk Aging Risk GP-MET-020 Y
Risk Total Value Risk GP-MET-021 Y
Issue Items Open Risk GP-MET-022 Y
Issue Item Distribution Risk GP-MET-023 Y
Issue Aging Risk GP-MET-024 Y
Action Item Items Open Risk GP-MET-025 Y
Action Item Item Distribution Risk GP-MET-026 Y
Action Item Aging Risk GP-MET-027 Y
5.1.3 F5.1.3 FORMALORMAL R REVIEWSEVIEWS
Formal Reviews are conducted at the end of each phase of the project. Program Managers may opt to use all or a mixture of the metrics. The following establishes a guideline for metrics to be reviewed during this review.
MMETRICETRIC CCATEGORYATEGORY PPRODUCTRODUCT C CODEODE RREPORTEDEPORTED
Cost (Planned Versus Actual) Cost GP-MET-001 Y
Earned Value Cost GP-MET-002 Y
Margin Cost GP-MET-003 N
Management Reserve Balance Cost GP-MET-004 N
Staffing (Planned Versus Actual) Staffing GP-MET-005 Y
Staffing Mix Staffing GP-MET-006 Y
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 45 OF 47
METRICS GUIDEBOOK 46
MMETRICETRIC CCATEGORYATEGORY PPRODUCTRODUCT C CODEODE RREPORTEDEPORTED
Effort Staffing GP-MET-007 Y
Deliverables (On Time Versus Late) Quality GP-MET-008 Y
Deliverables (Accepted Versus Rejected)
Quality GP-MET-009 Y
Deliverables (Total Number) Schedule GP-MET-010 Y
Deliverables (Complete/Remaining/Late)
Schedule GP-MET-011 Y
Deliverables (Late/Aging) Schedule GP-MET-012 Y
Function Point Size Sizing GP-MET-013 Y
Total Number of Requirements Sizing GP-MET-014 Y
CR Status (Approved, Rejected, Pending)
Change GP-MET-015 Y
Cost Impact Change GP-MET-016 Y
CR Categorization (Cost, Schedule, Quality)
Change GP-MET-017 Y
Risk Items Open Risk GP-MET-018 Y
Risk Item Distribution Risk GP-MET-019 Y
Risk Aging Risk GP-MET-020 Y
Risk Total Value Risk GP-MET-021 Y
Issue Items Open Risk GP-MET-022 Y
Issue Item Distribution Risk GP-MET-023 Y
Issue Aging Risk GP-MET-024 Y
Action Item Items Open Risk GP-MET-025 Y
Action Item Item Distribution Risk GP-MET-026 Y
Action Item Aging Risk GP-MET-027 Y
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 46 OF 47
METRICS GUIDEBOOK 47
5.2 C5.2 CHECKLISTSHECKLISTS
QA Checklist for Metrics, Product Code: GTA-PMO-CKL-035 will be used to crosscheck metrics prior to presentation for any review.
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 47 OF 47
METRICS GUIDEBOOK 48
6.0 S6.0 SUPPORTINGUPPORTING R REVIEWSEVIEWS ANDAND A AUDITSUDITS
Figure 33: Supporting Reviews and Audits
6.1 R6.1 REVIEWSEVIEWS
For information concerning reviews of metrics, reference section 5.0 for detailed information. Figure 33 illustrates this section in the context of the entire guidebook.
6.2 A6.2 AUDITSUDITS
Audits will be conducted on metrics as determined by the GTA PMO for the Georgia Technology Authority.
THIS IS A CONTROLLED DOCUMENT, REFER TO THE DOCUMENT CONTROL INDEX FOR THE LATEST REVISION
REVISION: 1.0 GTA-PMO-GUI-002 48 OF 47
MetricsMetricsGuidebookGuidebook
RelatedRelatedDocumentationDocumentation
ParentParentDocumentsDocuments
ApplicableApplicableDocumentsDocuments
InformationInformationDocumentsDocuments
SupportingSupportingReviews & Reviews &
AuditsAudits
ReviewsReviews
AuditsAudits
MetricsMetricsProcessProcess
OverviewOverview
ProjectProjectManagementManagement
MetricsMetrics
StatusStatusAccountingAccounting
ReportsReports
ChecklistsChecklists
IntroductionIntroduction
IdentificationIdentification
ScopeScope
PurposePurpose
OrganizationOrganization
Guidelines for Guidelines for UsingUsing
Guidelines for Guidelines for UpdatingUpdating
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects
FoundationFoundation
TerminologyTerminology
BaselinesBaselines
MetricsMetricsLibraryLibrary
Metrics StrategyMetrics StrategyFor SmallFor SmallProjectsProjects