Testing Job Family Goals & Objectives 2012-13 Page 1
G&O of roles in Testing job family Band Unique Role Repeat Role name Level G&O template
TRB/WASE/A1/A2/A3 Engineer Test Engineer Level 1 Click here
Band Unique role Repeat Role Name Level G&O template
B1 / WASE / Engineer Test Engineer Level 2 Click here
Band Unique Role Repeat Role Name Level G&O template
B2 Engineer Test Engineer Level 3 Click here
Band Unique Role Repeat Role Name Level G&O template
B3 Lead Test Lead Level 1 Click here
Band Unique Role Repeat Role Name Level G&O template
C1 Project Manager Test Project Manager Level 2 Click here
C1 Architect Test Architect Level 1 Click here
C1 Consultant Test Consultant Level 1 Click here
Band Unique Role Repeat Role Name Level G&O template
C2 Architect Test Architect Level 2 Click here
C2 Consultant Test Consultant Level 2 Click here
C2 Delivery Manager
Testing Practice Delivery Manager
Level 1 Click here
Band Unique Role Repeat Role Name Level G&O template
D1 Delivery Manager Testing Practice Delivery Manager
Level 2 Click here
Testing Job Family Goals & Objectives 2012-13 Page 2
Goals and Objectives
Test Engineer L1 Objectives 2012-13
Objectives Measurement Criteria Weight
Customer Focus
Timely Response to customer requests - Answering query state of FRs/SRs, responses for traces/reproduction.
Measure of regularity and on timeliness of updates of test execution results to the repository & defect reporting tools as per schedule decided by Project/Team Lead
10%
Test Design and Execution
Effective execution of test cases, test scripts; logging and tracking of own defects.
On time deliveries - WSRs, updation of status in tools, updation of accurate effort in Ecube, TMS etc as per schedule decided by Project/Team lead.
Achieve TC execution productivity expected by the program.
Ensure that the number of invalid defects raised, are as per the norm defined for project/program/account.
Ensure there are zero test escapes and defect slippages from the tests executed.
No instances of rejection/slippage of delivered work items or within the Wipro / Customer SLA / norms.
40%
Process Compliance
Adherence to Test process in the program (Test Execution, Fault reports, reviews, test audits, logging of results, etc)
Adherence to Wipro Quality Process
Zero instance of repeated violation of standards or test process
10%
Teamwork
Participation in team activities & initiatives 20%
Competency & Self Development
Measure on # of mandatory trainings attended for the year
Measure of # of relevant certifications and achievement of the target CPI in the stipulated time period
Testing Job Family Goals & Objectives 2012-13 Page 3
Test Engineer L2 Objectives 2012-13
Objectives Measurement Criteria Weight
Customer Focus
Timely Response to customer requests: Answering query state of FRs/SRs, responses for traces/reproduction.
Regular and on time updates to test repository/status reporting tools visible to customer
No instances of complaints at work from Internal/External customer and peer.
15%
Quality of interaction with customer (e-mail content etc)
Providing information with all relevant data points and clarity
Confidently communicate with the client in an unambiguous manner maintaining proper mail /teleconference etiquettes.
Understand and appreciate the cultural differences in communication
Test Design and Execution
Effective test case, automated test script development and execution; Enhancement of manual/automated test cases/script, logging and tracking of defects and end to end support for simple applications.
Measure on # of alternatives considered during Test Design or Scenarios for Test Design (Testing)
On time deliveries- reports, status update, effort log ins etc
Measure on achievement of TC execution productivity expected by the program.
Ensure number of invalid defects raised, are as per the norm defined for project/program/account.
Ensure there are zero test escapes and defect slippages from the tests executed.
No instances of rejection/slippage of delivered work items. Rework should be attributable to only customer requested changes and project requirement changes.
35%
Process Compliance
Adherence to Test process in the program (Test Execution, Fault reports, reviews, test audits, logging of results, etc)
Zero instance of repeated violation of standards or test process
10%
Teamwork
Contributions towards other modules/features through effective review, resolving problems, helping in test execution.
Measure on # of new joinees and juniors mentored.
20%
Competency & Self Development
Measure of # of KSS within own stream and across work streams
Measure of # of value-added contributions to the project demonstrating domain knowledge
Attend the required trainings related to the project and participate in knowledge sharing sessions.
Measure of # of relevant certifications and achievement of the target CPI in the stipulated time period
20%
Testing Job Family Goals & Objectives 2012-13 Page 4
Test Lead L1 Objectives 2012-13 Objectives Measurement Criteria Weight
Delivery/Customer Satisfaction 45%
Performance Feedback received from customer (for onsite members)
Timely response to customer requests/clarifications
Regular and on time updates to test repository/status reporting tools visible to customer
Ensure the preparation of Bi-directional Traceability matrix with 100% coverage to requirements
Achieve Test case development productivity expected by the program; % productivity improvement should be above project norms
Quality of interaction with customer (e-mail content etc)
Providing information with all relevant data points and clarity
Confidently communicate with the client in an unambiguous manner maintaining proper mail /teleconference etiquettes.
Understand and appreciate the cultural differences in communication
Health Proactively analyzing the field bugs & defect slippage and proving the action plan - Provide numbers analyzed and TCs added
Ensure >30% defects raised are P1/P2s
Track self and team's failed/blocked test cases to closure.
Adherence to all metrics by self and team as per SLAs defined
Process Compliance 15%
Process Compliance Ensure team Weekly effort logging should be 100%. No schedule/effort deviation.
Ensure team contribution towards Review effort >10 %
Defect Rejection <5%; Defect slippage <1%
Timely Escalations and initiatives to overcome the challenges.
Implementation of SToRM tools (DSM, OA, etc)
Adherence to Test process in the program (Test Plan/design preparation, LAM, Test Execution, Fault reports, reviews, test audits, logging of results, etc). No process deviation
People 15% Manage employee morale, confront negative behavior and
handle nonperformance)
Contribution to TeS Confluence by self and team
Knowledge Management & Self Development 25%
Measure on # of KSS/Trainings attended and evaluated/conducted in the team Target: 95%
Contribution to team: Preparing project specific training materials / KM activities and maintaining a repository
Complete the mandatory training assigned in ITMS
Testing Job Family Goals & Objectives 2012-13 Page 5
Test Engineer L3 Objectives 2012-13 Objectives Measurement Criteria Weight
Customer Focus
Timely Response to customer requests - Answering query state of FRs/SRs, responses for traces/reproduction.
Regular and on time updates to test repository/status reporting tools visible to customer
No instances of complaints at work from Internal/External customer and peer.
Measure on work done towards PCSAT enhancements ( > 6 on a scale of 7)
20%
Quality of interaction with customer (e-mail content etc)
Providing information with all relevant data points and clarity
Confidently communicate with the client in an unambiguous manner maintaining proper mail /teleconference etiquettes.
Understand and appreciate the cultural differences in communication
Test Design and Execution: Works independently to analyze test requirements, product specifications and test tools. Develop test case/automated test script based on impact analysis. Provide end to end support for applications. Provide technical guidance to the team and solves test bed issues and technical issues.
Prepare and review traceability matrix and ensure requirements coverage in test plans/test cases. Identify reusable TCs; Highlight individual project risks to lead/PM
Measure on # of alternatives considered during Test Design or Scenarios for Test Design (Testing)
On time deliveries - WSRs, analysis reports, updation of status in tools, updation of accurate effort in Ecube.
Contribution to cycle time reduction in activities involving preparation of scenarios, test cases, test data documentation, conducting Reviews and QA/Stage test execution.
Measure on achievement of TC execution productivity expected by the program.
Ensure number of invalid defects raised, are as per the norm defined for project/program/account.
Ensure there are zero test escapes and defect slippages from the tests executed.
No instances of rejection/slippage of delivered work items. Rework should be attributable to only customer requested changes and project requirement changes.
30%
Processes/Value Additions
Adherence to Test process in the program (Test Execution, Fault reports, reviews, test audits, logging of results, etc)
Zero instance of repeated violation of standards or test process
20%
Teamwork
Attend Team meetings regularly and contribute with ideas and suggestions.
Contributions towards other modules/features through effective review, resolving problems, helping in test execution.
Measure on # of new joinees and juniors mentored.
Demonstrate Understanding of the project (foresee interface issues and contribute effectively in other’s reviews)
Exploring new tools / new ideas useful for the project
Contribution in activities like Web page maintenance / Configuration manager / System admin for the project
Measure of # of presentations and participation in internal/external Tech Forums
20%
Testing Job Family Goals & Objectives 2012-13 Page 6
Competency & Self Development
Measure of # of KSS within own stream and across work streams
Measure of # of value-added contributions to the project demonstrating domain knowledge.
Measure of # of required trainings attended
Measure of # of relevant certifications obtained and achievement of the target CPI in the stipulated time period
10%
Testing Job Family Goals & Objectives 2012-13 Page 7
Test Architect L1 Objectives 2012-13 Objectives Measurement Criteria Weight
Test solution / Test Design Understand customer requirements at system level and Define and deliver Test Requirements at System level. Test estimates, overall Test strategy and solution. Preparation and articulation of technical issues/status during client interactions
Timely Response to customer’s technical requests or queries
Measure of # of continuous improvement in the project (for e.g. analyzing the field bugs to enhance the test coverage, look at automation possibilities, any tools that can enhance the productivity etc.)
Measure on work done with the DM/PM towards improving the customer perception with value adds and improve PCSAT score ( > 6.3 on a scale of 7)
Addresses and Resolves all Customer/Project technical Issues
30%
Technical Leadership
Contribution to effectively review the test deliverables from the team
Measure of # of team members mentored
Measure of # of presentations / participation in internal / external forums
30%
Test Deliverables Understanding the test requirements and preparation of the test strategy
Accuracy of test estimation, keeping overall project in view
Quality of test plan/strategy; number of reviews errors, missing scenarios, risks, mitigation plan, etc
Contributions towards the complete project through effective review, resolving problems
Measure of # of quality improvement initiatives conducted/participated - LAM, test audits, RCA
Measure of # of Solutions - Automation / Test Improvements suggested and implemented
20%
Business Development & Support
Create value propositions in terms of existing capabilities and new technologies
Measure of # of opportunities identified in & around the current engagement
Provide required support for estimation & development of solution for new opportunities
10%
Competency & Self Development
Pro-activeness in knowledge acquisition/sharing to help in problem resolution
Demonstrate acquisition of specialist knowledge in testing tools/ any aspect of technology/architecture.
Measure of # of KSS within own stream and across work streams
Measure of # of value-added contributions to the project demonstrating domain knowledge.
Measure of # of relevant certifications obtained and achievement of the target CPI in the stipulated time period
10%
Testing Job Family Goals & Objectives 2012-13 Page 8
Test Project Manager L2 (Band C1, Equivalent to PM) Objectives 2012-13 Objectives Measurement Criteria Weight
Financial 15%
Performance Gross margin achievement of the project Bonus/penalty from/to the customers
% Adherence to project cash flow schedule
Delivery & Customer Satisfaction
Performance Delivery quality compliance = average of assessment on the four metrics below
1) Effort performance indicator = (Actual effort spent (A) - Planned effort (B))/ Planned effort (B) 2) Schedule performance indicator = (Actual date of project or milestone completion (C) - Planned date of milestone completion (D)) / Planned days for the project or milestone (E) 3) DRFT score = DRFT score of the role holder for the measurement period (F) 4) SLA performance (Applicable to all MS projects) = Number of instances of SLA compliance (H) / Total number of instances where SLA is measured (I)Maintain metrics and perform trend analysis on the data captured and highlight the data to customer
Timely submission of EBS/Invoice inputs
No major or minor NCs. Ensure time closure of audit findings Measure on Unplanned & Unmapped Effort = 0, accuracy of billing inputs
100%. PM effort logged in for entire month. Achieve a CSAT of >=6.2 /7 & consistent improvement in CSAT YoY by >=
20%
Customer satisfaction score = (0.5* (NPS rating in PCSAT(A))) + (0.5 * (NPS rating in Pulse (B) or ACSAT(C) as applicable in that quarter))
35%
Health % of Bulge, % of Billable rookie ratio, Average Per Person Cost % indents cancelled or issued during SLA lead time to CRD, % of ERD
compliance PEI score of project
Ensure appropriate backup and recovery process of all artifacts
Measure on # of tools implemented/used by the team Target > 2 per year
Measure of # of value-adds generated and Implemented towards the customer
30%
Offering/Competency [ Manager can add more Practice Initiatives] 10%
Run at least 1 Six Sigma or LEAN. Conduct Periodic LAM/Project kickoff meetings/Milestone review meetings, as expected by SEPG
Contribution of utilities / tools developed in the project (non-customer IP) / best practices into Knet > 2 per year
Conceive ideas for POC and Support the COE in development of POC , Case studies
Architect and support the development of at least 2 accelerator/tool/solutions
People 10%
Attrition target <>
Ensure that 100% CPI / UCF compliance levels of project team by end of each Quarter
Identify and conduct regular project and domain specific trainings
Testing Job Family Goals & Objectives 2012-13 Page 9
Test Architect L2 Objectives 2012-13 Objectives Measurement Criteria Weight
Test solution / Test Design
Scope the testing activity by interacting with external and internal stakeholders.
Actively gather information to understand customer’s problems, needs, expectations and prospect for new projects; interact with customer to build understanding of issues and solutions
20%
Technical Leadership
Get in depth technical understanding of the complete project and be able to suggest improvements
Measure of # of value-adds generated and Implemented towards the customer
Measure of # of future technology / Technical needs identified for the account
20%
Business Development & Support
Contribute solutions / mentor outside project / account
Measure of # of Strong Differentiators created in the Services Offered that will enable business growth
Support for RFPs – Packaging and Positioning various solutions based on customer needs
30%
Innovation and Competency Building Spotting Industry wide trends and identify Processes,
Framework, Methodologies and Tools for - Evaluation - Facilitating Proof of Concepts and Pilots - Advising Delivery Teams on the adoption of the same - Advising Pre sales/sales teams on repositioning the
services accordingly
Measure on # of Papers submitted and/or presented at relevant Seminars and Conferences
Building solutions (combination of tools, methodologies, processes, technologies) for - Driving Non-Linearity - Improving Business Prospects - Identifying and building assets for reuse across projects
30%
Testing Job Family Goals & Objectives 2012-13 Page 10
Test Consultant L1 Objectives 2012-13 Objectives Measurement Criteria Weight
Test Consulting: Draw road map and recommendations for movement from ‘as-is’ to ‘would-be’ process levels and provide End to End Test Solutions aligned with client business and needs Provide Thought leadership & Strategic direction for Client / Wipro team
Document and analyze the current process, its effectiveness and make prioritized recommendations for improvements within the limits of scope, time and cost constraints.
Ensure reusability also ensure that the re-usable components available are utilized effectively to reduce the effort and time
Identify tools and licenses requirements ( existing and additional)
Handle and coordinate Proof of concept activities during the beginning of the project on new technologies
30%
Process & Quality Adherence
Prepare Requirements spec/Functional Spec without errors exceeding the Norm, as described by Wipro quality standards
Contribution of utilities / tools developed in the project/program (non-customer IP) / best practices into Knet > 2 per year
Define and create the measurement criteria for metrics at different stage of testing life cycle
Assist with Open source usage recommendation & adherence of the projects/programs involved with
20%
Customer Satisfaction
Measure on # of complaints on consulting quality, solution fitment, design/architecture, process adherence;
Effectiveness and timely resolution in case of a complaint: speed and the adequacy of resolution
First Time Right (Measured by specific question in PCSAT)
20%
Self & Team Development
Measure on # of Papers submitted and/or presented at relevant Seminars and Conferences
Complete the required TeS CPI/UCF assessment/other relevant certifications/trainings mapped to Role and Career Group
15%
Contribution to TeS
Meet TeS level objectives on Whitepaper, Technical Talks and
participation in technical forums Effective Participation in taskforces/COE initiatives
15%
Testing Job Family Goals & Objectives 2012-13 Page 11
Test Consultant L2 Objectives 2012-13 Objectives Measurement Criteria Weight
Test Consulting: Draw road map and recommendations for movement from ‘as-is’ to ‘would-be’ process levels and provide End to End Test Solutions aligned with client business and needs Provide Thought leadership & Strategic direction for Client / Wipro team
Work out the business benefits of improvement; ROI; Review and sign off on the recommendations.
Business process analysis: Biz process and functional model. Map the Business process onto the application and identify gaps.
Actively participant in discussions for solution definition, coming up with suggestions for solution design.
Work with the Delivery manager to identify and proactively manage project/program level risks
Incorporate test optimization methodologies
Provide Product evaluations; Analyzes competitive products and technologies and makes appropriate suggestions (may use demos) to influence product / technology direction.
Measure on # of suggestions provided and implemented for Performance improvements
Proposal participation, Sizing and Pre-sales work, participate in Customer presentations
30%
Process & Quality Adherence
Guide the Delivery team to ensure that the application/tool/framework is developed as per customer requirement.
20%
Customer Satisfaction
Achieve a CSAT of >=6.2 /7 & consistent improvement in CSAT YoY by >= 20% on the Consulting engagement
Collaborate effectively, work across the company's test leadership and development and program management community to drive synergy and appropriate integration
ACSAT: NPS>=8 and Experience Index 100 to be ensured
20%
Self & Team Development
Measure on # of Papers submitted and/or presented at relevant Seminars and Conferences
Enable Cross/Multi-Skilling by proactively identifying niche/new areas and getting trained or assist in training the other members
20%
Contribution to TeS
Proposals wins: >= 1 per year
Arrive at outcome based services, measure of success and value to the client & Wipro in achieving that success. Arrive at multiple pricing models based on the value of services rendered
Be able to suggest new solutions (tools, automation framework etc.) or provide feedback and work on enhancing the existing value
Identifying and creating new service lines within TeS
10%
Testing Job Family Goals & Objectives 2012-13 Page 12
Delivery Manager L1/ L2 Objectives 2012-13 Major difference between Delivery Manager L1 and L2 is the span of control. Refer role description for span details
Objectives Measurement Criteria Weight
FINANCIAL OBJECTIVES - Total weightage 20%
1 Performance Measures 20%
Revenue ($) Revenue ($) = Revenue achievement (A)
Gross Margins ($) Gross margin ($) = (Revenue (A) - Direct cost (B) - Loading (C))/ Revenue(A)
Bonus/penalty from/to the customers ($)
Bonus/penalty from/to the customers = Value of bonus received from customers (A) - Value of penalty paid to the customers during the same period (B)
Adherence to project cash flow schedule (%)
Adherence to project cash flow schedule = Actual billing done to the customer in the measurement period (A)/ Planned billing to be dome to the customer as per the project cash-flow projections (B)
DELIVERY/CUSTOMER SATISFACTION OBJECTIVES - Weightage 50%
1 Performance Measures 20%
Delivery quality compliance (Based on effort, schedule, DRFT, SLA) (rating)
Delivery quality compliance = average of assessment on the four metrics below 1) Effort performance indicator = (Actual effort spent (A) - Planned effort (B))/ Planned effort (B) 2) Schedule performance indicator = (Actual date of project or milestone completion (C) - Planned date of milestone completion (D)) / Planned days for the project or milestone (E) 3) DRFT score = DRFT score of the role holder for the measurement period (F) 4) SLA performance (Applicable to all MS projects) = Number of instances of SLA compliance (H) / Total number of instances where SLA is measured (I)Implement and close on ACSAT actions with Customer
Customer satisfaction score (rating)
Customer satisfaction score = (0.5* (NPS rating in PCSAT(A))) + (0.5 * (NPS rating in Pulse (B) or ACSAT(C) as applicable in that quarter))
Note: For accounts where customer runs its own survey and does not participate in Wipro
surveys, the supervisor shall set the target in terms of customer survey outcome.
Number of customer escalations (#)
Number of customer escalations = Number of customer escalations of High priority(A) + Number of customer escalations of Medium priority(B) + Number of customer escalations of Low priority©
% customer escalations with overdue resolution (%)
% customer escalations with overdue resolution = Number of customer escalations with target resolution date in the given period but still open (A) / total number of customer escalations with target resolution date in the given period (B)
Note: All customer escalations must be entered in the CRM/Quality system
2 Health Measures 30%
Bulge (%) Bulge (%) = (Number of people with <3 years of experience allocated to the project (A))/ (total number of resources allocated to the project (B))
Billable rookie ratio (%) Billable rookie ratio (%) = (Number of rookies (Fresher + <20Kpm salary)billed in the project (A)) / (total number of resources billed in the project (B))
Average Per Person Cost ($) Average per person cost = (Sum of salaries+RSU+Bonus of all resources allocated to the project) / (Total number of resources allocated to the project)
% of resources on progressive delivery models (flex) (%)
% of resources on progressive delivery model (flex) = Number of delivery resources billed in the account operating out of FLEX (A) / Total number of delivery resources billed in the account (B)
% indents cancelled or issued during SLA lead time to CRD
% indents cancelled or issued during SLA lead time to CRD = (Number of indents cancelled during SLA time to CRD(A) + Number of indents issued during SLA time to CRD (B)) / (Total number of indents with CRD in the given period (C))
Testing Job Family Goals & Objectives 2012-13 Page 13
ERD compliance (%) ERD compliance = (Number of project resources with ERD extended with <15 days lead time (A))/(Number of project resources with ERD falling within the measurement period (B))
PEI score of projects under role holder
Process Exception Index score of the project as per the internal quality standard (A)
OFFERING/COMPETENCY OBJECTIVES - Weightage 15%
1 Performance Measures 10%
% project effort charged to domain experts
% project effort charged to domain experts = (Effort/cost spent by domain experts on the project (A) / total effort/cost spent on the project (B))
No major NC’s during internal and external audits
Reusable Components idea generation
Delivery Model innovation o Implement factory model concepts covering at least 50 people
Usage of tools o Adoption of tools across the life cycle. o Adoption of Test tools
2 Health Measures 5%
% of employees and contractors with contribution above X%
Contribution per billed employee and contractor = ((Revenue from projects (A) - salary cost of billed employees and contractors tagged to those projects (B)) / ((Revenue from projects (A)) % of employees and contractors with contribution above X% = (Number of employees and contractors with contribution percent above X% (C)) / (Total number of employees and contractor relevant to the role(D))
PEOPLE OBJECTIVES - Weightage 15%
1 Performance Measures 10%
Employee attrition rate (top bin and overall) (%)
Top bin attrition rate (%) = Number of employees with top bin rating who quit Wipro while tagged to the account (or project) (including the cool off period) (A) / average number of top-bin employees tagged to the account (or project) for the measurement period (B) - Overall attrition rate = Number of employees who quit Wipro while tagged to the account (or project)
(including the cool off period) (C) / average number of employees tagged to the account (or project) for
the measurement period (D)
- Average number of top-bin employees tagged to the account (or project) for the measurement period
(B) = (Total number of top-bin employees tagged to the account (or project) at the beginning of the
measurement period (E) + Total number of top-bin employees tagged to the account (or project) at the
beginning of the measurement period (F))/2
- Average number of top-bin employees tagged to the account (or project) for the measurement period
(D) = (Total number of employees tagged to the account (or project) at the beginning of the
measurement period (G) + Total number of employees tagged to the account (or project) at the
beginning of the measurement period (H))/2
- Cool off period (I) = Number of days after an employee is released from an account (or project) but
would be considered tagged to the account(or project) for the purpose of attrition calculation
(Note: Top-bin is an existing category defined by competency, criticality and performance rating of the
employee
Contribution to Wipro building (Hrs)
Contribution to Wipro building = Hours spent in delivering internal training to Wipro employees (A) + Hours spent in contributing to recruitment activities (B)
2 Health Measures 5%
% of rotation eligible employees released for rotation (%)
% of rotation eligible employees released for rotation = Number of rotation eligible employees released (A) / Number of employees eligible for rotation during that time (B)