U s i n g C o m p e t e n c i e s t o I d e n t i f yH i g h P e r f o r m e r s : A n O v e r v i e wo f t h e B a s i c s
O u t s t a n d i n g p e r f o r m a n c e c a n b ea c h i e v e d b y s e l e c t i n g t h e r i g h t p e o p l e f o r k e y r o l e s
Selecting managers and executives on the basis of their technical skills or experience
alone often yields poor results.
Competencies are to performance what DNA is to people. The underlying elementsof competencies are less visible but largely direct and control “surface behavior.”
Organizations that apply competencies to select and develop individuals for keyroles reduce the potential of the collateral damage associated with a bad hire.
P A P E RW O R K I N G
U s i n g C o m p e t e n c i e s t o I d e n t i f yH i g h P e r f o r m e r s : A n O v e r v i e wo f t h e B a s i c s
Copyright © 2003 Hay Group, Inc. All rights reserved in all formats.
In t roduct ion 1
What Is a Competency? 2
Why Use a Competency-based Approach? 4
Stages of Competency Def in i t ion 5
1. Per formance Cr i ter ia 6
2 . Cr i ter ion Sample 6
3. Data Col lect ion 6
4. Competency Model Development 8
5. Va l idat ion 8
6. Appl icat ion 9
Innovat ive Appl icat ions of Competencies 10
Conclusion 11
O r g a n i z a t i o n s c a n a c h i e v e o u t s t a n d i n gp e r f o r m a n c e b y s e l e c t i n g t h e r i g h tp e o p l e f o r k e y r o l e s
P A P E RW O R K I N G
1
McCle l land conf i rmed that
t radi t ional predictors of
per formance such as apt i tude
tests , examinat ion resul ts ,
and references d id not in fact
predict job per formance.
W e’ve all seen it happen: Two motivated individuals with similar education,
experience, and skills are promoted into new roles. One quickly turns into
a star performer, achieving outstanding results with apparent ease. The other strug-
gles just to achieve the minimal level of success, frustrating both him and others.
Why, we ask, was one so much more successful than the other?
It’s a good question, one that continues to challenge organizations today. If
the brightest and even most experienced do not always succeed in the work-
place, then what can businesses do to identify their potential star performers?
They can begin by throwing out the IQ tests and other proxies that measure
intellect. Renowned Harvard University Psychologist David McClelland confirmed
this in an article he published in 1973 entitled “Testing for competence rather
than for intelligence.” McClelland summarized a number of studies that showed
that aptitude tests, which had traditionally been used by psychologists to predict
performance, did not in-fact predict job performance. Additionally, the tests
were often culturally based and therefore prone to bias. He also discovered that
other traditional measures used in the hiring process, such as examination
results and references, were equally poor at predicting success on the job.
McClelland set out to find an alternative to the traditional aptitude and intelli-
gence testing, which yielded a deeper measure that he labeled “competencies.”
A competency is defined as an underlying characteristic of a person which
enables them to deliver superior performance in a given job, role, or situation.
In the process of his research on competencies, McClelland established two key
tools—criterion samples and behavioral event interviews—to help enable his approach.
Criterion Samples
By studying two distinct (criterion) groups—star and average performers—
McClelland sought to understand what really differentiated performance and
created success in a job. This method, which proved to be highly successful in
predicting the future success of individuals, formed the foundation for Hay
Group’s approach to assessment, selection, and development. It is elegant in its
conceptual simplicity and application.
P A P E RW O R K I N G
2
A competency is an under ly ing
character is t ic of a person which
enables them to de l iver
super ior per formance in a
g iven job, ro le , or s i tuat ion.
Behavioral Event Interviews (BEI)
To understand what makes the best people successful, McClelland sought to
understand not just what they do, but the thoughts and feelings that generate
their actions. The Behavioral Event Interview (BEI) is a highly structured inter-
view that focuses on the characteristics of the person being interviewed rather
than on the work content.
The BEI identifies the deep-rooted thoughts and behavior patterns of people
who are successful in the jobs being studied. These reveal what would other-
wise be hidden characteristics that significantly influence behavior which in turn
drives excellent performance.
W h a t I s a C o m p e t e n c y ?
As we mentioned earlier, a competency is an underlying characteristic of a person
which enables them to deliver superior performance in a given job, role, or
situation. The “iceberg” model, as shown in Figure 1, shows different levels of
competency. The analogy within the illustration is deliberate: while some elements
are readily identifiable and measurable above the surface, there are several that
are more difficult to detect, yet which are—in most cases—more significant.
Figure 1: The Iceberg Model of Managerial Competencies
Skill
Knowledge
Social Role
Self-Image
Trait
Motive
Managerial competencies are like an iceberg, with skill and knowledge forming the tip.
The underlying elements of competencies are less visible but they largely direct and control
surface behavior. Social role and self-image exist at a conscious level;
traits and motives exist further below the surface, lying closer
to the person's core.
P A P E RW O R K I N G
3
I t makes more sense to
recru i t or se lect for the deeply
rooted competencies ra ther
than to t ra in people for them
in the short term.
1. Skills are the things that people can do well, such as computer programming.
2. Knowledge is what a person knows about a specific topic, such as a computer language.
3. Social Role is the image that an individual displays in public; it representswhat he or she thinks is important. It reflects the values of the person, suchas being a diligent worker or a leader.
4. Self-image is the view people have of themselves. It reflects their identity,such as seeing oneself as an expert.
5. Traits are enduring characteristics of people. They reflect the way in whichwe tend to describe people (e.g., “she is reliable” or “he is adaptable”).These characteristics are habitual behaviors by which we recognize people.
6. Motives are unconscious thoughts and preferences, which drive behaviorbecause the behaviors are a source of satisfaction (e.g., achievement driveand wanting to do better).
It is important to distinguish the different levels because they have significant
implications for human resources planning. The top levels—skills and knowl-
edge—are generally easier to train and develop, whereas those below the surface
are more difficult. As a result, it makes more sense to recruit or select for these
deeply rooted competencies rather than to train people for them in the short
term. However, it is possible to develop them over a longer period by planning
career paths and job changes for people that will give them the opportunity to
develop characteristics which will be important in later, more senior roles.
In addition, the more complex the job or role, the more likely it is that the very
best performance is driven by the characteristics found at the lower levels of the
iceberg than task-related skills and knowledge at the top. Selecting on the basis
of qualification or skills is therefore not going to help choose the very best per-
formers in these jobs.
There are many stories about how companies promote their best salesperson
or engineer into a managing role because they achieved the highest sales or
designed a breakthrough product, only to see them fail miserably in their new
position. It may seem obvious that the characteristics that delivered best per-
formance as a salesperson or engineer do not necessarily make for great per-
formance as a manager—and in fact those characteristics may even get in the
way. For example, the drive to personally beat targets or produce the best
designs will interfere with delivering group results through other people—
P A P E RW O R K I N G
4
Organ iza t ions can des ign
highly targeted programs to
develop the essent ia l
competencies that wi l l he lp
thei r average per formers
r ise to the next leve l .
which a manager typically has to do. Despite this obvious mismatch, upward
promotion is often seen as a just reward. The resulting failure is damaging to
both the new manager and to their company.
Identifying deeply rooted competencies that can most accurately determine
high-potential candidates requires expertise and organizational commitment.
We have seen some organizations that undertake competency studies stop at the
level of describing behavior. However, this does not give the full picture and
can in fact be misleading. For behavior to be a true competency it needs to be
associated with intent—the intentional use of behavior in delivering a perform-
ance outcome.
In defining competencies, it is important to distinguish between two major
categories:
Threshold Competencies, which are the characteristics that any jobholder
needs to have to do that job effectively—but that do not distinguish the
average from superior performer. For example, a good insurance salesper-
son must have an adequate knowledge of their products, but this is not
necessarily sufficient to ensure outstanding performance.
Differentiating Competencies, which are the characteristics that superior
performers have but average performers lack. For example, an insurance
salesperson that is customer-focused and empathetic, and can put them-
selves in the shoes of potential clients to really understand which products
are important to them and which are not.
W h y U s e a C o m p e t e n c y - b a s e d A p p r o a c h ?
A competency-based approach has as its frame of reference the performance of
the very best people in the job. Organizations can improve their overall per-
formance by hiring candidates with these competencies. They can also design
highly targeted programs to develop the essential competencies that will help
their average performers rise to the next level.
The cost of poor selection decisions can be substantial. Consider the hard costs
that go into filling an open position, including advertising and recruitment
costs, as well as candidate travel, lodging, and entertainment. Next consider the
negative long-term cost implications of hiring the wrong person, including:
P A P E RW O R K I N G
5
Charac te r is t i cs o f
outstanding per formers can
provide a template for a
number of human resources
management processes.
Dollars wasted in training and development.
Low productivity and quality while a poor performer is in the role.
Lost opportunities—sales that aren’t closed, processes that don’t improve,objectives that aren’t met.
Poor morale as others struggle to pick up the slack.
Dissatisfied customers who may not give you a second chance.
A competency-based selection process helps organizations avoid these costs by
providing a framework to consistently hire, develop, and promote top performers.
When you employ this process, turnover drops, individual and group perform-
ance improves, and your organization builds a strong and agile workforce that
can solve problems, change with the times, and meet organization-wide goals.
A rigorous and documented competency-based selection process also helps
organizations meet legal guidelines for fair employment practices. Interviewers
are trained to gather only job-related (legal) information that reflects a candi-
date’s abilities and motivations. This eliminates inconsistent selection criteria;
minimizes the impact of individual biases, assumptions, or preferences; and
helps avoid areas of inquiry that might violate employment regulations.
The characteristics of these outstanding performers can also provide a template
for a number of human resources management processes, such as selection,
development, succession planning, performance management, promotion, and
career pathing.
Incidentally, it is very important to have a clear understanding in advance of the
business issues that the competency model is intended to solve because this has
a direct influence on the degree of rigor needed for a successful solution. If the
model is intended for selection or pay, the direct economic impact can be sub-
stantial, and we recommend a very rigorous approach.
S t a g e s o f C o m p e t e n c y D e f i n i t i o n
There are six stages in defining a competency model for a given job. The scope of
each stage may vary depending on the depth of research required, but from our
experience, skipping stages will usually yield substandard results. The stages are:
P A P E RW O R K I N G
6
The BEI is a process for
indi rect ly col lect ing samples
of behavior which have led to a
person’s success and
frustrat ion in a ro le .
1. Establish the performance criteria.
2. Identify people for the criterion samples.
3. Collect data through behavioral event interviews (BEIs) or other assessmentmethods.
4. Analyze data and define the competencies.
5. Validate the model.
6. Design applications.
1. Performance Criteria
Establishing the performance criteria at the outset of the project is critical. It is
normal to establish a steering group to manage the project, and its members
should agree on the measures for superior performance in a job. The criteria
should include hard data if possible (e.g., productivity figures), but other crite-
ria such as managerial effectiveness as measured by direct reports or peer rat-
ings may also be included. Avoid using a single measure.
2. Criterion Sample
The criterion sample consists of individuals from two distinct groups—star and
average performers—to understand what really differentiates performance and
creates success in a job. Three factors are important to consider when selecting
people for the sample:
The outstanding performers should be the absolute best—those who arerated high on all or most of the performance criteria.
There needs to be a control or contrast group of fully acceptable performers.
The samples should be large enough to allow for statistical analysis.
From our experience, a total sample that consists of 10% of the position of
interest within organization should allow for proper statistical analysis.
However, if the total population is small, a higher proportion will be needed. As
a rule of thumb, it is advantageous to weigh samples more heavily toward supe-
rior performers—there is always a lot to learn from superstars.
It is important to note that if the compentency model is being developed to
change culture or aligning people behind a new strategy, then it might not
P A P E RW O R K I N G
7
The resul ts of a BEI a lso g ive
r ich data about the context in
which the competencies are
displayed and how they operate
together .
desirable to select those who were top performers under the old culture or
strategy. Rather, a group that are already executing the new strategy or acting in
accordance with the new culture would be selected as a comparator group.
If there are no “hard” measures, then a nomination approach can be employed
by having direct reports, peers, coaches vote . Usually if 2/3 of people who you
work with think your outstanding, then you probably are a top performer
Although performance ratings are good at identifying stars, they are notoriously
poor at identifying average performers.
3. Data Collection
Data may be collected through BEIs or other assessment methods, the most
common of which are expert panels or focus groups.
Behavioral Event Interviews
The BEI is the most effective assessment method. It is a structured interview
similar to a critical incident interview, but focused on the individual and their
competencies rather than the tasks. It is a process for indirectly collecting sam-
ples of behavior, which have led to success in the role the person has, as well as
events where he or she has been frustrated in delivering what they wanted to do.
The interview requires a high-degree of rigor from the interviewer and—if done
well—will reveal patterns of intentional behavior that deliver outstanding per-
formance. The interview focuses on thoughts, feelings, behaviors, and outcomes.
A comparison of all outstanding performers yields an excellent view of how they
deliver against the performance criteria and, when contrasted with average per-
formers, results in a template of excellent performance in that particular role or
job and which is specific to the organization.
It is very important that BEI be a “double blind” process to remove any bias.
That is, neither the interviewer nor the interviewee know if they are in the “out-
standing” or the “more typical” samples.
The results of a BEI provide not only the competencies, but also give rich data
about the context in which the competencies are displayed and how they operate
together. This can reveal valuable information that can be used to help others
P A P E RW O R K I N G
8
Data f rom the se lect ion
processes or per formance
reviews is important because
jobs evolve as s i tuat ions
change, and the competency
framework should a lso be
adjusted to re f lect new
requirements .
develop competencies. BEIs give the best results, and for key jobs or complex
roles they are well worth the investment.
Expert Panels
Expert panels, or focus groups, use people who are knowledgeable about the
job, such as outstanding performers, customers, HR specialists, and line man-
agers. The panel brainstorms the competencies needed to achieve outstanding
performance in the job. Expert support is required to prevent the panel from
producing either over-generalized competencies (motherhood statements), or is
overly influenced by any one group.
Panels typically do not generate the full range of competencies. In fact, they
often miss some the most important, deeply rooted competencies. From our
experience, panel data is are only about 50% as accurate as BEI data.
Surveys
Another method of collecting data is through surveys. While this is a quick way
of generating data from a broad population, it is limited because it only provides
responses to the questions asked. And, like expert panels, surveys often miss
the hidden competencies that are unique to the job or the organization.
Augmenting surveys with BEIs can improve the outcome, but still will not pro-
vide the richness of a model created from a larger number of BEIs.
4. Data Analysis and Model Development
Creating the models from BEIs is the most complex part of the process. The
BEIs need to be analyzed thematically, i.e., in clusters according to themes relat-
ed to patterns that are discernable in the interview. These will then generate
hypotheses on what the competencies are and how they work together to pro-
duce outstanding performance.
The desired outcome is a comparison of what outstanding performers do differ-
ently from average performers. If the two groups have been chosen well, the
differences often stand out very clearly. The data are usually analyzed both the-
matically from the interviews and statistically to test for real differences between
the two groups.
P A P E RW O R K I N G
9
Using competency models
for per formance management
helps people understand
how a lack of cer ta in
competencies impedes the i r
overa l l per formance, which
can then become a focus
for development .
The output may take the form of a “competency dictionary” that includes all the
competencies, their definitions, and descriptions of the levels expressed as
interval scales together with behavioral examples of the competency. The format
depends on the nature of the applications for which the model will be used.
5. Validation
There are several ways to validate the model. Where there are large numbers of
job-holders, it may be possible to create questionnaires based on the model and
to administer them to a wider sample of jobholders. This includes both average
and star performers. The analysis of this data will test the model and allow revi-
sions and refinements to take place.
For new roles, it is helpful to benchmark the competency model against people
who’s jobs are “close” to the new role and who are performing at a high level.
This calibration can ensure the new model hasn’t set expectations that are too
difficult to achieve and thus discourage and demotivating thise entering the
role.
Data from the selection processes or performance reviews should be kept to
validate and update the model in the future in case there are insufficient num-
bers for significant validation to occur. This data collection is important because
jobs evolve as situations change, and the competency framework will also have
to be adjusted to reflect the new requirements. Often the competencies them-
selves do not change because the underlying motivational aspects of the jobs
and job holders remain constant. However, the way in which the behaviors
reflect the underlying drivers may change.
6. Applications
Although this is final linear phase of the development of a competency, the
application of the competency model should be built into the thinking at an
earlier stage. The form that the competency model takes and the content of the
dictionary depend on the intended use. Different applications may require differ-
ent formats for the competencies and they can be rewritten in a variety of ways.
P A P E RW O R K I N G
10
Organizat ions that apply
competencies to se lect and
develop indiv iduals for key
roles avoid the col la tera l
damage associated wi th a
bad h i re .
For example, if the model is to be used for selection, then competencies that
are difficult to develop can be distinguished from those that can more easily be
developed. An organization will then know to take this into account when
assessing and selecting candidates. Selectors also need to be aware of threshold
competencies—those needed to achieve average performance—and the differ-
entiator competencies required to achieve outstanding performance.
If an organization intends to use the competency models for performance man-
agement, then the competencies might be presented in a way that links them to
specific deliverables. This powerful method helps people understand how a
lack of a certain competencies impedes their overall performance, which can
then become a focus for development.
I n n o v a t i v e A p p l i c a t i o n s o f C o m p e t e n c i e s
The approach described above works to define competencies for jobs that
already exist in an organization. However, a slight modification is required for
new or rapidly developing roles, or in organizations that simply do not have
many star performers.
The best approach is to look for similar jobs elsewhere—if they exist. This does
not have to be within the organization for which the competencies are being
defined. It is possible to conduct interviews with outstanding performers in
other organizations. In such studies, it is important to examine the deeper
competencies such as the motives and the cognitive or thinking patterns of
those in the study, rather than superficial behaviors.
This approach also works when managers do not believe they have star per-
formers in their own organization. Selecting comparative organizations and job-
incumbents needs to be done with great care to ensure that the performance
criteria give a good match. This is especially critical because many companies
use similar job titles, but the actual job content and accountabilities might vary
enormously. A vice president of marketing at one company might be responsible
for advertising and media relations, but be accountable for the entire top-line
results at another. It is very important to match job content and accountabilities
as opposed to job titles.
A second approach to applying competency models to new jobs is to define the
separate elements of the job and to look for jobs that reflect those elements.
Conducting BEIs and expert panels around those elements will provide a sound
basis for a model when the elements are merged.
A third approach is to focus on the environment in which these jobs will be
performed—what will be different, and the competencies that will be most
important to success.
C o n c l u s i o n
So, why are some people more successful than others? The answer is partially a
function of the individual and partially a function of how they fit in a particular role.
As McClelland showed, it is necessary to look beyond basic skills and knowledge
required to perform an adequate job and into the deeply rooted competencies—
an individual’s social role, self-image, traits, and motives—that can most accu-
rately determine high-potential candidates. In addition, an individual’s competen-
cies must fit, or be able to fit through development, those required to achieve
outstanding performance in a job.
When organizations make the effort to apply competencies to select and develop
individuals for key roles, they avoid the collateral damage—recruiting costs, low
morale, dissatisfied customers, missed opportunities—associated with a bad hire.
And, most importantly, they greatly increase the odds that selected individuals
will perform at a very high level and help drive the success of the company.
P A P E RW O R K I N G
11
A b o u t H a y G r o u p
Hay Group is a professional services firm that helps organizations worldwide
get the most from their people by creating clarity, capability, and commitment.
Founded in 1943 in Philadelphia, today we work from 72 offices in 37 countries.
Our areas of expertise include:
Organizational effectiveness, role clarity, and work design
Managerial and executive assessment, selection, and development
Compensation, benefits, and performance management
Executive remuneration and corporate governance
Employee and customer opinion research
We pride ourselves on being an expertise-driven firm. All our work is supported
by proven methodologies and global knowledge databases. And, we have 60
years of specific, documented evidence that people, not strategies, drive long-
term competitive advantage.
Argentina
Buenos Aires
AustraliaBrisbaneMelbourneSydney
AustriaVienna
BelgiumBrussels
BrazilSao Paulo
CanadaCalgaryCharlottetownEdmontonHalifaxMontrealOttawaReginaTorontoVancouverWinnipeg
ChileSantiago
ChinaHong KongShanghai
ColombiaBogota
Costa RicaSan Jose
Czech RepublicPrague
FinlandHelsinki
FranceLilleLyonParisStrasbourg
GermanyBerlinFrankfurtMunich
GreeceAthens
HungaryBudapest
IndonesiaJakarta
IrelandDublin
ItalyMilanRome
JapanTokyo
MalaysiaKuala Lumpur
MexicoMexico City
The NetherlandsZeist
New ZealandAucklandWellington
NorwayOslo
PolandWarsaw
PortugalLisbon
RussiaMoscow
Singapore
SlovakiaBratislava
SpainBarcelonaMadrid
SwedenStockholm
SwitzerlandZurich
TurkeyIstanbul
ThailandBangkok
United Arab Emirates
Dubai
United KingdomBirminghamBristolGlasgowLondonManchesterWindsor
United StatesArlington, VAAtlantaBostonCharlotte, NCChicagoDallasKansas City, MOLos AngelesNew York MetroNorwalkPhiladelphiaSan Francisco Metro
VenezuelaCaracas
Hay Group Headquarters100 Penn Square EastThe Wanamaker BuildingPhiladelphia, PA 19107-3388USA
Tel +215 861 2000Fax +215 861 2111
www.haygroup.com