ASSESSING COMPETENCE IN ASSESSING COMPETENCE IN PROFESSIONAL PSYCHOLOGY PROFESSIONAL PSYCHOLOGY LICENSING OF PSYCHOLOGISTS IN THE LICENSING OF PSYCHOLOGISTS IN THE UNITED STATES & CANADA UNITED STATES & CANADA JAMES E. MADDUX JAMES E. MADDUX DEPARTMENT OF PSYCHOLOGY DEPARTMENT OF PSYCHOLOGY CENTER FOR THE ADVANCEMENT OF WELL-BEING CENTER FOR THE ADVANCEMENT OF WELL-BEING GEORGE MASON UNIVERSITY GEORGE MASON UNIVERSITY [email protected][email protected]
Transcript
ASSESSING COMPETENCE IN ASSESSING COMPETENCE IN PROFESSIONAL PSYCHOLOGYPROFESSIONAL PSYCHOLOGY
LICENSING OF PSYCHOLOGISTS IN THE LICENSING OF PSYCHOLOGISTS IN THE UNITED STATES & CANADAUNITED STATES & CANADA
JAMES E. MADDUXJAMES E. MADDUX
DEPARTMENT OF PSYCHOLOGYDEPARTMENT OF PSYCHOLOGY
CENTER FOR THE ADVANCEMENT OF WELL-BEINGCENTER FOR THE ADVANCEMENT OF WELL-BEING
START WITH FUNDAMENTAL START WITH FUNDAMENTAL QUESTIONQUESTION
WHAT IS THE PURPOSE OF LICENSING OF WHAT IS THE PURPOSE OF LICENSING OF PROFESSIONALS OF ANY KIND?PROFESSIONALS OF ANY KIND?DOCTOR?DOCTOR?DENTIST?DENTIST?LAWYER?LAWYER?HAIRDRESSER?HAIRDRESSER?MASSEUSE?MASSEUSE?
Purpose of LicensurePurpose of Licensure
Protect the publicProtect the public BY LimitING practice to qualified PERSONS.BY LimitING practice to qualified PERSONS. BY ESTABLISHING STANDARDS OF PROFESSIONAL BY ESTABLISHING STANDARDS OF PROFESSIONAL CONDUCT.CONDUCT.
AND PUNISHING violatORS of standards of AND PUNISHING violatORS of standards of professional conductprofessional conduct
BUT. . WHAT IS A “QUALIFIED” INDIVIDUAL?BUT. . WHAT IS A “QUALIFIED” INDIVIDUAL? HOW DO YOU DETERMINE WHO IS “QUALIFIED?HOW DO YOU DETERMINE WHO IS “QUALIFIED?
WHAT “QUALFIED” PSYCHOLOGIST WHAT “QUALFIED” PSYCHOLOGIST MEANS IN THE USMEANS IN THE US
DOCTORAL DEGREE—PHD OR PSYD.DOCTORAL DEGREE—PHD OR PSYD. EDUCATION—SPECIFIC COURSWORK (APA ACCREDITED EDUCATION—SPECIFIC COURSWORK (APA ACCREDITED PROGRAM OR EQUIVALENT).PROGRAM OR EQUIVALENT).
SUPERVISION CLINICAL EXPERIENCE (PRE- AND SUPERVISION CLINICAL EXPERIENCE (PRE- AND POST-DOCTORAL—USUALLY 3000 HOURS)POST-DOCTORAL—USUALLY 3000 HOURS)
KNOWLEDGE OF PSYCHOLOGY REGULATIONS IN KNOWLEDGE OF PSYCHOLOGY REGULATIONS IN SPECIFIC STATE.SPECIFIC STATE.
PASSING SCORE ON THE EXAMINATION FOR THE PASSING SCORE ON THE EXAMINATION FOR THE PRACTICE OF PROFESSIONAL PSYCHOLOGY—EPPPPRACTICE OF PROFESSIONAL PSYCHOLOGY—EPPP
MAYBE PASSING AN ESSAY EXAM.MAYBE PASSING AN ESSAY EXAM. MAYBE PASSING AN ORAL EXAM.MAYBE PASSING AN ORAL EXAM.
WHAT DOES LICENSING REGULATE IN WHAT DOES LICENSING REGULATE IN THE U.S.?THE U.S.?
1.1. USE OF THE TERM “PSYCHOLOGIST”USE OF THE TERM “PSYCHOLOGIST”
1.1. CERTAIN “PSYCHOLOGICAL” CERTAIN “PSYCHOLOGICAL” ACTIVITIES AND SERVICES.ACTIVITIES AND SERVICES.
1.1. ACCEPTING DIRECT FEE FOR ACCEPTING DIRECT FEE FOR SERVICES. SERVICES.
BUT WHO ELSE CAN DO BUT WHO ELSE CAN DO PSYCHOTHERAPY?PSYCHOTHERAPY?
SOCIAL WORKERS—LICENESED WITH SOCIAL WORKERS—LICENESED WITH MASTER’S DEGREE.MASTER’S DEGREE.
MENTAL HEALTH COUNSELORS—LICENSED MENTAL HEALTH COUNSELORS—LICENSED WITH MASTER’S DEGREE.WITH MASTER’S DEGREE.
PSYCHIATRIC NURSES—LICENSED WITH PSYCHIATRIC NURSES—LICENSED WITH MASTER’S DEGREE.MASTER’S DEGREE.
IT HELPS TO UNDERSTAND THE US IT HELPS TO UNDERSTAND THE US CONSTITUTIONCONSTITUTION
LIMITS POWERS OF FEDERAL GOVERNMENT.LIMITS POWERS OF FEDERAL GOVERNMENT.
GIVES A LOT OF POWER TO STATES & PROVINCESGIVES A LOT OF POWER TO STATES & PROVINCES
PRO—50 + 10 LABORATORIES FOR INNVATIONPRO—50 + 10 LABORATORIES FOR INNVATION
CON—DIFFICULT TO DEVELOP CONSENSUS AND CON—DIFFICULT TO DEVELOP CONSENSUS AND CONSISTENCYCONSISTENCY
FOR THIS REASON . . .FOR THIS REASON . . .
A NATIONAL LICENSING LAW WAS A NATIONAL LICENSING LAW WAS NEVER REALLY A POSSIBILITYNEVER REALLY A POSSIBILITY
LEFT TO RESPONSIBILITY OF STATESLEFT TO RESPONSIBILITY OF STATES
AND PROFESSIONAL ORGANIZATIONSAND PROFESSIONAL ORGANIZATIONS
Historical DevelopmentHistorical Development
Rapid growth of the practice of Rapid growth of the practice of psychology after ww2psychology after ww2
Greatly expanded training Greatly expanded training opportunities, e.g., through funding opportunities, e.g., through funding from the us Veteran’s Administrationfrom the us Veteran’s Administration
Growing Growing concerns in us & canada concerns in us & canada regarding standards of professional regarding standards of professional practice of psychologypractice of psychology
Needed consistencyNeeded consistency National governments had no power to National governments had no power to act.act.
FROM ACCREDITATION TO LICENSUREFROM ACCREDITATION TO LICENSURE
EARLY 1940s—STATES BEGIN CONSIDERING EARLY 1940s—STATES BEGIN CONSIDERING CERTIFICATION OF PSYCHOLOGISTS AND REGULATION CERTIFICATION OF PSYCHOLOGISTS AND REGULATION OF PRACTICEOF PRACTICE
LOOKED TO APA ACCREDITATION GUIDELINES TO LOOKED TO APA ACCREDITATION GUIDELINES TO DEVELOP REQUIREMENTS FOR LICENSURE.DEVELOP REQUIREMENTS FOR LICENSURE.
1945—CONNECTICUT—FIRST STATE CERTIFICATION 1945—CONNECTICUT—FIRST STATE CERTIFICATION LAWLAW
1946—VIRGINIA—FIRST STATE TO REQUIRE A PHD1946—VIRGINIA—FIRST STATE TO REQUIRE A PHD
Entry to Independent Practice: Entry to Independent Practice: U.S & CanadaU.S & Canada
Most (49) states require a doctoral Most (49) states require a doctoral degree for licensure as a Psychologistdegree for licensure as a Psychologist
Canada & EU—master’s only is enougH.Canada & EU—master’s only is enougH. One (1) state (West Virginia) requires a One (1) state (West Virginia) requires a masters degree for licensure as a masters degree for licensure as a Psychologist Psychologist
Two (2) states also license at masters Two (2) states also license at masters level for independent practice, level for independent practice, different title:different title:
1967—APA GUIDELINES FOR 1967—APA GUIDELINES FOR LICENSURELICENSURE
MOST STATE LAWS BASED ON APA ACCREDITATION MOST STATE LAWS BASED ON APA ACCREDITATION GUIDELINESGUIDELINES
GOOD EXAMPLE OF COOPERATION BETWEEN GOOD EXAMPLE OF COOPERATION BETWEEN PROFESSIONAL ORGANIZATIONS AND GOVERNMENT.PROFESSIONAL ORGANIZATIONS AND GOVERNMENT.
1. REQUIRE DOCTORAL DEGREE FOR LICENSURE 1. REQUIRE DOCTORAL DEGREE FOR LICENSURE (FIRST SUGGESTED IN THE 1920s)(FIRST SUGGESTED IN THE 1920s)2. APA ETHICAL PRINCIPLES SHOULD BE 2. APA ETHICAL PRINCIPLES SHOULD BE WRITTEN INTO STATE LAWWRITTEN INTO STATE LAW3. EXEMPTIONS FOR PSYCHOLOGISTS IN3. EXEMPTIONS FOR PSYCHOLOGISTS IN INSTITUTIONAL & ACADEMIC SETTINGS.INSTITUTIONAL & ACADEMIC SETTINGS.
1940s & 1950s—GROWING NEED FOR 1940s & 1950s—GROWING NEED FOR CONSISTENCY IN LICENSE REQUIREMENTSCONSISTENCY IN LICENSE REQUIREMENTS
CONSISTENCY NEEDED ACROSS THE STATES AND CONSISTENCY NEEDED ACROSS THE STATES AND PROVINCES.PROVINCES.
U.S. & CANADA ARE MOBILE SOCIETIES.U.S. & CANADA ARE MOBILE SOCIETIES.
LIMITED POWERS OF THE FEDERAL GOVERNMENTS.LIMITED POWERS OF THE FEDERAL GOVERNMENTS. NO NATIONAL LICENSING LAW IN U.S. OR CANADANO NATIONAL LICENSING LAW IN U.S. OR CANADA BUT—A LOT OF VOLUNTARY COORDINATION AMONG THE BUT—A LOT OF VOLUNTARY COORDINATION AMONG THE STATE (US) AND PROVINCIAL (CANADA) PSYCHOLOGY STATE (US) AND PROVINCIAL (CANADA) PSYCHOLOGY LICENSING BOARDS.LICENSING BOARDS.
November 1959 meeting in Chicago November 1959 meeting in Chicago decideddecided
• Written exam needed to ensure adequate Written exam needed to ensure adequate knowledge for practiceknowledge for practice
• An organizational structure necessary to An organizational structure necessary to oversee development of an examoversee development of an exam
• The American Association of State The American Association of State Psychology Boards (AASPB) was formed, with Psychology Boards (AASPB) was formed, with 29 charter members29 charter members
• Held first meeting in 1961Held first meeting in 1961• later changed NAME to the Association of later changed NAME to the Association of State and Provincial Psychology Boards State and Provincial Psychology Boards (ASPPB) (ONTARIO JOINED)(ASPPB) (ONTARIO JOINED)
1961—ASSOCIATION OF STATE AND 1961—ASSOCIATION OF STATE AND PROVINCIAL PSYCHOLOGY BOARDS (ASPPB)PROVINCIAL PSYCHOLOGY BOARDS (ASPPB)
FORMED BY THE PSYCHOLOGY BOARDS OF A FORMED BY THE PSYCHOLOGY BOARDS OF A NUMBER OF US STATES AND ONTARIO. NUMBER OF US STATES AND ONTARIO.
GOAL—BRING SOME CONSISTENCY TO GOAL—BRING SOME CONSISTENCY TO LICENSING LAWS IN THE US AND CANADA.LICENSING LAWS IN THE US AND CANADA.
FORUM FOR SHARING IDEASFORUM FOR SHARING IDEAS
ASPPB MISSION STATEMENTASPPB MISSION STATEMENT
To enhance services and support its member To enhance services and support its member jurisdictions in fulfilling their goal of jurisdictions in fulfilling their goal of advancing public protection by:advancing public protection by:Offering examination & credentialing Offering examination & credentialing programs.programs.serving as the source for the current and serving as the source for the current and accurate information about the regulation of accurate information about the regulation of psychologists.psychologists.contributing to the critical consumer contributing to the critical consumer protection perspective in the on-going protection perspective in the on-going development of the profession.development of the profession.
FIRST TASK—STANDARDIZED TEST OFFIRST TASK—STANDARDIZED TEST OF BASIC KNOWLEDGE OF PSYCHOLOGY. BASIC KNOWLEDGE OF PSYCHOLOGY.
WHAT INFORMATION IS NECESSARY FOR THE WHAT INFORMATION IS NECESSARY FOR THE COMPETENT AND ETHICAL PRACTICE OF COMPETENT AND ETHICAL PRACTICE OF PSYCHOLOGY?.PSYCHOLOGY?.
EXAMINATION FOR THE PRACTICE OF EXAMINATION FOR THE PRACTICE OF PROFESSIONAL PSYCHOLOGY—EPPP.PROFESSIONAL PSYCHOLOGY—EPPP.
EXAMPLE OF INFLUENCE OF PSYCHOMETRIC EXAMPLE OF INFLUENCE OF PSYCHOMETRIC TRADITION.TRADITION.
Historical & Current DevelopmentsHistorical & Current Developments
• First form of EPPP administered IN 1965 to First form of EPPP administered IN 1965 to 27 candidates in eight states.27 candidates in eight states.
(B.F. SKINNER WROTE ITEMS FOR FIRST EXAM)(B.F. SKINNER WROTE ITEMS FOR FIRST EXAM)
• By 1978 4000 candidates were being tested By 1978 4000 candidates were being tested each yeareach year
• In 2012 5400 candidates were tested in 62 In 2012 5400 candidates were tested in 62 jurisdictions in U.S. & Canada.jurisdictions in U.S. & Canada.
Purposes of the EPPPPurposes of the EPPP Assist licensing boards in evaluating Assist licensing boards in evaluating candidates for licensurecandidates for licensure
Ensure that licensed psychologists have Ensure that licensed psychologists have acquired a broad, basic knowledge of acquired a broad, basic knowledge of psychology. psychology.
ENSURE SOME CONSISTENCY ACROSS JURISDICTIONS.ENSURE SOME CONSISTENCY ACROSS JURISDICTIONS.
Never intended as the only measure of Never intended as the only measure of readiness for practicereadiness for practice
EPPPEPPP USED IN ALL US STATES AND CANADIAN PROVINCES.USED IN ALL US STATES AND CANADIAN PROVINCES.
FRENCH VERSION IN QUEBEC & SPANISH VERSION IN FRENCH VERSION IN QUEBEC & SPANISH VERSION IN PUERTO RICOPUERTO RICO
MAINTAINED AND ADMINISTERED BY A PRIVATE, NOT-MAINTAINED AND ADMINISTERED BY A PRIVATE, NOT-FOR-PROFIT COMPANY.FOR-PROFIT COMPANY.
REVIEWED AND REVISED AT VARIOUS STAGES OF REVIEWED AND REVISED AT VARIOUS STAGES OF DEVELOPMENT BY ASPPB EXAMINATION COMMITTEE, DEVELOPMENT BY ASPPB EXAMINATION COMMITTEE, WHICH MEETS TWICE YEARLY. WHICH MEETS TWICE YEARLY.
CONSISTS OF TEN MEMBERS FROM THE US AND CANADA CONSISTS OF TEN MEMBERS FROM THE US AND CANADA REPRESENTING EXPERTISE ON THE VARIOUS DOMAINS REPRESENTING EXPERTISE ON THE VARIOUS DOMAINS REPRESENTED ON THE EXAM. REPRESENTED ON THE EXAM.
EPPPEPPP
175 MULTIPLE-CHOICE QUESTIONS.175 MULTIPLE-CHOICE QUESTIONS. CONTENT IS THE RESULT OF A PERIODIC SURVEY.CONTENT IS THE RESULT OF A PERIODIC SURVEY. THOUSANDS OF PRACTICING PSYCHOLOGISTSTHOUSANDS OF PRACTICING PSYCHOLOGISTS WHAT KNOWLEDGE DO THEY BELIEVE IS NECESSARY WHAT KNOWLEDGE DO THEY BELIEVE IS NECESSARY FOR COMPETENT PRACTICE?FOR COMPETENT PRACTICE?
GENERAL PSYCHOLOGY EXAM, NOT JUST CLINICALGENERAL PSYCHOLOGY EXAM, NOT JUST CLINICAL Computer administered at local sites Computer administered at local sites throughout calendar yearthroughout calendar year
Candidate must be approved by regulatory Candidate must be approved by regulatory board/college to take examboard/college to take exam
Fee = $500?Fee = $500?
EIGHT MAJOR DOMAINSEIGHT MAJOR DOMAINS
(CLOSELY MATCHING APA ACCREDITATION GUIDELINES)(CLOSELY MATCHING APA ACCREDITATION GUIDELINES)
1-BIOLOGICAL BASES OF BEHAVIOR (12%)1-BIOLOGICAL BASES OF BEHAVIOR (12%)
ITEM-DEVELOPMENT COMMITTEEITEM-DEVELOPMENT COMMITTEETEAM OF ITEM WRITERS ALWAYS WRITING ITEMS.TEAM OF ITEM WRITERS ALWAYS WRITING ITEMS.Pro-exam assembles pretest items into Pro-exam assembles pretest items into domains.domains.Pro-exam assembles examination formsPro-exam assembles examination formsExamination Committee (ExC) reviews & Examination Committee (ExC) reviews & revises pre-test ITEMS.revises pre-test ITEMS.ExC reviews & revises examination formsExC reviews & revises examination formsExaminations administeredExaminations administeredPro-exam and ExC review pretest and test Pro-exam and ExC review pretest and test question statisticsquestion statistics
Central GuidelinesCentral Guidelines Item tests knowledge important for Item tests knowledge important for entry entry levellevel practice.practice.
Knowledge of the item content relevant to Knowledge of the item content relevant to protection of the publicprotection of the public• Would not knowing this information cause Would not knowing this information cause less competent practice that might result less competent practice that might result in harm to the public?in harm to the public?
items should be based on:items should be based on:• Current research orCurrent research or• Best practice, preferably with research Best practice, preferably with research basebase
The content of the test helps to define the The content of the test helps to define the field of professional psychologyfield of professional psychology
Research on the EPPPResearch on the EPPP
Numerous studies supporting reliability & Numerous studies supporting reliability & validity of EPPPvalidity of EPPP
Data suggest best to take EPPP within 3 years Data suggest best to take EPPP within 3 years of graduationof graduation
Correlation education and performance on Correlation education and performance on EPPPEPPP
Those with more or better education Those with more or better education perform better on the EPPPperform better on the EPPP
Those rated more highly by faculty and Those rated more highly by faculty and supervisors do better on the EPPPsupervisors do better on the EPPP
The correlations in scores between the The correlations in scores between the various areas (domains) are highvarious areas (domains) are high
CONTENT VALIDITY: PRACTICE CONTENT VALIDITY: PRACTICE ANALYSISANALYSIS
Practicing psychologists surveyed Practicing psychologists surveyed and focus groupsand focus groups
What do entry levelKNOWLEDGE DO What do entry levelKNOWLEDGE DO psychologists need to know?psychologists need to know?
What knowledge is important for What knowledge is important for protection of the public?protection of the public?
Most Recent Practice AnalysisMost Recent Practice Analysis 4 Task Force Meetings, April 2008, Nov. 2008, July 4 Task Force Meetings, April 2008, Nov. 2008, July
2009, and Nov. 2009.2009, and Nov. 2009. 2 rounds of independent 2 rounds of independent subject matter expertsubject matter expert
reviews (30 reviewers)reviews (30 reviewers) 2 focus panels to refine delineation (Aug.-Sept. 2008)2 focus panels to refine delineation (Aug.-Sept. 2008) Large-scale validation survey of 8,000 psychologistsLarge-scale validation survey of 8,000 psychologists 2 focus panels and additional interviews to explore 2 focus panels and additional interviews to explore
competency assessment competency assessment
FOOD FOR THOUGHT . . .FOOD FOR THOUGHT . . .
HOW IS THIS SIMILAR TO OR HOW IS THIS SIMILAR TO OR DIFFERENT FROM HOW COMPETENCE FOR DIFFERENT FROM HOW COMPETENCE FOR PROFESSIONAL PRACTICE IS DETERMINED PROFESSIONAL PRACTICE IS DETERMINED IN URUGUAY? IN URUGUAY?
PROS & CONS?PROS & CONS?
EPPP CONTROVERSIESEPPP CONTROVERSIES
IS A MULTIPLE-CHOICE EXAM A GOOD WAY IS A MULTIPLE-CHOICE EXAM A GOOD WAY TO DETERMINE COMPETENCE?TO DETERMINE COMPETENCE?
DOES THE CONTENT TRULY REFLECT WHAT A DOES THE CONTENT TRULY REFLECT WHAT A PRACTITIONER NEEDS TO KNOW?PRACTITIONER NEEDS TO KNOW?
NOT ENOUGH “CLINICAL” CONTENT.NOT ENOUGH “CLINICAL” CONTENT.
NOT SUFFICIENTLY BASED ON RESEARCH. NOT SUFFICIENTLY BASED ON RESEARCH.
