Program Assessment in Workforce Education
Florida Community College at Jacksonville
Core Competencies,
Flexible Implementation
FCCJ Workforce Education
• Over 80 workforce education programs– Automotive
– Aviation
– Business and Finance
– Information Technology
– Construction Trades
– Public Service
– Culinary and Hospitality
– Engineering and Industrial Technology
– Allied Health
– Legal and Office Systems
• Workforce program features:– AS/AAS degrees, college
credit certificates, vocational certificates, and continuing ed
– College preparatory and vocational preparatory instruction (remediation)
– Dual enrollment for traditional and adult high school students
– Articulation between all educational levels and credit for prior learning
Workforce Program Assessment Model
Student learning outcomes
Assessmentmethods
Datacollection
Programimprovement
Timeline/schedule
Faculty achieve consensus on learning outcomes to be assessed, and map outcomes to curriculum
Faculty choose assessment methods appropriate to the outcomes, purpose of assessment, and student population
Faculty develop timeline for gathering assessment data,
both formative and summative
Faculty and staff work together to gather
formative and summative assessment data and
compile for review
Faculty and staff collaborate to interpret assessment data and develop strategies to improve
student learning outcomes
Continuous improvement
cycle
Assessment Program Components
• Identify Core Competencies: – Literacy (verbal, written, quantitative)– Problem-solving– Discipline-specific knowledge and skills
• Map competencies to curriculum and modify where necessary
• Identify/develop assessment strategies• Orient/train adjuncts• Gather, compile, and interpret data• Share with program advisory committee and other
stakeholders
Mirrors University outcome categories
Available Tools and Resources
• Professional development opportunities for faculty and staff
• Research analyst - assistance with data collection and analysis
• Faculty Fellows – support for planning and implementation
• Program Assessment Rubric – self-evaluation of progress
Core Competencies:Literacy (verbal, written, quantitative)
• Culinary arts:– Develop and execute, in both written and oral formats, such
foodservice management documents as a: menu plan, restaurant concept overview, purchasing specification, food production schedule, and catering contract proposal
• Practical Nursing:– Demonstrate grammatical and format proficiency in written
documentation of patient care.
• All:– Demonstrate the ability to conduct research via Internet and
other resources and put information together in a logical and concise written report.
Core Competencies:Problem-Solving
• Cisco CCNP:– When presented with problem or design scenarios, students will
demonstrate problem-solving abilities and critical thinking skills by performing appropriate configuration, design, assessment, and/or solution(s)
• Paramedic:– When presented with simulated patient scenarios students will
demonstrate problem-solving abilities and critical thinking skills by selecting appropriate assessment and treatment modalities
• All:– Demonstrate proficiency in working with customers (internal and
external) and colleagues who come from diverse backgrounds, age groups, socioeconomic groups
Core Competencies:Discipline-specific knowledge/skills
includes teamwork and productivity
• Aviation Maintenance:– Evaluate the requirements of a maintenance task and complete
it in a timely manner meeting industry standards
• Office Administration:– Demonstrate the ability to prioritize projects and assignments,
use effective time management techniques, and employ effective records management techniques
• Cosmetology:– Demonstrate leadership and exemplary interpersonal skills while
performing in groups simulating salon settings
Network Engineering TechnologyNetwork Engineering TechnologyE-Portfolio RequirementsE-Portfolio Requirements
CET2629 Internetwork Troubleshooting (CCNP4) - CET2629 Internetwork Troubleshooting (CCNP4) - Case StudyCase Study
CET2628 Building Remote Access Networks (CCNP2) - CET2628 Building Remote Access Networks (CCNP2) - Case StudyCase Study
CET2623 Quality of Service - CET2623 Quality of Service - NBar Case StudyNBar Case Study
CET2627 Building Multilayer Switched Networks (CCNP3) - CET2627 Building Multilayer Switched Networks (CCNP3) - HSRP Case StudyHSRP Case Study
EEV0585 or CET1175 Technical Support - EEV0585 or CET1175 Technical Support - Resume and PresentationResume and Presentation
EEV0531 or CET2186 - Computer Peripherals - EEV0531 or CET2186 - Computer Peripherals - Certificate of DisassemblyCertificate of Disassembly
EEV0543 or CET1512 - Operating Systems - EEV0543 or CET1512 - Operating Systems - DOS CertificateDOS Certificate
CET2677 Voice Over IP - CET2677 Voice Over IP - Case StudyCase Study
EEV0544 or CET1742 Intro to Networking - EEV0544 or CET1742 Intro to Networking - Putting it all together labPutting it all together lab
EEV0570 or CET2600 Cisco I - EEV0570 or CET2600 Cisco I - Report/LabReport/Lab
EEV0571 or CET2610 Cisco 2 - EEV0571 or CET2610 Cisco 2 - Case StudyCase Study
CET2626 Building Scalable Networks - CET2626 Building Scalable Networks - Case Study 1Case Study 1
Network Engineering TechnologyNetwork Engineering TechnologySample E-Portfolio Assignment, Cisco 7Sample E-Portfolio Assignment, Cisco 7
For each case study, submit For each case study, submit one Word document that one Word document that contains the following:contains the following:The graphic for the case study The graphic for the case study provided or created yourself provided or created yourself from the PowerPointfrom the PowerPointAll the configurations of each All the configurations of each device (make sure each device device (make sure each device is properly labeled with a is properly labeled with a hostname so it is easily hostname so it is easily identified)identified)Captured pertinent show Captured pertinent show commands that prove the commands that prove the requirements of the case studyrequirements of the case studyScreen captures of the host IP Screen captures of the host IP address and default gatewayaddress and default gatewayScreen captures of successful Screen captures of successful pings to the other hostspings to the other hosts
Legal Studies – Targeted OutcomesLegal Studies – Targeted Outcomes
Effective legal writingEffective legal writing
TeamworkTeamwork
Ethics and professionalismEthics and professionalism
Legal Studies – Assessment MethodsLegal Studies – Assessment Methods
Curriculum-embedded assessments covering the Curriculum-embedded assessments covering the targeted skillstargeted skills Teaches the skillsTeaches the skills Provides feedbackProvides feedback Administered in the courses each student must take to Administered in the courses each student must take to
complete the programcomplete the program
Transformation of Internship into a Capstone Transformation of Internship into a Capstone CourseCourse Internship work experienceInternship work experience Group presentation of solution to ethical dilemma present Group presentation of solution to ethical dilemma present
in a real life factual scenarioin a real life factual scenario Portfolio – to be compiled from specified embedded Portfolio – to be compiled from specified embedded
assessments throughout the required Legal Assisting assessments throughout the required Legal Assisting coursescourses
Group presentation and portfolio to be assessed by a Group presentation and portfolio to be assessed by a panel that includes employers and practicing paralegalspanel that includes employers and practicing paralegals
Aviation MaintenanceAviation Maintenance
GoalsGoals:: All graduates All graduates
complete written complete written exams within 60 days exams within 60 days of graduationof graduation
At least 90% will pass At least 90% will pass the exam on first the exam on first attemptattempt
Increase the number Increase the number of certified techniciansof certified technicians
Learning/Assessment Learning/Assessment Methods:Methods:
Entry and exit surveysEntry and exit surveys Examiner-Examiner-
administered practice administered practice oral examsoral exams• Provide students and Provide students and
instructors with instructors with feedback on students’ feedback on students’ skillsskills
• Encourage students to Encourage students to take the official examtake the official exam
Aviation MaintenanceAviation MaintenanceSpring 2006 OutcomesSpring 2006 Outcomes
73% of graduates have completed 73% of graduates have completed the licensure exam – up from 14% the licensure exam – up from 14% two years agotwo years ago
91% of graduates have a job in the 91% of graduates have a job in the aviation industryaviation industry
The practice exams show that there The practice exams show that there is room for improvement and is room for improvement and continuing evaluationcontinuing evaluation
Culinary ArtsClassroom vs. Program Assessment
Classroom Assessment Example: Chef-Instructor evaluates student mystery basket assignment and provides feedback to student via written and class critique (feedback for instructor…)
Program Assessment Example: Faculty members develop rubric for evaluating the mystery basket assignment, formally collect, aggregate and evaluate this data, and suggest and ultimately make meaningful curricular changes based on data (feedback for program…)
Culinary Arts Practical Assessment Rubric
Standard Levels of Quality
ProfessionalismHighly Competent (3) Competent (2) Needs Improvement (1)
Industry/course terms and nomenclature
Excellent knowledge of terms and technical nomenclature.
Overall good knowledge of terms with some improvement needed.
Overall knowledge of terms not adequate to perform successfully.
Professional dress and conduct
Excellent professional dress and demeanor observed.
Overall good dress and professional demeanor observed with some habits needing improvement.
Significant lapses in dress and professional demeanor were observed.
Teamwork and collaborative skills
Worked very well in team environment and showed initiative and outstanding group skills. Potential leadership attributes emerged.
Worked fairly well in a team environment with some group skills needing improvement.
Difficulty performing in team setting. Significant improvements needed in order to function well with others, and to successfully collaborate with working members of a group.
Interaction with site proctor or professor
Interacted with site proctor in a professional manner, reflecting outstanding industry expectations.
Proctor interaction was adequate with improvement needed in the area of interpersonal communication.
Some conflict emerged while interacting with site proctor. Significant improvements needed in the area of respect and overall professionalism.
Office Administration
Identified core competencies Mapped core competencies to
curriculum – spreadsheet that hyperlinks to actual assessment tools
Updated official course outlines with core competencies and assessment methods
Developing tracking and data management strategies
Office AdministrationCurriculum Map
Problem Solving OST 1100 OST 1581 OST 1384 OST 2771 OST2501
Demonstrate problem solving abilities by being able to troubleshoot minor computer operational problems.
Link to assignment
rubric
Link to assignment
rubric
When presented with typical business scenarios for which there are no obvious solutions, students will demonstrate problem solving abilities by selecting correct resources and actions to deal effectively with the scenarios.
Link to case studies
Link to exam and
scoring guide
Demonstrate proficiency in working with customers from diverse backgrounds and with a variety of issues, utilizing analytical and problem-solving tools.
Link to assignment
rubric
Link to project rubric