Assessing a University Core Curriculum by using the CAAP
TAIR 36th Annual Conference February 18-21, 2014
Tau Kadhi, PhDAVP for Learning AssessmentWest Texas A&M University
Topics Addressed
•Need for Assessment•Assessment at West Texas A&M•What are the components•Assessment Cycle•What is the CAAP?•What do our profiles look like?• Future of Assessment at WTAMU
Need for Assessment
100%
70%
60%
70%
80%
80%
80%
90%
70%
Class Average = 70%
Need for Assessment
0 missed
1. Prealgebra2. Coordinate Geom
Prealgebra 8 of 9Elem Alg 8 of 9Int Alg 4 of 9Coord Geom 2 of 9Coll Alg 9 of 9Trig 4 of 9
1. Inter Algebra2. Coordinate Geom
1. Trig2. Coordinate Geom
1. Inter Algebra2. Trig3. Coordinate Geom
1. Inter Algebra2. Coordinate Geom3. Prealgebra4. Trig
1. Elem Algebra2. Inter Algebra3. Coordinate Geom
1. Inter Algebra2. Coordinate Geom3. Trig 1. Trig
Organization of University Assessment
Institutional Mission
University Goals
Instructional Departments Non Instructional Units
Student Learning
Measurable Student Learning Outcomes
Library, Technology, & Student Support Outcomes
Measureable Learning Support and Administrative Outcomes
Levels of Assessment Outcomes
• Graduates from our campus can apply quantitative reasoning to real-world problems.
• Students who graduate in business can apply quantitative methods to business-related problems.
• Students who complete the Psychology program can use statistical tools to analyze and interpret data from psychological studies.
Course Level •Students who complete this course can calculate and interpret a variety of descriptive and inferential statistics
University Learning Assessment Reporting
Core
DSK
GLOs
Offices Reported
Discipline Specific Knowledge (DSK)
SACS
TAMUS
WTAMU
University Academic Core
(Core)
SACS
THECB
TAMUS
WTAMU
General Learning Outcomes
(GLOs)
SACS
THECB
TAMUS
WTAMU
Direct Measures Used
Discipline Specific Knowledge (DSK)
CAAP
EPP
Student Products
University Academic Core
(Core)
CAAP
EPP
General Learning Outcomes
(GLOs)
CAAP
EPP
Student Products
WTAMU Assessment Cycle
Aug 31Assessment Plan Due
Fall and Spring Semesters
Jun 30Assessment Report/Data Dissemination Profiles Due
Aug 31Plans of Action
1. Articulate Mission2. Identify Objectives
and Outcomes3. Determine Methods
to Gather Evidence4. Set Criteria
5. Gather Evidence 6. Review and Analyze Results
7. Recommend actions8. Make changes
(Document per curriculum committee when required)
PLANNING PHASE GATHERING EVIDENCE PHASE ACTION PHASE
Models of CAAP Administrations
Pre Post Student
Math Writing Reading Critical Thinking
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
Years vs Test Administrations
Pre Test Given Post Test Given Actual Content
WTAMU Profiles
Math Writing Reading Critical Thinking
0
0.5
1
1.5
2
2.5
3
3.5
Years vs Test Administration
Test Given Actual Content
Methodology• Administer instruments during week of April 7-11, 2014:• Specific courses are identified by appropriate Directors/Chairs• Instruments will be ordered to specific course numbers on March
3 (approximate 250 per subject area)• Assign instrument as ???% of final grade for equal student
motivation (will discuss more in Jan meeting)• April 1, Department Chairs to receive instruments from Tau• April 14, Tau collects instruments from Directors/Chairs and sends
to CAAP• April 25, Tau shares raw results to Directors/Chairs for optional
grades• Full assessment report provided by June 30 as per cycle
CAAP/EPP Courses TestedMATHEMATICS (250 students):• MATH 1314• MATH 1325• MATH 2414• MATH 2413• MATH 1332• MATH 1350
CRITICAL THINKING (250 students):• AGBE 2317• COMM 2377• CRIJ 1301• ECON 2302• PSYC 2301• SOCI 1301
READING (250 students):• HIST 1302• POSC 2306• POSC 2305• ENGL 2321• ENGL 2326
WRITING (250 students):• ENGL 2311• ENGL 1302• MCOM 2315• HIST 2XXX (2311 from
Drumheller/Clark)• ENGL 2XXX
CAAP Content TestedMATHEMATICS:1. Pre-Algebra2. Elementary Algebra3. Coordinate Geometry4. College Algebra5. Trigonometry
CRITICAL THINKING:1. Analysis of Elements of Arguments2. Evaluation of Arguments3. Extension of Arguments
READING:1. Reasoning Skills2. Referring Skills
WRITING:1. Punctuation2. Grammar3. Sentence Structure4. Strategy5. Organization6. Style
What do the CAAP profiles look like?
WTAMU University Profile
Critical Thinking Mathematics Reading Writing0
10
20
30
40
50
60
70
80
62
52
58 60
66
45
55
68
West Texas A&M 2013-2014 CAAP Profile
WTAMU Nat Norms
WTAMU College of Fine Arts and Humanities Profile
Critical Thinking Mathematics Reading Writing0
10
20
30
40
50
60
70
80
62
52
58 60
66
45
55
68
West Texas A&M 2013-2014 CAAP Profile
WTAMU Nat Norms
WTAMU Communications (MCOM) Program Profile
Critical Thinking Mathematics Reading Writing0
10
20
30
40
50
60
70
80
62
52
58 60
66
45
55
68
West Texas A&M 2013-2014 CAAP Profile
WTAMU Nat Norms
WTAMU Communications (MCOM) Program Profile
PreAlgebra ElemAlgebra CoordGeom CollAlg Trig0
10
20
30
40
50
60
70
80
90
62
77
58
68
6060
52
60 6055
West Texas A&M 2013-2014 CAAP Profile – Mathematics
WTAMU Nat Norms
What are we working on?1. Spreading common assessment language2. Overcoming assessment myths3. Inclusion of Student Affairs and Student Support units4. University Learning Assessment Committee (ULAC)
reporting of the University Academic Core5. Supporting Discipline Specific Knowledge (DSK)
efforts6. Supporting General Learning Outcome (GLO) ad hoc
committee efforts7. Organizing a comprehensive University Assessment
Cycle (Assessment Audit Sheet)8. New reporting document (12 pages to 4 electronic
pages)