STANDARD SETTING/ORIENTATIONCOMPUTER APPLICATIONS TECHNOLOGY
JANUARY 2012
Welcome and Farewell
New Colleagues New Schools Schools quitting the subject
CAT and IT can be offered together in Grade 10 from this year
Moves to do away with the “designated” list
CAT_Standard Setting_2012 2
Agenda Reflection:
Results, Exam papers Irregularities and Incidents (Marking Centre) Curriculum Delivery Assessment & Irregularities Moderation
The way forward CAPS PoA & Curriculum Delivery – Gr 11 and 12 Assessment and Moderation Important Dates Planned workshops
CAT_Standard Setting_2012 3
Reflection on 2011 NSC Examinations
CAT_Standard Setting_2012 4
National CAT Results
Provincial Results
“WC takes first place on average with two provinces blowing on WC’s neck. In terms of pass rate, WC takes 3rd position.”
CAT_Standard Setting_2012 7
Central Results
Exam Date Wrote Average Pass rate
30%Pass rate
40% 0-29% 70-79% 80-100% Not Resulted
200811 1338 50.8 83 61 238 111 86 0
200911 1211 45.5 85 63 182 69 32 0
201011 1347 47.6 88 66 151 84 41 51
201111 1157 46.4 88 60 129 69 37 32
Central compared to othersDistrict Wrote Average
Pass rate 30%
Pass rate 40% 0-29% 80-100%
Cape Winelands 1524 52.7 93.1% 76.0% 98 99
Eden and Central Karoo 968 49.6 87.7% 65.1% 112 76
Metropole_Central 1347 46.4 88.0% 64.0% 151 41
Metropole_East 1682 49.4 90.1% 71.7% 164 58
Metropole_North 2498 50.1 91.2% 73.0% 201 97
Metropole_South 1025 47.2 91.2% 70.5% 84 14
Overberg 433 48.8 93.5% 69.3% 24 20
Westcoast 535 52.4 97.2% 80.0% 15 30
10012 49.6% 91% 71.2% 849 435
CAT_Standard Setting_2012 8
Performance in Paper 1 (2011)
CAT_Standard Setting_2012 9
Q1 Q2 Q3 Q4 Q5 Q6 Q7 Paper0
10
20
30
40
50
60
70
80
Paper 1 2011
WCEDMCED
Performance in Paper 2 (2011)
CAT_Standard Setting_2012 10
Q1 Q2 Q3 Q4 Q5 Q6 Q7 Paper0
10
20
30
40
50
60
70
80
Paper 2 2011
WCEDMCED
CAT_Standard Setting_2012 11
Reflection 2010 NSC Practical Exams Practical Examinations
Significant Improvement in Data Management of data on CD’s – Fewer reports on missing data
Irregularities IncidentsMissing data Incorrect Date and Time stamps
0 wrote the backup paper Pink Information sheets without bar code stickersIncorrect folder structures
School Name on CD’s, pink sheets and other documents (letterheads)Incorrect indication of files modified on pink info sheets
CAT_Standard Setting_2012 12
Analysis of NSC Paper 1
Q1 Q2 Q3 Q4 Q5 Q6 Q7 Paper 10.0
10.0
20.0
30.0
40.0
50.0
60.0
70.0
80.0
90.0
100.0
Ave % per Question of Paper 1
Perc
enta
ge (%
)
Reflection: Poor Performance in questionsQuestion Poor performanceQuestion 1 1.4 Save bmp as jpg
1.6 Counting the occurrence of ‘e’1.7 Sorting and manipulating attributes
Question 2 2.7 Format Painter2.9 Column Break2.10.1 Flip Image2.11 Custom Symbol2.12 Outline Numbering
Question 3 3.1 Date Format3.5 Leader Tab3.6 Grouping of Objects3.8 Formulas in table3.9 Sorting in Table
CAT_Standard Setting_2012 13
Poor performing questions (Cont.)Question Poor performance inQuestion 4 4.4 Function vs. Formula
4.6 VlookUp functionNested-IF
Question 5 5.3 Combination of function & formula5.4 Correcting formula5.7 LEN function
Question 6 6.2.1 Unique field and Primary key6.7 Text Box vs. Label Box6.7.3 Formatting to currency6.7.4 Grouping Function in form
Question 7 Bookmarks; Hyperlink Properties
7.2 Paste Link7.3 [4] Bonus marks
CAT_Standard Setting_2012 14
NSC Paper 1: General remarks Lack of proficiency
Practise, practise, practise … Time management Poor foundation in Grade 10 Teaching Methodology Exam Techniques Exam dry Runs
CAT_Standard Setting_2012 15
CAT_Standard Setting_2012 16
Analysis of NSC Paper 2
Que
stio
n 1
Que
stio
n 2
Que
stio
n 3
Que
stio
n 4
Que
stio
n 5
Que
stio
n 6
Que
stio
n 7
Pap
er A
ve %
0.0
10.0
20.0
30.0
40.0
50.0
60.0
70.0
80.0
90.0
100.0
Ave % per Question for Paper 2 (Theory)
Perc
enta
ge
Poorly answered questions - Paper 2
Poorly answered questions – Paper 2
NSC Paper 2: General remarks Learners must write
Notebooks! Correct terminology Poor foundation in Grade 10 Teaching Methodology Exam Techniques Exam dry Runs
CAT_Standard Setting_2012 19
Reflection: Curriculum Delivery
CAT_Standard Setting_2012 20
What went well
PAT deadlines Mark sheets provided when requested No SBA assessment irregularities CA received warm welcome at all schools
CAT_Standard Setting_2012 21
What needs improvement
Some schools never submit mark sheets PAT irregularities
Not done under controlled conditions Not monitored by teacher
Not checking e-mails every day Failing to keep evidence of practical work
CAT_Standard Setting_2012 22
Notebooks
Empty notebooks – concern Volume – must correlate with planning and measure
curriculum delivery Learners must write Theory vs. practical notes –
Summary of Practical content also in learner notebooks Lack of application/exercises/questions and answers
CAT_Standard Setting_2012 23
CAT_Standard Setting_2012 24
Reflection: Assessment (SBA) Theory Tests:
Multiple Choice and Matching questions not in ratio with Section B questions
Example: Theory Test: 10 +10 + 30 = 50 vs. NSC Paper: 10 + 10 + 130 = 150
Theory Tests assess too little content Reduced Max Totals of Exams – must be communicated
and motivated to CA Theory Exams
Questions verbatim from NSC papers still occur …
Reflection: Internal Assessment (SBA) Practical Tests:
Must administer similar to NSC exam configuration Marking Guideline similar to NSC Prac. paper Time duration of tests not in ratio with max totals i.e.
70 Mark test within approx. 60 minutes Lack of proficiency/skill impacts on effective time
management in completing practical exams Loss of data a concern Marking be completed at least 1 week after
assessment Feedback
CAT_Standard Setting_2012 25
CAT_Standard Setting_2012 26
Reflection: Assessment (SBA) Examinations
Internal Practical Examinations - NSC security configuration. All Question papers to be moderated internally or by peer
teacher. The use of NSC-/Common-/Provincial/past SJ papers verbatim
NOT allowed Common Paper for Trial Exams in 2012 … Grade 12 Papers: Cannot be less!
Paper 1: 200 Marks Paper 2: 150 Marks
CAT_Standard Setting_2012 27
Best Practises Past Exam Papers
DoE Papers (Oct, Rewrite and Suppl.) Teachers to set their own papers Visit: Thutong Education Portal Use past NSC papers to set informal assessment Collated per content breakdown (Prac. & Theory)
Regular Homework on Operational Knowledge, Monitor learners' homework
Regular informal tests Test basic knowledge
Avoid copies pasted in notebooksLearners must write in order to comprehend
Assessment Irregularities (2011)-SAIC Recorded irregularities in 2011
PAT irregularities Consequences Position of CA
CAT_Standard Setting_2012 28
CAT_Standard Setting_2012 29
Internal Moderation Overall compliance, BUT, Script moderation still paper exercise… Please comply with the following:
Standard and Quality Setting of FATs; Tests and Exam Papers
Moderation of scripts (in line with NSC marking processes)
Administer – using control sheets Use Moderation control sheets:
Formal Tests (Practical and Theory) Examination Papers Scripts PAT
CAT_Standard Setting_2012 30
Moderation: Method Internal Moderation – imperative/compulsory Moderation by:
Subject Head Peer teachers at 1 specific school, or Peer teachers at neighbouring schools Support groups or mini-cluster
Set assessments/exams in small groups – minimise workload in setting and moderation Same pace setter
District Moderation Face Moderation (per term) of SBA at selected schools Desktop Moderation:
Formal Assessment and Mid-Year Exam papers (selected schools)
Submission of electronic recording sheets - July PATs – see timeline Teacher File with SBA Cluster/Peer Moderation - on-going Final Moderation and Verification (all schools)
CAT_Standard Setting_2012 31
CAT_Standard Setting_2012 32
Evidence of Learner Performance Available at all times – all stake-holders At school – not at home or with learners FATs for recording and promotion purposes. Absent due to valid reason, provide a copy of medical
certificate or other valid reason. No valid reason – a note (intervention) of the educator Intervention letters be co-signed by a witness (Subject
Head, Grade Head, Peer Teacher etc.) Archiving of Scripts …
CAT_Standard Setting_2012 33
Current Curriculum Developments: CAPS CAPS (Curriculum and Assessment Policy
Statement) Implementation in 2012 Orientation – 2011 Important notes on CAT CAPS:
Teaching Plan Work Schedule and Daily Planning Assessment (NCS vs. CAPS) Weightings of tests and exams? Exemplar tests and exams …
Important Events/DatesTerm Event Time Frame Schools
Term 1 Visitation to focus schools On-going Selected Schools
Term 2 Moderation of June Examination papers (Gr. 12)
7 May 2011 Selected Schools
Term 3
Submission of Gr. 10 to 12 Recording Sheets
23 July 2011 All Schools
Submission of Gr. 12 PAT Marks
17 August 2011 All Schools
Term 4
Submission of Gr. 12 Recording Sheets (SBA)
October 2011 All Schools
Gr. 12 Final Moderation & Verification
October 2011 Groups
Submission of Gr. 10 & 11 Recording Sheets
July 2011November 2011
All Schools
CAT_Standard Setting_2012 34
CAT_Standard Setting_2012 35
Curriculum Support - 2011 Some schools
2 visits per term Some schools
1 visit per term Other schools
On request Be prepared …
Programme of Assessment(PoA) PoA – Grade 10 (CAPS)
P1: 120 P2: 100 PoA – Grade 11 – as per 2011
June exams: P1 – 180 P2 – 100 November exams: P1 – 200 P2 - 150
PoA – Grade 12 – as for 2011 Tests only - no tasks Weighting of tests …?
CAT_Standard Setting_2012 36
Recording in 2012
Recording sheets for 2012 are being prepared The recording sheets for 2011 will work and can
be adapted
CAT_Standard Setting_2012 37
Planned workshops
PAT workshop Saturday 4 February (Garlandale)
Setting quality exam/test questions Saturday 14 April
Introduction to html (new content in 2013) Saturday 18 August
Venues TBA
CAT_Standard Setting_2012 38
Office-Suite
MSO 2003 vs. 2010 (DBE) MSO 2010 – Gr 10 to 12 Upgrade impacts on preparation for NSC
practical exam (Office 2003, 2007 or 2010) Challenges –
Outdated Hardware specs
CAT_Standard Setting_2012 39
CAT_Standard Setting_2012 40
Challenges Teacher training and development ICT maintenance and sustainability Data Management (Backups) Overcrowding? Office 2003/2007/2010 Classroom/Subject Management Remedial work after examinations Exam dry run NSC Practical Exam date -17 October 2011
CAT_Standard Setting_2012 41
Communication
Check e-mails regularly. Technical Problems – log a call (CEI)
Inform CA of Technical Problems Communication and deadlines WCED CAT web-site:
http://www.curriculum-dev.wcape.school.za/index.php?option=com_content&view=article&id=321&Itemid=122
Many Thanks