Date post: | 03-Jan-2016 |
Category: |
Documents |
Upload: | davis-witt |
View: | 33 times |
Download: | 1 times |
Presentation Outlinea) Introduction
b) Test Development
c) Learner registration
d) Printing, packing and distribution
e) Test administration
f) Marking
g) ANA Verification
h) Support to Learners
i) Conclusion
Introduction• Standardised testing is an international practice that serve as
a useful tool for assessing student achievement and can be used to focus intervention on desired outcomes.
• USA : NAEPBrazil: Prova BrasilUK: Key Stage testsAustralia: Core Skill TestingS Africa: ANA
• ANA 2012 - 27 days to go
Introduction• ANA provides credible and reliable information for monitoring
progress in learner performance towards achieving the national goals of “improving the quality of basic education”.
• Key expected effects:- Serve as a diagnostic tool identifying areas of strength and
weakness in teaching and learning Expose teachers to better assessment practices. Provide districts with information to target schools in need of
assistance. Encourage schools to celebrate outstanding performance. Empower parents by providing them information about the
education of their children.
Introduction• ANA 2012 will be administered in Grades 1 to 6 and Grade 9 in
public schools and at Grade 3 or 6 in independent schools.
• The credibility of ANA is determined by:- The assessment instrument- The administration of the assessment- The marking and moderation of assessment- The analysis
• Stringent measures will be implemented to validate the test administration process and thus enhance the credibility of ANA 2012.
Limitations of the ANA 2011
• First administration of an assessment on this scale.
• Formulation and translation of certain questions.
• Test administrative procedures were not followed strictly.
• Marking may not have been consistent across schools.
• Systems for collecting the data from schools, capturing and cleaning, proved to be inadequate.
Learner performance results (VA)Grade 3 mean score (%) Grade 6 mean score (%)
Literacy Numeracy Language Maths
EC 39 35 29 29
FS 37 26 23 28
GP 35 30 35 37
KZN 39 31 29 32
LIM 30 20 21 25
MPU 27 19 20 25
NC 28 21 27 28
NW 30 21 22 26
WC 43 36 40 41
NATIONAL 35 28 28 30
Level, trends & quality of performance: Literacy
8
Level, trends & quality of performance: Numeracy
9
Test Development
• All tests for grades 1 to 6 and 9 in Mathematics and Language have been set, moderated, edited, externally reviewed and quality assured.
• Subjected to scrutiny by an Advisory Committee comprising of international experts.
• Tests have been adapted for the deaf learners as well as for the blind.
• Tests for the blind are being brailled.
Learner Registration• Learner registration schedules distributed to each school.
• Service provider appointed to capture the registration
schedules on GET system.
• Capture process completed end of June 2012.
• Registration schedules printed and forwarded to schools for
verification
• Amendments being captured on the GET system.
• Triangulation of GET data with SNAP 2012 and workbook data
Learner Registration
Total (learners) Captured Captured %Total (schools) Captured Captured %
EC 1 106 441 1 069 121 96 5755 4954 86
GT 1 099 503 1 101 643 100 2559 2204 86
KZ 1 570 847 1 507 451 96 6180 5720 93
LP 925 247 897 721 97 4073 3932 96
MP 587 187 577 299 99 1931 1752 91
NC 168 7177 168 474 101 611 549 90
NW 461 796 438 013 94 1669 1435 86
FS 394 457 390 729 99 1437 1340 93
WC 606 726 595 732 98 1636 1450 89
Total 6 920 921 6 746 183 97 25851 23336 90
12
Printing, Packing and Distribution• Printing, packing and distribution for four PEDs has been
outsourced to a service provider appointed by DBE.
• Four PEDs i.e. MP, NW, WC and KZN have opted to take responsibility for the printing, packing and distribution.
• Printing and packing is currently underway.
• Distribution points have been established in each of the PEDs, from where tests will be collected by school principals.
Printing ,Packing and Distribution
Setting of ANA Tests30/06/12
Printing of ANA Tests03/08/12
Packing of ANA Tests17/08/12
Printing ,Packing and Distribution
Provincial Warehouse24/08/12
Distribution Point (220)31/08/12
Schools14/09/12
Test Administration
• Administration categories: Universal ANA (U-ANA); Verification ANA (V-ANA); Independent Schools
• Orientation for test administration conducted in all PEDs in July 2012.
• Further cascade orientation sessions are still to be rolled out to districts to eventually cover all schools, starting 13 August 2012.
• Test Administration Manual developed and will be printed per school.
Marking• Marking Guideline discussions will be hosted in Pretoria for
Grades 3, 6 and 9. Each PED will host provincial marking guideline discussions.
• Marking will take place at school level under the supervision of the school principal.
• Senior teacher and HoDs will be responsible for school moderation.
• All marking, moderation and mark sheets must be completed by 26 September 2012.
• School-based marking will also involve the marking of all grades in special schools.
Centralised Moderation)• Grades 3, 6 and 9 scripts will be sampled for centralised
moderation.
• Sample of between 3 to 15 scripts per school, per grade , per subject will be sampled.
• DBE has developed a Marking Manual for marking and moderation processes.
• The PED is responsible for selection, appointment and payment of marking personnel, marking centres, and the overall conduct and management of all marking processes.
• Marks will be captured centrally in the province by a service provider.
ANA Verification• ANA Verification will be conducted by an independent Verifying
Agent.
• Sample size:
- Grades 3, 6 and 9: 2168 schools nationally (approximately 125 schools per province).
- Grades 1, 2, 4 and 5: 450 schools nationally (50 schools per province)
• Monitor the test administration in each of the schools.
• Tests collected from schools and marked independently.
• Capture and process data.
ANA Verification
• Test responses will be captured per question – produce an Item Analysis Report.
• Final Independent Report presented to Minister.
Support to Learners
• Analytical report with national, district and school data.• Guideline on the utilisation of ANA data.• Detailed qualitative analysis report on ANA 2011 – highlighting
specific areas of weakness with proposed remedial measures. • First set of exemplars handed out to district directors during a
meeting with the Minister on 19 April 2012. • Second and third sets are now available.• Developed a full test for pre- ANA revision.• Assessment guidelines which specifies the scope and depth of
ANA 2012.• Teachers, parents, SGBs, officials and communities are called
to support learners in preparation for ANA 2012.
Support to Learners
• Focus on curriculum coverage – Curriculum Coverage Monitoring tool.
• Teacher Accountability and Class Attendance.
• Focus on Early Childhood Development.
• Literacy and Numeracy (LITNUM) Plan.
• Focus on Maths, Science and Technology (MST) Plan
Conclusion
• ANA processes are on track.
• Progress made in achieving the goals of Action Plan 2014 will become evident with the outcome of these tests.
• ANA is more than a test, it is a diagnostic tool that guides the Nation on route to developing quality basic education.
“ANA comes once a year: Literacy and Numeracy last a lifetime”