Apedagogicalendgameforexams:alook10yearsintothefutureofhighstakesassessment
TransformingExams.com
Dr Mathew Hillier Monash University and University of Queensland Dr Andrew Fluck
TransformingExamsAcrossAustraliaAustralianGovernmentOfficeforLearningandTeachingNa:onalGrantID15-4747:AU$500Kover3Years+100KMonash
Acknowledgements-DiamondandGoldSponsors!500KinsupportforthisprojecthasbeenprovidedbytheAustralianGovernmentOfficeforLearningandTeaching.TheviewsexpresseddonotnecessarilyreflecttheviewsoftheAustralianGovernmentOfficeforLearningandTeachingorpar:cipa:ngins:tu:ons.100Kaddi:onalcashfromMonashUniversity.
Demo&Guide
s
Dr Mathew Hillier; Leader OLT national project. Seed leader
Monash University 5 Oct 2015 (was University of Queensland)
Dr Andrew Fluck; Originator of USB e-exam concept. Seed partner.
University of Tasmania
Dr Michael Cowling, Mr Kenneth Howah Seed trial site.
Central Queensland University
Dr Kim Blackmore Australian National University Assoc. Prof. Paul Newhouse Edith Cowan University Dr Matthew Bower, Prof. Dominic Verity Macquarie University Prof. Marilyn Baird (H), Mr Scott Grant (A) Monash University Assoc. Prof. Shona Leitch RMIT University Dr Ruth Geer, Mr Bruce White University of South Australia TransformingExams.com
Civil Service Exam Under Emperor Jen Tsung (fl.1022) from a history of Chinese emperors(colour on silk): Bibliothèque Nationale, Paris, France.
Is this your exam space?
Thedissonanceofitall!RealworldofworkExams
4
World Economic Forum – How will digital change your working world. https://agenda.weforum.org/wp-content/uploads/rtr2m8vm1-628x330.jpg
Exams at Monash Caufield in 2015 (mathew.hilier[at]monash.edu)
Wearefacedwithagrowingdisconnectbetweenthewayhighstakestes*ngisconductedusingpenonpaperexamsandstudents’everydayexperiencesofstudy,workandlife.
APossibleFutureAnevolu:onratherthanarevolu:on.Someaspectsmayoccurquickerthenothersdependingonpar:cularimplementa:onandtechnicalmodelschosen.
5
Wherewearegoing:Post-paperexamsWeneedgreaterpedagogicalflexibilityandmoreauthen:cassessmentsintheexamroom.…alignment!
6
Simula:ons,toolsofthetrade,virtualexperiments…
'Windows'soawareviaWINE.E.g.CAD/3Dmodeling,Celes:a.
Moodlequizwithmedia(automarked).
7
Physical hardware can be connected to the internet or we can use software simulations of labs and experiments.
SimulatedLabs
VirtualImmersiveLanguageLessons(1)
TAwebinarhhp://transformingassessment.com/events_1_april_2015.php8
ScohGrant(MonashUniversity,Australia)hhp://www.virtuallyenhancedlanguages.com
VirtualImmersiveLanguageLessons(2)TaskBasedLearningorTaskBasedLanguageLearning(TBLL).Includescommunica:onac:vi:es,usinglanguagetocarryouttasks,languageusethatismeaningfultothelearnerandhasapurpose,andcommunica:onac:vi:esthatreflectreal-lifeac:vi:eswithauthen:cmaterials.Learnbydoing:Purchasesuppliesthencooknoodles–allinChinese.
9
Wherewearenow:PaperEquivalent(UQ)Suitable format adjustments were made to cater for both paper and screen.
Wherewearenow:PaperPlus(UTAS)Worddoc,plusapps.Ques:ondocumentwithlinkstolaunchlocalappsandresources:graphics,Scratchprogrammingtools,presenta:onslides,PDFs.Allon-boardtheUSBs:ck.‘ITinEduca:on’exams:AndrewFluck,UTAS.
11
Scratch SDK
Exam doc
e-ExamTrialsWorkflow
Postsession:retrieveresponsesandassessment
Examroomuse
ResponsesretrievedfromUSBs. Collatede-responsessenttoacademic.
CreatemasterUSB(tested)
USBsduplicatedperstudentAcademiccreatesexamlearningmaterial
Set-up:prepareexamlearningmaterials Pre-session:Studentlaptopsetup&prac:ce.
CollectUSBs(responses)
1. Studentsenterroom.
2. GivenUSB.3. Bootlaptop.4. Doexam.5. ReturnUSB.6. Leaveroom.
e-Examsystemtakesoverlaptop.UbuntuLiveUSB.LibreOffice.
Ready?
13
Moreinforma:on….Demoset-upGuide,StudentPrac:ceandUserGuidehhp://transformingexams.com
Demovideosstart-up,useandrecoveryexamples.Applehhp://ta.vu/eexam-demo-a'Wintel'(Dell)hhp://ta.vu/eexam-demo-dContact:mathew.hillier[at]monash.edu
e-ExamProjectResources
14
End
CitethisresourceHillier,M&Fluck,A(2015)“Apedagogicalendgameforexams:alook10yearsintothefutureofhighstakesassessment”Presenta:onatASCILITEConference,Perth,Australia,30Nov-2Dec.Moretomorrow!Wed12.05PMBld216.room206e-Examtrialresults–“Totypeorhandwrite:student'sexperienceacrosssixe-Examtrials”Contact:mathew.hillier[at]monash.edu
References• ABS(2013)YoungAdults:NowandThen,4102.0-AustralianSocialTrends,April2013,AustralianBureauofSta:s:cs
hhp://www.abs.gov.au/AUSSTATS/[email protected]/Lookup/4102.0Main+Features40April+2013• ABS(2014)Non-schoolqualifica:onatBachelorDegreelevelorabove,personsaged20-64years,6227.0-Educa:on
andWork,Australia,May2014,AustralianBureauofSta:s:cshhp://www.abs.gov.au/AUSSTATS/[email protected]/DetailsPage/6227.0May%202014
• Ackoff,R.(1999)Re-Crea:ngtheCorpora:on:adesignoforganiza:onsforthe21stcentury.OxfordUniv.Press,NewYork
• Binkley,M.,Erstad,O.,Hermna,J.,Raizen,S.,Ripley,M.,Miller-Ricci,M.,&Rumble,M.(2012).DefiningTwenty-FirstCenturySkills.InGriffin,P.,Care,E.,&McGaw,B.AssessmentandTeachingof21stCenturySkills,Dordrecht,Springer.hhp://www.atc21s.org/
• Crisp,G.(2009).TowardsAuthen:ce-AssessmentTasks.InG.Siemens&C.Fulford(Eds.),ProceedingsofEdMedia:WorldConferenceonEduca:onalMediaandTechnology2009(pp.1585-1590).Associa:onfortheAdvancementofCompu:nginEduca:on(AACE).hhp://www.editlib.org/p/31689/
• Fluck,A.,Pullen,D.,&Harper,C.(2009).CaseStudyofaComputerBasedExamina:onSystem.AustralasianJournalofEduca:onalTechnology,25(4),509–523.hhp://ajet.org.au/index.php/AJET/ar:cle/view/1126
• Herrington,J.,Reeves,T.C.&Oliver,R.(2010).Aguidetoauthen:ce-learning.NewYork:Routledge• Hillier,M&Fluck,A.(2014)TransformingExams:ProcessesandPla}ormfore-ExamsinSupervisedBYOD
Environments,AustralianGovernmentOfficeforLearningandTeaching.hhp://www.olt.gov.au/resource-transforming-exams-byod-environments
• Hillier,M.,&Fluck,A.(2013).Arguingagainfore-examsinhighstakesexamina:ons.InH.Carter,M.Gosper,&J.Hedberg(Eds.),ElectricDreams(pp.385–396).MacquarieUniversity.Retrievedfromhhp://www.ascilite.org.au/conferences/sydney13/program/papers/Hillier.pdf
• Linstone,H.A.(1999)Decisionmakingfortechnologyexecu:ves,ArtechHouse,Boston• Rihel,H.&Webber,M.(1973)DilemmasinaGeneralTheoryofPlanning,PolicySciences,4,pp.155-169.
16
References• TasmanianQualifica:onsAuthority(2013)BoardMee:ngs.hhp://www.tqa.tas.gov.au/10270&
hhp://www.tqa.tas.gov.au/23727• Universi:esAustralia(2015)Universi:esAustraliaPre-BudgetSubmission2015–16.Canberra,ACT.• VonZansen,A.(2015)DigabiNewsleherII/2015.
hhp://translate.google.com.au/translate?hl=en&sl=sv&u=hhps://digabi.fi/%3Flang%3Dsv_se&prev=search• TransformingExams(2015).'e-ExamSystem'project,hhp://transformingexams.com
220moreat:hhps://www.zotero.org/groups/e-assessment/items/tag/e-exam
17