Digital assessmentsa shared solutionIngrid Melve, NORDUnet2014, Uppsala, 2014-09-24

Digital assessment and exam day

4

eCampus: national program for video, collaboration tools and IT architecture for flexible higher education

UNINETT, the Norwegian research network

Building infrastructure, supporting inter-institutional ICT

DIGG: digital exam systems development project

8 universities, 15 university colleges and UNNETT

Specifications for digital exam: rooms, security, integration etc

Multiple vendors develop software and help in testing

Aiming for joint procurement in 2016

2014-06-20 6

Digital assessment for all students ASAP

eCampus project

Local pilots

High level

expert group

Project goals

7

Technical solution for exams

Defining needs, standardization

Working with vendors to develop solutions

Large scale roll-out: live test

Change ”school” exams

23 universities and colleges

Students get text processing tools

Change room requirements

Change workflow

Kill paper for millions of exams per semester

National mandate: find solution

Prepare Examination GradingFeedback on grade and complaints

LocalityCandidateExamination/questionsMedium

AnswersStatus Info Journal

Digital

Manual

Digital Digital Digital

Manual Manual Manual

FS

Examination-registry

System for register examinations

FormalitiesOverviewt,e.g. language-variantsShortage, reminders

Archiving: Need of history archiving.

Critical: Access

FSAnswers

Systems for digital exam

Challenges:• Control access• Scaling• Context• Infrastructur• Costs• Competence

Critical: Stability

FS

System for digital censorship- Process support- Transparent

censorship

Support for varying methodology

Critical: Access, Security, Transfer results.

In general:• Must support digital og manualroutines• Access to systems. People with loose connection to

institution• Digital signatures• Clarify regulations• Different forms of assessment• Role of Learning Management Systems• Hand over information to internal and national archives

Assessment process: From manual to digital routines

Need for system support.Case management systemIntegration with archive system

Archive

Inform thestudents

Norwegian StateEducation Loan Fund

Ministry of Education(DBH)

Figure by NTNU

First time we do

9

Digitalization and dematerialization of exam process

Policy alignment for assessment, at practical level

BYOD for critical situations

Integration of multiple components for assessments

Pre-commercial Procurement (PCP)

10

Behov Dialog Konkurranse Leveranse

Needs Dialog Competition Delivery

http://www.innova-eu.net/docs/pcp17.pdf

Workflow

12

Digital process

Supported by FS (shared student registry)

Principals

Teacher, reviewer, grading teacher

Study administration, library etc

Student

Green IT, remove paper

How does it play together?

14

Architecture

What is the framework and expectations?

Best Current Practice

Aligning practice from multiple institutions

Testing integrations/APIs

Integration

16

Shared extract

Who are the candidates?

Who are grading exams?

What are the grades?

Transparency and complaints

Workflow handover to other systems: archive, student registry etc

Integration (gory details)

18

Establish integration point (Mule)

Define APIs for exam info

Test with multiple vendors

Adjust APIs

Harden integration point

Test, test, test, test

Exam systems

Student registry

Calendar, room planning

Check plagiarism

Grading system

Case processing system (complaints)

Archive

BYOD – student´s stuff

19

Software requirements

Hardware requirements

Practical stuff

Must have 5-15% PCs to lend to students

Power supply

Security aspects

Specifications and good practice documentation

Examination rooms

20

Power

Wifi

Do you see the screen?

Security inspections

BCP document in draftPublish in November

Next steps

24

Large scale testing

15% digital for 2015

60% for 2016

Best Current Practice docs

National alignment of practices

Develop software (vendors)

Development contracts

Paperwork and procurement rules

Joint procurement Q1 2016