+ All Categories
Home > Documents > Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve...

Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve...

Date post: 29-Mar-2015
Category:
Upload: felipe-sinclair
View: 216 times
Download: 0 times
Share this document with a friend
Popular Tags:
32
Submit, feed back, publish: Using Blackboard to enhance students’ assessment experience and improve administrative process efficiencies Louise Thorpe Program Manager, Bb Consulting
Transcript
Page 1: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Submit, feed back, publish: Using Blackboard to enhance students’ assessment

experience and improve administrative process efficiencies

Louise ThorpeProgram Manager, Bb Consulting

Page 2: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Louise Thorpe

Program Manager – Blackboard Consulting

Universities, colleges and professional education

Strategy, implementation and change management

UK, Ireland, Netherlands, Belgium, Scandinavia

2005-2010 Head of Academic InnovationSheffield Hallam University

2003-2005 Head of Learning Strategy and EnhancementUniversity of Sheffield

1999-2003 e-learning@shu Project ManagerSheffield Hallam University

About Me

Page 3: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

About you

Page 4: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Overview

Technology to support assessment and feedback

Focus on online coursework management

Drivers to make greater use of technology in assessment

3 case studies

Share experiences and Q&A

      

Page 5: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Assessment and Feedback Platform

OnlineTesting

Assessing Online Activity

Online Grades and Feedback

Online Administration of Coursework

A&F

Page 6: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

OnlineTesting

Routine online tests

Online diagnostics Online summative exams

A&F

Page 7: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Assessing discussion

Assessing Online Activity

Assessing blogs wikis etc

ePortfolios

A&F

Page 8: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Assessment and Feedback Platform

OnlineTesting

Assessing Online Activity

Online Grades and Feedback

Online Administration of Coursework

A&F

Page 9: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

OnlineSubmission

Onscreen Marking

Text matching/Plagiarism detection

Online Administration of Coursework

A&F

Page 10: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Delivery of marksonline

Delivery of feedback online

Online Grades and Feedback

Publishing grades online

A&F

Page 11: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Common Drivers

Student expectations• expectation of online transactions and services

High student numbers • assessment types that can handle high volumes• ability to deliver grades and feedback at scale

New and expanding global markets • effective processes for fully online assessment

management and feedback delivery

Cost, efficiency and effectiveness• workflow efficiency and accuracy

Page 12: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Additional UK Drivers

National Student Survey (2011)• 83% satisfied with overall experience • 68% satisfied with their assessment and feedback

experience

New higher education funding regime (2012)• Switches primary cost of HE from public purse to student• Students are paying more but institutional income

remains same • Institutions anticipate that prospective students:

– will seek evidence of quality from information in the public domain – will look for indicators of “distinctiveness” in student experience– will have higher customer expectations

Page 13: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Institutional starting points

Strategic “we want to define an assessment and feedback strategy/policy”

Implementation “we want to have 100% online submission”

Tactical “we want a tool that will improve deliver feedback”

Operational “we need to establish key service foundations”

Page 14: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Scenario 1 (end to end)

Online Administration of Coursework

Online Submission

Onscreen Marking

Online Grades and Feedback

Online Delivery of Marks &

Feedback in Bb

Online Publication

of Grades in SIS

Page 15: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

University of Salford• 3 Colleges and MediaCity in Manchester• 20,000 students• 2,500 staff• Existing use of Turnitin for some e-submission• Workflow efficiency alongside upgrade to Bb9.1 • Administering Academic Progress and

Blackboard Programme

Page 16: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Challenges• How to reduce the number of exceptions to

online submission?

• How to improve workflow for the transaction of handling coursework collection, feedback and return?

• How to improve grade collation process - double mark entry?

Page 17: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.
Page 18: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

• E-submission and tools in use• Detailed design requirements• Blackboard – Student Record System

integration planning• Feasibility of timeline

– Decisions required– Technical build– Process redesign impact – Staff development

Page 19: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Scenario 2 (establishing the basics)

Online Administration of Coursework

Online Submission

Onscreen Marking

Online Grades and Feedback

Online Delivery of Marks &

Feedback in Bb

Online Publication

of Grades in SIS

Page 20: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Staffordshire University• 2 campuses – Stoke-on-Trent, Stafford• 16,000 students• 2,000 staff• enhance assessment and feedback experience

of students through the application of technology to support e-assessment, e-assignment management and importantly feedback

Page 21: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Challenges• How to meet student expectations of online

submission and support growth in distance learning?

• What are we able to deliver with the core functionality that we already have?

• What is the academic change process required to move online submission and online publication of marks and feedback to “business as usual”?

Page 22: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Design and discovery

Online Administration of Coursework

Online Submission

Onscreen Marking

Online Grades and Feedback

Online Delivery of Marks &

Feedback in Bb

Online Publication

of Grades in SIS

Page 23: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Implementation planning- What needs to be in place

- Technical infrastructure and service resilience- Core system integration- Upgrade to latest version

- What needs to be done- Regulations and recommendations- Staff development, training and support- Impact on practice- Academic change process

Page 24: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Scenario 3 (extending out the platform)

24

Online Administration of Coursework

Online Submission

Onscreen Marking

Online Grades and Feedback

Online Delivery of Marks &

Feedback in Bb

Online Publication

of Grades in SIS

Third party receipting Batch down/upload of feedback

Grades Transfer

Technical solutions

Page 25: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Case study 3: Extending out the platform

University of the West of England• 4 campus sites in and around Bristol• 30,000+ students (full-time, part-time and sandwich)• 3,500 staff• Bb rolled out in 2004 and used institution-wide

(>500k logins per month)• One University Administration

....partnering for custom development to meet UWE’s business process needs

Page 26: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Case study 3: University of the West of England

Challenges• How to get the marks from Blackboard to the

student record system with minimum administrative intervention?

• How to accommodate local assessment policies (e.g. student anonymity, second marking approaches)?

• How to achieve consistency given diverse staff IT skills and awareness?

Page 27: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Starting point

BlackboardAssignment

BlackboardGrade Centre

ISISMarks

Validation and

Import

Page 28: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Encourage adoption

BlackboardAssignment

BlackboardGrade Centre

ISISMarks

Validation and

Import

Marks and Feedback

Tool

Easy for staff to put feedback files alongside marks

Student Receipts

Provide student with a detailed receipt of submission

Offline Marking

Tool

Page 29: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Blackboard to SIS workflow

BlackboardAssignment

BlackboardGrade Centre

ISISMarks

Validation and

Import

Marks and Feedback

Tool

Student Receipts

Offline Marking

Tool

Grade Mapping Tool

Get the marks into

ISIS ??

ISISWork Item

Data Extract

CreateBlackboardAssignment

By using data from ISIS to create Bb Assignment and associated Grade Centre columns can we can specify what

Extract Marks

to extract

Page 30: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Result - End to end process

Staff publish assignment details to students online Students submit coursework files online System issues a detailed receipt to students Staff access in one place and online to all assignments Staff easily download work to mark offline Staff easily upload all marks with feedback files Students access in context and online marks and feedback All coursework marks are visible to staff and students in Bb System transfers marks to SIS for processing and

publication

Page 31: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Summary

Case study 1 – Salford

Complementary technologies

Admin process change

Case study 2 – Staffordshire

Within existing Bb toolset

Hearts and minds of academic practice

Case study 3 - University of the West of England

Core Bb technologies with bespoke enhancements

Admin efficiencies and scale

Page 32: Submit, feed back, publish: Using Blackboard to enhance students assessment experience and improve administrative process efficiencies Louise Thorpe Program.

Thank you

Louise Thorpe, Program Manager, Bb Consulting

[email protected]


Recommended