OER Impact: Towards an Evidence Base

Post on 19-Dec-2014

601 views 4 download

Preview:

Click to see full reader

Tags:

Report this document
SHARE

description

The open education movement has achieved much in the last decade, but there remains wide acknowledgement that the impact of OER has yet to be fully understood. A suggested approach is to address this through collective approaches that collate information and present them back in an integrated way. This has some appeal, particularly in the way it matches to ideals of openness, but needs to be implemented with care. In this presentation I critically evaluate attempts that have been made to support communication and collaboration through mapping OER. After endorsing the basic rationale for mapping evidence surrounding OER implementation I review two examples of where this has been attempted. The Open Learning Network (OLnet) Evidence Hub used the concept of Contested Collective Intelligence to inform a discourse-centric social-semantic web application that could structure the discourses of the OER community. I provide a short critique of this approach which focuses on the data model and the metadata requirements made upon users. I go on to consider the UNESCO OER Mapping Project which set out some quite specific protocols for metadata (despite never getting beyond the prototype stage). The value of a mapping approach is defended at the same time as noting that different audience will likely have very different needs in terms of evidence. A rationale for a new, improved evidence hub is provided along with a number of design considerations and a proposal for future development. I conclude with a brief presentation of the new Evidence Hub being developed as part of the OER Research Hub (OERRH) project. I describe the ways in which our evidence model tries to overcome some of the issues which were manifest in these earlier projects, a range of different data sources, the importance of data visualization, and account for how different types of evidence might be flexibly accommodated. The final part of the session will be given over to group discussion about the idea of mapping the OER evidence base and what the OER community might want from such services.

transcript

Dr. Robert Farrow, The Open University

OER Impact: Towards an Evidence Base

#oerrhub / @oer_hub

Evidence of OER Impact

Background

Rationale

Design

Implementation

Data Visualization

Future Iteration

Call for Evidence / Feedback

Background

About me

• Philosopher & Educational Technologist

• Based at the Institute of Educational Technology (IET) Open University UK

• Research Associate (OER Research Hub)

• http://flavors.me/philosopher1978

• Twitter @philosopher1978

About The Open University

• Europe’s largest distance learning university

• Access: foremost provider to mature, disabled and working students

• A world leader in technology-enhanced pedagogy

• Head of the FutureLearn MOOC consortium

http://flavors.me/philosopher1978

About the Project

• Funded by William & Flora Hewlett Foundation for two years

• Two professors lead four researchers among a team of ten

• Tasked with building the most comprehensive picture of OER impact

• Organised by a set of research hypotheses

• Working across different educational sectors

• Collaboration model

• Global reach but with a USA focus

• http://oerresearchhub.org

http://oerresearchhub.org/

Collaboration Model

Collaboration Model

Rationale: Why Evidence of OER Impact?

Filtering data according to sector, hypothesis & polarity

Framework for comparing disparate evidence types

Collaborative research, analysis & dissemination

Openness in action: openly licensed research instruments, data

Effective evidence-based decision-

making and advocacy

Keyword Hypothesis

Performance OER improve student performance/satisfaction

Openness People use OER differently from other online materials

Access OER widen participation in education

Retention OER can help at-risk learners to finish their studies

Reflection OER use leads educators to reflect on their practice

Finance OER adoption brings financial benefits for students/institutions

Indicators Informal learners use a variety of indicators when selecting OER

Support Informal learners develop their own forms of study support

Transition OER support informal learners in moving to formal study

Policy OER use encourages institutions to change their policies

Assessment Informal assessments motivate learners using OER

Research Hypotheses

Methodological Challenges

Incommensurability Granularity

Previous Initiatives

UNESCO Mapping Project (2012)http://unescochair.athabascau.ca/oer-mapping-exercise

• Mapping to raise awareness of OER

• Tracking complexity, identifying major players & actions

• Community building, communication and advocacy

• Localised data with centralised quality control

OLnet Evidence Hub (2011-2012)http://ci.olnet.org/

• Explore and debate key challenges for OER movement

• Collective intelligence: raise questions, propose solutions

• Sharing relevant web resources

http://unescochair.athabascau.ca/oer-mapping-exercise
http://unescochair.athabascau.ca/oer-mapping-exercise
http://www.olnet.org/
http://www.olnet.org/

OLnet Evidence Hub Data Model

Designing a new evidence model

DesignFiltering / navigation

Diverse, fragmentary

evidence

Encouraging contribution

Metadata specification

Mapping locations

UI / Accessibility

Polarity (+ve/-ve)

K.I.S.S.

Information Architecture

• Text Title• Text / HTML• Supports embedding of multimedia contentCopy• Association of evidence with hypothesisHypothesis• Evidence is either +ve/-ve in relation to a hypothesis Polarity• Geotagging / GPSLocation• School (K12) / College / HE / InformalSector• Academic citation• Hyperlink / URLCitation

Evidence FLOW

Survey Data

Anecdotes

Case Study

Institute Metrics

Case Study

YouTube Interview

Academic Papers

Implementation

http://oerresearchhub.org/2013/10/04/building-an-evidence-hub-plugin-for-wordpress/ Technical Development

• Popular OS platform• Easy to customize• Over 27,000

existing plugins

Wordpress

• CSV importer• Location plugin• JSON

Customization • Project code available on GitHub

• Easy to link, share and engage

Openness

http://oerresearchhub.org/2013/10/04/building-an-evidence-hub-plugin-for-wordpress/
http://oerresearchhub.org/2013/10/04/building-an-evidence-hub-plugin-for-wordpress/

tinyurl.com/oerimpact

http://sites.hawksey.info/oerhub/
http://sites.hawksey.info/oerhub/
http://sites.hawksey.info/oerhub/

Sample Entries

Flexible

Granular

Support comments, sharing

Citations field

Node Examples

Visualizing the Data

Sankey Diagrams track the flow of evidence

Global Evidence Map

See summaries by country with click-through to evidence

Detailed map view

Explore Projects

Filter evidence (College evidence in USA)

Summaries of evidence gathered for each hypothesis

Future Iteration

Explore Survey Data Policy Map Machine

curation

API Integration: SurveyMonkey,

Google, etc.

Data Visualizations

Human curation bookmarklet

Data mashups using open data

Exporting data sets under

open license

Argumentation analysis

Call for Evidence / Feedback

We want your feedback!

… and your data!

Thanks for listening!

oerresearchhub.org

rob.farrow@open.ac.uk@philosopher1978

mailto:Rob.farrow@open.ac.uk

Top related

Community College OER Showcases: Washington’s OER Faculty Training and Lane College’s OER Faculty Fellowship Program
Education
Presented by Bernard Acquah Obeng (Ph.D.). What are OER? Elements of OER Why use OER? How to use OER? Where can I find OER? How to evaluate.
Documents
4 - Towards Semantic IoT, oneM2M Base Ontologywiki.onem2m.org/images/f/f7/04_SENSINOV_Towards_Semantic...4 - Towards Semantic IoT, oneM2M Base Ontology Dr. Mahdi Ben Alaya Founder
Documents
from local/regional OER Silos towards an OER Global Dataspace
Education
OER State Legislative Guide - Creative Commons€¦ · Many organizations, institutions, and foundations are working towards increasing adoption of OER, ... "Open educational resources"
Documents
OER Talk @ North Dakota OER Summit
Education
Towards a Knowledge Base for
Documents
Negotiating Social and Digital Literacies Through Encounters with OER at NMMU: Starting Point: Towards Advocating for Open at NMMU
Education
Towards Online Learning Excellence of Higher Education in Thailand: OER Initiative at SPU
Documents
Faculty Attitudes Towards OER
Education
Towards 5G – Base Stations, Antennas and Fibre Everywhere
Technology
Research Article Towards a Food Safety Knowledge Base ...downloads.hindawi.com/journals/bmri/2015/830809.pdf · Research Article Towards a Food Safety Knowledge Base Applicable in
Documents
African Health OER Network - OER World Congress
Education
Towards open education at a private university in Kenya - OER Africa paper... · 2017-09-01 · Managing curriculum transformation through OER Within the broad curriculum framework
Documents
Taking OER beyond the OER Community
Documents
The Evidence Towards Impact: The Maricopa Millions OER Project
Education
Faculty attitudes towards OER and open textbooks in B.C. and beyond
Education
The Deep-Water Architecture Knowledge Base: towards …pages.bangor.ac.uk/~oss40d/download/Baas et al (PetrGeo 2005).pdf · The Deep-Water Architecture Knowledge Base: towards an
Documents
Chapter 6 Effectiveness of OER use in first-year higher ......of OER or Open Education at the time of the study. The lack of awareness and level of indifference towards OER is not
Documents
UNESCO Open Educational Resources (OER) Programme€¦ · What is the UNESCO OER Programme 1. Paris OER Declaration 2. OER Platform 3. OER Policy Guidelines 4. OER Community on the
Documents

Copyright © 2018 DOCUMENTS