The JLeRN Experiment Paradata Challenge 2012

Bharti Gupta Applications Developer

Mimas, University of Manchester

bharti.gupta@manchester.ac.uk #jlern #learningreg @dulcet_bg

»  Nationally designated data centre based at the University of Manchester

»  Hosts significant number of UK’s information assets

»  Key role is to support advancement of knowledge, powering world-class research and teaching

»  Main partners, collaborators and sponsors ›  JISC ›  Economic and Social Research Council (ESRC) ›  The University of Manchester

Mimas – Centre of Excellence

»  JLeRN aka JISC Learning Registry Node

»  Innovative collaboration project funded by JISC to develop a Learning Registry test node at Mimas, with input and support from JISC CETIS.

»  Focus is on content from the higher education and cultural sectors.

»  Test node successfully setup on Ubuntu server called alpha.mimas.ac.uk

»  Work is in progress to set up another test node on Windows 2008 server.

The JLeRN Experiment Project

»  Open technology framework, developed as a joint effort of the US Department of Education and the Department of Defense

»  Open community of learning resource creators, publishers, curators and consumers collaborating to share resources

»  Defines a learning resource distribution network model, open APIs and open standards.

»  Lightweight mechanism to publish learning resources.

»  Ability to consume published data and publish additional feedback.

»  High-latency, loosely connected network distributing resources, metadata and paradata

Background – Learning Registry Project

Learning Registry Stack

Learning Registry Community - Locations

Learning Registry Community - Names

»  Publish (push from user) ›  Publish ›  SWORD (1.3, 2.0) ›  3rd party OAI-PMH Utility

»  Access (pull to get data) ›  Obtain (by ID, record, by URL) ›  Harvest (JSON or OAI-PMH) ›  Slice (by identity, date range, keyword tags) <-- the primary means of retrieving data

»  Distribute (node to node, with regex “filtering”)

»  Admin (status, discovery, etc.)

»  Documentation ›  https://docs.google.com/document/d/1Bq_69wnnQJ56O6jyLK2C_fcp-Ovb7MYxXUXD0Rl1Mag/edit?

hl=en&authkey=CK7k5r8F&pli=1 (Quick reference) ›  https://docs.google.com/document/d/191BTary350To_4JokBUFZLFRMOEfGYrl_EHE6QZxUr8/edit?

hl=en (Technical Specification)

Learning Registry APIs

Demo Learning Registry Browser

h"p://demolearningregistry.sri.com/browse/index.html?search=nsdl    

»  Publish the JSON formatted file named "fileName.json” using cURL

Format curl -X POST -H "Content-Type:application/json" "<<url>>" -d @fileName.json

Example curl -X POST -H "Content-Type:application/json” "http://testnode.org/publish -d @my_basicpublish_formatted.json"

Return

Publish API

»  Obtain a single document by its document ID ›  Specify that the request is for a document by setting by_doc_ID to "true”.

Format curl -X GET "<<url>>/obtain ?by_doc_ID=true &request_ID=some_Document_ID" Example curl -X GET "http://testnode.org/obtain?by_doc_ID=true &request_ID=klm174s08n05f031961td15sep011fad" Returns (Document Found) (Document Not Found)

Obtain API

»  Get a single document by its document ID Format curl -X GET "<<url>>/harvest/getrecord &by_doc_ID=true &request_ID=<<Document_ID>>" Example curl -X GET "http://testnode.org/harvest/getrecord &by_doc_ID=true ?request_ID=klm174s08n05f031961td15sep011fad" Returns (continued…)

Harvest API

Document Found { "OK": "true", "responseDate": "2011-09-28T14:27:08.598835Z",

"error": "" "request": {

"by_doc_ID": "true", "HTTP_request": "", "verb": "getrecord", "by_resource_ID": "false",

"identifier": "klm174s08n05f031961td15sep011fad" },

"getrecord": { "record": [{

"header":{ "datestamp": "2011-09-28T14:27:08.607941Z",

"status": "active",

"identifier": "klm174s08n05f031961td15sep011fad" },

"resource_data": { etc...

etc... } }] }

}

Returns – Harvest API

Document Not Found { "OK": "false", "responseDate": "2011-09-28T19:58:17.240463Z", "error": "idDoesNotExist", "request": {

"by_doc_ID": "true", "HTTP_request": "", "verb": "getrecord", "by_resource_ID": "false", "identifier": "the_invalid_request_ID_you_submitted" }, "getrecord": { "record": [] } }

}

Returns – Harvest API

»  Particular kind of metadata – mainly usage data

»  Say things about activities

»  Includes usage data, feedback, rankings, likes, etc.

»  Provides a metadata timeline—a stream of activity data about a learning resource.

»  The paradata format is basically an extended and altered version of the Activity Stream JSON

»  Three main parts to a basic paradata statement: ACTOR, VERB, and OBJECT

»  Cookbook - https://docs.google.com/document/d/1lggCnowWsDgQxrNjYRAgh2KNwKfq-MV8vLJzRXbAaos/edit

Paradata

Example 1- Matching standards

Example 2 – Use resource in curriculum

Example 3 - Ratings

»  Public Learning Registry network requires that submitted documents be digitally signed

»  Validation of authenticity of the submitter’s identity and integrity of signed document

»  Steps to use digital signatures ›  Create a key value pair (OpenPGP Certificate) ›  Publish your public key ›  Sign and validate documents

»  Documentation ›  https://docs.google.com/document/d/

1UO6bdIfBlnSDYRwLejOrRO05XzNbyxQDwvebDofbXpw/edit?hl=en ›  https://docs.google.com/document/d/1vK66RY4S6AVtMJXB7jSqwl30J6NVBj6Gs8UWBcP-

IPY/edit?hl=en_US#heading=h.2eu5kpj7khu7

Signing Documents

»  Node URL – alpha.mimas.ac.uk

»  Supports publish and retrieval services

»  Authentication – open ›  Username: fred ›  Password: flintstone

»  Note – JSONview extension for Firefox browser

»  Examples ›  http://alpha.mimas.ac.uk/status ›  http://alpha.mimas.ac.uk/description ›  http://alpha.mimas.ac.uk/obtain

›  [all documents in node, one batch at a time] ›  http://alpha.mimas.ac.uk/slice?any_tags=apple ›  http://alpha.mimas.ac.uk/slice?identity=nick%40mimas

Alpha Node

»  curl -v http://alpha.mimas.ac.uk/obtain?request_ID=”http://www.flickr.com/photos/41639353@N08/4369788825″

»  curl -Xv POST -H “Content-Type:application/json” “http://alpha.mimas.ac.uk/publish” -d @test_data.json -u fred

cURL Examples

»  Installed Python OAI-PMH third party module to work with LR team’s Python script

»  Installed the Python ElementTree third party module to parse

»  Harvested all JORUM OAI-PMH data and published on JLeRN node

»  Blog post - http://jlernexperiment.wordpress.com/2012/02/14/jorum-oai-pmh-data-published/

»  Example queries ›  http://alpha.mimas.ac.uk/obtain?request_ID=http://dspace.jorum.ac.uk/xmlui/handle/

123456789/1000 ›  http://alpha.mimas.ac.uk/slice?any_tags=curve ›  http://alpha.mimas.ac.uk/slice?any_tags=magnetism

JORUM OAI-PMH Data in JLeRN

»  Windows 2008 Server 64 bit OS at Mimas

»  Installation Guide - https://github.com/LearningRegistry/LearningRegistry/wiki/Windows-Installation-Guide

»  Related blog posts - http://jlernexperiment.wordpress.com/2012/01/12/some-more-exploring/

»  LR team fixed some errors, merge pending - https://github.com/LearningRegistry/LearningRegistry/pull/167#issuecomment-3905263

Windows Node

»  Used to publish and harvest data

»  Library name - LRJavaLib ›  Code on Github - https://github.com/navnorth/LRJavaLib

»  Required bencode - http://code.google.com/p/bee-encode/downloads/detail?name=bee-encode-0.2.tar.gz&can=2&q

Untar and install jar using maven

»  Code in progress using JAX-RS in Eclipse IDE

Learning Registry Java Library

» Capture, use, share or mash-up paradata

» Do you wish to explore ›  where and how learning resources are used? ›  how they are shared by social media? ›  what is being talked about those resources?

» Create applications which interact with existing

tools, services, or repositories in the OER domain.

The Challenge – what to do??

» Create something with paradata

›  demonstrate how to capture or mash-up paradata using your own content or shared in JLeRN node or the Learning Registry node in US, or

›  share an idea for a service that JLeRN might offer for publish, retrieve or mashing-up of paradata, or

›  create a mock-up of a tool or an add-on to work with a tool used currently to capture social media sharing or learning context paradata

The Challenge Criteria

»  The US Learning Registry

›  Beta Release - http://www.learningregistry.org

›  Technical guides - http://www.learningregistry.org/documents

›  Useful presentations - https://docs.google.com/viewer?a=v&pid=explorer&chrome=true&srcid=0B3g0HwhfaPvPNTUxZWViNzYtZDlhNS00ZDM3LTllODQtNzZhZjIzOTgzMjE3&hl=en_US&pli=1

(Daniel Rehak, Learning Registry Technical Architect)

»  The JLeRN Experiment

›  Project Blog URL - http://jlernexperiment.wordpress.com/

›  Twitter tags - #jlern, #learningreg

›  Other blogs - http://blogs.cetis.ac.uk/othervoices/2011/03/22/thelearningregistry/ http://blogs.cetis.ac.uk/lmc/2012/01/13/the-jlern-experiment/ http://blogs.cetis.ac.uk/lmc/2012/02/01/jlern-hackday-issues-identified/

The Project Documentation

»  Sarah Currier ›  Project Lead

›  sarah.currier@manchester.ac.uk ›  @morageyrie

»  Nick Syrotiuk

›  Developer ›  syrotiuk@manchester.ac.uk

»  Bharti Gupta ›  Developer

›  bharti.gupta@manchester.ac.uk ›  @dulcet_bg

The Team