National Mission on Education through ICT

IIT Bombay

PROGRESS REPORT 2009PROGRESS REPORT 2009

IIT Bombay Project OSCAR 2

Process overview

MODELS ADOPTED TO GENERATE MODELS ADOPTED TO GENERATE CONCEPTS & IDDSCONCEPTS & IDDS

• Online through Project OSCAR website: http://oscar.iitb.ac.in/oscarHome.do

• Conducting workshops for students periodically in and around Mumbai

• Contacting interested individual faculty in various departments of IIT Bombay

• Domain Reviewer model

Google Analytics(OSCAR View Report)Google Analytics(OSCAR View Report)

Google AnalyticsGoogle Analytics

A. ONLINE MODEL :A. ONLINE MODEL :PROJECT OSCAR WEBSITEPROJECT OSCAR WEBSITE

Concept Proposal StageConcept Proposal Stage

Fill up registration form

as proposer/

developer/both

Submit

concept proposal

form :NPTEL/

CDEEP/Others

Reviewer reviews form

On approval status, proposer

expected to submit IDD within 15 days

The Reviewer checks whether:a) Animations similar to the suggested one are not lready available in open source.b) If they are, then suggested animation can be accepted if and only if significant improvements have been suggested over the existing animations.

IDD Creation StageIDD Creation Stage

Approved concept developed into Instructional

Design Document (IDD)

Developed IDD reviewed

by domain experts

On approval, an honorarium of Rs.1000/-

given to proposer

a. Concept process explanation stepwise through Images/ diagram.

b. User interactivity to be included in the animation.

c. Small questionnaire to test the user’s comprehension

Contents of IDD

1. No. of proposers: 46

2. No. of developers: 37

3. No. of proposers & developers both: 40

4. No. of Concept proposals obtained online: 49

5. No. of Concept proposals approved: 32

6. No. of IDDs obtained online: 13

7. No. of IDDs approved online: 05

8. No. of IDDs rejected online: 02

ONLINE data ONLINE data

B. WORKSHOP MODELB. WORKSHOP MODEL

IDEA GENERATION WORKSHOPS IDEA GENERATION WORKSHOPS CONDUCTED IN & AROUND CONDUCTED IN & AROUND

MUMBAIMUMBAI

19th & 20th September,2009

Walchand College of Engg., Sangli

IDEA Generation Workshop, Walchand College of Engg.

5

17th & 18th September, 2009

D.J.Sanghvi College of Engg., Vile Parle

IDEA Generation Workshop, D.J.Sanghvi College of Engg.

4

14th September,2009

CDEEP Seminar Hall, KReSIT

IDEA Generation Workshop, Entire IITB Faculty & Students

3

11th September ,2009

Department of Computer Sc. & Engg. Conference Room

IDEA Generation Workshop , Chemistry

2

20th August,2009 Mechanical Engg. Department, IIT Bombay

IDEA Generation Workshop, Mechanical Engg.

1

Date VenueWorkshop NameSr. No.

Date VenueWorkshop NameSr. No.

15thOctober,2009Dept. of Computer Sc. & Engg., IIT Bombay

IDEA Generation Workshop, Entire IITB Students

8

14th October,2009Department of Physics, IIT Bombay

IDEA Generation Workshop, Department of Physics, IIT Bombay

7

25th September,2009

Environmental Science & Engineering Seminar Room

IDEA Generation Workshop, Environmental Sc. & Engg., IIT Bombay

6

WORKSHOPS PLANNED FOR FUTUREWORKSHOPS PLANNED FOR FUTURE

28th

Nov.,2009

Tentative Date

Generate good Instructional Design Documents on concepts to be animated

Purpose

IIT Bombay students

College teachers

Target Audience

IIT Bombay

Instructional Designing

2

IIT Bombay

Instructional Designing

1

VenueWorkshop name

No.

THE WORKSHOP PROCESS MODELTHE WORKSHOP PROCESS MODEL

1. Arranging Logistics

2. Presentation & forms

3. IDD Generation

4. IDD Review

Take advise on the venue and date of workshop from the Head

of the department

Send out invitation mails to individual faculty and student groups in the department

Send reminder mails to faculty & students on the eve of the workshop

Create 2 types of forms for faculty and Students

Faculty form : i) Concept details, in brief

ii) Email ID of the TA/RA/RS/PS of the concerned faculty who can later be contacted to fill up the IDD template.

(b) Student form: i)Asked to explain the concept in some detail.

ii) Asked to visualize the animation stepwise as far as possible while filling up the forms.

1. Arranging Logistics

Explain through a presentation, what is expeced from faculty

and students.

Show already made UG level animations to set a benchmark to aim at.

Distribute Instructional Design Document forms to students.

Distribute Concept Definition forms to faculty.

Show examples of both types of already filled forms on screen.

Provide tea & snacks to dispell an exam environment & create a cozy one, where students can discuss and come up with good ideas.

Wherever possible, arrange for textbooks from the departmental Library.

2. Presentation & Forms

IDD forms where the concept has been relatively well explained

through images are selected.

Web search is then done to check animations on these selected concepts, not already available in open source.

Finally, proposers of selected concepts are mailed the Instructional Design Document [IDD] template for filling up.

An example of a filled template is also sent.

For faculty given concepts, their referred students are mailed the concept with the details (given to us by the faculty) and the IDD template.

A timeline of a week is given for submissions.

Until the IDD is obtained, reminder mails are sent periodically.

3. IDD Generation

The course instructor for the particular topic is contacted for IDD review.

A review form has been designed for the purpose, which is mailed to

faculty alongwith the IDD.

In case of confusion, reviewer is personally explained his expected role.

Review reports are mailed back to the proposers.

Once approved, the IDD is uploaded at Project OSCAR website.

The concept proposer is awarded an honorarium of Rs.1000/- .

4. IDD Review

Workshop AttendanceWorkshop Attendance

MEChem

DJSanhv iEntire IITB

W LC SangliEnv ironmental Sc .

Phy s ic s

0

20

40

60

80

100

120

140

160

S tud e nt vs . F ac u lty p artic ip atio n in w o rks ho p s

No. o f Fac u lty Pres entNo.o f S tudents pres ent

W orks h op s h e ld

No.

of S

tude

nts/

facu

lty

C. CONTACTING INDIVIDUAL C. CONTACTING INDIVIDUAL FACULTY FOR CONCEPTSFACULTY FOR CONCEPTS

THE PROCESSTHE PROCESS

1. Send Invitation Mails

2. Meet Interested Faculty

individually

3. Introduce OSCAR

4. Get Contact Information

of TA

5. Mail IDD template to TA

6. IDD generation

7. IDD review

Graph of Faculty attended workshop vs. Faculty responded Graph of Faculty attended workshop vs. Faculty responded only after individual mailsonly after individual mails

Chemist

ry

Electric

al Eng

ineer

ing

Chemica

l Eng

ineer

ing0

2

4

6

8

10

12

Profs attended workshopProfs responded to individual mails

Num

ber o

f fac

ulty

D. Domain Reviewer ModelD. Domain Reviewer Model

THE PROCESSTHE PROCESS

Review process proving to be time consuming

Hence, “Domain Reviewer” model proposed.

Herein, faculty takes care of the review stage of all IDDs submitted

in his/her domain.

Work of getting the concepts & IDDs still done by us.

Faculty will be paid honorarium on a per-review basis.

This model already being tried out in Physics

Review process time length has considerably shortened.

How did workshop processHow did workshop process evolve?evolve?

Questions creating confusions replaced in the second version.

Head of Departmentwas consulted for venue and time of the workshop.

How we changed?

Some questions were confusing for the student

Not getting the venue exclusivelyfor our workshop

Result

Better understanding of what is wanted from proposers

2. Feedback taken from students about the IDD form.

Better turnout of faculty.

1. An individual faculty consulted for the venue and time in ME.

EffectWhat we did?

ME Chem Entire IITB Env ironmenta l Sc . Phy s ic s0

12

34

56

78

910

F ac ulty P atic ip atio n In I IT B W o rks ho p s

IITB W o rks h o p

No.

of f

acul

ty

THE EVOLUTION CONTD…THE EVOLUTION CONTD…

Proposers gave stepwise images of the process

IDD templatedesign changedtwice

Not understood by animators

5. IDDs received text heavy with minimal images

Understoodas instructionfor animators

Term changed to Instructional Designing

“Storyboard” term not understood

4. Referred InstructionalDesigning as “Storyboard

Improved understanding of IDD forms

Needed help to fill up IDD forms

3. Asked for written Instructionsfor animators

EffectHow we changed?

ResultWhat we did?

Showing examples of filled formsonscreen

CONCEPT CONCEPT PROPOSER PROPOSER FORM: StudentFORM: Student Version 1

Questions that created confusion

CONCEPT CONCEPT PROPOSER PROPOSER

FORM:FORM:StudentStudent

Version 2Version 2

CONCEPT CONCEPT PROPOSER PROPOSER

FORM:FORM:facultyfaculty

First Storyboard Template

Problem statement: Stepwise description and illustrations (Add more slides if necessary)

Second Storyboard Template [Renamed IDD Template]

INSTRUCTIONS SLIDE

1

5

3

2

4

Concept details: In this section, provide the stepwise detailed explanation of the concept.

Please fill in the steps of the explanation of the concepts in the table format available in the slides to follow (see the sample below).

Resize the table dimensions as per your requirements.

Step Details of the step

Image / Diagram Text to be displayed

Action / Motion in the step

1 The Thermoacoustic refrigerator employs high pressure waves for the required heat transfer.

The Thermoacoustic refrigerator employs high pressure waves for the required heat transfer.

Blue arrows are animated from the speaker, and white hollow arrows would move vertically. - Blue arrows should disappear by the time they reach the end of box (system)

Stage 2Stage 2Reviewer Reviewer

Form:Form:

Reviewers were unsure of what & how to judge.

Hence, reviewer form designed to the satisfaction

of reviewers.

MODELS TO BE TRIEDMODELS TO BE TRIED

A. OUTSOURCING : TENDER MODEL

Inspite of good faculty response, IDD generation taking long time.

Process of the students filling up IDD had to be changed.

Outsourcing the IDD filling up process for a given concept was mooted.

Tendering process is underway for the generation of IDDs and the subsequent development of animations.

MODELS TO BE TRIEDMODELS TO BE TRIED

B: DOMAIN OWNER MODEL

Generating sizeable number of IDDs from TA/RS of faculty taking 1 month on an average.

To meet our timeline, idea of Domain owner model suggested.

Herein, a faculty takes charge of generating at least 50 approved IDDs from his/her domain within a timeframe (i.e. IDD generation + review).

The financial incentive planned to be in terms of equipment, consummables & manpower salary.

MODELS TO BE TRIEDMODELS TO BE TRIED

C. INDIVIDUAL FACULTY PARTICIPATION MODEL

Getting the IDDs from TAs proving to be very time consuming.

To overcome the TA bottleneck,concept explanations from the faculty are being recorded verbally. Aim to convert them to IDDs by employing someone from that domain to play the role envisaged for TAs. IDDs are then expected to be generated within our timeline.

RESULTSRESULTS

Concept proposal vs. IDD Conversion Chart : Workshop

02468

101214161820222426283032343638

ME Chem DJSanghvi WLC, Sangli Entire IITB EnvironmentalSc.

IITB students

Num

ber o

f

No. of Concepts Approved

No. of IDDs Received

Online Concept Proposal/IDD Conversion Status

02468

101214161820222426283032343638

ApprovedCP

IDDs rec IDDs app IDDsrejected

IDDs tomodify

IDDs underreview

Num

ber o

f

Concept proposals/IDD received & IDD Approved through workshops

02468

101214161820222426283032343638

ME Chem DJSanghvi Entire IITB WLC Sangli EnvironmentalSc.

IITB students

Num

ber o

f

No. of ConceptsApproved No. of IDDs ReceivedNo. of approved IDDs

Expected to Actual IDD Conversion : Workshops

0

5

10

15

20

25

30

ME Chem DJSanghvi WLC Sangli Entire IITB EnvironmentalSc.

IITB students

Num

ber o

f

Expected No. Of IDDs from WorkshopsNo. of IDDs Received

OSCAR Workshop Statistics

14

IDDs approved

213203555

IDDs rejected

IDDs under review

IDDs to be modified

IDDs Received

Approved CP

Concept Proposals (CP)

OSCAR Online Statistics

13

IDDs approved

441940174217

IDDs rejected

IDDs Under review

IDDs to be modified

IDDs Received

Approved CP

Concept Proposals (CP)

Online vs. Workshop IDD generation comparison

0%

20%

40%

60%

80%

100%

Approved CP IDD received IDD approved IDD modify

perc

enta

ge c

ontri

butio

n

Workshop

Online