Information Systems for Production and Operations Management

Perspectives on European Quality Initiatives and Programs and their

Impacts and Implications

LoD Meeting, Zürich, 2004-02-16

Dr. Jan M. Pawlowski

http://www.eqo.info ::: University of Duisburg-Essen - Slide2

Information Systems for Production and Operations Management

Contents

E-Learning Quality

Individual Quality: Localization and Adaptation

The Quality Decision Cycle

Towards Individual Quality: Support & StandardsThe European Quality ObservatoryISO/IEC: Reference Framework for the Description of Quality

Approaches

Conclusion

http://www.eqo.info ::: University of Duisburg-Essen - Slide3

Information Systems for Production and Operations Management

E-Learning Quality?!

Return on Investment

Learner Satisfaction

Strategic Impact

ProductivityPersonality

Development

Process Optimization

Customer Satisfaction

Organization‘sSuccess

Market Share

Media QualityMethod MixIndividualization/

Personalization

Interoperability Ergonomics

Learning Culture

Availability

Flexibility

Accessibility

Individual Quality Profile

http://www.eqo.info ::: University of Duisburg-Essen - Slide4

Information Systems for Production and Operations Management

Diversity of Quality Approaches & Standards

ImplementLearning Scenario

Design Learning Scenario

Evaluate Learning Scenario

… …

LOMLOM

SCORMSCORM

SGML, XML, RDF, XHTML SGML, XML, RDF, XHTML

Author GuideAuthor Guide

ISO 9241ISO 9241

Accessibility Guidelines

Accessibility Guidelines

DIN CriteriaDIN Criteria

ASTD CriteriaASTD Criteria

Organization’s Criteria

Organization’s Criteria

ISO 9000ISO 9000 EFQMEFQM EFQM QAAEFQM QAA ……EQUISEQUIS

ECTSECTSQoL

Bench-marks

QoL Bench-marks

European DE Guide-

lines

European DE Guide-

lines

Media Association Certificate

Media Association Certificate

Auto Industry Standard

Auto Industry Standard

……

http://www.eqo.info ::: University of Duisburg-Essen - Slide5

Information Systems for Production and Operations Management

European Diversity

Educational system (education vs. training) Cultural, religious, social backgroundLanguage, DialectsPedagogical, didactical tradition and practice

Different concepts of QualityNot a single standard, but an adaptable frameworkOne standard, many profiles

Country-specificSector-specificOrganization-specific

Quality Standard as an orientation and description framework

Individual QualityNational, regional, local requirementsOrganizational requirementsContextQuality Objectives & GoalsQuality Instruments …

Support by the European Quality Observatory

http://www.eqo.info ::: University of Duisburg-Essen - Slide6

Information Systems for Production and Operations Management

European Issues to Quality

Focus Issues

Localization / ContextualizationCultureLanguageDidactics

Harmonization vs. Localization Regional Aspects

Learning Regions

AccessibilityIntegration / Inclusion

New EU countries

European Initiatives

E-Learning Initiative (DG Education and Culture)

4 Quality Perspective

National InitiativesDIN (German Standards Body),

D.ELANUK, QAA…

Learning Regions

European StandardizationCEN/ISSS Workshop Learning

Technologies

http://www.eqo.info ::: University of Duisburg-Essen - Slide7

Information Systems for Production and Operations Management

How to adapt a quality approach…

Identify requirements and options

QualityManagement Approaches

Specific Standards /

Criteria

QualityAssurance

Approaches

Input

EQO ModelAnalyze & Compare Quality

Approaches

Use as Analysis

Model

Decision for an approach

Quality Approach(RFDQ)

Consensus

Localize and Adapt

Harmonized Model

Individual Approach

Country Profile

Company Profile

…

Specific Profiles

European Quality

Observatory

Information Systems for Production and Operations Management

http://www.eqo.info ::: University of Duisburg-Essen - Slide8

What do you need to analyse quality approaches?

General Information

Context of Usage

Experiences

Method of Quality Approach

E-Learning-Related

Processes

EQO Model

What? Where? Who?Description Location Contributor Language….

What? Where? Who?Description Location Contributor Language….

Who? Where?Sector Target GroupSubject ….

Who? Where?Sector Target GroupSubject ….

How?Focus Method …How?Focus Method …

For which process?Planning Framework/ ProgramCourse Development Learning Processes…

For which process?Planning Framework/ ProgramCourse Development Learning Processes…

How does it work?Experience Description General Information Context of Usage ….

How does it work?Experience Description General Information Context of Usage ….

http://www.eqo.info ::: University of Duisburg-Essen - Slide9

Information Systems for Production and Operations Management

EQO Model: Basis for a Repository1. What are the quality goals (e.g. improving economic

efficiency, improving learning results, increasing market share, flexibility etc.)?

2. In which educational field/context is quality to be developed? a. School b. College and university c. Vocational training d. Private further training e. Company further training f. Other

3. What are the national, regional or local requirements for quality development in the field of education? In what country/countries is a quality approach to be used?

4. For which process(es) in the e-learning training sequence is quality to be developed?

a. Organizational pre-planning phase, market exploration and resource scheduling

b. E-learning program planning (technological) c. E-learning program planning (pedagogical/didactic) d. Course development (technological) e. Course development (pedagogical/didactic) f. Learning process support g. Learner support h. Teacher support i. Evaluation j. Other process/subprocess

5. Is a quality approach needed for a particular topic (for example, biology instruction, product training in the automobile industry?)

…

http://www.eqo.info ::: University of Duisburg-Essen - Slide10

Information Systems for Production and Operations Management

Reference Framework for the Description of Quality Approaches (RFDQ)

Framework to specify a quality profile

Process orientation Categories to formalize quality

management, quality assurance, and quality assessment

Simple, open, extensible framework

Status: Committee Draft (March 2004)

ID Category Process Name Description Relations 3.2 Conception /

Design Concept of the con-tents

Concept of learning and teach-ing contents

1.1 Demand analysis

2.2 Qualifications

Sub proc-ess(es)

Content selection

Content Design

Objective

1. Learner Demand: The goal is to provide contents adapted to the needs and demand of the learner.

2. Adaptation: Each course shall provide different content presentation formats and entry points based on the user experience.

Method

1. A prototype of the content shall be provided to a group of learners’ representatives. In a consensus process, the contents shall be prioritized and agreed on.

2. For each course, classify groups of learners according to their learning type. Adapt presen-tation format and methods according to these learning types.

Result 1. Documentation of planned and agreed contents

2. Periodically, evaluate learning performance of different learners (test groups).

Actors Curriculum designer, didactic experts, institution accreditation authority, teacher, learners’ repre-sentatives

Metrics / Cri-teria

The content are measured based on their relevance, importance, exemplaricity, …

Standards Higher Education Standards

Annotation / Example

http://www.eqo.info ::: University of Duisburg-Essen - Slide11

Information Systems for Production and Operations Management

Towards Individual Quality

Specify your requirements and preferencesInclude AND educate all perspectives

LearnersExecutivesDevelopersAdministrationDepartment heads

Research existing approachesCompare approachesSelect your quality instruments, guidelines, metrics, …Specify your quality profileAdapt your approachEvaluate, improve, optimize…

http://www.eqo.info ::: University of Duisburg-Essen - Slide12

Information Systems for Production and Operations Management

Summary Quality standards will serve as a framework Quality standards will require profiles through localization and

adaptation Quality approaches will be subject to individualization European diversity will be a role-model for localization and

adaptation procedures Adequate tools must be available to support Individual

Quality Tools must ensure certain quality levels (e.g. for learning

objects) according to specific quality requirements

http://www.eqo.info ::: University of Duisburg-Essen - Slide13

Information Systems for Production and Operations Management

Contact us

Thank you for your attention

The path to European Quality: http://www.eqo.infojan.pawlowski@icb.uni-essen.de++49-(0)201-1834061