Questionnaire Development

Harald Schomburg, Senior Consultant, Germany

Tracer Study Workshopin Tehran, Islamic Republic of Iran, 24th May 2017

h.schomburg@qtafi.de

www.qtafi.de

First Step: Collection of Used

Questionnaires

• See http://ingradnet.org/

• CHEERS 1999: http://www.ingradnet.org/quest/q_cheers_1999_master_en.pdf

• AAU 1996

• Standardinstrument 1995 (Schomburg)

• REFLEX 2005

• KOAB 2009

Do not try to reinvent the wheel!

15/05/2017

Ha

rald

Sch

om

bu

rg, Q

ue

stio

nn

aire D

eve

lop

me

nt

2

http://ingradnet.org/

15/05/2017

Ha

rald

Sch

om

bu

rg, Q

ue

stio

nn

aire D

eve

lop

me

nt

3

Examples of International Tested

Questionnaires

15/05/2017

Ha

rald

Sch

om

bu

rg, Q

ue

stio

nn

aire D

eve

lop

me

nt

4

Second Step: Adaptations and Testing

• Selection of subjects/topics according the own objectives

• Selection of questions and answers according the own objectives

• Adaptation of the questions/answers to local conditions (country, institution, study programme)

• Development of new question and answers

• Formatting of the questionnaire

• Printing the questionnaire

• Testing the questionnaire

• Revision of the questionnaire

• Final (paper) version of the questionnaire

15/05/2017

Ha

rald

Sch

om

bu

rg, Q

ue

stio

nn

aire D

eve

lop

me

nt

5

Example of Questions (1) – Standardization of

Styles

15/05/2017

Ha

rald

Sch

om

bu

rg, Q

ue

stio

nn

aire D

eve

lop

me

nt

6

Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.

Question number

Question text

Answers

Explanations

All answered are left aligned

Hidden Technical Information in the

Questionnaire

15/05/2017

Ha

rald

Sch

om

bu

rg, Q

ue

stio

nn

aire D

eve

lop

me

nt

7

• Every element (like a question) is a WORD table• Every element has sequence number (N001 …)• Every element has a type Identification like

SE – Section; EX = Explanation; CV = Categorical variable; OR = Ordinal variable; ME = Metric variable • Every question has a question identification number (like Q1)• The variable names are include in the question

Styles

Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.

Hidden Technical Information in the

Questionnaire

15/05/2017

Ha

rald

Sch

om

bu

rg, Q

ue

stio

nn

aire D

eve

lop

me

nt

8

• Every element (like a question) is a WORD table• Every element has sequence number (N001 …)• Every element has a type Identification like

SE – Section; EX = Explanation; CV = Categorical variable; OR = Ordinal variable; ME = Metric variable • Every question has a question identification number (like Q1)• The variable names are include in the question

Styles

Variable name

Question identification numberType of question

Subject/topic

Example of Questions (1) – Different Types

15/05/2017

Ha

rald

Sch

om

bu

rg, Q

ue

stio

nn

aire D

eve

lop

me

nt

9

Half-open question

Open question

Half-open question

CV - Categorical variable

Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.

Ordinal Question/Variables

15/05/2017

Ha

rald

Sch

om

bu

rg, Q

ue

stio

nn

aire D

eve

lop

me

nt

10

Five-point ordinal scale

Eight items = variables

Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.

Ordinal Question – with Variables

and Subject

15/05/2017

Ha

rald

Sch

om

bu

rg, Q

ue

stio

nn

aire D

eve

lop

me

nt

11

Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.

Metric Question (open)

15/05/2017

Ha

rald

Sch

om

bu

rg, Q

ue

stio

nn

aire D

eve

lop

me

nt

12

Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.

Closed Instead of Open Questions –

Reduction of Errors

15/05/2017

Ha

rald

Sch

om

bu

rg, Q

ue

stio

nn

aire D

eve

lop

me

nt

13

Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.

Example of Filtered Questions

15/05/2017

Ha

rald

Sch

om

bu

rg, Q

ue

stio

nn

aire D

eve

lop

me

nt

14

Source: Harald Schomburg, Carrying out tracer studies. Appendix 2, Questionnaire Modules for a VET/HE Tracer Study.

THANK YOU VERY MUCH

FOR YOUR ATTENTION

15/05/2017

Ha

rald

Sch

om

bu

rg, Q

ue

stio

nn

aire D

eve

lop

me

nt

15