ICT in Private Households 2010 Pretesting results 2 _presentatio… · Phone, PDA (e.g. via UMTS,...

© Federal Statistical Office of Germany, Institute for Research and Development in Official Statistics

ICT in Private Households 2010 Pretesting results

Kick-off-meeting: Pretesting of ICT questions

November, 17-18th 2011, Copenhagen

Karen Blanke, FSO Germany

© Federal Statistical Office of Germany, Institute for Research and Development in Official Statistics Folie 2

Contents

� Background

� Pretesting Methodolgy

� Selected findings


ICT in Private Households 2010

� Main Survey design:

� Annual quota sample in Germany

� Voluntary survey, 12.000 households

� Self-administered questionnaire

� Household and individual questionnaire

� Aims of pretesting:

� Technical terms

� Reference periods

� Activities in the Internet


2. Pretesting Methodology


Qualitative Pretest spring 2010

� Cognitive interviews in the pretest laboratory

� 17 probands (different age, education etc.)

� Evaluation by „triangulation“:

� Observation of behaviour

� Partially standardised cognitive interview

� Evaluation of completed questionnaire


3. Selected findings


Main problems � Wording of questions is demanding

(C5)

� Difficult technical terms

� Reference period: too long and probably inappropriate

� Less sensitive

� Answering category two or three dimensional (e.g. device and type of access)

� Overlap of answering categories

Judgment

Comprehension

Retrieval

Response

See Tourangeau, answering model


Fundamental challenge: Change of concepts

� Module A: Computer & Internet: Use „at home“

� Module B: Use of Computer anywhere, but last 3 month

� Module C: Use of Internet (C1-C3), anywhere, last 3 month

� Module C: Use of Internet via wireless connection (C4)

� Module C: C5 Use of the Internet „for private purpose“ (3 month)

� Module D: Use of e-Commerce, private purpose, 12 month


Computer at home (Module A)

A1: Do you or any in your household have access to a Computerat home? (any type: e.g. desktop, laptop, palmtop):

FSO: Do you have a Computer in your household? ((any type: e.g. desktop, laptop, palmtop).

� Inconcistent concept or overlooked

� Conflicting: „at home“ at one hand, but mobile devices too� Overlooked: Mobile device like (Smart) phone to be covered

too � Broader concept: FSO used household members. But TP

refer to the location

� Recommendation:

� Term Computer: List all what the question should cover

� Use „at home“: if you want to show the equipment at home.


Access to the Internet…

� A2: Do you or any in your housedold have access to the Internet at home regardless of whether it is used?

Yes …. ��

No … ��

� Finding:

� Odd question: People who don‘t use the internet, don‘t know if they have/might or could have access to the Internet

� Recommendation:

� Discussion: Do you need the variable?


Devices & connections

� FSO (3): Which technolgy do you use in your household to accessed in the Internet (see A3/A4/C4)

DSL connection ��

Cable-fixed internet conn.(TV-cable) ��

Fixed, wireless conn. (WiMax, satellite ��Point-to-Multipoint)

Mobile, wireless Internet conn. for mobile phones ��Phone, PDA (e.g. via UMTS, mobile WiMax)

Mobile, wireless Internet conn. for Laptops ��(e.g. via UMTS, mobile WiMax)

Analog Modem or ISDN ��Mobile phone via narrow band ��None, Internet not in useDon‘t know ��


Findings: Devices & connections:

� Most of the probands stayed very long on the question and shook their heads

� 11/17 firstly expressed their opinion to know the subject during the cognitive interview, whereas 6 had their doubts

� Finally only 6/17 gave consistent, right answers, due to the cognitive interview.


What was the problem?� Probands don‘t always know the connections, but the

devices

� What they don‘t always know: type of connection like wireless, fixed, mobile, …

� Abbreviations are less known: UMTS, GDPS etc.

� They are not familiar with narrow- and broadband

� Sometimes they check explanations


Recommendations

� Don‘t mix up connections and devices in one questions

� First step: Asked devices oriented

� Desk-top PC and Laptops

� Mobile phones/Smartphones

� Second step: Asked the connections as follow up

� Use keywords like: WLAN, Modem, DSL, ISDN, cable connection

� For possible testing: Asked people what they can do with their devices in order to impute the connections

� Try to present more user-oriented explanations …


Reference periods� Several concepts:

� No reference period: Modul A

� 3 month (Modul B/C)

� 12 month (Modul C6 and D, E)

� Findings:

� Period of 3/12 months is considered to be too long

� Switch of reference periods is troublesome

� Recommendations:

� Cut down reference period

� Cut down the reference period to 2 weeks/3 month

� Test the feasibilty of shortening

� Don‘t use more than two reference periods


Other Internet terminology

Terms

� Hotspot

� Respondents don‘t know (10/17)TP.

� Use „public WLAN“/Hotspot

� Smartphones

� Less known (in spring 2010!!)

� If possible: e.g. iPhone, or Blackberry

� Check definition: e.g. mixture of a mobile phone/laptop with Internet connection

� Notebook:

� Better: Laptop (incl. Notebook or Netbook)

-


Interaction with public services

C5: For which of the following activities relating with public services or adminstrations and during which period did you use the Internet for private purpose?

� Findings:

� Which institutions are considered to be public services?

� Tax authorities, other administrative offices. But: Museums, child-care facilities, inssurances, libraries, what else?

� Even the order of listed public services has influence

� Recommendations:

� Public services: A concept/definition is needed

� Alternative: Select main public services, asked concrete


Activities in the InternetC5: For which of the following activities did you use the Internet in

the last 3 month for private purpose?

� Communication:

� Missing: Sending emails (FSO quest.)

� Missing: Online-dating (e.g. Stayfriends)

� Information search and online services

� Overlap with C5/D2: Downloading of software

� Training and education

� Online courses: Does this include E-Learning?

� o) to q) overlaps

� Missing: Youtube, ebay buying ( odd, actually below D2)


Purchase of goodsD2: What types of goods and services did you buy or order in the

Internet for private use in the last 12 month?

� Overlap with C5 (especially by downloading activities)

� E-Learning material: Needs specification/check with Online-courses

� Upgrades and Updates (difference unknown)

� Buying tickets/overlap with C5 (activities in the Internet)

� Yes/No options in D2: Burdensome, TP don‘t like


Conclusion� Respondents are not familiar with IT-terms:

� E.g. Smartphones, PDA, Notebooks & Netbooks,

� Hotspot, Point-to-Multipoint, WiMax

� Broadband/narrowband

� Upgrades/Updates

� Downloads

� „Computer“

� Different concepts in the questions:

� Some questions ONLY related to the use „at home“ other

NOT at home/not at work (thus really mobile)

� Some questions on the perspective of „private purpose“

� Different reference periods

© Federal Statistical Office of Germany, Institute for Research and Development in Official Statistics Folie 21Folie 21

Thank you for your attention.

[email protected]

Date post:	16-Oct-2020
Category:	Documents
Upload:	others
View:	1 times
Download:	0 times

ICT in Private Households 2010 Pretesting results 2 _presentatio… · Phone, PDA (e.g. via UMTS,...

Documents