Developing the web data collection in

personal surveys

Kirsti Pohjanpää Senior Officer for Development

Data Collection

Nordic Statistician Meeting

Bergen 15.–16.8.2013

Personal and business surveys are different

The data of business surveys are collected by web since

2005–06 in Statistics Finland

There are several differences between business and

personal data collection

The answering is volunteering

The time of answering 24/7

We are planning the mixed mode data collection (CATI +

CAWI)

We are moving from (telephone) interviewing to web

data collection (self answering)

15 August 2013 A 2 Kristi Pohjanpää

Development of web data collection in personal surveys

Set of about ten projects

From 16 May 2012 to 30 April 2014

(a) To develop an infrastructure for web data collection for

personal surveys

(b) To support and co-ordinate the development of web and

mixed mode data collections for personal data collections, and

especially for the Labour Force Survey.

Several departments of Statistics Finland take part in the work

15 August 2013 3 Kristi Pohjanpää

As part of Statistics Finland's strategic goal

An Internet questionnaire will be available as an alternative

data collection tool in all personal data collections by 2017

The project is part of Eurostat's ESSnet project DCSS

Data Collection for Social Surveys using Multi Modes

2012–14

DE, NL, UK, NO, FI

15 August 2013 4 Kristi Pohjanpää

15 August 2013 5 Kristi Pohjanpää

MAIN

PRO-

JECT

WEB00

Kirsti

Pohjanpää

start15 May

2012

end

30 April

2014

Web questionnaire for LFS (WEB01)

Marjaana Järvensivu

LFS web pilot (WEB02)

Kirsti Pohjanpää

Vision of the mixed-mode process of LFS (WEB03), Not necessarily a project

Consumer Survey and Finnish Travle Survey,

2nd pilot (WEB04), Tiina Heikkinen

Integration of the web and telephone interview

system (WEB05), not set

Recommendation on

web q. layout (WEB06), not set

Statistics Finland’s data collection pages (WEB07),Reija Helenius

IT infrastructure A (WEB08),Pirjo Hyytiäinen

Questions about occupation and industry

on the web (WEB11), Laura Hulkko

2012 2013 2014

Other projects where necessary

S

T

E

E

R

I

N

G

G

R

O

U

P

Jari

Tar-

koma

A Seperate

Steering Group

Steering

Group

Steering GroupIT infrastructure B (WEB10)

IT Dep., not set

A Seperate Steering Group

A Seperate

Steering

Group

Steering Group

Steering Group

Steering Group

Occu+ind.y(WEB09)

Kati Heikkinen

Steering Group

A Seperate

Steering Group

Where are we now?

Four projects have finished

Mixed mode pilot of Consumer Survey

Web questionnaire of LFS

IT infrastructure, pre project

Questions about occupation and industry, pre project

Two projects are still working

Data collection pages

Web pilot of LFS

2 to 4 project will be set 2013

Two main IT projects!

15 August 2013 A 6 Kristi Pohjanpää

The Mixed Mode Pilot Study

of Consumer Survey 2012 Tiina Heikkinen, Project Manager

Tara Junes & Pertti Kangassalo

15 August 2013 A 7 Kristi Pohjanpää

The Mixed Mode Pilot Study of Consumer Survey

To study mode effect between telephone interview and

web data collection

Data collection Nov 2012

Sample size n=2,350

A random sample of 15 to 84 year-olds

First web, after that a telephone interview (for non

response)

15 August 2013 8 Kristi Pohjanpää

The Mixed Mode Pilot Study

of Consumer Survey

Response rate of the pilot

1,305 responses

Total response rate 56% (Consumer Survey 61%)

Web 23.5%

Telephone 32.1%

In the web respondents there were …

little more women (26% vs. 21%)

more high educated

only a few 65+ year-olds (65-74: 17%, 75-84: 8%)

15 August 2013 9 Kristi Pohjanpää

The Mixed Mode Pilot Study

of Consumer Survey

About 42% answered by web

15 August 2013 10 Kristi Pohjanpää

Confidence Indicator November 2012

15 August 2013 A 11

The Mixed Mode Pilot Study

of Consumer Survey

Kristi Pohjanpää

-5,2

-1,4

-3,4

1,0

-10 -8 -6 -4 -2 0 2 4 6 8 10

Pilot Survey: CAWI

Pilot Survey: CATI

Pilot Survey

Main Data Collection: Cati

=> CAWI is not

recommended

to be used.

Statistics Finland’s

data collection pages Reija Helenius, Project Manager

15 August 2013 A 12 Kristi Pohjanpää

Statistics Finland’s data collection pages

1. Renew the data collections section of Statistics Finland’s

website to better support household and personal

surveys

2. Improve communications with respondents to achieve a

higher response rate

In personal surveys the participating is based on

voluntariness, and in web surveys there are no one to

motivate people.

15 August 2013 Kristi Pohjanpää A 13

Statistics Finland’s

Data Collection Pages

Benchmarking and brainstroming

1. Collected external benchmarking data from other

statistical organisations and survey producers

Including all the Nordic organisations

2. Held two brainstorming sessions to collect ideas and

feedback from employees

Three perspectives: Users, appeal, and content

A total of 36 participants

Gathered a total of over 500 unique suggestions

All ideas have been categorised and reviewed

15 August 2013 Kristi Pohjanpää A 14

Statistics Finland’s

Data Collection Pages

Some other plans for developing

Calendars of current and future surveys

Notices of service breaks and changes in surveys

Content to motivate survey participants

Login to web questionnaire by bank codes

Launch in the beginning of 2014

15 August 2013 Kristi Pohjanpää A 15

Statistics Finland’s

Data Collection Pages

The Web Pilot of LFS 2013 Some plans

15 August 2013 A 16 Kristi Pohjanpää

The Web Pilot Study of LFS

To study the mode effect between telephone interview and web

data collection (the pilot data)

LFS normal data as a comparison data (CATI)

Sample size n=8,000

A random sample of 15 to 74 year-olds

Data collection at October 2013

There will three split-plot tests in the pilot

15 August 2013 17 Kristi Pohjanpää

The Web Pilot Study

of LFS, plans

Three split-plot tests, two groups

15 August 2013 18 Kristi Pohjanpää

Group A Group B

(1) Number of hours Total hours, and minutes per

weekHours, and minutes per day by day

(2) Methods used

to find work

Separate questions (yes / no),

seperate pages

All questions at the same page

(yes / no)

(3) Don't know option In view If needed

Sample n=4,000 n=4,000

The Web Pilot Study

of LFS, plans

Experiences of the project work

Some challenges

Joining the project work and other work

IT resources => 2 main IT projects are not yet set

Eagerness, and energetic work

A lot of knowledge, and learning

1.1.2013 Data Collection Unit

It has been very good idea to lump together all the projects!

To be sure that all have the same goal

Timing of work

15 August 2013 A 19 Kristi Pohjanpää