Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
ESSnet on Data Collection for Social Surveys Using Multi Modes (DCSS)
UN-ECE Conference of European Statisticians
Seminar on Statistical Data Collection
Geneva, Switzerland , 25 -27 September [email protected]
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
Slide 2
Outline
Background and aims
Work in progress Query on Data Collection in Social
Surveys Web data Collection Mixed-Mode Data Collection
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
Slide 3
Some background
Initiated by Eurostat to support NSIs in: Developing web data collection tools Implementing and assessing the impacts of mixed mode data
Labor Force Survey (LFS) chosen as a concrete example
Duration of the project: autumn 2012 – 2014
Consortium: Partners (5): FI, NO, NL, UK, DE (coordinator) Support-group-members (3): SE, DK, IT External consultants
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
Slide 4
Query on Data Collection in Social Surveys (Preliminary results)
• Data collection: spring 2013• 37 NSIs (ESS & overseas)• 85 % response rate
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
21.04.23 Folie 5
• Diversity in mixed mode data collection in the NSIs
• Planning for implemenation of CAWI more than a third
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
Slide 6
WP II: Web data collection
CAWI questionnaires are … self-administered instruments computerised distributed via the net rich on functionalities and layout
However, ... “A product by itself has no value,
it has value only insofar as (functionalities) are used” (Dumas/Redish 1999)
http://www.thiossane.org/images/usability2.jpg
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
Explanations (UK)
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
Slide 8
Placement & design of explanations (DE)
Text behind link
Keyword and text behind link
Directly visible text
Combination of visible text and link
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
Slide 9
Long lists & functionalities (DE)
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
DE: Error checks: soft/hard checks
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
11
Don‘t know options (NL)
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
12
Don‘t know options (NL)
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
Functionalities & sensitive wording (FI)
Slide 13
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
Smartphones (NO)
Slide 14
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
Slide 15
WP III: Multimode data collection
Mode effects: Review of current knowledge on mode effects How to analyse mode effects, in experiments and
in regular LFS production Impact of mode effects for the main variables of the LFS
Fieldwork and case –management systems & It-environment Impacts on weighting and estimation
►Recommend methodological activities to further harmonisation of MM data collection in the European Statistical System
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
Slide 16
Conclusion
Mixed-mode is very divers in the different countries
Tailored recommendations are requested due to different conditions and data collections strategies:
Different mm designs are less or more sensitive against mode-effects
Different applied modes are crucial to survey organisation Weighting & estimation is sophisticated
Implementation of Web questionnaires is very sensitive: Switch from interviewer administered to self-completion Change from oral to visual communication design
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
Further contact:
Coordinator/WP II: Karen Blanke ([email protected])
Federal Statistical Office of Germany
WP III: Annemieke Luiten ([email protected])
CBS Statistics Netherlands
Eurostat: (http://www.cros-portal.eu)
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
Slide 18
Error messages (I): soft checks (DE)
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
Slide 19
Error messages (II): hard checks (DE)
Statistical Data Collection, 25-27 September 2013, Geneva
ESSnet DCSS
Slide 20
Placement & design of explanations (DE)
Text behind link
Keyword and text behind link
Directly visible text
Combination of visible text and link
