Final evaluation report update

Final Evaluation Report UPDATE

Unveiling European Union citizenship rights through Powerful messages, Developed in Attractive Technological Environment (2012 - 2013)

UPDATE

PROJECT FINAL EVALUATION REPORT

2

UPDATE PROJECT 2012-2013

Unveiling European Union citizenship rights through Powerful messages,

Developed in Attractive Technological Environment

External Evaluator Project Manager UPDATE Open Youth

Mr. Daniel Vankov j.k. Darvenitsa, 6 Kanarche Str. entr. B app. 7

1756 Sofia, Bulgaria [email protected]

Vriestyle Projects LL.M Jetty de Vries Workum The Netherlands [email protected]

Final Evaluation Report UPDATE 3

OUTLINE

1 | EXECUTIVE SUMMARY ............................................................................................................... 4

2 | INTRODUCTION ......................................................................................................................... 6

3 | SHORT DISCRIPTION OF THE PROJECT ..................................................................................... 7

4 | CONTENTS AND IMPLEMENTATION OF THE EVALUATION ..................................................... 8

4.1 |Design of evaluation ......................................................................................................... 8

4.2 | Indicators and instruments of Evaluation ........................................................................ 8

5 | RESULTS OF QUANTITATIVE EVALUATION.............................................................................. 10

5.1 | General quantitative goals ............................................................................................. 10

5.2 | Realised products ........................................................................................................... 10

5.3 | Number of trained volunteers ....................................................................................... 12

5.4 | Number of local actions, material and (in)direct participants ....................................... 12

5.5 | Conclusion quantitative results ..................................................................................... 14

6 | RESULTS OF QUIZ ABOUT EUROPEAN CITIZEN RIGHTS ......................................................... 15

6.1 | The interactive quiz ....................................................................................................... 15 6.2 | The Knowledge of volunteers about European Rights .................................................. 15

6.3 | The knowledge of the citizens about their European rights ......................................... 20

6.4 | Statistical report on the data collected from 2845 quiz cards ...................................... 22

7 | RESULTS OF VISIBILITY AND DISSEMINATION ........................................................................ 30

7.1 | The visibility of the project and the activities in the media .......................................... 30

7.2 | The visibility of the project and the activities by the general public ............................ 31

7.3 | The online visibility ....................................................................................................... 31

7.4 | The visibility of the project and the activities by the networks .................................... 32

8 | PROCESS EVALUATION ............................................................................................................ 33

8.1 | Event Number 8: Evaluation ........................................................................................... 33

8.2 | Proces evaluation of the Project management ............................................................. 34

8.3 | Proces evaluation of the project team meetings ........................................................... 34 8.4 | Proces evaluation of the development of the used material ......................................... 35

8.5 | Proces evaluation of the organising of the local actions ................................................ 35

9 | CONCLUSIONS AND RECOMMENDATIONS ............................................................................. 36

Annexes ........................................................................................................................................... 38 A. Update Material Counting (EVA1) B. Form to filled after the action by volunteers (EVA2) C. Form to be filled after the action by coordinator of the volunteer (EVA3) D. Process evaluation (EVA 4) E. Evaluation of the volunteers F. Quiz questions G. Quiz results Bulgaria 2008-2012-2013 H. Examples of statements in the media I. Results Process Evaluation (EVA4)


EXECUTIVE SUMMARY

The executive summary aims to summarize the most important objectives and results mentioned in the work plan of the project and assessed by evaluating the project. It is aimed to clarify theEvaluation Report in order to have a clear picture of the results reached or may be not reached during the project.

The project "Unveiling European Union citizenship rights through Powerful messages, developed in Attractive Technological Environment” (UPDATE) was successful. The project partners were from Bulgaria, Hungary, Belgium and the Netherlands. The goal was to develop an original comic book, explaining to the young people their basic European citizens’ rights in an interesting and understandable way and to reach the tech-savvy youth wherever they are, combining the message with this risk-free traffic participation one.

The objectives, mentioned in the work plan were:

Development and production of information and communication material Accomplished! After development of the visual concept, the information cards, the interactive quiz, the comic book, the online comic application, the local stands, the shirts and pens have beenproduced.

Development of website Accomplished! In the languages English, Bulgarian, Hungarian, French and Dutch.

80 trained local volunteersAccomplished! There were 105 trained volunteers in total.

16 successful local actionsAccomplished! All actions were performed successfully. For UPDATE there have been 23 actionsin total.

Publications to be distributed during the projectThe products, developed during the project were distributed. These products were: information cards (24.320), interactive quiz, quiz cards (2.845), comic books (2.552) and pens (1.275).

2.400 direct participants quiz cards Accomplished! In total, there were 2.845 (young) direct participants (face-to-face approach): During 23 local events, the quiz cards were completed by these young participants.

24.000 indirect participantsAccomplished! 24.320 informative cards have been distributed during the campaign.

50.000 people reached through media Accomplished! Good press contacts were maintained during the campaigns, which resulted in: 93 Internet articles, 18 press articles in newspapers, 15 radio announcements, 8 TV reportages on national and local television and 7 information agency reports Estimated audience = about 1.720.332 people.

1


50.000 people through the website Although all performance indicators were met, the number of website visitors was below the expectations. 1.900 people visited the website of which 531 people completed the quiz queries and downloaded the comic book. From the total number of downloaded online applications, 406 were done for Android while Apple store does not provide download information for free apps. But the UPDATE application received a review of 4+. This shortcoming is offset by targeted efforts in the online social media (e.g. Facebook). The online campaign triggered 14.537 people to interact with the provided content. 740.246 were reached indirectly. Still the main purpose of these tools, i.e. to bring sustainability of the project results after its completion, is to be explored in the future.

To inform the target audience about the awareness message: EU rights The target group of youngsters < 30 years old was approached using the quiz cards and information cards, holding the message about their EU rights.On a scale of 1 to 5 the volunteers evaluate their knowledge of EU rights at 3 before training and at 4 after training. Results quiz cards: 2.845 quiz cards x 8 questions= 22.760 questions. 66% of these questions were answered correctly. Bulgarian participants with a score of 77% achieved the best result. This best scores may have been the result of earlier awareness campaigns of Open Youth in 2008 and 2012.

UPDATE action in Bulgaria


INTRODUCTION

The UPDATE project is an European project in which four European partners cooperate. The reason the partners were chosen as such is their long lasting fruitful cooperation with the project leader and for variety of experience, they bring. All organizations are experienced in working with youngpeople but their experience defers. TOP-25 (BE) is a big organization with a long history, huge volunteer base and a strong professional team. OY (BG) is an organization, developed by youngenthusiasts, and it is mainly based on volunteer efforts. RYD (NL) is representing a developedcountry with strong corporate spirit. HAHA (HU) is a university student association.

Open Youth Bulgaria

Project Manager

TOP 25 Belgium

Project Partner

HAHA Hungary

Project Partner

Responsible Young Drivers

The Netherlands Project Partner

Timetable of the project is form 01.08.2012 to 31.01.2014 In this period the listed numbered events have been completed.

Event Number 1: Project Management Event Number 2: Preparation meeting Brussel Event Number 3: Development and production of information and communication materials Event Number 4: Training for trainers Event Number 5: Pilot action Event Number 6: Local actions Event Number 7: Media relations Event Number 8: Evaluation Event Number 9: Dissemination Event Number 10: Evaluation Meeting

This evaluation report will address all events. The event numbers 3-4-5-6 will be addressed in the chapters 5 and 6 (QUANTITAVE RESULTS). The event numbers 7-9 will be addressed in Chapter7 (RESULTS OF VISIBILITY AND DISSEMINATION). The event numbers 1, 2 and 10, including the whole project, will be part of the Process Evaluation. This report is the result of event number 8.Chapter 4 (CONTENTS AND IMPLEMENTATION OF THE EVALUATION) describes the build up of the evaluation.

2


SHORT DISCRIPTION OF THE PROJECT PROPOSAL

„Media tablets are poised for strong growth with worldwide end user sales projected to total 54.8 million units in 2011, up 181 percent from 2010, and surpass 208 million units in 2014.” (Gartner) According to some analysts the total number of sold smart phones worldwide is expected to surpass 875 million in 2014 from “only” 267 million in 2010. The number of downloads is expected to almost double in 2011, reaching 18.1 billion from 9.5 in 2010, according to IHS Screen Digest. The expected figure for 2014 is 33 billion. This is a very powerful base for reaching tech savvy young people wherever they are. But it is still underused due to lack of information and experience. The project consortium believes that there are synergies that can be explored by cross-fertilizing regular channels with those innovative ones for promoting European citizenship rights to young Europeans. UPDATE aims to develop a genuine comics book, explaining to the young people in an interesting and understandable way their basic EU rights and how they can appeal to the European Ombudsman, and to adapt it to the world of mobile devices using AppStore platform as a pilot as it holds 75% of that market. The comics book will be promoted offline, through regular people-to-people public awareness raising activities, and online through a shared Internet marketing campaign. The developed comics book will be disseminated in at least 16 local actions in four different EU Member States. During the project we will train 80 volunteers, involve 2 400 direct participants and reach more than 24 000 indirectly. The project is based mainly on the developed capacity in the field of awareness raising campaigns and developing high-tech applications, built by the HEROES project (an EAHC co-funded initiative cross-fertilizing road safety, alcohol, drugs and AIDS prevention messages) and “European citizenship… not only words but concrete rights” campaign (a DG JLS funded communication campaign in Bulgaria).

3


CONTENTS AND IMPLEMENTATION OF THE EVALUATION

4.1 | Design of evaluation

The evaluation of the UPDATE project consist of the following:

- Internal process evaluation (chapter 8)

- Internal evaluation on the knowledge and views of the volunteers, implementing the actions

on site (chapter 6) - External evaluation on the knowledge by the youngsters of the European rights for young people itself (Chapter 6) - Visibility of the project in the media (chapter 7)

The process evaluation data is collected from the Process Evaluation Form (EVA4), which is completed during the final meeting in Sofia by each partners coordinator. Also the external evaluator has observed the state of affairs during the whole project and has drawn her conclusions.The internal evaluations amongst the volunteer team is done using forms, completed by the volunteers (EVA2) and the action coordinators EVA3), before and after each local action.The external evaluation on the knowledge of the youngsters under the age of 30 of the Europeanhuman rights is done, based on the results of the interactive quiz. These results are entered by eachcountry in a system, analysed by the external evaluator and summarized in this report. The external evaluation on the visibility of the project Update in the media is based on the actual media attention for this project. Each partner has collected their media coverage.

4.2 | Indicators and instruments of evaluation

As a part of the work plan the evaluation indicators were assessed and the evaluation instruments were designed to measure them. The table shows the indicators and the related evaluation instruments to assess, whether the targets of the project have been reached.

specific objective Process Indicator Outcome Indicator Target Evaluation

Instrument

To train local volunteers Number of volunteers

active during the field

activities

Volunteers can disperse

and share the knowledge

of the European human

rights under the

youngsters

80 EVA4

To create successful local

awareness actions

Number of local activities

implemented

Number of different

activities organized

16 EVA1, EVA3

To reach participants on

the local actions

Number of people met

during the field

implementations

Handover the knowledge

of the European rights to

the youngsters

2.400 Quiz cards

4


To inform the target

audience about the

project and awareness

message

Number of distributed

information cards

Knowledge of the

awareness message

among the target

audience

24.000 Counting

To inform the general

public about the project

and field activities

Number of collected press

articles, radio and TV

interviews. Internet audience.

Publications in local and

national media, 50 000

people reached through

media and 50.000 online

50.000

50.000

Media

Coverage

& Internet

Website

To analyse the process of

the European project

UPDATE

During and after the

project an external

evaluator evaluates the

project

Evaluation report EVA4

Final

Evaluation

Meeting


RESULTS OF QUANTITATIVE EVALUATION

5.1 | General quantitative goals

According Event Number 3 of the plan of action the needed material for the project is developed between 01.10.2012 and 31.03.2013. This contains the information and communication materials to be used during the local actions.

- development of website;

- production of visual concept;

- production of 2.400 comic book;

- production of 40 project t-shirts;

- production of 24.000 information cards;

- production of 2.400 quiz cards;

- production of interactive quiz;- production of AppStore comics application;

- production of 2.400 pens;

- production of stands for the local actions.

5.2 | Realised products

During the Start Up meeting in Brussels (24-26.09.2012) the process ofdeveloping and producing of the needed materials is discussed and the tasks handed out. Development of the website, the visual concept, the interactive quiz and theAppStore comics applications have been started up by the project manager and completed by the participating countries. The concept was to have a Young man called Eugene come alive in the comics and have him return in the visuals. Each partner wrote a story for the comic book and developed its local material. Anonline application was created for iPhone, iPad and Android platforms and is downloadable throughAppStore and PlayStore. Everything was developed in time before the start of the pilot actions. During the pilot actions the material was tested and put straight for using it in the four countries.

Production of the comic book and the information and quiz cards

5


The online applications in AppStore

The UPDATE website

USED MATERIAL UPDATE

This table shows the amount of material used in all 23 local actions. Of all produced material, more is deployed than calculated during the UPDATE project. 2.552 comic books, 2.845 quiz cards, 23.320 information cards and 1.275 pens were disseminated. Paragraph 5.4 will give more information on the dissemination of the material per action.

Material update

Project indicator

Used material

Comic book 2.400 2.552

Info cards 24.000 24.320

Quiz cards 2.400 2.845

Pens 2.400 1.275

0

5000

10000

15000

20000

25000

30000

comic books

info card

quiz card

Pens

used

indicator


5.3 | Number of trained volunteers

Event Number 4 On March 15, 2013 the meeting “Training for trainers” was held. Each partner had sent a delegate who can educate its own team of volunteers in a later stage to benefit the performance during the localactions. Chapter 7 gives the process evaluation of this meeting. This addresses the quantitative evaluation of the number of educated local volunteers.

According to the project, the target indicator was “educating and training of 80 volunteers” this is 20volunteers for each partner. All partners together have 105 volunteers, educated and deployed duringthe local actions. The table below shows that Bulgaria educated 36 volunteers, Hungary - 25, Belgium - 24 and The Netherlands - 20. The average age of all the volunteers was 21 years, the youngest was 15years old and the oldest was 30 years old. 75% of all the volunteers were students. The total group ofvolunteers nicely met the target group of the UPDATE project: youngsters < 30 years!

105 TRAINED VOLLUNTEERS • range of age 15 - 30• average age 21

• 76% are students• 23% are (un)employed

We also asked the volunteers about their knowledge on the European human rights before andafter the actions. This qualitative data will be addressed in Chapter 6.

5.4 | Number of local actions, material and (in)direct participants

Event Number 5 A pilot action will be organized by each partner in order to test the developed method and products. Each action has to attract at least 150 people to complete the interactive quiz.

Event Number 6 Taking into account the result from the pilot action and implementing changes where necessary, each partner will have to implement three more actions,using the developed in Event 5 approach.

Expected results 16 successful local actions, 80 trained youth volunteers, 2.400 direct participantson the interactive quiz; 24.000 indirect participants, informed by the project materials

Between 01.03.2013 and 31.10.2013 the partners have organised and implemented the localactions. The table below outlines the quantitative data on the actions: - Number of actions - Dates and locations of the actions - Number of trained volunteers - Number of direct participants on the interactive quiz - Number of indirect participants

24

36 25

20 BE

BU

HU

NL


LOCAL ACTIONS IN BELGIUM (information form of the coordinator of the volunteers)

Action Date Location Number of trained

volunteers

Number of direct participants on the

interactive quiz

Number of indirect

participants

1 31.05-2013 02.06.2013

Francorchamps 6 141 1.000

2 28.06.2013 30.06.2013

Brussel 6 136 1.000

3 26.07.2013 28.07.2013

Marche-en-Famenne

6 87 1.000

4 19.10.2013 Brussel 6 236 1.000

total 24 600 4000

LOCAL ACTIONS IN BULGARIA (information form of the coordinator of the volunteers)


volunteers

Number of direct particpants on the

interactive quiz

Number of indirect

participants

1 22.04.2013 23.04.2013

Blagoevgrad 6 206 1.050

2 07.05.2013 08.05.2013

Vratsa 4 107 954

3 09.05.2013 Belogradchik 5 85 912

4 18.05.2013 Sofia 5 176 1.100

5 10.08.2013 Pernik 5 26 730

6 17.09.2013 Smolyan 4 102 988

7 18.09.2013 Stara Zagora 7 25 960

8 19.09.2013 20.09.2013

Pleven 0 207 986

total 36 934 7.680

LOCAL ACTIONS IN HUNGARY (information form of the coordinator of the volunteers)

Action Date Location Number of trained volunteers


interactive quiz

Number of indirect

participants

1 17.07.2013 20.07.2013

Debrecen 8 394 4.000

2 10.08.2013 11.08.2013 18.08.2013

Debrecen 5 94 1.230

3 01.10.2013 02.10.2013 03.10.2013

Debrecen 3 109 1.300

4 04.10.2013 Debrecen 2 26 550

5 12.10.2013 Hajdúszoboszló 2 21 575

6 14.10.2013 Debrecen 2 26 490

7 18.10.2013 Balmazújváros 3 41 495

total 25 711 8.640


LOCAL ACTIONS IN THE NETHERLAND (information form of the coordinator of the volunteers)


volunteers


interactive quiz

Number of indirect

participants

1 20.07.2013 De Veenhoop 4 163 1.000

2 30.07.2013 Franeker 6 219 1.000

3 18.09.2013 Franeker 5 167 1.000

4 19.10.2013 Drachten 5 51 1.000

total 20 600 4.000

TOTAL OF LOCAL ACTIONS: PARTICIPANTS AND MATERIAL

BE BU HU NL TOTAL PROJECT INDICATOR

Actions 4 (6 days) 8 (12 days) 7 (14 days) 4 23 16

Volunteers 24 36 25 20 105 80

Participants male 336 458 436 328 1.558 1.200

Participants female 257 472 247 266 1.242 1.200

Participants total <30* 600 934 711 600 2.845 2.400

Indirect participants 4.000 7.680 8.640 4.000 24.320 24.000

Comic books 560 1.030 442 520 2.552 2.400

Info cards 4.000 7.680 8.640 4.000 24.320 24.000

Quiz cards 600 934 711 600 2.845 2.400

Pens 180 622 157 316 1.275 2.400

5.5 | Conclusions of quantitative results

The above mentioned paragraphs show that the quantitative scorecard indicators have been met extensively. In total 23 local actions were accomplished (score card indicator was 16) in which 105 trained volunteers were deployed (score card indicator was 80). The target was that the partners should directly address in total 2.400 youngsters <

30 years using the quiz cards. Effectively the partners have addressed 2.845 youngsters. The final result is that the UPDATE project directly addressed 14% more youngsters on the European rights than originally targeted.

24.320 youngsters were reached by using and distributing the same number of information cards.

* According to the collected quiz cards.The sum differs from the reported distribution by gender,because 45 people did not report gender (7 for BE, 4 for BG, 28 for HU and 6 for NL).


RESULTS OF THE QUIZ ABOUT EUROPEAN CITIZEN RIGHTS

6.1 | THE INTERACTIVE QUIZ

Inventory on the knowledge of the youngsters is done by using an interactive quiz. For this purpose a quiz card was developed containing 8 queries. The quiz card was completed by youngsters < 30 years. Apart from these quiz cards, the queries could also be answered online. The results of the answered quiz cards were entered in the system by the four partners. The results are used to draw the conclusions on the level of knowledge the youngsters have on their European rights which are presented in this chapter. 2.845 quiz results were used.

Topics of the interactive quiz 1. Move and reside freely within the EU

2. Vote for and stand as a candidate in European Parliament and municipal elections

3. Be protected by the diplomatic and consular authorities of any other EU country

4. Petition the European Parliament and complain to the European Ombudsman.

The volunteers were trained before the local actions. The training did not only focus on the communication skills towards the youngsters but also on the target group knowledge of the European rights, giving the volunteers the ability to educate the message. As a surplus value of the project a conclusion can be made that 105 volunteers have more knowledge on the European rights now. In the project, after the training and any local action, the volunteers were interviewed on their experience and knowledge. The results are presented in paragraph 6.2.

Paragraph 6.3 presents the results on the interactive quiz about the knowledge of youngsters on their own European rights.

6.2 |THE KNOWLEGDE OF VOLUNTEERS ABOUT EUROPEAN RIGHTS

The results below are based on the interview results of the 105 volunteers. The age group of the volunteers is between 15 and 30 years old with an average of 21 years. A number of questions were asked (see Annex B EVA2 form “to be filled in after the action”) This paragraph presents the results of this questionnaire. Annex E presents the full results.

Knowlegde volunteers about European Rights before and after the training

1. What’s your knowledge about the EU rights before the training?2. What’s your knowledge about the EU rights after the training?3. Do you find the knowledge about EU rights important?

6


Some reasons why EU rights are important according to the volunteers:

Everyone in our country need to know their rights; Every person must have know about EU rights;

Because we are country member of the EU; Because it is important;

It is our right!!; Because we are real Europeans;

Yes, it can help when we are abroad; Because it is important for Young people;

It could be useful in life; For the education of Young people;

I will need it in the future; Citizenship obligation.

Needed European Rights for now and in the future? 1. Have you ever needed EU rights? yes no2. Do you think you will ever need the EU rights? yes no3. Do you find this awareness campaign about EU rights useful? yes no

2 3 3 3

4 4 4 4

5 5 5 5

0%

20%

40%

60%

80%

100%

BE BU HU NL

knowlegde EU rights volunteers

important

after training

before training

96%

4%

Will you need EU rights in the future?

yes

no

23%

77%

needed before

yes

no


89% of the volunteers were satisfied with the actions of the awareness campaign.

11% of the volunteers recommend to improve the approach to the visitors.

campaing

99% of all the volunteers consider

the awareness campaign on the

European rights to be useful!

What was, to your sense, the most interesting part for the participant (as the volunteer)? - get new information - to do the quiz - get the comic book - other.....

33%

31%

35%

1%

interesting part for the participant

information

quiz

comic book

other

99%

1%

awareness campaign EU rights

campaign useful

campaign not useful


Knowledge about the EU rights from the participants before the action, according the volunteers. Knowledge about the EU rights from the participants after the action, according the volunteers.

To the opinion of the volunteers, the knowledge on the European rights the youngsters has increased after the actions.

On a scale from 1 to 5, the general knowledge prior to the awareness action was 2.4 and 3.7 after it.

Which part of the project was for the volunteer personally the most interesting?

To the opinion of the volunteers, working as a team was considered to be the most interesting part.

15%

15%

16%

25%

29%

tools project

learning EU rights

training EU rights

contact visitors

team volunteers

Most interest part of the project for the volunteers

0

0,5

1

1,5

2

2,5

3

3,5

4

before after

knowlegde participants before & after the action


Conclusions over the volunteers A total number of 105 volunteers have been educated by the 4 partners to facilitate successful realisation of the actions. The age of the volunteers was between 15 and 30 years with an average age of 21. On a scale from 1 to 5 the general knowledge on the European rights of the volunteers during the project increased by 1 point. All volunteers consider the knowledge on the European rights important for the purpose of travelling, education or simply for the

feeling of being part of the European community. No less than 77% of the volunteers have never needed their European rights. The remaining 23% did mostly while travelling or studying in other countries. 95% of the volunteers expects to make use of the European rights in the future. 99% of the volunteers find this awareness campaign useful.

We also questioned the volunteers about the combination/relation of the various implemented campaign materials. This resulted in the opinion that the interconnection and relation of the 3 products (quiz card, comic book en information card) was considered to be very good and have resulted in a successful and complete awareness campaign. No less than 89% of the volunteers judged both the campaign and the actions as very useful and satisfactory.

To the opinion of the volunteers the knowledge of the participants clearly increased, too. This knowledge increased with more than 1 point on a scale of 0 to 5.

Finally we also asked the volunteers what they thought to be the most interesting aspects of the project for themselves. Almost one third (29%) enjoyed most the team work, while 25% judged the contact with the participants as most interesting. The training (16%), the knowledge on the European rights (15%) as well as the used campaign material (15%) was considered to be less interesting for the volunteers.

Conclusion


6.3 | THE KNOWLEDGE OF THE CITIZENS ABOUT THEIR EUROPEAN RIGHTS

Statistical report on the data collected from 2.845 quiz cards, completed by youngsters < 30 years.

Topics of the interactive quiz (the complete quiz can be seen in Annex F)1. Move and reside freely within the EU

2. Vote for and stand as a candidate in European Parliament and municipal elections

3. Be protected by the diplomatic and consular authorities of any EU country

4. Petition the European Parliament and complain to the European Ombudsman.

Number and profile of participants on the interactive quiz The knowledge of the youngsters on the European rights is investigated by using an interactive quiz. Completing the quiz is done both offline during actions and online. The results presented below arebased on the outcome of the 2.845 completed quiz cards. All information from the quiz is processed on the basis of the participating country. This paragraph presents an overview of the processed information.

Participants by country

The biggest number of reached youngsters was accomplished by Bulgaria (33% of all youngsters). Belgium, Hungary and the Netherlands reached about the same number of youngsters. All participating countries have met the performance indicator.

Bulgaria 934 participants

Belgium 600 participants

Hungary 711 participants

The Netherlands 600 participants

Total 2.845 participants

21%

33% 25%

21%

participants by country

BELGIUM

BULGARIA

HUNGARY

NETHERLANDS


Participants by gender

56% of the Total participants were male (1.558) and 44% were female (1.242).

Participants per country by gender

Participants by age

The age groups of the queried participants by country

Conclusions on the profile of the participants 1) 1.558 of the 2.845 quiz card were completed by male participants and 1.242 by female

participants. For 45 participants the gender was not specified. In Bulgaria the number ofqueried female and male participants was almost equal. In Hungary 189 more male than female participants were queried (total 711). In Belgium and the Netherlands also more male than female participants were queried, but the difference was marginal.

2) The age Group 21-24 years was the most represented one in all 4 countries, also the ageGroup 18-20 years has a good representation.A remarkable representation of the age group 12-17 years can be seen in Bulgaria in comparison with the other countries.

Gender BE BU HU NL TOTAL

Female 257 472 247 266 1.242

Male 336 458 436 328 1.558

Unknown 7 4 28 6 45

600 934 711 600 2.845

44%

56%

2.845 participants: female of male

female

male

0

50

100

150

200

250

300

350

unknown 12-17 18-20 21-24 25-30

age of the 2845 participants

BEL

BUL

HUN

NL


6.4 | STATISTICAL REPORT ON THE DATA COLLECTED FROM 2.845 QUIZ CARDS

The quiz card holds 8 questions on the European rights. The full outline of the quiz queries can be found in Annex E. In the context of the project 2.845 quiz cards were completed. Each quiz card has 8 questions, which puts the total number of questions at 22.760. From these 66% were answered correctly.

The individual correct scores per country are: Bulgaria 77% Netherland 66% Belgium 62% Hungary 54%

Average 66%

The table below presents the percentage of correct answers by question number and country. Bulgaria had a reasonable high score in all questions, bringing their correct score to 77%! All countries scored very well on questions 7 and 8. The questions 3 and 6 turned out to be the most difficult ones for all countries. Hungary showed the lowest total score which one can see in most of the individual scores (red bar).

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1 2 3 4 5 6 7 8

goo

d a

nsw

ers

in %

the questions

quiz results by country

BE

BU

HU

NL

66%

34%

Averaged over all questions

correct

wrong


CORRECT ANSWERS BY QUESTION AND BY COUNTRY

Question 1 - The term "freedom of movement" in the European Union affects: Answer 1: all together capital, goods, services and people Answer 2: only capital Answer 3: only services Answer 4: only goods

Explanation: The so-called "four freedoms" are freedom of movement, of goods, of services, of capital and people.

Question 2 - Which of the following is valid for a Bulgarian citizen who wants to go on vacation in Germany? Answer 1: "He should apply for a visa at the German consulate." Answer 2: "He must ask permission from the municipality he lives in." Answer 3: "He must have a valid passport or identity card to be able to cross the border." Answer 4: "He must prove he has sufficient funds."

Explanation: To cross the border, he must present his passport or ID card.

62%

89%

31%

79%

0%

20%

40%

60%

80%

100%

BE BU HU NL

Question 1: correct answers

77%

92%

52%

86%

0%

20%

40%

60%

80%

100%

BE BU HU NL



Question 3 - I am Spanish and I live in Bulgaria. As for the elections to the European parliament, which of the following statements is true? Answer 1: "Unfortunately, I cannot stand for elections for members of the European parliament in Bulgaria." Answer 2: "I can stand for European parliament elections in Bulgaria if I have permission from the Spanish Embassy." Answer 3: "I can run for the next European parliament elections in Bulgaria after 10 years." Answer 4: "I can run for the next European parliament elections in Bulgaria."

Explanation: Every citizen of the Union has the right to vote and to stand as a candidate at elections to the European Parliament in the Member State, in which he or she resides, under the same conditions as nationals of that State.

(Article 39 of the Charter of Fundamental Rights of the European Union - Right to vote and to stand as a candidate at elections to the European Parliament). (http://www.europarl.europa.eu/charter/default_en.htm)

Question 4 - Which of the following statements of Bulgarian citizens living in a village in Germany is true? Answer 1: "I have no right to vote in local elections." Answer 2: "I have no right to stand in local elections." Answer 3: "I have the right to vote and stand in local elections, but not to be elected as mayor." Answer 4: "I have the right to vote and stand in local elections and even to be elected as mayor."

Explanation: Every citizen of the Union has the right to vote and to stand as a candidate at municipal elections in the Member State in which he or she resides under the same conditions as nationals of that State. (Article 40 of the Charter of Fundamental Rights of the European Union - Right to vote and to stand as a candidate at municipal elections).

38%

49% 50%

7% 0%

10%

20%

30%

40%

50%

60%

BE BU HU NL


72% 66%

54%

81%

0%

20%

40%

60%

80%

100%

BE BU HU NL


http://www.europarl.europa.eu/charter/default_en.htm


Question 5 - If a citizen of the European Union has a problem in a third country in which his country has no consular service, he is entitled to: Answer 1: go to a consular office where his native language is spoken Answer 2: cry Answer 3: contact the embassy or consulate of any European Union country Answer 4: go to a consular office of a country which is close to his own one

Explanation:Every citizen of the Union shall, in the territory of a third country in which the Member State of which he or she is a national is not represented, be entitled to protection by the diplomatic or consular authorities of any Member State, on the same conditions as the nationals of that Member State. (Article 46 of the Charter of

Fundamental Rights of the European Union - Diplomatic and consular protection). (Http://www.europarl.europa.eu/charter/default_en.htm)

Question 6 - Acquisition of citizenship of a Member State of the European Union depends on the: Answer 1: Member State in question Answer 2: person himself Answer 3: European institutions Answer 4: Member State and European institutions

Explanation: The answer of the question whether a person can acquire citizenship of a Member State depends entirely on the national legislation of that Member State.

77% 84%

40%

86%

0%

20%

40%

60%

80%

100%

BE BU HU NL


5%

65%

36%

8% 0%

10%

20%

30%

40%

50%

60%

70%

BE BU HU NL




Question 7 - The right to petition the European Parliament: Answer 1: belongs to all nations of the earth Answer 2: belongs to every citizen and every resident in a Member State of the European Union Answer 3: belongs to the large companies Answer 4: belongs to God

Explanation: Any citizen of the European Union and any person residing in a Member State has the right to petition the European Parliament.

Question 8 - In the event of maladministration by the European Union institutions I have the right to: Answer 1: appeal to the U.S. Supreme Court Answer 2: turn to the Belgian Embassy Answer 3: stop paying my taxes Answer 4: complain to the European Ombudsman

Explanation: In case of maladministration by European Union institutions (with the exception of the Court of Justice), citizens and residents of the European Union are entitled to complain to the European Ombudsman.

79%

83%

79%

87%

74%

76%

78%

80%

82%

84%

86%

88%

BE BU HU NL


83% 85%

93%

90%

75%

80%

85%

90%

95%

BE BU HU NL



Conclusions quiz results Bulgaria with 77% correct answers had the best score. The Netherlands with 66% scored second, followed by Belgium with 62% and Hungary with 54%. Some questions showed differences by country. I.e. The Netherlands had a very low score on question 3 (only 7%) and also for question 6 we see big differences for individual countries. An explanation for this could not be found.

In an earlier stage, Open Youth carried out extensive awareness

campaigns on the European rights in Bulgaria. This was done in

2008 and in 2012. The results of these two campaigns were

compared with the results of UPDATE in 2013. The major

increase of correct answers compared with the results of the

earlier campaigns is remarkable. Annex G presents the

differences between the various campaigns by year.

Conclusion


Quiz results by gender The avarage score on correct answers by gender show no dramatic differences. Both genders scored with an avarage of 66%. This concludes that the level of knowledge on European rights is the same for both females and males.

Quiz results by age By registering the age of the participants, a comparison can be made with the number of correct answers within the age group. The relatively high score of the age group 12-17 years is remarcable. With a correct score of 72% this group scored far better than all others. The remaining 3 groups had almost the same score. Age group "18-20 years" has an average correct score of 64%, age group "21-24 years" - 66% and age group "25-30 years" - 64%.

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1 2 3 4 5 6 7 8

Co

rre

ct a

nsw

ers

in

%

the questions

Quiz results by age

12-17 yrs

18-20 yrs

21-24 yrs

25-30 yrs

0%

20%

40%

60%

80%

100%

1 2 3 4 5 6 7 8

Co

rre

ct a

nsw

ers

in

%

questions

quiz results: female versus male

female

male


Conclusions results of the quiz 1) 2.845 quiz cards, all together with 22.760 queries,

were completed. 66% of the answers were correct.2) Bulgaria had the highest score with 77% followed by the

Netherlands with 66%, Belgium with 62% and Hungary with 54%, meaning that the youngsters European rights knowledge level is reasonably high in the participating countries.

3) The question “Vote for and stand as candidate in European Parliament and municipal elections” (no. 3) resulted in a low score of correct answers of 33%.

4) Also the question “protection by the diplomatic and consular authorities of any other EU country” (no. 6) seemed to be difficult. Only 33% gave a correct answer.

5) The two questions on the European Ombudsman (no. 7 and 8) scored the best with respectively 82% end 87% correct answers.

6) Not much difference was encountered in the overall result between male and femaleparticipants. Both had an average score of 66%

7) Remarkable in a positive way were the quiz results of the age group 12-17 years. This group scored with 72% correct answers. The other age categories scored almost equal: 64% for the age groups 18-20 years and 25-30 years and 66% for the age group 21-24 years.

8) Open Youth organised awareness campaigns in Bulgaria on this subject before and this presumably explains the higher scores compared with the other 3 countries.This proves that the knowledge of youngsters is increased by these campaigns.

questions 12-17 yrs 18-20 yrs 21-24 yrs 25-30 yrs

1 83% 61% 67% 68%

2 90% 74% 77% 77%

3 40% 37% 38% 34%

4 68% 67% 70% 67%

5 77% 69% 75% 72%

6 55% 33% 26% 24%

7 78% 83% 84% 83%

8 84% 87% 90% 88%

average 72% 64% 66% 64%

Conclusion


RESULTS OF VISIBILITY AND DISSEMINATION

Event Number 7: Media relations The project partners will list medias both on national as on local level in chosen cities for local actions. Those will be contacted on regular basis to allow them to follow the development of the project and its results. Expected results: Publications in local and national media, 50.000 people reached through media

Event Number 9: Dissemination The project result will be disseminated by the project partners throughout their various networks, covering the whole European Union (e.g. the European Youth Forum for Road Safety, the INSIDE network, the “Youth for Europe” online community of more than 3.000 active entities from all over Europe). Each partner will also have a dedicated budget for developing a local Internet marketing campaign, disseminating information about the comics for mobile devices. Expected results: The project results are disseminated EU wide.

7.1 | The visibility of the project and the activities in the media

Press releases had been sent by the 4 partners to national and regional press during all actions. The table below presents the number of media contact of each partner. The second table presents the actual appearances in the media. With the experience that the partners have with the media, they knew how to find the way inside the media organisations and how to make the project visible for the public. Annex H presents a number of examples of published media content.

Number of media contacts

Local level National level

Bulgaria 575 188

Belgium* 0 0

Hungary** 0 0

The Netherlands 26 29

* During one action Belgium received a vist of their Minister of Road Safety and Agriculture, Mr. Carlo di Antonio.**Hungary did the final closing event of the project on December 16th, 2013 and gave a short presentation about the results for the regional and local NGOs. A final article will be published in the February edition of their University Journal.

Number and type of publiciations

TV Radio Newspaper News agencies Internet

Bulgaria 7 14 8 7 77

Belgium 0 0 0 0 0

Hungary 0 0 0 0 0

The Netherlands 1 1 10 0 16

7


Participants by media A calculation is made for the number of individuals thatencountered an appearance or broadcast about the UPDATE project. In our context these are named indirect participants.

Bulgaria made a detailed calculation on the indirect outreach ofpeople through media coverage. Only in Bulgaria this resulted inan indirect reach of 1.478.332 people. This calculation is based on reported audience by the diffent media and does not account for any possible overlap.

The Netherlands also made a calculation of the media based on the total number of inhabitants as well as the various reaches per individual utterance. This resulted in a reach through the media of 242.000 indirect participants.

7.2 | The visibility of the project and the activities by the general public

The project went extremely well for the visibility under a big group of spectators. The big booth usedduring the actions already draws public attention. Also the distribution of the information cards about the European rights contributed to good visibility and spreading out information to the public.The voluntear teams are trained to address big groups of public at big events in which manyyoungsters participate. After completing the quiz card each participant received a comic book totake home. The after effect of distributing the information card and the comic book unfortunately is hard to measure, but must be a multiple of the total distributed materials (24.320 information cardsand 2.552 comic books).

7.3 | The online visibility

Although all performance indicators were met, the number of website visitors was below the expectations. 1.900 people visited the website of which 531 people completed the quiz queries and downloaded the comic book. From the total number of downloaded online applications, 406 were done for Android. The Apple store does not provide download information for free apps, but the UPDATE application received a user review of 4+.

In the period between March 12 and May 5, Bulgaria launched an internet marketing campaign using 2 facebook pages: Open Youth and Youth for Europe. By using this campaign, 14.537 people were reached directly (i.e. interacted with the provided content) and 740.246 people were reachedindirectly (i.e. saw the content).

In Bulgaria

1.478.332 indirect participants

by media!

In The Netherlands

242.000 indirect participants

by media!


7.4 | The visibility of the project and the activities by the networks

The partners of UPDATE are part of big (inter)national networks and participate in multiple international projects. Project UPDATE was disseminated at the following conferences:

Name ‘Traffic Police’ Media Seminar Location & date Hisar (Bulgaria), 14 of june 2013 Number of participants 100 participants

Name ‘Speed Management’ Training Courses Location Sofia, Veliko Tarnovo, Varna, Burgas, Plovdiv (Bulgaria) Date 26-30.08.2013 Number of participants 109 participants

Name ‘Employability of Young People’ Conference at EESC, CCMI, Location & date Brussels (Belgium) 22 of November 2013 Number of participants 150 participants

Name European Youth Forum for Road Safety (EYFRS)

Location & date Crotone (Italy) 26, 27, 28 of November 2013

Number of participants 100 participants a day

Number of media relations 50 local journalists, 5 local TV stations, 1 national TV station

Name Location & date Reason Number of participants

Bulgarian Forum for Road Safety Sofia (Bulgaria) / 04th of December 2013 UPDATE press-conference114 participants

Conclusion visibility The ultimate goal was to reach 100.000 people, from which 50.000 through direct media and 50.000 through online media. The UPDATE project reached in total:

Medium and products Reach

2.552 comic books 2.552 direct participants

Quiz Cards 2.845 direct participants

Information Cards 24.320 indirect participants

Online web and app 743.083 indirect participants

Media 1.720.322 indirect participants

Networks partners Unkown


PROCESS EVALUATION

8.1 | Event Number 8: Evaluation

The project envisages the implementation of an integrated evaluation system foreseeing an INTERNAL EVALUATION (progress evaluation) + AN EXTERNAL EVALUATION (final evaluation) whose objectives are: - to analyze the level of implementation of the working programme at each stage; - to verify the achievements that could affect the implementation of each subsequent activity; - to collect information about the effectiveness of the work in each partner’s context.

Expected results Evaluation report for the project achievements; project manual, describing the project process; statistical report on the data, collected from 2 400 quiz cards, giving information on the concrete knowledge of the ordinary citizens about their European rights. Another evaluation will be done on the experience of the involved volunteers. The evaluation will be subcontracted to an experienced external evaluator who will also participate at the preparation and evaluation meetings.

The chapters 4 and 5 outlined the external evaluation. This chapter will deal with the internal evaluation, the process evaluation of the project UPDATE.

On a periodic basis all partners were asked to complete an evaluation form to collect the needed data for the process evaluation. All answered questions are assembled in evaluation form EVA4 (Annex D). Finally the process of the project UPDATE was discussed and evaluated during the Final Meeting in Sofia (BG) between all partners. Annex I presents the results of the process evaluation. This chapter presents the conclusions of these 2 evaluations.

The process evaluation is presented in 4 paragraphs: 1) Project management2) Meetings of the project team3) Development of the used material4) Organisatiion of the local actions

On the evaluation form the partners could give their judgement about a subject on a scale of 0 to 5 (Very bad 0-1-2-3-4-5 Excellent) about a subject. This judgement is used in the process evaluation.

8


8.2 | Proces evaluation of the Project management

The description of the task for process management is as follows: The project will be coordinated and managed internationally by Open Youth in its capacity as leading partner. The project coordinator plays a strategic role in meeting the objectives that have been set and in achieving results which can be useful and transferable at a European level. 1. The coordinator will be in charge of managing the relationships with EACEA .2. The other project partners will be actively involved in this work package. Each will appoint a

person, who will be responsible.

Expected results Sound project management process allowing all activities to be implemented as foreseen and the aims to be achieved; activities and financial reports.

Open Youth performed its job very well and reached an avarage score of 4.7 on this item. The information about the project itself, as well as the involvement of the partners, the task balancing between the partners and the goals of achievement have been expierenced as positive and clear. Also the information about how to organise local actions and the method of reporting the results was clear. A strong advantage for this was that the partners are well known with the awareness campaigns for youngsters and also cooperate together within other projects. The effect of this is a flexible running process and a efficient performing of tasks by each partner.

8.3 | Proces evaluation of the project team meetings

24-26.09.2012 15.03.2013

Within the project 3 team meetings were held. Preparation Meeting in Brussel Training for the trainers in Amsterdam Final Meeting in Sofia 03-04.12.2013

Thanks to the project management these meetings were organised within the established time table and the proposed results were met.

In the preparation meeting, the project partners will discuss and develop the project strategy in details, including information materials, project logic, defining the locations for the local actions, recruitment of local youth volunteers. After the training for the trainers meeting each partner will have a well prepared trainer who will be responsible for training a team of volunteers for the implementation of each local actions in the different partner's settings. At the end of the project the participants will meet to discuss the project achievements. They will do analysis of project development, discussion of project results, evaluation of project communication activities, instructions for final report (activities and financial), discussion of future project development. A press conference will be organized to inform the media about the project results.

The Preparation meeting in Brussels reached a score of 4.35 where the Train the trainers meeting reached a score of 4.7. This means that the information about the development of the needed material was accomplished very well both at project and partner level. Each partner wrote its own EU story and all these were united in the comic book.


The Training for trainers meeting in Amsterdam was also successful. The partners were already well experienced in training volunteers in a way that actions could get performed well. For this reason the Training for the trainers meeting had been run efficiently and fast.

The Final meeting in Sofia also went well. During this meeting the partners shared and evaluatedtheir experiences within the local actions. On the second day of the Final meeting Open Youthorganised a press conference. The results of this press conference is presented in chapter 7.

8.4 | Process evaluation of the development of the used material

Development of the material to be used by the project was done well and all was realised well before the start of the first pilot actions. On local level all partners have developed their material and produced it with the branding of the project.The material used by the project received a high avarage score of 4.3 from which the comic bookunanimous scored 5. Also the booth used by the actions had a very high avarage score of 4.75 and the avarage score of 4.0 for the “Appstore application comic book” is remarkable, too. In general all the project materialwas received very positive by the partners.

8.5 | Proces evaluation of the organising of the local actions

Organising a pilot action and 3 local actions are described in Event Numbers 5 and 6Event Number 5: A pilot action will be organized by each partner in order to test the developed method and products. Each of them will be for three days - an orientation one, a training for at least 5 local youth volunteers, enabling them to successfully implement the next day action, and the local action itself, implemented by the volunteers, supported by the trainer and the country project manager. Each action has to attract at least 150 people to complete the interactive quiz. Event Number 6: Taking into account the result from the pilot action and implementing changes where necessary, each partner will have to implement three more actions, using the developed inEvent 5 approach.

All partners of project UPDATE are well experienced in organising awareness campaigns andactions for youngsters. They can make use of many contacts and networks to choose, organise and realise local actions by trained volunteers. The quantitative data is presented in chapter 5 and, effectively, is higher than the pre-defined performance indicators. This part of the project was run without any problems by all partners who gave an avarage score of 4.5 for this process.


CONCLUSIONS AND RECOMMENDATIONS

General conclusions The project UPDATE was finalised successful. The quantitative indicators were widely met. Development of information and communication materials was done in accordance with the agreements and the plan of action. For the local actions all materials like the web site, the comic book, the information cards, the quiz cards, the booth, the T-shirts and pens were prepared and ready to use on time. Also the online versions of the

comic book were developed on time and in accordance with the plan of action. The project trained 105 volunteers for realising the 23 local actions. During these local actions 2.845 quiz cards were completed and 24.320 information cards distributed. The specially developed comic book and the connected online applications addressed the young target group very well. The great experience of the participating partners concluded in a successful realisation of the project UPDATE, within the given time frame and meeting the predefined targets.

Specific conclusions about European Rights The aim of the UPDATE project was to explain the fundamental European rights to the youngsters. This explanation was realised by using a specially developed comic book offline with a real book and online using special apps. In this way the maximum possible number of youngsters was reached. Since many awareness actions for road safety target the aimed group of youngsters < 30 years, a combination with these awareness campaigns was often made by the project UPDATE.

Both the volunteers and the participants were questioned about their knowledge on European rights. The most interesting conclusions on the knowledge on European rights of the volunteers is as follows:

1) 77% of the volunteers have never used their EU rights, but 96% think that they will needthem in the future;

2) On a scale of 0 to 5 they evaluate their knowledge of EU rights at 3 before training and at 4after it;

3) On a scale of 1 to 5 they evaluate the knowledge of the young project participants about their European rights at 2.4 before the respective campaign and at 3.7 after it;

4) 89% of the volunteers were satisfied with the actions of the awareness campaign.

From the completed quiz cards by the 2.845 young participants the following conclusions can be drawn:

1) The total proportion of given correct answer is 66%;2) There is no gender difference, the proportions of correct answers given by boys and girls

was 66%;3) Most correct answers are given by the youngest participants, aged 12 to 17 years: 72%;4) The Bulgarian participants had the greatest knowledge on the European rights: They scored

77% correct answers, with the Dutch scoring 66%, the Belgiums scoring 62% and theHungarians scoring 54%.

5) The score about the freedom of movement in the European Union (question 1) was very high, although Hungary had a relatively low score of 31% correct answers on this topic.

9

Conclusion


6) Also 77% of the youngsters is aware of the need of a valid ID card or passport while travelling to another European Union country for i.e. holidays (question 2)

7) The question “Vote and stand as candidate in the European Parliament” is more complex. 33% correct answers were given to this question (no. 3).

8) 68% of the youngsters are aware that they have the right to vote at local elections and also that they can stand for mayor in the place where they live, independently their nationality (question no. 4)

9)

10)

Question 5 “Protection by the diplomatic and consular authorities” was more complex, this query had an average score of 33% correct answers.

11)

The question about the European Parliament had a correct score of 82% (question 7).

The youngsters showed to be well informed about the European Ombudsman. This question received a score of 88% correct answers (question 8).

Recommendations 1) The project UPDATE was very successful which was caused by both the big experience and

great networks of the partners within the project. The partners are also experienced in training and working with volunteers inside a project, organising awareness campaigns and with communicating with and informing youngsters.

2) Cooperation between the partners was very good (this scored high in the process evaluation). Having worked together before in various projects eased helping and approaching each other.

3) The general knowledge about the European rights of the young participants is relatively high. The average score was 66% correct answers.

4) Open Youth already conducted 2 awareness campaigns in Bulgaria in 2008 and 2012 and from the results one can clearly see that the knowledge of the European rights strongly increased. Bulgaria finished in the total results as the country with the best results.

5) A conclusion can be drawn that an awareness campaign, such as the one realised by project UPDATE, is useful and successful and that the knowledge on the European rights increased for the target group.


ANNEXES UPDATE PROJECT

A. Update Material Counting (EVA1) B. Form to filled after the action by volunteers (EVA2) C. Form to be filled after the action by coordinator of the volunteer

(EVA3) D. Process evaluation (EVA 4) E. Evaluation of the volunteers F. Quiz questions G. Quiz results Bulgaria 2008-2012-2013 H. Examples of statements in the media I. Results Process Evaluation (EVA4)

ANNEXES


Annex A: Update Material Counting (EVA1)

EVA 1. Form to be filled before and after the action

Date : Country: Place: Time :

Material UPDATE

Comic books Quiz

cards

Information cards pens

Number

before the

action (a)

Number after

the action (b)

Number

distributed (c)

(c) = (a) – (b)

On average 150 people per action to complete the interactive quiz


Annex B: Form to filled after the action by volunteers (EVA2)

by the VOLUNTEERS


Name of the Volunteer

Age of the volunteer

Identity student employed unemployed

Your Coordinator on the action

Your number off action first second third fourth fifth

1 Your knowledge about EU rights before the training Negative 0___1___2___3___4___5 Positive

2 Your knowledge about EU rights after the training Negative 0___1___2___3___4___5 Positive

3 Do you find the knowledge about the EU right important?

Negative 0___1___2___3___4___5 Positive

4 If yes, why?

5 If no, why not?

6 Have you ever needed the EU rights?

yes no

7 Do you think you ever need the EU rights?

yes no

8 Do you find this awareness campaign about EU rights useful?

yes no

9 How many participants / visitors did you talk to during the action today? (on the average)

less than 20 between 20 & 50 between 50 & 100 more than 100

10 What was at you sense the most interesting part for the visitors you talked to?

Get new information Do the quiz Get the comic book Others: .......................................

EVA2. Form to be filled after the action


3 The knowledge about EU right from the visitors before the action (your assumption)


4 The knowledge about EU right from the visitors after the action (your assumption)


13 I recommend to change the activities in part

yes no

14 If YES, what changes do you have in mind:

the given information the tools the approach of the visitors others: ..................................

15 Which part of the project was for you personally most of interest?

the contacts with visitors/youngsters learning about EU rights the team of volunteers the training the tools others: ..................................


Annex C: Form to be filled after the action by coordinator (EVA3)

by coordinator off the volunteers


profile youngsters: peer-to-peer Total Male

Total female

Total yougsters < 30

material update Total comics

Total information cards

Total quiz cards

Total pens

knowledge about EU rights Youngsters volunteers

General knowledge:


General knowledge:


EVA3. Form to be filled after the action


Annex D: Process evaluation (EVA 4)

to be filled in by the country project manager

Name of the evaluator

Name of the organisation

Date

Project Management

Information about the project Clear objectives

Achievable objectives Information about local actions

Information about the reports Partners actively involved by the project

Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent

Start Up Meeting Brussel (24-26.09.2013)

Clear project strategy Information about develop material

Information about develop comic book/story Information about local actions

Information about recruitment local volunteers

Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent

Training for the trainers Amsterdam (15.03.2013)

Instructions about the training local volunteers Instructions about communicating young people

Instructions about working with the interactive quizzes Instructions about the administration of the quizcard

Instructions about dissemination of the project material Instructions about the collection of data


How would you rate the material (useful)

Website Comic book

Informations cards Interactive quizcards

Appstore comics applications Pens

Projects shirts Local stands

Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent Very bad 0___1___2___3___4___5 Excellent

EVA4. Process evaluation update


How would you rate the locale action organization & visuals?

The preparation The material used (the tools)

The visibility The welcoming of the visitors The involvement of the NGO

The location


Pilot & local actions

Number of trained volunteers

Number of successful actions

Number of participants on the interactive quiz

Other questions

Your knowledge about EU rights before the project Negative 0___1___2___3___4___5 Positive

Your knowledge about EU rights after the project Negative 0___1___2___3___4___5 Positive

Do you find this awareness campaign about European rights is useful?

yes no

I recommend to change the activities in the project yes no

If yes, what changes do you have in mind?

Media: were there publications in the local media about Update?

If yes, wil you mail this to Daniel of Jetty


Annex E: Evaluation of the volunteers

EVALUATIONS OF THE VOLTUNEERS

BE BU HU NL ALL

Number of volunteers 24 36 25 20 105

Average age 22 20 22,5 21 21

Range of age 21 - 29 15 - 30 17 - 27 17-24 15 - 30

Student 66% 86% 68% 85% 76%

(Un)employed 34% 14% 32% 15% 23%

Knowledge volunteer before training*

2.5 2.4 2.4 2.7 2.5

Knowledge volunteer after training*

4.1 4 4 3.9 4

Knowledge important according the volunteer*

4.4 4.3 4.8 4.8 4.6

Ever needed EU rights? yes no

20% 80%

3% 97%

8% 92%

15% 85%

11,5%

Need EU rights in the future? yes no

100% 0%

97% 3%

100% 0%

100% 0%

99% 1%

Campaign EU rights useful? yes no

100% 0%

97% 3%

100% 0%

100% 0%

99% 1%

Interest part for the visitor according to the volunteer**

new info quiz

comic book other

31% 28% 39% 2%

40% 27% 31% 2%

27% 38% 35% 0%

32% 31% 37% 0%

33% 31% 35% 1%

Knowledge visitor befor the action* 2.4 2.5 2.3 2.5 2.4

Knowledge visitor after the action* 3.6 3.8 3.7 3.7 3.7

Change activities awareness campaign

yes no

8% 92%

14% 86%

12% 88%

10% 90%

11% 89%

Most interest part of the project for the volunteer**

contact visitor learning EU rights

team volunteers training

tools

30% 16% 29% 19% 6%

22% 16% 25% 13% 24%

18% 11% 22% 25% 24%

31% 17% 40% 7% 5%

25% 15% 29% 16% 15%

* negative 0__1__2__3___4__5 positive** multiple answers possible


Annex F: Quiz questions

quiz to be filled during the action Form to be filled for each group or person met


PROFILE YOUNG EU CITYZEN

Sex Age

Male: ......... Female: ..........

Total : ........

12-17 18-20 20-24 25-30

Unknown Various

INTERACTIVE QUIZ1. MOVE AND RESIDE FREELY WITHIN THE EU

1.1 The term 'freedom of movement' in the European Union affects:

A: altogether capital, goods, services and people B: only capital C: only services D: only goods

Explanation: The so-called "four freedoms" are freedom of movement of goods, services, capital and people.

1.2 - Which of the following is valid for a Bulgarian citizen who wants to go on vacation in Germany?

A: "He should apply for a visa at the German consulate." B: "He must ask permission from the municipality he lives in." C: "He must have a valid passport or identity card to be able to cross the border." D: "He must prove He has sufficient funds."

Explanation: For the need of border crossing, he must present his passport or ID card.


2. VOTE FOR AND STAND AS A CANDIDATE IN EUROPEAN PARLIAMENT AND MUNICIPALELECTIONS

2.1 I am Spanish and I live in Bulgaria. As for the elections to the European parliament, which of the following statements is true?

A: "Unfortunately, I cannot stand for elections for members of the European parliament in Bulgaria." B: "I can stand for European parliament elections in Bulgaria if I have permission from the Spanish Embassy." C: "I can run for the next European parliament elections in Bulgaria after 10 years." D: "I can run for the next European parliament elections in Bulgaria."

Explanation: Every citizen of the Union has the right to vote and to stand as a candidate at elections to the European Parliament in the Member State, in which he or she resides, under the same conditions as nationals of that State. Article 39 of the Charter of Fundamental Rights of the European Union

2.2 Which of the following statements of Bulgarian citizens living in a village in Germany is true?

A: "I have no right to vote in local elections." B: "I have no right to stand in local elections." C: "I have the right to vote and stand in local elections, but not to be elected as mayor." D: "I have the right to vote and stand in local elections and even to be elected as mayor."

Explanation: Every citizen of the Union has the right to vote and to stand as a candidate at municipal elections in the Member State in which he or she resides under the same conditions as nationals of that State. Article 40 of the Charter of Fundamental Rights of the European Union

3. BE PROTECTED BY THE DIPLOMATIC AND CONSULAR AUTHORITIES OF ANY OTHER EU COUNTRY

3.1 If a citizen of the European Union has a problem in a third country in which his country has no consular service, he is entitled to:

A: go to a consular office of a country which is close to his own one B: cry C: contact the embassy or consulate of any European Union country D: go to a consular office where his native language is spoken

Explanation: Every citizen of the Union shall, in the territory of a third country in which the Member State of which he or she is a national is not represented, be entitled to protection by the diplomatic or consular authorities of any Member State, on the same conditions as the nationals of that Member State. Article 46 of the Charter of Fundamental Rights of the European Union

3.2 Acquisition of citizenship of a Member State of the European Union depends on the:

A: Member State in question B: person himself C: European institutions D: Member State and European institutions



4. PETITION THE EUROPEAN PARLIAMENT AND COMPLAIN TO THE EUROPEAN OMBUDSMAN.

4.1 - The right to petition the European Parliament:

A: belongs to all nations of the earth B: belongs to every citizen and every resident in a Member State of the European Union C: belongs to the large companies D: belongs to God


4.2 - In the event of maladministration by the European Union institutions I have the right to:

A: appeal to the U.S. Supreme Court B: turn to the Belgian Embassy C: stop paying my taxes D: complain to the European Ombudsman

Explanation: In case of maladministration by the and European Union institutions (with the exception of the Court of Justice), citizens and residents of the European Union are entitled to complain to the European Ombudsman.


Annex G: Quiz results Bulgaria 2008-2012-2013

Question 1 - The term "freedom of movement" in the European Union affects:

Answer 1: altogether capital, goods, services and people Answer 2: only capital Answer 3: only services Answer 4: only goods

Explanation: The so-called "four freedoms" are freedom of movement of goods, services, capital and people.

Question 2 - Which of the following is valid for a Bulgarian citizen who wants to go on vacation in Germany?

Answer 1: "He should apply for a visa at the German consulate." Answer 2: "He must ask permission from the municipality he lives in." Answer 3: "He must have a valid passport or identity card to be able to cross the border." Answer 4: "He must prove He has sufficient funds."

Explanation: For the need of border crossing, he must present his passport or ID card.

0

10

20

30

40

50

60

70

80

90

100

Answer 1 Answer 2 Answer 3 Answer 4

85

7 4 4

96

1 1 2

89

3 5 3

2008 2012 2013

0

20

40

60

80

100


7 7

69

17

2 2

94

2 1 3

92

4

2008 2012 2013


Question 3 - I am Spanish and I live in Bulgaria. As for the elections to the European parliament, which of the following statements is true?

Answer 1: "Unfortunately, I cannot stand for elections for members of the European parliament in Bulgaria." Answer 2: "I can stand for European parliament elections in Bulgaria if I have permission from the Spanish Embassy." Answer 3: "I can run for the next European parliament elections in Bulgaria after 10 years." Answer 4: "I can run for the next European parliament elections in Bulgaria."

Explanation: Every citizen of the Union has the right to vote and to stand as a candidate at elections to the European Parliament in the Member State, in which he or she resides, under the same conditions as nationals of that State. (Article 39 of the Charter of Fundamental Rights of the European Union - Right to vote and to stand as a candidate at elections

to the European Parliament). (http://www.europarl.europa.eu/charter/default_en.htm)

Question 4 - Which of the following statements of Bulgarian citizens living in a village in Germany is true?

Answer 1: "I have no right to vote in local elections." Answer 2: "I have no right to stand in local elections." Answer 3: "I have the right to vote and stand in local elections, but not to be elected as mayor." Answer 4: "I have the right to vote and stand in local elections and even to be elected as mayor."

Explanation: Every citizen of the Union has the right to vote and to stand as a candidate at municipal elections in the Member State in which he or she resides under the same conditions as nationals of that State. (Article 40 of the Charter of Fundamental Rights of the European Union - Right to vote and to stand as a candidate at

municipal elections).

0

5

10

15

20

25

30

35

40

45

50


23 20

18

39

19

24

11

46

7

17

27

49

2008 2012 2013

0

10

20

30

40

50

60

70


27

19 16

38

13

24

16

47

9 9

16

66

2008 2012 2013



Question 5 - If a citizen of the European Union has a problem in a third country in which his country has no consular service, he is entitled to:

Answer 1: cry Answer 2: go to a consular office where his native language is spoken Answer 3: go to a consular office of a country which is close to his own one Answer 4: contact the embassy or consulate of any European Union country

Explanation: Every citizen of the Union shall, in the territory of a third country in which the Member State of which he or she is a national is not represented, be entitled to protection by the diplomatic or consular authorities of any Member State, on the same conditions as the nationals of that Member

State. (Article 46 of the Charter of Fundamental Rights of the European Union - Diplomatic and consular protection). (Http://www.europarl.europa.eu/charter/default_en.htm)

Question 6 - Acquisition of citizenship of a Member State of the European Union depends on the:

Answer 1: Member State in question Answer 2: person himself Answer 3: European institutions Answer 4: Member State and European institutions


0

20

40

60

80

100


4 14

9

73

1 7 3

89

5 6 5

84

2008 2012 2013

0

10

20

30

40

50

60

70


41

9 10

40

52

4 4

40

65

6 5

24

2008 2012 2013



Question 7 - The right to petition the European Parliament:

Answer 1: belongs to all nations of the earth Answer 2: belongs to every citizen and every resident in a Member State of the European Union Answer 3: belongs to the large companies Answer 4: belongs to God


Question 8 - In the event of maladministration by the European Union institutions I have the right to:

Answer 1: appeal to the U.S. Supreme Court Answer 2: turn to the Belgian Embassy Answer 3: stop paying my taxes Answer 4: complain to the European Ombudsman

Explanation: In case of maladministration by the an European Union institutions (with the exception of the Court of Justice), citizens and residents of the European Union are entitled to complain to the European Ombudsman.

0

20

40

60

80

100


9

72

16

3 4

89

5 2 7

83

6 4

2008 2012 2013

0

10

20

30

40

50

60

70

80

90


3

17

5

75

4 5 2

89

4 7 4

85

2008 2012 2013


Annex H: Examples of statements in the media

Newspaper: Local action in Franeker, Newspaper: Local action Pleven

The Netherlands, 30.07.2013 Bulgaria, 20.09.2013

Website Local action Blagoevgrad Bulgaria 22-23.04.2013

Website Local action Vratsa Bulgaria 07-08.05.2013


Local action

Hungaria


Annex I: Results Process Evaluation (EVA4)

EVA 4 Process evaluation Update

Project Management BE BU HU NL average

Information about the project 5 5 5 5 5

Clear objectives 5 5 5 5 5

Achievable objectives 5 5 4 4 4,5

Info about local actions 4 5 4 4 4,25

Info about the reports 5 5 4 4 4,5

Partners actively involved by the project 5 5 5 5 5

Start Up Meeting Brussel

Clear project strategy 5 5 4 4 4,5

Info about develop material 5 5 3 5 4,5

Info about develop comic book story 5 5 3 4 4,25

Info abtou local actions 4 5 4 4 4,25

Info about recruitment local volunteers 4 5 4 4 4,25

Training for the trainers Amsterdam

Instructions about the training local volunteers 4 5 5 4 4,5

Instructions about communicating young people 5 5 5 4 4,75

Instructions about working with the interactive quiz 5 5 4 5 4,75

Instructions about the administration of the quizcards 5 5 5 5 5

Instructions about dissemination of the quizcard 5 5 4 4 4,5

Instructions about the collection of data 5 5 5 4 4,75

How would you rate the material (useful)

Website 4 4 5 3 4

Comic book 5 5 5 5 5

Information card 4 5 4 4 4,25

Interactive quiz card 4 5 5 4 4,5

AppStore comics applications 5 4 4 3 4

Pens 4 4 5 5 4,5

Project shirt 4 3 3 5 3,75

Local stands 5 5 4 5 4,75

How would you rate the actions organisation & visuals

The preparation 4 5 4 4 4,25

The material used (the tools) 4 5 5 5 4,75

The visibility 4 5 5 4 4,5

The welcoming of the visitors 5 5 4 5 4,75

The involvement of the NGO 5 5 4 5 4,75

The location 5 4 4 4 4,25

Other questions

Your knowledge about EU rights before the project 4 5 3 1 3,25

Your knowledge about EU rights after the project 5 5 4 5 4,75

Do you find this awareness campaign useful yes yes yes yes 100% yes

I recommend to change the activities in the project no no no no 100% no

Project Title Commissioned by Author and external evaluator

Translator

UPDATE Final Evaluation Report UPDATE Project Manager Update, Mr. Daniel Vankov LL.M Jetty de Vries, Workum, The Netherlands [email protected] Mr. Eric Mehlbaum

Date 07.01.2014

Date post:	02-Jul-2015
Category:	News & Politics
Upload:	vriestyle-projects
View:	306 times
Download:	3 times

Final evaluation report update

News & Politics