+ All Categories
Home > Documents > Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and...

Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and...

Date post: 26-Feb-2020
Category:

Documents
Upload: others
View: 0 times
Download: 0 times
Download Report this document
Share this document with a friend
21
Emerging Opportuni.es Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent Consultant OECD-DAC Mee:ng, April 27, 2016
Transcript
Page 1: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

EmergingOpportuni.esInforma.onandCommunica.onTechnologies(ICT)

inEvalua.onPrac.ce

LindaRa(ree,IndependentConsultantOECD-DACMee:ng,April27,2016

Page 2: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

WhyshouldwecareaboutICTsinEvalua.on?

Page 3: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

Deviceexplosion

hBp://conceptdraw.com/How-To-Guide/network-icon

http://conceptdraw.com/How-To-Guide/network-icon
Page 4: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

SocialMediaexplosion

hBp://socialmedia.biz/wp-content/uploads/2015/09/social-media.jpg

Page 5: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

Dataexplosion

hBp://cdn.business2community.com/wp-content/uploads/2015/06/big-data-cloud-e1383271750410-460x394.png

Page 6: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

Thereisanewecosystemtounderstandandtapinto

(asappropriateanduseful)

Page 7: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

GrowinguseofICTintheProgramCycle

Repor.ng,Sharing,Learning

Evalua.on

Implementa.on&Monitoring

Planning

Datacollec.onResearch

DocumentsharingReal-.medata

BigdataVisualiza.onsCommunica.on

Diagnosis

Page 8: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

Buy?Build?Whoismakingdecisionswiththedata?

Privacy?Context?Extrac.on?Ethics?

Howtogetbeyondmobiledatacollec.on?

But…HypevsReality

DataDashboards!

BigData!

Mobiledatacollec.on!

Biggapsincapacity.Resistance.

Sensorsand“InternetofThings!”

How?Why?When?touse

ICTs?

Areagenciesnimbleenoughtousereal-.me

data?

Real-.meData!

BeneficiaryFeedbackLoops!

Where’stheevidenceforICTin

M&E?

Page 9: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

So,howcanICTstrengthenevalua.on?

Page 10: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

Datacollec.on

Structureddatagathering

Decentralizeddatagathering

Data‘harves:ng’

‘Real-:me’data

Page 11: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

New&MixedMethods

Constructvalidity

ComplexityEvalua:on

Mul:-dimensionalindicators

BeBertriangula:on

Page 12: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

Dataanalysis&visualiza.on

‘BigData’&datascienceapproaches

Dashboardsfordecisionmaking

Datavisualiza:ontoshareconclusions

Page 13: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

Equity-focusedevalua.onWideningthebaseforinputvia

mobile

Incorpora:ngreal-:mefeedback

Sharingevalua:onresultswithcommuni:es

Page 14: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

NewChallengesandRiskswithICT-enabledEvalua.on

Page 15: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

Opera.onal/Ins.tu.onal

Highinvestmentinnewdigitalsystems

Technology-drivenprocesses&methods

InsufficientaBen:ontoins:tu:onalchangeprocesses

Page 16: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

MethodologicalSelec:onandsamplebias

Dataqualityandrigor

Validitychallenges

Fallacyoflargenumbers

Extrac:veprocesses

Failuretoiden:fyunintendedconsequences

Page 17: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

EthicalandLegal

Changingnatureofprivacyrisks

Datarightsandownershipofpersonaldata

Decisionsmovingawayfromtheground

LiBleevidenceonICTandM&E

Page 18: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

12Tips

Page 19: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

TipsforICTandM&E1. Start with a high-quality M&E plan

2. Ensure design validity

3. Determine whether and how new ICTs can add value to your M&E plan

4. Select or assemble the right combinaEon of ICT and M&E tools

5. Adapt and test the process with different audiences and stakeholders

6. Be aware of different levels of access and inclusion

Page 20: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

TipsforICTandM&E7. Understand moEvaEon to parEcipate, incenEvize

8. Review/ensure privacy and protecEon measures, risk analysis

9. Try to idenEfy unintended consequences of using ICTs in the evaluaEon

10. Build in ways for the ICT-enabled evaluaEon process to strengthen local capacity

11. Measure what maVers – not what a cool ICT tool allows you to measure.

12. Use and share the evaluaEon learnings effecEvely through social media.

Page 21: Informa.on and Communica.on Technologies (ICT) in Evalua ... · Emerging Opportunies Informa.on and Communica.on Technologies (ICT) in Evalua.on Prac.ce Linda Ra(ree, Independent

[email protected]

Thankyou!

mailto:[email protected]?subject=

Recommended
Evalua.on(of(the(Surface(Climate(Fields(in(the(NARCCAP ...9.Evalua(on.of.the.simulated. interannual.variability.in.terms.of.the.bias,. normalized.by.the.interannual.variability.of.

Evalua.on(of(the(Surface(Climate(Fields(in(the(NARCCAP ...9.Evalua(on.of.the.simulated. interannual.variability.in.terms.of.the.bias,. normalized.by.the.interannual.variability.of.

Documents

Pearl Mussel Project...Further informa.on please contact: Pearl Mussel Project | Bell Height | Kenmare | County Kerry | IRELAND L: 064 6640685 | M: 086 8510292 E: info@pmproject.ie

Pearl Mussel Project...Further informa.on please contact: Pearl Mussel Project | Bell Height | Kenmare | County Kerry | IRELAND L: 064 6640685 | M: 086 8510292 E: [email protected]

Documents

Using big data in prac.ce: Computaonal infrastructuresBig Data • Defined as Vs – Volume: Just about size, Giga, Tera, Petabytes – Variety: Formats, text, databases, pictures,

Using big data in prac.ce: Computaonal infrastructuresBig Data • Defined as Vs – Volume: Just about size, Giga, Tera, Petabytes – Variety: Formats, text, databases, pictures,

Documents

Evalua.on of Composted Poultry Manure & Potassium as Plant ...

Evalua.on of Composted Poultry Manure & Potassium as Plant ...

Documents

Happy Marriage - Belgium Testing Days - Huib Schoots Marriage...The,7,principles,of,Context'driven,Tes.ng, 1. The,value,of,any,prac.ce,depends,on,its,context., 2. There,are,good,prac.ces,in,context,,but,there,are,no,best,

Happy Marriage - Belgium Testing Days - Huib Schoots Marriage...The,7,principles,of,Context'driven,Tes.ng, 1. The,value,of,any,prac.ce,depends,on,its,context., 2. There,are,good,prac.ces,in,context,,but,there,are,no,best,

Documents

Introduc.on Key areasfiles.ctctcdn.com/b24c98a5301/29844d6e-a5ee-4c21... · Circular 230 Issues • Loving case – Tax returns not prac.ce – Anyone can get a PTIN – IRS response-

Introduc.on Key areasfiles.ctctcdn.com/b24c98a5301/29844d6e-a5ee-4c21... · Circular 230 Issues • Loving case – Tax returns not prac.ce – Anyone can get a PTIN – IRS response-

Documents

Effect of Informa.on Availability on Stability of Traffic Flow: … · 2017-07-28 · • The propaga.on of informa.on within the vehicular network is similar to the • Transport

Effect of Informa.on Availability on Stability of Traffic Flow: … · 2017-07-28 · • The propaga.on of informa.on within the vehicular network is similar to the • Transport

Documents

Págico: Evalua.ng(Wikipediabased ( informa.on(retrievalin ... · Evalua.ng(Wikipediabased (informa.on(retrievalin(Portuguese ... - culin´aria 5 3,33 1008 3,10 57 2,85 15 2,24 63

Págico: Evalua.ng(Wikipediabased ( informa.on(retrievalin ... · Evalua.ng(Wikipediabased (informa.on(retrievalin(Portuguese ... - culin´aria 5 3,33 1008 3,10 57 2,85 15 2,24 63

Documents

Diagnosis of Convec.ve Organiza.on and Cold Pools … · Diagnosis of Convec.ve Organiza.on and Cold Pools using ARM Datasets and Evalua.on of UNICON Daehyun Kim1, Wei-Yi Cheng1,

Diagnosis of Convec.ve Organiza.on and Cold Pools … · Diagnosis of Convec.ve Organiza.on and Cold Pools using ARM Datasets and Evalua.on of UNICON Daehyun Kim1, Wei-Yi Cheng1,

Documents

By#Edgar#Allan#Poe# - docs.voanews.eu · Lesson$Elements$ Prepare$ Present$ Prac.ce$ Self9Evaluate$ Expand$ Prepare$ Students!benefit!from!knowing!some!of!the!key! words!of!the!story!before!they!begin!reading.!

By#Edgar#Allan#Poe# - docs.voanews.eu · Lesson$Elements$ Prepare$ Present$ Prac.ce$ Self9Evaluate$ Expand$ Prepare$ Students!benefit!from!knowing!some!of!the!key! words!of!the!story!before!they!begin!reading.!

Documents

On#Using#Informa.on#Retrieval#for#the#Selec.on#&# Sensi ...cs-sys-1.uis.georgetown.edu/~sz303/sigir2014-pir-workshop/proceed… · On#Using#Informa.on#Retrieval#for#the#Selec.on#&##

On#Using#Informa.on#Retrieval#for#the#Selec.on#&# Sensi ...cs-sys-1.uis.georgetown.edu/~sz303/sigir2014-pir-workshop/proceed… · On#Using#Informa.on#Retrieval#for#the#Selec.on#&##

Documents

Developmental Evalua.on Toolkit - Collaboration for Impact · Developmental Evalua.on Toolkit Prepared as part of the developmental evaluaon of the Victorian Children & Youth Area

Developmental Evalua.on Toolkit - Collaboration for Impact · Developmental Evalua.on Toolkit Prepared as part of the developmental evaluaon of the Victorian Children & Youth Area

Documents

Why You Want to Practice BDD - iDIA Computingidiacomputing.com/pub/Why You Want to Practice BDD.pdf · 2019. 7. 24. · Why You Want to Prac.ce Behavior Driven Development Even Though

Why You Want to Practice BDD - iDIA Computingidiacomputing.com/pub/Why You Want to Practice BDD.pdf · 2019. 7. 24. · Why You Want to Prac.ce Behavior Driven Development Even Though

Documents

YARO PODCAST - Amazon S3a blog, growing an email list, and then selling your own digital informa.on product. My guest today is Tien Chiu who is in fact one of my students. She is in

YARO PODCAST - Amazon S3a blog, growing an email list, and then selling your own digital informa.on product. My guest today is Tien Chiu who is in fact one of my students. She is in

Documents

Manual&vacuum&aspira.on:&aservice&evalua.on.& …...Manual&vacuum&aspira.on:&aservice&evalua.on.& Dr.J.Chester, 1&Miss&M.&Shehmar.2 1.&Good&Hope&Hospital,&Su?on&Coldfield.&2.&Birmingham&Women’s&Hospital,&Birmingham.&

Manual&vacuum&aspira.on:&aservice&evalua.on.& …...Manual&vacuum&aspira.on:&aservice&evalua.on.& Dr.J.Chester, 1&Miss&M.&Shehmar.2 1.&Good&Hope&Hospital,&Su?on&Coldfield.&2.&Birmingham&Women’s&Hospital,&Birmingham.&

Documents

Computer Informa.on Systems · 2017. 3. 28. · Hardware and Soware • Hardware – physical components used to collect, input, store, and process data, and to display and distribute

Computer Informa.on Systems · 2017. 3. 28. · Hardware and Soware • Hardware – physical components used to collect, input, store, and process data, and to display and distribute

Documents

You may have already been to my site, but if you …...Administra.on: Everything you need to know to improve your prac.ce. I have provided this module in mul.ple formats. You can watch

You may have already been to my site, but if you …...Administra.on: Everything you need to know to improve your prac.ce. I have provided this module in mul.ple formats. You can watch

Documents

Young King Marketing Guide 21July16 - arTour | Home King... · Slingsby's The Young King Marke/ng Guide Further informa.on please contact: Jodi Glass Execu.ve Producer Slingsby Email

Young King Marketing Guide 21July16 - arTour | Home King... · Slingsby's The Young King Marke/ng Guide Further informa.on please contact: Jodi Glass Execu.ve Producer Slingsby Email

Documents