UCB i190 Spring 2014 ICTD in Practice_Lect23_final_23apr14

transcript

i190 Spring 2014: Information and Communications Technology for Development (ICTD) in Practice

University of California Berkeley, School of Information

LECTURE 23: 23 Apr 2014

Instructor: San Ng (www.sanng.com)

Class Website: i190spring2014.sanng.com

Our Core Values Open, collaborative, inclusive, community

Share class resources (especially) with developing world

Ideas and innovation in learning AGILE method of teaching/learning Learning in all directions (not just instructor to

students) failure ok

Tech Curious Walk the talk- try technology and social networks,

see what sticks FUN and interesting WHAT ABOUT YOU?

Course Revisit: 190 Framework Conceptual

Week1: Introduction to Course W2: What is Development? W3: What is ICTDW4: Who Does What in Practice? Mapping the ICTD Landscape

i190ICTD in

Practice: Core Skills

Technical (eApplications)

W5: Overarching Issues of eApplications W6: Infrastructure, Telecenters, Agriculture,W7: Revisiting Agriculture,, W8 : e-Health, EducationW9: eGovernance Microfinance

Management

W10: BreakW11: Intro to Project Management Planning and Assessment W12: Budgeting, Scheduling, Fundraising W13: Implementation W14: Monitoring and Evaluation/ Next Cycle W15: Final Projects & Wrap Up

What Is International Development Especially watch the second (later in time)

TED Talk

•http://www.ted.com/talks/hans_rosling_shows_the_best_stats_you_ve_ever_seen.html

•http://www.ted.com/talks/hans_rosling_reveals_new_insights_on_poverty.html

Theories of International Development

Liberalism

Modernization

Neo-Liberalism

Dependency

Critics of Liberalism

Globalization

???!!!!!

Post-Modernization

Civil Society

Gender Based

Sustainable development

Rights Based ApproachesDevelopment as Freedom

Institution

Theories of International Development

Liberalism

Modernization

Neo-Liberalism Dependency

Critics of Liberalism

Globalization

Post-Modernization

Civil Society

Gender Based

Sustainable development

Rights Based Approaches

Development as Freedom

Institutions

A Very Simple FrameworkMARKET STATE/

PEOPLE

Measurement of International Development: See list of broad indicators listed in Wikipedia and read The Guardian, How would you measure development progress?

•http://www.ted.com/talks/hans_rosling_reveals_new_insights_on_poverty.html

•Some typical index/indicators:

•Well Being ? Happiness?

Measurement of International Development

GDP, GINI, Mortality Rate, Population, Education, Security, etc, etc, etc, etc…

Mortality vs Population?

In Practice, mainly:

• Human Development Index (HDI)http://hdr.undp.org/en/statistics/hdi

• World Bank’s World Development Indicators (WDI)http://data.worldbank.org/indicator/all

Does International Development Work?

Does International Development Work? Review books listed here by visiting links: http://blog.sanng.com/2010/08/does-international-development-aid-work.html

Careers in International Development

Development Career and Jobs:Sign up (for free) for www.devex.com, one of the major development and job hubs. Then read ABC of development jobs and Career transitions: How to figure out if an aid job is right for you

Theories of ICT4D (Some Distinctions First: Technology vs ICT)

Good Ol’ Development Theory from Development Studies, including new concepts such as Globalization & Knowledge Societies? (Unwin)

Theories of ICT4D

State of ICT4D Theories (Articles: Heeks? Unwin? Raita? Wikipedia?)

• From what disciplines? • Development Studies? Governance? Knowledge

Societies?

• Criticisms of current state of literature

• Relevance to us?

Theories of ICT4D

•From what disciplines?

History and Future ICT4D

-Origins?

-ICT4D 0.0-1.0-2.0

-ICT4D 2.0- Priorities?- Innovation Models?- Implementation Changes? - Theories/Worldviews?

-What would YOU recommend?

History and Future ICT4D

History and Future ICT4D- Teaching ICTD

From Heeks, 2009 From i190, 2014

ConceptualWeek1: Introduction to Course W2: What is Development?

W3: What is ICTDW4: Who Does What in Practice? Mapping the ICTD Landscape

ICTD in Practice: Core SkillsTechnical

(Applications)W5: Overarching Issues of Technical Applications W6: Infrastructure, Telecenters, Agriculture, W7: Health, Education, Microfinance W8: Governance and Law

ManagementW9: Intro to Project Management W10: BreakW11: Planning and Assessment W12: Budgeting, Scheduling, Fundraising W13: Implementation W14: Monitoring and Evaluation/ Next Cycle

Does ICT4D Work?

Courtesy of Inveneo: http://www.flickr.com/photos/inveneo/6252235953/in/photostream/

Heeks, 2002 (http://ictlogy.net/bibliography/reports/projects.php?idp=199)

Does ICT4D Work?

http://failfaire.org

Mapping the Stakeholders in ICT4D

Multilaterals and Governments:

Civil Society:

Private Sector:

Here is the final mapping from the spreadsheets: https://mapsengine.google.com/map/edit?mid=zaN1njwon8jM.kzggt23tlaow

i190 Framework Conceptual

i190ICTD in

Management

Overarching Issues

Trends/Buzzwords in ICTD and e-Application

BOPRights Based Approaches

Digital Divide

ICTD Policies Innovation

Appropriate Technology

Open Everything (development, data, etc)

Web 3.0

Big Everything

Convergence

Mobile Mobile Mobile

Social enterprise

ICTD Policies

•Broad Categories of Policy APC, ICT Policy Handbook

•ICTD Policy in Practice Lessons Learnt in ICT4D Policy Making

• How is it done ? In content and institutionally?

• What are the lessons learned?

•What is the BOP concept? The Fortune at the Bottom of the Pyramid (BOP)• •How is it like in practice? ICT4D: The Bottom of the Pyramid Model in Practice”.

• What is the project?

• What worked or didn’t work?

• What are recommendations?

Appropriate Technology and Innovation

•What are some of your suggestions/predictions for innovation and appropriate technology?: Heeks, The ICT4D 2.0 Manifesto: Where Next for ICTs and International Development?

Openness

•What is it?!

•What is good about it?

•What is not so good about it?

ICT in Agriculture •Skew of disciplinary research (econ, ethnographic, ENR, energy, geog…etc)

•Jensen work: - neat econ study:

• People:=only 2• Tech: = 1 function• Welfare= income

•Burrell et al. – making a mess: • Other players:/relationships

auctioneer, fish waste vendor, gender etc

• Tech: lots of other usage • Context: n/s, types of terrain, boards• Welfare= WAY more than income

•Can it be generalized then? •What to do in practice?

• Be cognizant of debates• Local context• Don’t start with tech • Same old foundational factors in

design and implementation• Usually dynamic, changing, needs,

messy, ‘it’s complicated’

Heeks, ICTD 2.0

ICT in Infrastructure

Inveneo.org

Eric Brewer, The Challenges of Technology Research for Developing Regions

Telecenters, Shared Access and Libraries

http://gurstein.wordpress.com/2013/11/16/beyond-access-libraries-as-the-new-telecentres/

ICTD and Education: Theories continued

Traditional Dev Theories (loosely: market, growth, top down)

Alternative Dev Theories(loosely: state, rights, bottom up)

Trends in i-, e-, m-, blended-. etc-Education

“leap frog e-learning through m-learning”.

•Differences within the field: ICT for education, distance learning, elearning, m-learning, blended learning

•A new fad? But a new fad that can make a difference?

E-Health

•What is it?

•eHealth solutions & strategic coordination

•What are some trends, in developed, transitioning and developing countries?

• Forever-pilot pattern and lessons learned?

Introductions, trends and lessons learned: Implementing e-Health in Developing Countries Pg7-14, 22-23, 27-28, 31-39Get an overview of how an actual e-health project design looks like: e-health portal in Dwesa, pg 7-15

eGovernance- what works and not?

•What is eGovernance?

•What is the Framework being used to measure?

•What are the results of this case study?

Success and Failure Factors for e-Government projects implementation in developing countries

eGovernance

Microfinance & Mobile Banking•What is Mobile Banking?

•Different trends/pace in different countries- regulations, technologies, leadership,

•Issues: Trust, Fraud/attacks, Motivation of savings/accumulation, Behavior change, cultural values about money,

•What works, and not? Reasonable Project Time, Building trust, managing expectations, values/behavior changing, needs assessment important

i190 Framework Conceptual

i190ICTD in

Management

Introduction to Project Management•Review of Course (Conceptual, Technical- see slide pack from last class)What are some themes within the lessons learned?

•How is ICTD project management similar and different to traditional development project management? (theories)

•Life Cycle and Management Approaches

•How can we apply management tools to address the lessons learned?

Introduction to Project Management

•How is ICTD project management similar and different to traditional development project management? (theories)•Life Cycle and Management Approaches

Planning

Initiation

Implementation

Monitoring & Evaluation

Next Phase? Transformation?

•What are some themes within the lessons learned from last parts of course?•How can we apply management tools to address the lessons learned?

Introduction to Project Management: Planning

Introduction to Project Management: Planning (cont’d)

Initiation

Introduction to Project Management: Initiating

Implementation

Introduction to Project Management: Initiating (cont’d)

Introduction to Project Management: Implementation

Introduction to Project Management: Monitoring & Evaluation

Introduction to Project Management: Transformation

Planning

Initiation

Implementation

Planning- Needs Assessment•What are the general steps in Planning?

• Planning & Methodology Design• Data Collection• Analysis• Possible Solutions • Recommendations

• (then to Initiating Phase: Project Design etc.)

Planning- Needs AssessmentCase study: Agri-Supply Chain Project Proposal - help Ruchita plan her upcoming needs assessment (Goal a.). For background information about the issues, Read Pg 6-8 of Indian School of Business, Inefficiencies in agriculture supply chain in Punjab and opportunities for IT interventions and see especially Fig 3.1. Levels Question

sSources of Data

Collection Methods

Analysis Tools

Challenges/Solutions

Strategic

Tactical

Operational

Initiating- Proposal Development: Overview

Initiating- Proposal Development: Project Design

Initiating- Proposal Development: Project Design Case Study

A needs assessment to identify the reality of two rural school cases in South Africa: Potential for ICT4D or not? Also visit website generally: (http://siyakhulall.org/) Based on this Needs Assessment, we will be developing a mini-proposal for the next phase of this project, specifically for the Educational Resource component.

Proposed Logframe and Workplan

Initiating- Proposal Development: Project Design Case StudyProposed Logframe and Workplan

Initiating- Proposal Development: Project Design Case StudyIn Class Exercise to develop a Log Frame

Initiating- Proposal Development: Budgeting and Human Resource Case Study

Planning

Initiation

Implementation

Implementation- Best PracticesCase: ITC e-Choupal: What are the needs/problems that this ICTD project is trying to address?

Implementation- Best PracticesCase: ITC e-ChoupalWhat made implementation successful?•Trust: choice•Meets Needs: Clear Value•Appropriate Tech: Simplicity of technology, new and old tech•Local structures and systems•Incremental Roll out •Mission-based

Implementation-IT requirements/User Design

Case: ITC e-Choupal

Implementation-IT requirements/User Design

Case: ITC e-Choupal

Planning

Initiation

Implementation

Implementation- Complex Environments

Case: Competing for Development (A)Facts:

Case: Competing for Development (B1-6)

Role play exercise: Make the case within your role for the $65,000 investment

Case: Competing for Development (A)•If you were Ghazialam, would you go ahead with the $65,000 investment? What are the key tradeoffs? What would an ‘ideal’ outcome look like?

•(See next slide)

Case: Competing for Development (A)•If you were Ghazialam, would you go ahead with the $65,000 investment? What are the key tradeoffs? What would an ‘ideal’ outcome look like?

Planning

Initiation

Implementation

Different Types of Evaluation and Performance Measurement

Program Level Organization Level Community andSocietal level

WikipediaCase

Evaluation Purpose

Measuring program effectiveness

Determining if a program meets its objectives

*baselinesFormative*ongoing

* feedback* changing

the program

Summative* look at final outcomes

*impacts* cut or keep

OTHER PURPOSES* compliance* legitimacy* certification* lessons learned* check for unintended consequences* benchmarking * more money* white wash and eye wash p* kill a project

* political attack

* new opportunities

* protection and self interest

* melt down indicators

EVALUATION CHECK LIST

WHEN IS EVALUATION WORTH DOING?

* Who Wants This and What Decision Do They Want to Make?(lessons learned)

* Are the Impediments Manageable?(resources, objectives, agreement, special issues)

* Is there Political Support?(general support)

THE REGULAR COMPONENTS OF THE EVALUATION PROCESS* Purpose and Objectives

* Indicators

* Design

* Data and Utilization

* Problems

EVALUATION ACTOR MAPPING

BOARDOR LEGISLATORS

OTHERSTAFFOR DEPTS.

TOP MGMT

PROGRAMPARTICIPANTS

PROGRAM STAFF

PRESS ORCOMMUNITY

DONORS

MIDDLEMGMT.

OUTSIDERSFOR TEACHINGPURPOSES

RANGE OF INDICATORS

FEELINGS DO YOU TRUST THESE

INPUTS PEOPLE/

PROCESS involvement/coordination

OUTCOMES(INTERMEDIATE) INCREASED INCOME(FINAL) X LEVEL OF CONTANIMATION

EFFICIENCY AND PRODUCTIVITY lbs. Of fish/$ $/lbs. Of fish

SPAN AND SCOPE OF COVERAGE % target population served

SATISFACTION customer satisfaction/ commercial

IMPACTS (sustainable) measurable change/ broader/ (PROGRAM CAUSED OUTCOME) longer term

* HOW WOULD YOU ASSURE THAT YOURRESULTS WERE VALID AND RELIABLE?

RELIABLITY-- DO YOU GET THE SAME RESULTTIME AFTER TIME.

VALIDITY-- UNBIASED COMPARED TO A STANDARD

Using Evaluation Results-- Style Differences

Academic Style* Slow

* Scientific Method

* Clear Objectives

* Careful Study

* Written Communication

* Precision

* Academic Reference Group

Managerial Style* Pressure to Decide

* Many Simultaneous +Fragmented Tasks

* Competing Objectives

* Action

* Verbal Communication

* Incomplete Date

* Managerial Reference Group

PROBLEMS

* TIME * VERY RIGOROUS * IRRELEVANT

* FORMAT * NOT RIGOROUS * COMMUNICATION

Some of the More Common Methods

* Balanced Score Cards and Other Overall General Assessments

* Goals vs. Performance and also Cost and Efficiency

* Outcome Assessment

* Benchmarking

* Best Practice

* Rapid Assessment Tools (quicker and dirtier rather than deeper)

* More based on sampling than 100% study

DATA COLLECTION METHODS* General Statistical Analysis

* Cost Benefit/ Rates of Return

* Simulations

* Content Analysis

* Record Reviews

* Unobtrusive Measures

* Group Observation

* Surveys and Testing

* Personal Interviews

* Participation Observation

* Case Studies

LESSINTRUSIVE

MOREINTRUSIVE

THE ETERNAL TRIANGLE

Precision

Cost Complexity

Measureable Indicators

Types of Data needed

Data Collection Methods/Frequency for M&E

Overriding Goal

Objectives (at least 4)

Instructions: Everyone was pleasantly shocked by these successful results. However, the founder Jimbo Wales intuitively knows that the number of articles per se does not measure Wikipedia's success completely, especially since Wikipedia began with a completely different set of goals/activities and became 'successful' only organically. He wants to hire you to determine a sound methodology to evaluate Wikipedia's success. He wants you to design a Logical Framework for Wikipedia (based on what we already learned in class), with indicators he can measure to determine Wikipedia progress and success. He has given us a sample template that we will discuss and brainstorm in class:

Course Wrap Up: 190 Framework Conceptual

i190ICTD in

Management