The Measuring Success Project

March 21, 2014J.Billman, P.J. Lundgren, S. Brown

Purpose of the Project

• To ‘Practice what we preach’• To address 3 key questions:

Who are we? What do we want to do? IDENTITY

How are we organized? STRUCTURE

What are we actually doing? FUNCTION

Project Overview Part A: Analysis of organization’s

archived records Part B: Interviews with founding

membersPart C: Wilder Collaboration Inventory SurveyPart D: Interviews with current participants

Findings: Part A

• Analysis of historical documents revealed the higher order themes of

IDENTITYSTRUCTUREFUNCTION

Findings: Part CThe results of the Wilder Collaboration Inventory Survey identified potential areas for growth in the areas of Process & Structure and Purpose

OPPORTUNITIES FOR GROWTH

FACTORS FACTOR AVERAGE

Development of clear roles and policy guidelines 2.5

Concrete, attainable goals and objectives 2.8

Findings: Part B & D Conducting Interviews

• Interviews with founding members and current participants were conducted– 9 interviews with founding members– 10 interviews with current participants

• Interview transcripts were shared with interviewees to ensure accuracy

Findings: Parts B & DInterview Questions: Historical

• What motivated you to become involved in the Consortium?

• What did you expect to contribute to the Consortium?

• What did you expect to receive from the Consortium?

• In your own words, state the original purpose of the Consortium.

Findings: Parts B & DInterview Questions: Current

• The Wilder Collaboration Inventory scale revealed strong agreement in shared vision and unique purpose. An area of opportunity for improvement pointed out is the factor “concrete, attainable goals and objectives.” What are your thoughts on this as we move forward?

• The Wilder Collaboration Inventory Scale revealed strong agreement in mutual respect, understanding, and trust. An area of opportunity for improvement pointed out is the factor “development of clear roles and policy guidelines.” What are your thoughts on this as we move forward?

Findings: Part B & DCoding Interview Transcripts

• Interview transcripts were coded by a team of individuals (minimum 3) for references to each of the 3 higher order themes: Identity, Structure, Function

• Consensus was required for all coding • Coded data was uploaded into Nvivo, a

Computer Assisted Qualitative Data Analysis Software program (CAQDAS)

NVivo: Data AnalysisTransfer Coded Data into Nodes

• Identity: We are ________• Identity Current Perspective• Identity Historical Perspective

• Function: We _____ • Function Current Perspective• Function Historical Perspective

• Structure: Roles/Responsibility/Internal Organization

• Structure Current Perspective• Structure Historical Perspective

e.g.teachers

e.g.teach

Nvivo: Word Frequency QueriesIdentity

Historical Perspective Current Perspective

Key Theme: Is the Consortium a provider of services to external agencies?Key Theme: What is the role of collaboration in the Consortium? (internal/external)

Nvivo: Word Frequency QueriesFunction

Current PerspectiveHistorical Perspective

Key Theme: Where does measurement fit into the Consortium’s function?Key Theme: How can the Consortium make volunteering meaningful for participants?

Nvivo: Word Frequency QueriesStructure

Historical Perspective Current Perspective

Key Theme: Structure was not a key focus at the beginning.Key Theme: Roles need to be clearly defined.

So . . . What next?