Join Together Advisory BoardJoin Together Advisory BoardEvaluation Team ReportEvaluation Team Report
Donna MertensDonna MertensKatrina BledsoeKatrina Bledsoe
Heidi HolmesHeidi HolmesPauline GinsburgPauline Ginsburg
ACE-DHH ConferenceACE-DHH ConferenceDenver, ColoradoDenver, Colorado February 2006February 2006
Join Together Evaluation TeamJoin Together Evaluation TeamObj 1.1 Obj 1.1 Tom and Tom and Karen and Karen and Heidi Heidi HolmesHolmes
Obj Obj 1.2/2.3 1.2/2.3 Shelly, Shelly, Maribeth, Maribeth, Liz & Liz & Karen & Karen & Katrina Katrina BledsoeBledsoe
Obj 2.1 Obj 2.1 Dave Nanci Dave Nanci & Pauline & Pauline GinsburgGinsburg
Obj 1.4 Kate Obj 1.4 Kate & Pamela; & Pamela; Obj 2.2 Obj 2.2 Susan & Susan & Brenda;Brenda;
Obj 1.3 Obj 1.3 Joyce & Joyce & Sharon & Sharon & KatrinaKatrina
Obj 2.4 John Obj 2.4 John Sandy AND Sandy AND Donna Donna MertensMertens
Yr 2 Evaluation Team Yr 2 Evaluation Team
John McLaughlin & John McLaughlin & Donna MertensDonna Mertens
Assessment SurveyAssessment Surveywww.Deafed.netwww.Deafed.net evaluationevaluationOn-going TTL On-going TTL consultationconsultationTTL SurveyTTL SurveyYear 2 report Year 2 report
WWW.DEAFED.netWWW.DEAFED.net
MethodsMethods Online surveyOnline survey Treasure Hunt (Heidi Holmes)Treasure Hunt (Heidi Holmes)
And the results are…And the results are…
What is your primary status in terms of What is your primary status in terms of deaf education? (results from deaf education? (results from
deafed.net survey)deafed.net survey)
0
5
10
15
20
25
30
35
Undergraduatestudent
PreK-12 teacher Faculty
Percent
How often do you visit How often do you visit www.deafed.net?www.deafed.net?
0
5
10
15
20
25
30
35
40
45
Almosteveryday
Aroundonce amonth
Not untiltoday
Percent
How often do you use the following How often do you use the following features of www.deafed.net? features of www.deafed.net?
0
5
10
15
20
25
30
35
40
45
post jobopportunities
for yourschoo...
postdocuments
coveringsubjects of i...
submit aresponse to
BulletinBoards
view streamedVirtual Topical
Seminars
searchscholarship
opportunitiesfor ...
change yourpassword
almost everyday once wk once mo few times yr not until today never
Most frequently used featuresMost frequently used features
Job searchJob search Post/search for documents of interestPost/search for documents of interest Read Bulletin Board entries; respond to Read Bulletin Board entries; respond to
BB threadsBB threads Visit Help and FAQ areasVisit Help and FAQ areas Search calendar of eventsSearch calendar of events Communication with team membersCommunication with team members
Rate the following features in terms of ease of useRate the following features in terms of ease of use
05
1015202530354045
Loginprocedure
Posting jobs Viewing VirtualTopical
Seminars
Best Better Average Improve Not used
Recommended ImprovementsRecommended Improvements ““Mostly very happy; items barely Mostly very happy; items barely
mentioned: accessing bulletin boards & mentioned: accessing bulletin boards & findings what I’m looking for”findings what I’m looking for”
““Quality of documents”Quality of documents” ““Remember my password; login Remember my password; login
frustration; internal links broken”frustration; internal links broken” ““Post choice entry; post documents”Post choice entry; post documents” ““Too much text; make it friendlier & more Too much text; make it friendlier & more
transparent – e.g., change ‘documents’ to transparent – e.g., change ‘documents’ to ‘Resources and suggestions for teacher’”‘Resources and suggestions for teacher’”
Best ExperiencesBest Experiences
““It is wonderful to have a one-stop point of It is wonderful to have a one-stop point of reference to refer people to. I feel like it is the reference to refer people to. I feel like it is the BEST place to go for anyone interested in deaf BEST place to go for anyone interested in deaf education. We've needed something like this for education. We've needed something like this for a long time. I'm proud of our collective work to a long time. I'm proud of our collective work to bring the site to fruition and continue to refine it.”bring the site to fruition and continue to refine it.”
““Finding other teachers of the deaf and making Finding other teachers of the deaf and making connections. It's a wonderful resource!!”connections. It's a wonderful resource!!”
““Working with Michelle Hoversten. She is always Working with Michelle Hoversten. She is always
positive, very helpful and personable.” positive, very helpful and personable.”
Year 2 ReportYear 2 Report
Reporting Form Changed by US Reporting Form Changed by US Department of EducationDepartment of Education
Survey of TTLs and Interviews with Project Survey of TTLs and Interviews with Project leadersleaders
Review of Review of www.deafed.netwww.deafed.net Project leaders and evaluator met for 2 Project leaders and evaluator met for 2
days to construct the first draft of the days to construct the first draft of the report – followed by electronic report – followed by electronic communicationscommunications
Report is now at www.deafed.netReport is now at www.deafed.net
1. Project Objective - Topical Team 1.1 Technology Infrastructure: Create an efficient collaborative network of consortium members (CM), institutes of higher education (IHE), State educational agencies (SEA) and local educational agencies (LEA) that results in empirical evidence regarding the impact of Web-based video conferencing (VC) to reform d/hh teacher preparation.
1.b. Performance MeasureMeasure
Type Quantitative Data
Increase number of JT members who use Web-based video conferencing technology (WBVCT).
Project Target Actual Performance Data
Raw Numb
er Ratio %
Raw Numbe
r Ratio %
25 /
42 /
170%
1.c. Performance MeasureMeasure
Type Quantitative Data
Increase the number of technology and software alternatives evaluated for a Virtual Professional Development School (VPDS).
Project Target Actual Performance Data
Raw Numb
er Ratio %
Raw Numbe
r Ratio %
2 /
7 /
350%
1.d. Performance MeasureMeasure
Type Quantitative Data
Increase the amount of technical assistance provided to the JT community.
Project Target Actual Performance Data
Raw Numb
er Ratio %
Raw Numbe
r Ratio %
500 /
1,120 /
224%
Year 2 report included Goals for Year 2 report included Goals for Year 3Year 3
Each TTL has established goals that include Each TTL has established goals that include dissemination and measurement of effects of dissemination and measurement of effects of grant related activitiesgrant related activities
Priorities established:Priorities established: Engagement with deaf community strengthenedEngagement with deaf community strengthened Video based products captionedVideo based products captioned Research teams supported by evaluation teamResearch teams supported by evaluation team
Quarterly reportsQuarterly reports
TTLs interviewed re: accomplishments, TTLs interviewed re: accomplishments, challenges, support needs, spin offs; Project challenges, support needs, spin offs; Project leadership interviewed.leadership interviewed.
Document reviews: Executive Advisory Board Document reviews: Executive Advisory Board and TTLs phone conference minutes; TTL and TTLs phone conference minutes; TTL postings to postings to www.deafed.netwww.deafed.net ; review of email ; review of email records re: cyber mentors and master teachers.records re: cyber mentors and master teachers.
Evaluation team supporting research of project Evaluation team supporting research of project teamsteams
Synergy Synergy
Teams are working togetherTeams are working together Year 3 represents synergy of teams Year 3 represents synergy of teams
toward achievement of overall toward achievement of overall Join Join TogetherTogether goals goals
Sustainability is a major issueSustainability is a major issue Any chance for voice recognition software Any chance for voice recognition software
to provide real time captioning for video to provide real time captioning for video conferences?conferences?