1
EdReports.orgQualityInstructionalMaterialsTool:EnglishLanguageArts3-8ReviewToolContents
TableofContentsAboutEdReports.org.................................................................................................................................................................................................................2AboutThisTool.........................................................................................................................................................................................................................3
InstructionsforConductingHighQualityReviews.................................................................................................................................................5UsingtheToolandToolkit:ReferenceMaterialstoSupportQualityReviews........................................................................................................................5HowtoApplyRatingsUsingtheEvaluationToolin4Steps....................................................................................................................................................6BackgroundInformationofReviewedMaterials...................................................................................................................................................................10Gateway1:TextQualityandComplexityandAlignmenttotheStandardswithTasksandQuestionsGroundedinEvidence................................................11
ReviewersusedatarecordedinRatingSheets1.1-1.3todeterminetheoverallratingforgrade3-5materials.........................................................................14ReviewersusedatarecordedinRatingSheet2.1todeterminetheGateway2overallrating....................................................................................................16
Gateway2:StrategyandPurpose........................................................................................................................................................................................16RatingSheet3.1:UseandDesigntoFacilitateStudentLearning...............................................................................................................................................17RatingSheet3.2:TeacherPlanningandLearningforSuccesswithCCSS...................................................................................................................................18ReviewersusedatarecordedinRatingSheets3.1-3.5todeterminetheGateway3overallrating.............................................................................................22
GatewayGateway3:StructuralSupportsandUsabilityIndicators........................................................................................................................................223a-e:UseandDesigntoFacilitateStudentLearning.....................................................................................................................................................................223f-j:TeacherPlanningandLearningforSuccesswithCCSS..........................................................................................................................................................223k-n:Assessment...........................................................................................................................................................................................................................223s-w:EffectiveTechnologyUse.....................................................................................................................................................................................................22
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
2
IntroductionTheCommonCoreStateStandards(CCSS),informedbythreedecadesofknowledgearoundlearning,createanunprecedentedopportunitytoimprovestudentachievementnationwide.However,simplyadoptingtheCommonCoreandworkingwithteachersontheinstructionalshifts—asover40-plusstatesaredoing—willnotdirectlytranslateintostudentsuccess.Evidenceindicatesthatinstructionalmaterialshaveasignificanteffectonstudentoutcomes.1AndasHarvard’sRichardElmoreargues,togetinsidetheinstructionalcoreandimprovelearningatscale,itisessentialtogetqualitycontentintothehandsofteachersandstudents.2Ifqualityinstructionalmaterials(e.g.,textbooks,curriculum,digitalresourcesandotherinstructionalcontent)areascriticalastheresearchsuggests,localdecisionsaboutwhatCCSSmaterialstoadoptorpurchasearenowmoresignificantthanever.Publishersareupdatingtheirmaterials,independentcurriculumprovidersarelaunchingandteachersnationwidearegenerouslypublishingtheirownmaterialsforthebenefitofothers.States,districtsandorganizationsalsohavebeendevelopinganddisseminatingCommonCore-alignedlessons.Withsomanynewandrepackagedinstructionalproductsbeingintroducedintoaquicklychangingmarketplace,stateanddistrictleadersandeducatorsneedindependentinformationaboutinstructionalmaterialsinordertomakeinformedpurchasingdecisionsand,overtime,tomovetheneedleonstudentperformance.AboutEdReports.orgOurVision:AllstudentsandteachersintheUnitedStateswillhaveaccesstothehighest-qualityinstructionalmaterialsthatwillhelpimprovestudentlearningoutcomes.
OurMission:EdReports.orgwillincreasethecapacityofteachers,administratorsandleaderstoseek,identifyanddemandthehighest-qualityinstructionalmaterials.Drawinguponexperteducators,EdReports.org’sevidence-basedreviewsofinstructionalmaterialsandsupportofsmartadoptionprocesseswillequipteacherswithexcellentmaterialsnationwide.
OurTheoryofAction:Credibleinformationagainstqualitycriteriainaquicklychangingmarketplacehelpseducatorsmakebetterpurchasingdecisionsandimprovestudentperformance.Identifyingexcellenceandimprovingdemandforcredibleinformationwillimprovethesupplyofqualitymaterialsovertime,leadingtobetterstudentachievementoutcomes.
1G.Whitehurst.“Don’tForgetCurriculum.”BrownCenterLettersonEducation.(Washington,DC:BrookingsInstitute,2009);M.ChingosandG.Whitehurst.ChoosingBlindly:InstructionalMaterials,TeacherEffectivenessandtheCommonCore.(Washington,DC:BrownCenteronEducationPolicyatBrookings,April2012).2RichardElmore,inhisworkontheinstructionalcore,assertsthattherearethreewaystoimprovestudentlearningatscale:(1)raisethelevelofcontentthatstudentsaretaught;(2)increasetheskillandknowledgethatteachersbringtotheteachingofthatcontent;and(3)increasethelevelofstudents’activelearningofthatcontent.R.Elmore.ImprovingtheInstructionalCore(Cambridge,MA:HarvardGraduateSchoolofEducation,2008).
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
3
AboutThisToolEdReports.orgconvenededucatorstodevelopthistooltoprovideeducators,stakeholders,andleaderswithindependentandusefulinformationaboutthequalityofcoreEnglishlanguageartsinstructionalmaterials(whetherdigital,traditionaltextbook,orblended).ExperteducatorswillusethetooltoevaluatefullsetsofinstructionalmaterialsinEnglishlanguageartsagainstnon-negotiablecriteria(seeFigure1).Thistoolbuildsontheexperienceofeducators,curriculumexperts,stateprocesses,andleadingrubricdevelopersandorganizations–suchasAchieve,Inc.,theCouncilofGreatCitySchools,andStudentAchievementPartners,amongothers–thathaveconductedreviewsofinstructionalmaterials,lessons,andtasks.Tocreatetheevaluationtool,EdReports.orgconductedresearchintotheuseofcommonly-usedrubrics,gatheredinputfromeducatorsandEnglishlanguageartsexpertsduringanationwidelisteningtour,interviewedprofessorsofEnglishlanguagearts,developersandpublishersofmaterials,andconvenedanAnchorEducatorWorkingGroup(AEWG).ThetoolmayberefinedbytheAEWGafterthefirstsetofreviewsiscomplete.Thetoolhasthreemajorgateways(seeFigure1)toguidetheevaluationprocess.ReviewerswillapplythethreegatewayssequentiallytoensureEdReports.orgreportstothefieldtheextenttowhichmaterialsareCCSS-alignedandusablebyeducators.ThosematerialsthatmeetorpartiallymeettheexpectationsforGateway1(TextQualityandComplexity,andAlignmenttoStandardswithTasksandQuestionsGroundedinEvidence)willmovetoGateway2(BuildingKnowledgewithTexts,Vocabulary,andTasks).OnlythosematerialsthatmeettheexpectationsforbothGateway1andGateway2willbereviewedinGateway3(UsabilityIndicators).Tosupporteachindicatorrating,reviewersdocumentspecificevidencefromthematerials.
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
4
Figure1:GatewayEvaluationProcessforReviewofEnglishLanguageArtsMaterials(grades3-8)
“Meets”or“PartiallyMeets” “Meets”forGateways1AND2movetoGateway2 movetoGateway3
Gateway 1: Text Quality and Complexity, and Alignment to Standards with Tasks and Questions Grounded in Evidence
Gateway 2: Building Knowledge with Texts, Vocabulary, and Tasks
Gateway 3: Instructional Supports and Other Usability Indicators
Are quality anchor texts at grade level text complexity? Do they represent the rigor and balance addressed in the standards? Are the tasks and questions in reading, writing, speaking, listening, and language aligned to grade level standards? Do they support student learning?
Do materials build students’ knowledge across topics and content areas? Is instruction intentionally and coherently sequenced to build vocabulary? Do questions and tasks build to culminating tasks that demonstrate students’ ability to analyze components of texts and topic?
Does the instructional material support high quality instruction?
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
5
InstructionsforConductingHighQualityReviewsUsingtheToolandToolkit:ReferenceMaterialstoSupportQualityReviewsInadditiontotheEdReports.orgQualityInstructionalMaterialsTool:EnglishLanguageArts3-8,reviewersworkwiththefollowingmaterialsasreferences:
● TheCommonCoreStateStandardsforEnglishLanguageArts,includingAppendices(includingtheRevisedAppendixA)● Publishers'CriteriafortheCommonCoreStateStandardsforEnglishLanguageArts,Grades3-12● Supportmaterialstoidentifytextcomplexityandrigorappropriateforeachgrade● EvidenceGuides(technicaldocumentationsupportindicatinghowtocollectevidence,wheretofindevidenceandreportinginformation)
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
6
HowtoApplyRatingsUsingtheEvaluationToolin4StepsSTEP1:ReviewtheCriteriaandIndicatorsforeachGateway
● EachGatewayconsistsofanumberofCriteriaandIndicators.CriteriainGateways1and2refertoAlignmentandQuality.CriteriainGateway3referstoUsability.
● ReviewersmustprovidearatingaccordingtothescoreoptionsprovidedforeachIndicatorandmustcitemultipleexamplesofspecific,concreteevidencetojustifytherating.Reviewersdocumentevidence,includingpagenumbers,lessonnames,unittopics,etc.,inanevidencecollectiondocument.
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
7
STEP2:RateeachIndicator
● ReviewerswillevaluateinstructionalmaterialsagainsteachIndicatorusingtheappropriateratingscale.● EvidenceGuideswillprovidein-depth“look-fors”foreachcriteriontoguidetheexpertreviewer.EachRatingissupportedwithevidence
fromthematerialsthatspecificallyalignswiththecriteria.
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
8
STEP3:DeterminetheCriterionRating
● AnoverallratingforeachCriterionisdeterminedbyaddingthetotalpointsearnedfromtheCriterion’sIndicators.● OncethetotalfromtheIndicatorsisadded,selecttheRating(e.g.,MeetsExpectations,PartiallyMeets,etc.)basedonwherethepointtotal
falls(seesamplebelow).
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
9
STEP4:DeterminetheFinalGatewayRating
● ThescoringfromeachCriterionisaddedtodetermineafinalGatewayScore.GatewayScoresaredeterminedusingthesameratingscaleasearlier.
SampleGatewayRating
CRITERIA RATINGSCORE EVIDENCEGateway1:TextQualityandComplexityandAlignmenttotheCCSS-ELAHigh-qualitytextsarethecentralfocusoflessons,areattheappropriategradeleveltextcomplexity,andareaccompaniedbyqualitytasksalignedtothestandardsofreading,writing,speaking,listening,andlanguageinservicetogrowliteracyskills.Meetsexpectations(Grade3-5:37-42points;Grades6-8:32-36points)Partiallymeetsexpectations(Grades3-5:21-36points;Grades6-8:18-31points)Doesnotmeetexpectations(Grades3-5:<21points;Grades6-8:<18points)Partiallymeets=ContinuetoGateway2
1a-1f.Textsareworthyofstudents’timeandattention(ofquality,rigorous,andattherighttextcomplexityforgradelevel,student,andtask)
PointTotalsfromRatingSheet(s):
17
1g-1o:Materialsprovideopportunitiesforrichandrigorousevidence-baseddiscussionsandwritingabouttexts.
PointTotalsfromRatingSheet(s):
12
1p-1r:Materialsprovideexplicitandsystematicinstructionanddiagnosticsupportinphonics,vocabularydevelopment,morphology,syntax,andfluency.(Grades3-5)
PointTotalsfromRatingSheet(s):
6
Materialsmust“MeetExpectations”or“PartiallyMeetExpectations”inGateway1tobereviewedinGateway2.Materialsmust“MeetExpectations”inBOTHGateway1andGateway2tobereviewedinGateway3.
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
10
EvaluationToolBackgroundInformationofReviewedMaterials
MATERIALSREVIEWReviewerName:_______________________________________________________________________________________________Date:_________________________________________________________________________________________________________TitleofInstructionalMaterial:____________________________________________________________________________________Grade:________________________________________________________________________________________________________Publisher:_____________________________________________________________________________________________________EditionYear:___________________________________________________________________________________________________Additionalreferences,notes,links:_________________________________________________________________________________
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
11
Gateway1:TextQualityandComplexityandAlignmenttotheStandardswithTasksandQuestionsGroundedinEvidence• Aretextsworthyofstudents’timeandattention(ofquality,rigorous,andattherighttextcomplexityforgradelevel,student,andtask)?• Istherearangeoftasksandquestionstodevelopreading,writing,speaking,listening,andlanguagethatarehighqualityandalignedwith
theappropriategradelevelstandards?• Arequestionsofhighqualityandtextspecifictosupportopportunitiesforrichandrigorousevidence-baseddiscussionsandwriting?• Forgrades3-5,domaterialssupportfoundationalskillsdevelopment?
RatingSheet1.1:TextComplexityandQuality
• For‘TextComplexityandQuality’toattainascoreof‘MeetsExpectations,’materialmustearnatleast18points.
CRITERION INDICATORS RATING EVIDENCETextsareworthyofstudents’timeandattention:textsareofqualityandarerigorous,meetingthetextcomplexitycriteriaforeachgrade.Materialssupportstudents’advancingtowardindependentreading.Earned:_____of20pointsMeetsexpectations
(18-20points)
Partiallymeetsexpectations(10-17points)
Doesnotmeetexpectations(<10points)
1a.Anchortextsareofpublishablequalityandworthyofespeciallycarefulreadingandconsiderarangeofstudentinterests.
024
1b.Materialsreflectthedistributionoftexttypesandgenresrequiredbythestandardsateachgradelevel. 024
1c.Textshavetheappropriatelevelofcomplexityforthegradeaccordingtoquantitativeanalysis,qualitativeanalysis,andrelationshiptotheirassociatedstudenttask.
024
1d.Materialssupportstudents’increasingliteracyskillsoverthecourseoftheschoolyear.(Seriesoftextsshouldbeatavarietyofcomplexitylevelsappropriateforthegradeband.)
024
1e.Anchortextsandseriesoftextsconnectedtothemareaccompaniedbyatextcomplexityanalysisandrationaleforeducationalpurposeandplacementinthegradelevel.
012
1f.Supportmaterialsforthecoretext(s)provideopportunitiesforstudentstoengageinarangeandvolumeofreadingtosupporttheirreadingatgradelevelbytheendoftheschoolyear.
012
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
12
RatingSheet1.2:AlignmenttotheStandardswithTasksandQuestionsGroundedinEvidence• For‘AlignmenttotheStandardswithTasksandQuestionsGroundedinEvidence’toattainascoreof‘MeetsExpectations,’materialmust
earnatleast14points.
CRITERION INDICATORS RATING EVIDENCEMaterialsprovideopportunitiesforrichandrigorousevidence-baseddiscussionsandwritingabouttextstobuildstrongliteracyskills.Earned:____of16pointsMeetsexpectations
(14-16points)
Partiallymeetsexpectations(8-13points)
Doesnotmeetexpectations(<8points)
1g.Mostquestions,tasks,andassignmentsaretext-dependent,requiringstudentstoengagewiththetextdirectly(drawingontextualevidencetosupportbothwhatisexplicitaswellasvalidinferencesfromthetext).
012
1h.Sequencesoftext-dependentquestionsandtasksbuildtoaculminatingtaskthatintegratesskills(maybewriting,speaking,oracombination).
012
1i.Materialsprovidefrequentopportunitiesandprotocolsforevidence-baseddiscussionsthatencouragethemodelinganduseofacademicvocabularyandsyntax.
012
1j.Materialssupportstudents’listeningandspeakingaboutwhattheyarereadingandresearching(includingpresentationopportunities)withrelevantfollow-upquestionsandevidence.
012
1k.Materialsincludeamixofon-demandandprocesswriting(e.g.multipledrafts,revisionsovertime)andshort,focusedprojects,incorporatingdigitalresourceswhereappropriate.
012
1l.Materialsprovideopportunitiesforstudentstoaddressdifferenttexttypesofwritingthatreflectthedistributionrequiredbythestandards.
012
1m.Materialsincludefrequentopportunitiesforevidence-basedwritingtosupportcarefulanalyses,well-defendedclaims,andclearinformation.
012
1n.Materialsincludeexplicitinstructionofthegrammarandconventionsstandardsforgradelevelasappliedinincreasinglysophisticatedcontexts,withopportunitiesforapplicationbothinandoutofcontext.
012
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
13
RatingSheet1.3(Grades3-5ONLY):TasksandQuestions:FoundationalSkillsDevelopment(Grades3-5)• For“TasksandQuestions:FoundationalSkillsDevelopment(Grades3-5)”toattainascoreof‘MeetsExpectations,’materialsmustearnat
least5points.
CRITERION INDICATORS RATING EVIDENCETasksandQuestions:FoundationalSkillsDevelopment(Grades3-5):Materialsinreading,writing,speaking,listening,andlanguagetargetedtosupportfoundationalreadingdevelopmentarealignedtothestandards.Earned:____of6pointsMeetsexpectations
(5-6points)
Partiallymeetsexpectations(3-4points)
Doesnotmeetexpectations(<3points)
1o.Materials,questions,andtasksaddressgrade-levelCCSSforfoundationalskillsbyprovidinginstructioninphonics,wordrecognition,morphology,vocabulary,syntax,andreadingfluencyinaresearch-basedandtransparentprogression.
012
1p.Materials,questions,andtasksguidestudentstoreadwithpurposeandunderstandingandtomakefrequentconnectionsbetweenacquisitionoffoundationskillsandmakingmeaningfromreading.
012
1q.Instructionalopportunitiesarefrequentlybuiltintothematerialsforstudentstopracticeandachievereadingfluencyinoralandsilentreading,thatis,toreadon-levelproseandpoetrywithaccuracy,rateappropriatetothetext,andexpression.
012
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
14
OverallGateway1Rating:TextQualityandComplexityandAlignmenttotheStandardswithTasksandQuestionsGroundedinEvidenceReviewersusedatarecordedinRatingSheets1.1-1.3todeterminetheoverallratingforgrade3-5materials.ReviewersusedatarecordedinRatingSheets1.1-1.2todeterminetheoverallratingforgrades6-8materials.
CRITERIA RATINGSCORE EVIDENCEGateway1:TextQualityandComplexityandAlignmenttotheCCSS-ELAHigh-qualitytextsarethecentralfocusoflessons,areattheappropriategradeleveltextcomplexity,andareaccompaniedbyqualitytasksalignedtothestandardsofreading,writing,speaking,listening,andlanguageinservicetogrowliteracyskills.
Meetsexpectations(Grade3-5:37-42points;Grades6-8:32-36points)
Partiallymeetsexpectations(Grades3-5:21-36points;Grades6-8:18-31points)
Doesnotmeetexpectations(Grades3-5:<21points;Grades6-8:<18points)
Doesnotmeet=doesnotcontinuetoGateway2
1a-1f.Textsareworthyofstudents’timeandattention(ofquality,rigorous,andattherighttextcomplexityforgradelevel,student,andtask)
PointTotalsfromRatingSheet(s):
1g-1n:Materialsprovideopportunitiesforrichandrigorousevidence-baseddiscussionsandwritingabouttexts.
PointTotalsfromRatingSheet(s):
1o-1q:Materialsprovideexplicitandsystematicinstructionanddiagnosticsupportinphonics,vocabularydevelopment,morphology,syntax,andfluency.(Grades3-5)
PointTotalsfromRatingSheet(s):
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
15
Gateway2:BuildingKnowledgewithTexts,Vocabulary,andTasks• Doinstructionalmaterialsbuildstudents’knowledgeacrosstopicsandcontentareas?• Isacademicvocabularyinstructionintentionallyandcoherentlysequencedtobuildvocabulary?• Doquestionsandtasksbuildinrigorandcomplexitytoculminatingtasksthatdemonstratestudents’abilitytoanalyzecomponentsof
textsandtopics?• Arereading,writing,speaking,listening,andlanguageskillstaughtandpracticedinanintegratedmanner?
Ratingsheet2.1:BuildingKnowledge● For“BuildingKnowledge”toattainascoreof‘MeetsExpectations,’materialsmustearnatleast28points.
CRITERION INDICATORS RATING
Materialsbuildknowledgethroughintegratedreading,writing,speaking,listening,andlanguageEarned:_____of32pointsMeetsexpectations
(28-32points)
Partiallymeetsexpectations(16-27points)Doesnotmeetexpectations(<16points)
2a.Textsareorganizedaroundatopic/topicstobuildstudents’abilitytoreadandcomprehendcomplextextsindependentlyandproficiently.
024
2b.Materialscontainsetsofcoherentlysequenced,highqualityquestionsandtasksthatrequirestudentstoanalyzethelanguage,keyideas,details,craft,andstructureofindividualtexts.
024
2c.Materialscontainacoherentlysequencedsetofhighqualitytext-dependentquestionsandtasksthatrequirestudentstoanalyzetheintegrationofknowledgeandideaswithinindividualtextsaswellasacrossmultipletexts.
024
2d.Thequestionsandtaskssupportstudents’abilitytocompleteculminatingtasksinwhichtheydemonstratetheirknowledgeofatopicthroughintegratedskills(e.g.combinationofreading,writing,speaking,listening).
024
2e.Materialsincludeacohesive,year-longplanforstudentstointeractandbuildkeyacademicvocabularywordsinandacrosstexts. 024
2f.Materialsincludeacohesive,year-longplantosupportstudents’increasingwritingskillsoverthecourseoftheschoolyear,buildingstudents’writingabilitytodemonstrateproficiencyatgradelevelattheendoftheschoolyear.
024
2g.Materialsincludeaprogressionoffocusedresearchprojectstoencouragestudentstodevelopknowledgeinagivenareabyconfrontingandanalyzingdifferentaspectsofatopicusingmultipletextsandsourcematerials.
024
2h.Materialsprovideadesign,includingaccountability,forhowstudentswillregularlyengageinavolumeofindependentreadingeitherinoroutsideofclass. 024
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
16
OverallGateway2Rating:BuildingKnowledgewithTexts,Vocabulary,andTasksReviewersusedatarecordedinRatingSheet2.1todeterminetheGateway2overallrating.
CRITERIA
RATINGSCORE
EVIDENCE
Gateway2:StrategyandPurposeMaterialsbuildknowledgethroughintegratedreading,writing,speaking,listening,andlanguage.Meetsexpectations(28-32points)Partiallymeetsexpectations(16-27points) Doesnotmeetexpectations(<16points)
2a-2h:Materialsbuildknowledgethroughintegratedreading,writing,speaking,listening,andlanguage.
PointTotalsfromRatingsSheet:
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
17
Gateway3:InstructionalSupportsandUsabilityIndicators● Gateway3RatingSheetsincludesomeIndicatorsthatareratedandsomethatarenotrated.IncaseswhereIndicatorsarenotrated,the
evidencecollectedprovidesvaluableinformationaboutinstructionalmaterials,althoughtheindicatorisnotscoredanddoesnotaffecttheratingfortheCriterionorGateway.3
RatingSheet3.1:UseandDesigntoFacilitateStudentLearning
● For“Useanddesignfacilitatestudentlearning”toattainascoreof“MeetsExpectations,”materialmustearnatleast7points.
CRITERION INDICATORS RATING EVIDENCE
Useanddesignfacilitatestudentlearning:Materialsarewelldesignedandtakeintoaccounteffectivelessonstructureandpacing.Earned:_____of8pointsMeetsexpectations(7-8points)Partiallymeetsexpectations(5-6points)Doesnotmeetexpectations(<5points)
3a.Materialsarewell-designedandtakeintoaccounteffectivelessonstructureandpacing.
012
3b.Theteacherandstudentcanreasonablycompletethecontentwithinaregularschoolyear,andthepacingallowsformaximumstudentunderstanding.
012
3c.Thestudentresourcesincludeamplereviewandpracticeresources,cleardirections,andexplanation,andcorrectlabelingofreferenceaids(e.g.,visuals,maps,etc.).
012
3d.Materialsincludepublisher-producedalignmentdocumentationofthestandardsaddressedbyspecificquestions,tasks,andassessmentitems.
012
3e.Thevisualdesign(whetherinprintordigital)isnotdistractingorchaotic,butsupportsstudentsinengagingthoughtfullywiththesubject.
3 Forindicatorsthatdonotcurrentlyreceiveanumericalrating,EdReports.orgisprovidingevidenceofthepresenceoftheseindicatorsbutwearecurrentlynotincludingthemintheratingsuntilwegathermoreinformationfromreviewersandthefieldontheirusefulness.
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
18
RatingSheet3.2:TeacherPlanningandLearningforSuccesswithCCSS● For“TeacherPlanningandLearningforSuccesswithCCSS”toattainascoreof“MeetsExpectations,”materialsmustearnatleast7points.
CRITERION INDICATORS RATING EVIDENCE
TeacherPlanningandLearningforSuccesswithCCSS:MaterialssupportteacherlearningandunderstandingoftheStandards.Earned:_____of8pointsMeetsexpectations
(7-8points)Partiallymeets
expectations(5-6points)Doesnotmeet
expectations(<5points)
3f.Materialscontainateacher'seditionwithampleandusefulannotationsandsuggestionsonhowtopresentthecontentinthestudenteditionandintheancillarymaterials.Whereapplicable,materialsincludeteacherguidancefortheuseofembeddedtechnologytosupportandenhancestudentlearning.
012
3g.Materialscontainateacher’seditionthatcontainsfull,adult-levelexplanationsandexamplesofthemoreadvancedliteracyconceptssothatteacherscanimprovetheirownknowledgeofthesubject,asnecessary.
012
3h.Materialscontainateacher’seditionthatexplainstheroleofthespecificELA/literacystandardsinthecontextoftheoverallcurriculum.
012
3i.Materialscontainexplanationsoftheinstructionalapproachesoftheprogramandidentificationoftheresearch-basedstrategies.
012
3j.Materialscontainstrategiesforinformingallstakeholders,includingstudents,parents,orcaregiversabouttheELA/literacyprogramandsuggestionsforhowtheycanhelpsupportstudentprogressandachievement.
Notscored
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
19
RatingSheet3.3:Assessment● For“Assessment”toattainascoreof“MeetsExpectations,”materialsmustearnatleast7points.
CRITERION INDICATORS RATING EVIDENCE
Assessment:MaterialsofferteachersresourcesandtoolstocollectongoingdataaboutstudentprogressontheStandards.Earned:_____of8pointsMeetsexpectations
(7-8points)Partiallymeets
expectations(4-6points)Doesnotmeet
expectations(<4points)
3k.Materialsregularlyandsystematicallyofferassessmentopportunitiesthatgenuinelymeasurestudentprogress. 012
3l.The purpose/use of each assessment is clear:i. Assessmentsclearlydenotewhichstandardsarebeing
emphasized. 012
ii. Assessmentsprovidesufficientguidancetoteachersforinterpretingstudentperformanceandsuggestionsforfollow-up.
012
3m.Materialsshouldincluderoutinesandguidancethatpointoutopportunitiestomonitorstudentprogress. 012
3n.Materialsindicatehowstudentsareaccountableforindependentreadingbasedonstudentchoiceandinteresttobuildstamina,confidence,andmotivation.
NotScored
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
20
RatingSheet3.4:DifferentiatedInstruction● For“DifferentiatedInstruction”toattainascoreof“MeetsExpectations,”materialsmustearnatleast9points.
CRITERION INDICATORS RATING EVIDENCE
Differentiatedinstruction:Materialsprovideteacherswithstrategiesformeetingtheneedsofarangeoflearnerssothattheydemonstrateindependentabilitywithgrade-levelstandards.Earned:_____of10pointsMeetsexpectations(9-10points)Partiallymeetsexpectations(6-8points)Doesnotmeet
expectations(<6points)
3o.Materialsprovideteacherswithstrategiesformeetingtheneedsofrangeoflearnerssothecontentisaccessibletoalllearnersandsupportstheminmeetingorexceedingthegrade-levelstandards.
012
3p.Materialsregularlyprovideallstudents,includingthosewhoread,write,speak,orlistenbelowgradelevel,orinalanguageotherthanEnglish,withextensiveopportunitiestoworkwithgradeleveltextandmeetorexceedgrade-levelstandards.
024
3q.Materialsregularlyincludeextensionsand/ormoreadvancedopportunitiesforstudentswhoread,write,speak,orlistenabovegradelevel.
012
3r.Materialsprovideopportunitiesforteacherstouseavarietyofgroupingstrategies. 012
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
21
RatingSheet3.5:EffectiveTechnologyUse● For“EffectiveTechnologyUse,”indicatorsarenotratedbutevidenceshouldbecollectedifincludedinreviewmaterials.EdReports.org
considerstechnologyusetobeanimportantelementofusability,butsinceprintedandonlinematerialsvarywidelyintheiruseoftechnology,wearenotscoringtheseindicatorsatthistime.
CRITERION INDICATORS RATING EVIDENCE
Effectivetechnologyuse:Materialssupporteffectiveuseoftechnologytoenhancestudentlearning.Digitalmaterialsareaccessibleandavailableinmultipleplatforms.
3s.Digitalmaterials(eitherincludedassupplementarytoatextbookoraspartofadigitalcurriculum)areweb-based,compatiblewithmultipleInternetbrowsers(e.g.,InternetExplorer,Firefox,GoogleChrome,etc.),“platformneutral”(i.e.,arecompatiblewithmultipleoperatingsystemssuchasWindowsandAppleandarenotproprietarytoanysingleplatform),followuniversalprogrammingstyle,andallowtheuseoftabletsandmobiledevices.
Notscored
3t.Materialssupporteffectiveuseoftechnologytoenhancestudentlearning,drawingattentiontoevidenceandtextsasappropriate.
Notscored
3u.Materialscanbeeasilycustomizedforindividuallearners.
i. Digitalmaterialsincludeopportunitiesforteacherstopersonalizelearningforallstudents,usingadaptiveorothertechnologicalinnovations.
Notscored
ii. Materials can be easily customized for local use.
3v.Materialsincludeorreferencetechnologythatprovidesopportunitiesforteachersand/orstudentstocollaboratewitheachother(e.g.websites,discussiongroups,webinars,etc.)
Notscored
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
22
OverallGateway3:InstructionalSupportsandUsabilityIndicatorsReviewersusedatarecordedinRatingSheets3.1-3.5todeterminetheGateway3overallrating.
CRITERIA RATINGSCORE EVIDENCE
GatewayGateway3:StructuralSupportsandUsabilityIndicatorsMeetsexpectations(30-34points)Partiallymeetsexpectations(24-29points) Doesnotmeetexpectations(<24points)
3a-e:UseandDesigntoFacilitateStudentLearning
Pointtotalsfromratingssheets:
3f-j:TeacherPlanningandLearningforSuccesswithCCSS
Pointtotalsfromratingssheets:
3k-n:Assessment
Pointtotalsfromratingssheets:
3o-r:DifferentiatedInstruction Pointtotalsfromratingssheets:
3s-v:EffectiveTechnologyUse