Professional Documents
Culture Documents
By: _______________________________________________________
Christine Thompson
Executive Director
(602) 542-5057
Friday, August 14, 2015
9:00 AM
Arizona Department of Education, Room 122
1535 W. Jefferson, Phoenix, AZ 85007
EXECUTIVE SUMMARY
Issue:
Action/Discussion Item
Information Item
EXECUTIVE SUMMARY
Minimally
Proficient
2395-2496
2400-2509
2419-2519
2431-2531
2438-2542
2448-2550
2454-2554
2458-2566
2465-2568
Partially
Proficient
2497-2508
2510-2522
2520-2542
2532-2552
2543-2560
2551-2571
2555-2576
2567-2580
2569-2584
Proficient
2509-2540
2523-2558
2543-2577
2553-2596
2561-2599
2572-2603
2577-2605
2581-2605
2585-2607
Highly
Proficient
2541-2605
2559-2610
2578-2629
2597-2641
2600-2648
2604-2658
2606-2664
2606-2668
2608-2675
AzMERIT Math
Scale Score
Ranges
Grade 3
Grade 4
Grade 5
Grade 6
Grade 7
Grade 8
Algebra I
Geometry
Algebra II
Minimally
Proficient
3395-3494
3435-3529
3478-3562
3512-3601
3529-3628
3566-3649
3577-3660
3609-3672
3629-3689
Partially
Proficient
3495-3530
3530-3561
3563-3594
3602-3628
3629-3651
3650-3672
3661-3680
3673-3696
3690-3710
Proficient
3531-3572
3562-3605
3595-3634
3629-3662
3652-3679
3673-3704
3681-3719
3697-3742
3711-3750
Highly
Proficient
3573-3605
3606-3645
3635-3688
3663-3722
3680-3739
3705-3776
3720-3787
3743-3819
3751-3839
The adoption of these scale score ranges will result in the following estimated
performance on the Spring 2015 AzMERIT assessments.
EXECUTIVE SUMMARY
AzMERIT ELA
est. % of students for
Spring 2015
Grade 3
Grade 4
Grade 5
Grade 6
Grade 7
Grade 8
Grade 9
Grade 10
Grade 11
Minimally
Proficient
44%
43%
37%
39%
41%
40%
47%
49%
54%
Partially
Proficient
15%
19%
33%
27%
26%
27%
26%
21%
20%
AzMERIT Math
est. % of students for
Spring 2015
Grade 3
Grade 4
Grade 5
Grade 6
Grade 7
Grade 8
Algebra I
Geometry
Algebra II
Minimally
Proficient
27%
29%
29%
38%
48%
43%
45%
47%
47%
Partially
Proficient
31%
29%
31%
30%
22%
24%
23%
24%
24%
Proficient
31%
33%
27%
30%
29%
26%
21%
22%
17%
Highly
Proficient
10%
5%
3%
4%
4%
6%
6%
8%
8%
Proficient
27%
32%
27%
21%
18%
20%
23%
24%
23%
Highly
Proficient
15%
10%
13%
11%
13%
13%
9%
6%
6%
Recommending AzMERIT
Performance Standards
English Language Arts Grades 3-11
Math Grades 3-8, Algebra I, Geometry,
and Algebra II
Technical Report
June 27, 2015
Arizona Assessments
Summer 2015 Standard Setting
Technical Report
AzMERIT
StandardSettingTechnicalReport
TABLE OF CONTENTS
Introduction....................................................................................................................................1
PerformanceStandardsandValidityofTestScoreInterpretations...........................................1
OverviewofStandardSettingApproach........................................................................................5
WorkshopDesign........................................................................................................................5
WorkshopLocation.....................................................................................................................7
WorkshopStaffing......................................................................................................................7
WorkshopPanelists....................................................................................................................7
HigherEducationPanel...............................................................................................................8
WorkshopTraining....................................................................................................................10
StandardSettingMaterialsandProcedures.................................................................................12
PerformanceLevelDescriptors.................................................................................................12
OrderedItemBooklet...............................................................................................................13
AzMERITBookmarkPlacement.................................................................................................15
BenchmarkInformation............................................................................................................17
PanelistFeedbackandImpactData..........................................................................................18
VerticalArticulation..................................................................................................................19
WorkshopEvaluation................................................................................................................20
RecommendedPerformanceStandardsandImpactData...........................................................21
EvaluationoftheStandardSettingWorkshop.............................................................................28
PanelistEvaluationofStandardSettingWorkshop..................................................................28
IndependentObserverReviewofStandardSettingWorkshop...............................................29
References....................................................................................................................................30
AppendixAWorkshopAgendas................................................................................................A1
AppendixBCompositionofPanels...........................................................................................B1
AppendixCTrainingPresentations...........................................................................................C2
AppendixDPerformanceLevelDescriptors.............................................................................D1
AppendixETestBlueprints.......................................................................................................E1
ii
AzMERIT
StandardSettingTechnicalReport
AppendixFSummaryofOrderedItemBooklets......................................................................F1
AppendixGOIBItemDataPlots...............................................................................................G1
AppendixHBookmarkPlacementReadinessForms.................................................................H1
AppendixIInvestigationofEquatingStudentScoresAcrossAzMERITTest
AdministrationModes..................................................................................................................I1
AppendixJAzMERITVerticalLinkingStudy...............................................................................J1
AppendixKPanelistEvaluationForms......................................................................................K1
AppendixLRecommendPerformanceStandardsbyRound.....................................................L1
AppendixMConvergenceofBookmarksacrossRounds........................................................M1
AppendixNEstimatedPercentageofStudentsatEachPerformanceLevelforPanelist
RecommendedPerformanceStandards,OverallandbyGenderandEthnicity.........................N1
AppendixOSummaryofPanelistEvaluations..........................................................................O1
AppendixPIndependentObserverReporttoStateBoardofEducation.................................P1
iii
AzMERIT
StandardSettingTechnicalReport
Introduction
In2010,ArizonaadoptednewacademiccontentstandardsinEnglishlanguagearts(ELA)and
math.TheArizonaCollegeandCareerReadyStandardsaredesignedtoensurethatstudents
acrossgradesarereceivingtheinstructiontheyneedtobeontrackforcollegeandcareerby
thetimetheygraduate.Inspring2015,theArizonaDepartmentofEducation(ADE)
administeredforthefirsttimeArizonasMeasurementofEducationalReadinesstoInform
Teaching(AzMERIT)toassessproficiencyonthenewArizonaCollegeandCareerReady
Standards.TheAzMERITmeasuresEnglishlanguageartsingrades311,andmathingrades38
andfollowingcompletionofhighschoolcourseworkinAlgebraI,Geometry,andAlgebraII.
TheAzMERITisaseriesoffixedformassessmentsthatareintendedtobeadministeredonline,
althoughtheassessmentisofferedasadualmode,onlineandpaper,assessmentto
accommodateschoolsthatarenotreadytotransitiontotheonlinetestingenvironment.A
commonoperationalbaseformwasadministeredtoallstudentswithinagiventestgradeand
subject.Eachassessmentiscomprisedoftwotothreediscretetestsessions.
ThefirstoperationaladministrationoftheAzMERITassessmenttookplaceinspring2015.
OnlineadministrationoftheAzMERIToccurredfromMarch30throughMay8,2015.Thepaper
versionoftheAzMERITwasadministeredbetweenApril13andApril24,2015.Followingthe
closeofthetestadministrationwindows,theAmericanInstitutesforResearch(AIR),under
contracttoADE,convenedeightpanelsofArizonaeducatorstorecommendperformance
standardsontheassessments.Thisdocumentdescribestheproceduresusedtoconductthe
standardsettingworkshopsaswellastherecommendedperformancestandardsandresulting
impacts.
ResponsivetoStandardsforEducationandPsychologicalTesting:Standard9.13
AzMERIT
StandardSettingTechnicalReport
Thus,thetestitselfisnotconsideredvalid,butratherthevalidityoftheintendedinterpretation
anduseoftestscoresisevaluated.
Centraltoevaluatingthevalidityoftestscoreinterpretationsisdeterminingwhetherthetest
measurestheintendedconstruct.Suchanevaluationinturnrequiresacleardefinitionofthe
measurementconstruct.ForArizonasnewAzMERITassessments,thedefinitionofthe
measurementconstructisprovidedbytheArizonaCollegeandCareerReadyStandards.
TheArizonaCollegeandCareerReadyStandards(ACCRS)specifywhatstudentsshouldknow
andbeabletodobytheendofeachgradelevelinorderforstudentstograduatereadyfor
postsecondaryeducationorentryintotheworkforce.Becausedirectlymeasuringstudent
achievementagainstofeachbenchmarkintheACCRSwouldresultinanimpracticallylongtest,
eachtestadministrationisdesignedtomeasurearepresentativesampleofthecontentdomain
definedbytheStandards.Toensurethateachstudentisassessedontheintendedbreadthand
depthoftheStandards,testformconstructionisguidedbyasetoftestspecifications,or
blueprints,whichindicatethenumberofitemsthatshouldbesampledfromeachcontent
strand,standard,andbenchmark.Thus,thetestblueprintsrepresentapolicystatementabout
therelativeimportanceofcontentstrandsandstandardsinadditiontomeetingimportant
measurementgoals(e.g.,sufficientitemstoreportstrandperformancelevelsreliably).Because
thetestblueprintdetermineshowstudentachievementoftheArizonaCollegeandCareer
ReadyStandardsisevaluated,alignmentoftestblueprintswiththecontentstandardsiscritical.
ADEhaspublishedtheAzMERITtestblueprintsthatspecifythedistributionofitemsacross
reportingstrandsanddepthofknowledgelevels.
AlignmentoftestcontenttotheArizonaCollegeandCareerReadyStandards(ACCRS)2ensures
thattestscorescanserveasvalidindicatorsofthedegreetowhichstudentshaveachievedthe
learningexpectationsdetailedintheACCRS.However,theinterpretationoftheAzMERITtest
scoresrestsfundamentallyonhowtestscoresrelatetoperformancestandardswhichdefine
theextenttowhichstudentshaveachievedtheexpectationsdefinedintheACCRS.AzMERIT
testscoresarereportedwithrespecttofourproficiencylevels,demarcatingthedegreeto
whichArizonastudentshaveachievedthelearningexpectationsdefinedbytheArizonaCollege
andCareerReadyStandards.ThecutscoreestablishingtheProficientlevelofperformanceis
themostcritical,sinceitindicatesthatstudentsaremeetinggradelevelexpectationsfor
achievementoftheArizonaCollegeandCareerReadyStandards,thattheyarepreparedto
benefitfrominstructionatthenextgradelevel,andthattheyareontracktopursuepost
secondaryeducationorentertheworkforce.Proceduresusedtoadoptperformancestandard
fortheAzMERITassessmentsarethereforecentraltothevalidityoftestscoreinterpretations.
FollowingthefirstoperationaladministrationoftheAzMERITassessmentsinspring2015,a
standardsettingworkshopwasconductedtorecommendtotheArizonaStateBoardof
EducationasetofperformancestandardsforreportingstudentachievementoftheArizona
CollegeandCareerReadyStandards.Thisdocumentdescribesthestandardizedandrigorous
proceduresthatArizonaeducators,servingasstandardsettingpanelists,followedto
ResponsivetoStandardsforEducationandPsychologicalTesting:Standard12.8and12.10
AzMERIT
StandardSettingTechnicalReport
recommendperformancestandards.TheworkshopsemployedtheBookmarkprocedure,a
widelyusedmethodinwhichstandardsettingpanelistsusetheirexpertknowledgeofthe
ArizonaCollegeandCareerReadyStandardsandstudentachievementtomaptheperformance
leveldescriptorsadoptedbytheArizonaStateBoardofEducationontoanordereditembook
basedonthefirstoperationaltestformadministeredtostudentsinspring2015.
Panelistswerealsoprovidedwithcontextualinformationtohelpinformtheirprimarilycontent
drivencutscorerecommendations.Panelistsrecommendingperformancestandardsforthe
highschoolassessmentswereprovidedwithinformationabouttheapproximatelocationofthe
relevantACTcollegereadyperformancestandardforthegrade11ELAandAlgebraII
assessments,andProgrammeforInternationalStudentAssessment(PISA)performance
standardsforthegrade10ELAandGeometryassessments.Panelistsrecommending
performancestandardforthegrade38summativeassessmentswereprovidedwiththe
approximatelocationofrelevantNAEPperformancestandardsatgrades4and8,aswellas
interpolatedvaluesforgrade6.Panelistswereprovidedwiththeapproximatelocationsofthe
SmarterBalancedperformancestandardsforthegrade38and11assessmentsinELAand
mathtoprovideadditionalcontextaboutthelocationofperformancestandardsforstatewide
assessments.Additionally,panelistswereprovidedthecorrespondinglocationsfortheprevious
AIMSperformancestandards.Panelistswereaskedtoconsiderthelocationofthese
benchmarklocationswhenmakingtheircontentbasedcutscorerecommendations.When
panelistsareabletousebenchmarkinformationtolocateperformancestandardsthat
convergeacrossassessmentsystems,validityoftestscoreinterpretationsisbolstered.
Inaddition,panelistswereprovidedwithfeedbackabouttheverticalarticulationoftheir
recommendedperformancestandardssothattheycouldviewhowthelocationsoftheir
recommendedcutscoresforeachgradelevelassessmentsatinrelationtothecutscore
recommendationsattheothergradelevels.Thisapproachallowedpaneliststoviewtheircut
scorerecommendationsasacoherentsystemofperformancestandards,andfurtherreinforces
theinterpretationoftestscoresasindicatingnotonlyachievementofcurrentgradelevel
standards,butalsopreparednesstobenefitfrominstructioninthesubsequentgradelevel.
Basedontherecommendedcutscores,Table1showstheestimatedpercentageofstudents
meetingtheAzMERITproficientstandardforeachassessmentinspring2015.Table1also
showstheapproximatepercentageofArizonastudentsthatwouldbeexpectedtomeetthe
ACTcollegereadystandard,andthepercentageofArizonastudentsmeetingtheNAEP
proficientstandardsatgrades4and8.Table1alsopresentstheexpectedproficientrateforthe
SmarterBalancedAssessments,systemwide,basedonthespring2014fieldtest
administration.AsTable1indicates,theperformancestandardsrecommendedAzMERIT
assessmentsarequiteconsistentwithrelevantACTcollegeready,andtheNAEPandSmarter
Balancedproficient,benchmarks.Moreover,becausetheperformancestandardswere
verticallyarticulated,theproficiencyratesacrossgradelevelsaregenerallyconsistent.
AzMERIT
StandardSettingTechnicalReport
Table1.EstimatedPercentageofStudentsMeetingAzMERITandBenchmarkProficient
Standards.
Assessment
AzMERIT
Proficient
Grade3
Grade4
Grade5
Grade6
Grade7
Grade8
Grade9
Grade10
Grade11
41%
38%
30%
34%
33%
32%
27%
30%
25%
Grade3
Grade4
Grade5
Grade6
Grade7
Grade8
AlgebraI
Geometry
AlgebraII
42%
42%
40%
32%
31%
33%
32%
30%
29%
PercentofStudentsMeetingStandard
ArizonaACT
ArizonaNAEP
ProjectedSBAC
CollegeReady
Proficient
ELA
38%
28%
41%
44%
41%
38%
28%
41%
34%
41%
Mathematics
39%
42%
38%
33%
33%
33%
32%
32%
36%
33%
AzMERIT
StandardSettingTechnicalReport
Workshop Design
TorecommendperformancestandardsforeachoftheAzMERITassessments,ADEconvened
eightpanelsrepresentingfourgradebands(34,56,78,and911)foreachsubject.Thepanels
consistedofeducatorsfromtherespectivegradebandsandcontentareas.Thepanelists
recommendedperformancestandardsbasedprimarilyoncontentconsiderationswith
additionalcontextprovidedbyrelevantbenchmarkinformationfromstatewide(SBAC),
national(NAEP),international(PISA),andcollegeentrance(ACT)exams,aswellasestimated
studentperformanceontherecommendedstandardspriortoRound2.PanelistsusedOrdered
ItemBooklets(OIBs)andPerformanceLevelDescriptors(PLDs)toplaceperformancestandards
forallthreeperformancelevels,PartiallyProficient,Proficient,andHighlyProficient,intwo
rounds.Firstpanelistsrecommendedperformancestandardsfortheanchorgrades,4,6,8,
11/AlgebraII(grade10/Geometrywerealsoconsideredanchorgrades).Afterrecommending
performancestandardsfortheanchorgrades,amoderationsessionwasconductedwiththe
tableleadersfromeachofthepanelstoreviewtheverticalarticulationoftheperformance
standards,andtoimplementanyadjustmentstotheanchorgraderecommendationsto
facilitateverticalarticulation.Followingtheverticalarticulationsession,panelistscontinuedon
torecommendperformancestandardsfortheremaininggradelevelassessments,usingthe
AzMERIT
StandardSettingTechnicalReport
interpolatedstandardstoprovidefurthercontextualinformationaboutthelikelylocationof
performancestandards.
TheAzMERITStandardSettingworkshopswereconductedoverfourdays,withthehighschool
panels,whichhadtorecommendperformancestandardsforthreeassessments,beginningon
Monday,andtheremaininggradelevelpanelsconveningonTuesday.Abroadoverviewofthe
workshopcalendarispresentedinTable2.Detailedagendasforthestandardsetting
workshopsareincludedasAppendixA.
Table2.CalendarDatesfor2015GradeLevelandHighSchoolELAandMathStandardsetting
Workshops
Workshop
Monday,July13
Tuesday,July14
Wednesday,July15
Thursday,July16
GradeLevel
N/A
StandardSetting
Day1
StandardSetting
Day2
StandardSetting
Day3
HighSchool
StandardSetting StandardSetting
Day1
Day2
StandardSetting
Day3
StandardSetting
Day4
Theworkshopsbeganwithabrieftableleaderorientationtoreviewwithtableleaderstheir
roleandresponsibilities.Theworkshopproperbeganwithalargegrouptrainingtoprovide
panelistswithanoverviewoftheworkshopactivitiesandinitialtraininginthebookmarking
procedures.Followingthelargegroupsession,theworkshoppanelsconvenedintheirmeeting
rooms,andbegantheirworkbyparticipatinginthesameAzMERITonlineassessmentthatwas
administeredtotheirstudentsinthespring.Paneliststhenspentseveralhoursworkingthrough
theperformanceleveldescriptors(PLDs)developedbyADE,anddevelopingmodified
descriptorstocharacterizethespecialsubsetofstudentswhojustbarelyqualifyforentryinto
eachoftheperformancelevels.Afterdevelopingdescriptorsforthejustbarelystudents,
panelistsspenttheremainderofdayonereviewingtheirordereditembooks(OIBs).
Panelistsdidnotbeginrecommendingperformancestandardsuntildaytwo,whichbeganwith
trainingonthebookmarkplacementtask.PaneliststhenworkedthroughtheirOIBsandplaced
theirbookmarksforRound1.AfterRound1,panelistswereprovidedfeedbackaboutthe
bookmarkplacementsoftheotherpanelistsanddiscussedthosebookmarkplacementsattheir
tablesandacrosstheroommoregenerally.Panelistswerethenalsoprovidedwithimpactdata
showingtheestimatedpercentageofstudentswhowouldmeeteachoftheperformance
standardsandengagedinpaneldiscussionsaboutanyimplicationsofthoseproficiencyrates.
Uponcompletionofpaneldiscussions,panelistsmadeasecondroundofbookmark
placements,andthenbegantheprocessoveragainforthesubsequentassessment.
AzMERIT
StandardSettingTechnicalReport
Workshop Location
TheworkshopswereheldattheHyattRegency,locatedat122North2ndStreetinPhoenix,
Arizona.ThelocationprovidedmeetingspacestoholdtheAzMERITworkshoppanels,aswellas
apsychometricworkroomforcompletionofanalysisactivitiesandstoragespaceforsecure
materialsthroughouttheworkshop.
Workshop Staffing
Aseniorworkshopcoordinatorwastaskedwithleadingthecrossworkshopintroductory
trainingandverticalmoderationmeetings,andwasresponsibleforworkingwitheach
facilitatorandmonitoringtheflowofactivitiesacrossworkshops.AIRtestdevelopmentstaff
servedasworkshopfacilitators,leadingeachpanelthroughtrainingactivitiesandexecutionof
thestandardsettingprocess.Additionally,anAIRresearchassistantwasassignedtoeachpanel
tosupporttheworkshopfacilitator.Becausetestdevelopmentstaffservedasworkshop
facilitators,theywerehighlyqualifiedtofacilitatethedevelopmentofjustbarelyperformance
leveldescriptors,andtoserveasasubjectmatterresourceforpanelistsastheynavigatedthe
OIB.AteamofthreeAIRpsychometriciansmanagedpsychometricactivitiesinsupportofthe
workshop,includingensuringaccuratedatacaptureofbookmarkplacements,presentationof
verticalarticulationresultsformoderationmeetings,andproductionoffinalresultsforthe
standardsettingtechnicalreport.Inaddition,AIRprojectstafffacilitatedorganizationof
meetingspaceandmealsandprovidedsupporttopanelistsasnecessary.
ADEstaffmonitoredallstandardsettingactivities,andalsoaddressedanypolicyortest
developmentquestionsforpanelists.WhileADEstaffansweredspecific,directquestions,they
werenotactivelyinvolvedinthefacilitationofthemeeting.
Workshop Panelists
ADEworkedtoobtainbroadlyrepresentativepanelsforthestandardsettingworkshopsthat
reflectedtheteacherpopulationinthestateofArizonaintermsofgender,race,ethnicity,and
geographicalrepresentation.Diversegroupsofpanelistsbringawiderangeofperspectivesand
experiencetothestandardsettingeffort,ensuringthattherecommendationsthatare
forwardedtotheStateBoardofEducationarethoughtfulandrepresentativeofbroad
educationalconstituencies,andrepresenttherangeofexpertiseandexperiencesfoundinthe
educatorpopulationacrossthestate.
WithineachoftheELAandmathpanels,atotalof12panelistspergradebandsubpanelwere
recruitedtorecommendstandards.ADEtargetedthenumberofmaleandfemalepaneliststo
mirrorthepopulationofeducators.Inthesameway,ADEworkedtoincludeproportional
representationofAmericanIndian/NativeAmerican,Asian/PacificIslanders,Black(Non
Hispanic),HispanicandWhite(NonHispanic)panelists,andaproportionalnumberofpanelists
fromrural,urban,andsuburbandistricts.Forcoursebasedassessmentsinmaththatrequire
specificcontentexpertise,ADEsoughttoincludeteacherswhohaveexpertiseinthecontent
standardsandcourseworkforallthreeareastheyrecommendedperformancestandardsfor:
AzMERIT
StandardSettingTechnicalReport
AlgebraI,Geometry,andAlgebraII.Inaddition,ADEworkedtoincludespecialeducationand
EnglishLanguageLearners(ELL)teachers.
Withineachsubpanel,tableswerebalancedtoincludepanelistswithvaryingcontentexpertise
anddemographicrepresentationineachgroup.
ADEdesignatedthreetableleadersforeachpanel.Tableleadersattendedanadditional
orientationmeetingandweretaskedwithassistingstandardsettingstaffby
facilitatingdiscussionswithintheirtable;
distributingandcollectingreadinessandrecordingsheetsandsecurematerials;
alertingworkshopstaffofconfusionorconcernswithintheirtables;and
representingtheirtableandpanelduringverticalarticulationmeetings.
Letterscontaininglogisticalinformationandremindersaboutthepurpose3oftheworkshop
wereemailedtoconfirmedpaneliststwoweekspriortothestandardsettingworkshop.Inthe
weekprior,testingcontractorstaffcontactedallpanelistsviaphonetoconfirmreceiptof
information.Throughouttheprocess,ADEcontinuedtorecruitreplacementsforpanelistswho
withdrewtheirparticipation.
AppendixB4presentsthecompositionofthestandardsettingpanels.Foreachpanel,thetable
includesarecordforeachpanelistandindicatesthegeographicregionheorsherepresents
andhisorhergender,ethnicity,andmainexpertise.Whileitiscriticallyimportanttoincludea
rangeofstakeholdersinthestandardsettingprocess,experiencehasshownthatitisessential
forpaneliststohavedirectknowledgeofacademicstandardsandstudentgradelevel
performancetoparticipatemeaningfullyintheBookmarkingprocedure.Forthisreason,panel
participationwasrestrictedtoclassroomteachersandcurriculumspecialistswithexpertisein
ELAandmathcurriculumandinstruction.
3
4
ResponsivetoStandardsforEducationandPsychologicalTesting:Standard5.0,5.21,5.22,and7.0
ResponsivetoStandardsforEducationandPsychologicalTesting:Standard7.5
AzMERIT
StandardSettingTechnicalReport
ThefirstactivityforthispanelwasareviewofthedetailedPLDsforELA11andAlgebraIIheldat
ADEsofficesonMay13,2015.Tosetthestageforthisactivity,anoverviewofAzMERIT,the
detailedPLDs,andhowthedetailedPLDswouldbeusedintheupcomingAzMERITStandard
Settingwasprovidedtoall10participants.ThepanelthenbrokeoutintoseparateELAand
mathgroupstofirstdeterminethecollegecoursethatbestfitsthedescriptorcreditbearing
entrylevelcollegecoursefortheircontentarea.ForELA,thatentrylevelcoursewas
determinedtobeFreshmanComposition,whiletheentrylevelcourseformathematicswas
determinedtobeCollegeMath.Whilestillintheirsubjectareagroups,thepaneliststhen
reviewedanddiscussedtheskillsandabilitiesdescribedintheELA11orAlgebraIIdetailedPLDs
forstudentsintheProficientlevelandwhetherthatlevelofskillorabilitywassufficienttobe
preparedforentrylevelcoursework.TheconsensusdecisionofboththeELAgroupandthe
mathgroupwasthatstudentswhohadtheskillsandabilitiesdescribedintheProficientlevel
wouldbeadequatelypreparedforthetargetentrylevelcourseupongraduation.
Additionally,boththeELAgroupandthemathgroupfeltitwasimportanttoindicatethattheir
endorsementofcollegereadinessincludedtheexpectationthatstudentswouldtakeonemore
yearofhighschoolEnglishaftertheELA11testandonemoreyearofhighschoolmathafter
theAlgebraIItest.Thisisnotanunreasonableexpectationsincemoststudentswouldbetaking
theELA11testattheendoftheirthirdoffourrequiredhighschoolEnglishcoursesandwould
betakingtheAlgebraIItestattheendoftheirthirdoffourrequiredhighschoolmathematics
courses.
ThesecondactivityforthispanelwasareviewoftheitemsincludedintheELA11andAlgebraII
testtodeterminewhichitemsdemonstratedtheskillsandabilitiesneededforstudentstobe
adequatelypreparedforentrylevelcoursework.Toaccommodatevacationschedules,panelists
participatedinthisonlineactivityindividuallyatthetimeandlocationoftheirchoosinginearly
July.Thisonlineactivityincludedatrainingmodulefollowedbyanitemreviewbasedona
variationontheItemDescriptorMatchingprocedure(Ferrara,Perie,&Johnson,2008).
LikethebookmarkingprocedureusedtorecommendperformancestandardsforAzMERIT,the
IDMatchingprocedurereliesonanordereditembook(OIB).Thisbookcontainstestitemsthat
appearinorderfromeasiesttomostdifficult,basedonstudentperformanceinthespring2015
testadministration.ThevariationoftheIDMatchingprocedureusedforthisactivityaskedthe
paneliststodeterminewhethertheknowledgeandskillsnecessarytoanswereachitem
correctlywereprerequisiteskillsforsuccessinentrylevelcoursework,thatis,CollegeMathor
FreshmanComposition.
HighereducationpanelistsbeganbyreviewingtheOIBfollowingthesameproceduresusedby
thestandardsettingworkshoppanelists.BeginningwiththefirstpageintheOIB,participants
answeredtwoquestionsastheyreviewedeachitem:
Whatdoesastudentneedtoknowandbeabletodotosuccessfullyrespondtothisitem?
Whyisthisitemmoredifficultthantheprecedingitems?
AzMERIT
StandardSettingTechnicalReport
Thisactivitywasdesignedtofocusparticipantsontheknowledgeandskillsmeasuredbyeach
item,aswellastocommunicatetoparticipantsthefullrangeofknowledgeandskillsmeasured
intheassessments.UponcompletionoftheOIBreview,participantswerepreparedtoperform
theIDMatchingtask.
ToperformtheIDMatchingtask,participantswereaskedtoconsiderwhatknowledgeand
skillsareprerequisiteforsuccessinentrylevelcourseworkattheirrespectiveinstitutions.
ParticipantsrepresentingCollegeMathperformedtheIDMatchingtaskfortheAlgebraIIOIB,
whileparticipantsrepresentingFreshmanCompositionperformedtheIDMatchingtaskusing
theGrade11ELAOIB.
ToperformtheIDMatchingtask,participantsjudgedwhethertheknowledgeandskills
necessarytoanswertheitemsuccessfullywereprerequisitetosuccessintherelevantentry
levelcourse.ForeachitemintheOIB,participantsansweredyesornothattocorrectly
answertheitemrequiredknowledgeandskillsthatareprerequisiteforsuccessintheentry
levelcourse.
Becauseitemswereorderedbydifficulty,theexpectationwasthatparticipantswouldgenerally
identifytwodistinctregionsofachievement,aloweronewhereitemsclearlywereprerequisite
forsuccessinentrylevelcollegecoursework,andahigheronethatreflectedachievement
beyondwhatwouldbeconsideredprerequisiteknowledgeforsuccessincollege.Itwasalso
expectedthattherewouldbearegionofuncertaintybetweenthetwo,withthenotionthata
likelycollegereadyperformancestandardwouldliewithintheregionofuncertainty.Whenthe
responsesoftheparticipantsweretabulatedtogetherhowever,therewasnodetectableregion
intheOIBwheretheknowledgeandskillsassessedbytheitemswerereliablynotprerequisite
forsuccessinentrylevelcoursework.Inotherwords,itemsconsideredprerequisiteforcollege
successwerereliablyidentifiedacrosstheentirerangeoftheOIB.Therefore,itwasnot
possibletoprovidethestandardsettingworkshoppanelistswithaconstrainedregioninwhich
acollegereadystandardmightbeidentifiedbaseduponthereviewbythispanelofArizona
highereducationrepresentatives.
Workshop Training
Thoroughtrainingisanessentialelementofastandardsettingworkshop.Trainingatthe
meetingshelpedpanelistsbecomefamiliarwiththeassessmentsystemandthestandard
settingprocess.Italsoinvolvedareviewanddiscussionoftheassessments,thestudent
populationsthatparticipatedineach,andtheperformanceleveldescriptors(PLDs).Inaddition,
trainingincludedindepthdiscussionofconceptskeytobookmarkplacement,suchasthe
notionofwhatwouldconstituteastudentjustbarelyinaperformancelevel.Allpanelists
wereadministeredanoperationaltestinordertounderstandthetestcontent,thetesting
interface,andvariousitemtypesthroughwhichstudentknowledgeandskillswereassessed.A
10
AzMERIT
StandardSettingTechnicalReport
sampleofthepresentationslidesusedtoconducttheintroductorytraining,andthoseusedto
facilitateeachworkshopareprovidedinAppendixC5.
Tobegintheworkshop,thepanelistswereconvenedforabriefintroductorytrainingthat
focusedonthepurposeofthestandardsettingworkshopandareviewofthemainworkshop
activities.Followingthislargegroupintroduction,panelistsjoinedtheirassignedworkshop
panelswheretheworkshopleaderforeachassessmentguidedpaneliststhroughthestandard
settingactivitiesandprovidedindepthtrainingthroughoutthecourseoftheworkshop.
Tableleadershadtheadditionalresponsibilitiesofensuringthattableactivitiesremained
focusedonthetaskathand,helpingtoverifythatpanelistsunderstoodtheirtasks,andalerting
workshopleaderstoanyissuesencounteredbypanelistsastheyengagedintheirworkshop
tasks.Tableleaderswerenotexpectedtoprovidetrainingtopanelistsbutratherserveas
liaisonsbetweenthepanelistsandworkshopleaderstoensurethatworkshopactivitieswere
implementedcorrectly,alertingworkshopleaderstoanyissuesthataroseduringthecourseof
conductingworkshopactivities,andrepresentingtheirtablesinthecrosspanelmoderation
deliberations.Atableleaderorientationmeetingwasconvenedpriortothestandardsetting
workshoptofamiliarizetableleaderswiththeirrolesandresponsibilities,includingsuggestions
onhowtoprovideleadershipatthetablesduringthestandardsettingprocessandhowto
managethesecurematerials.
ResponsivetoStandardsforEducationandPsychologicalTesting:Standard7.5
11
AzMERIT
StandardSettingTechnicalReport
12
AzMERIT
StandardSettingTechnicalReport
Thesediscussionsyieldedcommondescriptionsofstudentsjustbarelycharacterizedbyeach
performanceleveldescriptorwithineachroom.
ResponsivetoStandardsforEducationandPsychologicalTesting:Standard7.1and12.4
13
AzMERIT
StandardSettingTechnicalReport
Itemswereorderedaccordingtotheirresponseprobability(RP)levelbasedontheirItem
ResponseTheory(IRT)parameters.InIRT,theitemcharacteristiccurveforeachitemindicates
thelikelihoodofrespondingcorrectlyforeachpointalongthestudentachievementdimension.
Theresponseprobabilitycriterionreferstothelocationontheachievementscalethat
correspondstoagivenprobabilityofsuccess.Incontextofthestandardsettingworkshop,this
criterionisusedtodevelopacommonunderstandingofwhatconstitutesmasterywhen
evaluatingwhetherastudentcanrespondsuccessfullytoanitem.AnRPvalueof0.67wasused
asthemasterycriterionforallofstandardsettingworkshopsexceptthehighschoolendof
courseassessmentsinmath.Panelistswereaskedtoconsiderwhether,forexample,ajust
barelyproficientstudenthada0.67likelihoodofansweringtheitemcorrectly.Theywerealso
encouragedtoaskthisquestioninotherrelatedways,includingwhetherofjustbarely
proficientstudentswouldanswertheitemcorrectly,orwhetherajustbarelyproficientstudent
wouldrespondcorrectlytoitemtwoofthreetimes.Theendofcoursemathtestswerevery
difficultandthenumberofitemsonwhichstudentscoulddemonstratethatlevelofmastery
wasquitelow,resultinginaveryshortfunctionalOIB.Thus,anRPvalueof0.50wasadopted
fortheEOCmathtests,meaningthatajustbarelyproficientstudent,forexample,hada0.50
likelihoodofrespondingcorrectly,orthatofjustbarelystudentscouldrespondsuccessfully
toanitem,orthatajustbarelystudentcouldrespondsuccessfullytotheitematleastoneof
twotimes.
Dichotomouslyscored(e.g.,incorrectvs.correct)AzMERITitemswerecalibratedusingthe
Raschmodel.Multipoint,partialcredititemswerecalibratedusingMasterspartialcredit
modelwithorderingofscorepointpagesintheOIBbasedonstepleveldifficulties.
Theordereditembookletswerepresentedonline,allowingpaneliststoviewitemsinthesame
contextasstudenttesttakers.ThecompositionoftheELAandmathordereditembookletsby
assessmentandgradearesummarizedinTable3below.AtechnicalsummaryoftheOIBsare
presentedinAppendixF,includingforeachpageintheOIB,theitemscorepointassociated
withthepresenteditem,thedifficultyrepresentedbythepage,andthestandarderrorofthe
difficulty.Inaddition,theappendixindicatestheoverallpercentofstudentswhowouldscore
atorabovethestandardassociatedwitheachOIBpage,andthelocationofexternal
benchmarkswithinthebooklet.
Table3.CompositionofOrderedItemBooklets
Test
ELA3
ELA4
ELA5
ELA6
ELA7
ELA8
ELA9
42
42
42
42
42
42
44
NumberofItemsInOIB
Operational
FieldTest
Total
9
51
8
50
10
52
7
49
10
52
12
54
11
55
14
PagesinOIB
(TotalPoints)
67
67
68
68
68
71
69
AzMERIT
Test
ELA10
ELA11
Math3
Math4
Math5
Math6
Math7
Math8
AlgebraI
Geometry
AlgebraII
44
44
45
45
45
47
47
47
47
47
47
StandardSettingTechnicalReport
NumberofItemsInOIB
Operational
FieldTest
Total
9
53
9
53
13
58
19
65
20
65
10
57
14
61
18
65
21
68
15
62
15
62
PagesinOIB
(TotalPoints)
68
67
58
66
66
57
61
70
70
66
66
15
AzMERIT
StandardSettingTechnicalReport
UsingtheirjustbarelyPLDsasaguide,thepanelistsweretheninstructedtosetabookmarkon
theitemthatbestdelineatedeachoftheperformancelevels.Panelistswereremindedhowto
setbookmarks,andpriortomakinginitialplacements,facilitatorsledagroupactivitythat
reviewedthekeyconceptsofthebookmarkprocedure,allowingfacilitatorstoprovide
additionaltrainingifnecessary.Priortoplacingrecommendedperformancestandardsineach
round,panelistswereaskedtocompleteareadinessformtoindicatetheirpreparednessto
recommendperformancestandards.Thisformaskedpaneliststoasserttheirunderstandingof
thetoolsusedtorecommendperformancestandardsineachround.Ifapanelistindicatesthat
theydonotfeelpreparedtorecommendperformancestandards,theworkshopleader
providesadditionaltrainingandopportunitiesfordiscussion.Allpanelistshadtoindicatethat
theyfeltpreparedtomoveforwardbeforetheyrecommendedacut.AllAzMERITstandard
settingpanelistsindicatedtheyunderstoodthetaskathandandfeltreadytorecommend
performancestandards.Samplesofreadinessformsusedforcompletingthebookmarktaskare
presentedinAppendixH.
Bookmarkplacementwasconductedintworounds,allowingpaneliststomakeindependent
judgmentswhilestillbenefitingfromdiscussionwiththeirfellowpanelists.Panelistswere
instructedtoidentifytheirrecommendedcutsforProficient,PartiallyProficient,andHighly
Proficientineachround.TheplacementofthebookmarkisillustratedinFigure1.Eachpanelist
usedtheirjustbarelyPLDstoidentifywhichitemrepresentedthelowerboundofeach
performancelevel.Intheexample,apanelistconcludedthatstudentswhowerejustbarelyat
theProficientlevelwoulddemonstratemasteryontheitemonthepageindicatedbythe
arrow,whilestudentsbelowtheProficientlevelwouldnot.Therefore,thepanelistdecided
thattheProficientperformancelevelwouldbeginonthepageindicatedbyanarrow.The
panelistbelievedthatstudentsbelowtheProficientperformancelevelwouldnotbeableto
demonstratemasteryofitemsbeyondtheindicatedpageintheordereditembooklet.
16
AzMERIT
StandardSettingTechnicalReport
Benchmark Information
Panelistswerechargedtorecommendperformancestandardscomparabletootherimportant
assessmentsystems,includingnationalandinternationalbenchmarkssuchasNAEP,other
statewideassessments,andcollegeentryexams.TofacilitatecomparisonsofArizona
performancestandardswithothernationalandinternationalbenchmarks,panelistswere
providedwiththelocationsofperformancestandardsfromtheseotherassessmentssystemsin
theirOIBs.Inparticular,performancestandardlocationsforthefollowingassessmentswere
providedaspartofpanelistsOIBreview:
SmarterBalancedELAandmathperformancestandardsingrades38and11/AlgebraII,
PISAperformancestandardsingrade10ELAandGeometry,
NAEPperformancestandardsinreadingandmathingrades4and8(andinterpolated
forgrade6),
ACTcollegereadyperformancestandardingrade11ELAandAlgebraII,and
ArizonaspreviousAIMSassessment.
17
AzMERIT
StandardSettingTechnicalReport
18
AzMERIT
StandardSettingTechnicalReport
studentsestimatedtomeetorexceedeachpotentialperformancestandardontheAzMERIT
wasbasedonallstudentswhoparticipatedintheoperationalassessment.Asummaryofthe
modecomparabilitystudyispresentedinAppendixI7.
PriortoRound2oftheBookmarkprocedure,thepercentageofstudentsmeetingthe
standards,basedontheRound1mediancutscore,waspresentedtopanelists.
Vertical Articulation
Performancestandardsshouldideallybewellarticulatedacrossgrades.Unlessthereare
systemicdifferencesinthequalityofinstructionacrossgrades,theexpectationisthatstudents
whomeetthestandardsandarepreparedforinstructioninthesubsequentgradewilllikely
continuetomeetstandardsastheyprogressthroughtheirschoolyears,andthatthereforewe
wouldnotexpecttoseelargechangesintheproficiencyratesfromgradetograde.Whilethis
verticalarticulationisincorporatedintothedevelopmentoftheArizonaCollegeandCareer
ReadyStandardsaswellasthetestspecificationsforeachoftheAzMERITassessments,
maintainingandreinforcingthecrossgradearticulationinthesettingofmeaningful
performancestandardsisimportant,especiallyforELAandmath,wherestudentsareassessed
annually.Lackofarticulationinthesesubjectscanresultinconfusion,especiallywhenthereare
unreasonablylargeshiftsinstudentperformancelevelclassificationsfromgradetograde.
Articulationwasconsideredfromtwoperspectives:thepercentofstudentsmeetingstandards
acrossgradesandcourses,andthelocationoftheperformancestandardsonthevertically
linkedAzMERITscale,whichallowedpaneliststoevaluatetheirrecommendedperformance
standardswithrespecttoexpectedstudentgrowthfromgradetograde.Adescriptionofthe
proceduresusedtoyieldtheAzMERITverticalscaleispresentedinAppendixJ.
Tohelpfosterconsistencyintheidentificationofperformancestandardsacrossgrades,after
performancestandardswererecommendedfortheinitialgradelevelineachgradeband,table
leaderswereconvenedtoparticipateinaverticalmoderationsession.Tableleaderswere
shownthepercentageofstudentsscoringatoraboveeachoftheperformancestandards,and
thepercentofstudentsclassifiedateachperformancelevelacrosstests.Wherethepercentage
ofstudentsexpectedtomeetstandardsvariedgreatlybetweengradeorcoursebased
assessments,tableleaderswereaskedtoconsidermodificationstotherecommended
standardsthatwouldachieveamorearticulatedsystemofstandards.Intheseinstances,table
leadersreviewedtheordereditembookletsandconsideredwhetherthecontentoftheOIB
supportedtheadjustment.Thus,whiletableleadersworkedtoarticulatestandardsacross
grades,theyalsoensuredthatanychangesresultingfromthemoderationmeetingbe
consistentwiththeknowledgeandskillsdescribedinthePLDs.
Withanchorgradeperformancestandardsinhand,AIRevaluatedbothimpactdatafromeach
gradelevelassessment,aswellasstudentabilityestimatesfromtheverticallylinkedAzMERIT
ResponsivetoStandardsforEducationandPsychologicalTesting:Standard3.0,3.5,3.6,3.8,3.15,5.7,5.12,5.13,
5.14,5.15,12.3,12.17,and13.6
19
AzMERIT
StandardSettingTechnicalReport
scale,tointerpolatethelikelylocationofeachperformancestandardforeachoftheremaining
gradelevelandEOCassessments.
Torecommendperformancestandardsinthesenonanchorgradeassessments,thestandard
bookmarkproceduresweremodifiedsothatpanelistswereinstructedtodeterminewhether
thejustbarelyPLDssupportedtheplacementofaspecificbookmarkontheinterpolatedpage.
IfthePLDsdidnotsupporttheplacementofthebookmarkontheinterpolatedpage,then
panelistswereaskedwhethertheycouldidentifyabookmarkplacementneartheinterpolated
pagethatwouldbesupportedbythePLDs.Panelistswereinstructedthattheirbookmark
placementsmustbeguidedbycontentconsiderations,whethertheyrecommendedthe
interpolatedpageintheOIBoradifferentbookmarkplacement.Otherwise,bookmark
placementsproceededaswiththeanchorgraderounds.FollowingRound1bookmark
placements,panelistsreceivedfeedbackaboutthebookmarkplacementsofpanelistsattheir
table,andfortheroomasawholeandimpactdata.
Afinalmoderationsessionwasconductedfollowingthecompletionofworkshopactivitiesfor
theinterpolatedgrades.Thisfinalmoderationactivityensuredthattableleadershadan
opportunitytoreviewtheentiresystemofrecommendedstandardsandtomakeanydesired
adjustmentspriortocompletionoftheworkshop.Aswiththeinitialmoderationsession,in
thoseinstanceswheretableleaderschosetoadjustaperformancestandardduringthefinal
moderationsession,theyreviewedtheirordereditembookletstoensurethattheadjustments
hadabasisintestcontent.
Theadvantageofthisapproachisthatitresultsinasystemofperformancestandardsthatare
moreconsistentacrossgradelevels.Atthemostbasiclevel,itensuresthattherearenotwide
fluctuationsintheproportionofstudentsmeetingeachperformancestandardacrossgrades.
Crossgradearticulationinformedbytheverticalscalealsoensuresthattherearenoreversals
inrecommendedperformancestandardsacrossgrades.
Workshop Evaluation
Panelistswereencouragedtoprovidefeedbackconcerningtheproceduresandoutcomesof
thestandardsettingworkshopthroughouttheprocess,viagroupdiscussions,practice
activities,andcompletionofreadinessformspriortoplacingtheirbookmarks.
Atthecompletionoftheworkshop,panelistswereaskedtocompleteaworkshopevaluation
formdesignedtoelicitfeedbackonallaspectsoftheworkshop,includingclarityoftrainingand
tasks,appropriatenessofthetimespentonactivities,andsatisfactionwiththeoutcomeofthe
workshop.SamplesoftheevaluationformsarepresentedinAppendixK.
20
AzMERIT
StandardSettingTechnicalReport
21
AzMERIT
StandardSettingTechnicalReport
Table4.FinalRecommendedPerformanceStandardsforAzMERIT
Test
Grade3
ELA
Grade4
ELA
Grade5
ELA
Grade6
ELA
Grade7
ELA
Grade8
ELA
Grade9
ELA
Grade10
ELA
Grade11
ELA
Grade3
Math
Grade4
Math
Grade5
Math
PerformanceLevel
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
OrderedItem
BookletPage
18
25
49
19
32
57
15
32
53
16
30
58
18
36
61
19
38
62
17
32
56
13
32
59
13
29
52
10
33
52
10
35
58
4
27
52
22
Theta
0.09
0.29
1.36
0.14
0.60
1.80
0.13
0.63
1.80
0.12
0.58
2.03
0.02
0.61
1.90
0.06
0.64
1.72
0.12
0.59
1.57
0.11
0.58
1.42
0.02
0.52
1.27
0.16
1.04
2.43
0.31
0.76
2.20
0.65
0.41
1.74
EstimatedPercentage
ofStudentsAtor
AbovePerformance
Standard
56
41
10
57
39
5
63
30
3
61
34
4
59
33
4
60
33
6
53
27
6
51
30
8
46
26
8
73
42
15
71
42
10
71
40
13
AzMERIT
Test
Grade6
Math
Grade7
Math
Grade8
Math
AlgebraI
Geometry
AlgebraII
PerformanceLevel
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
PartiallyProficient
Proficient
HighlyProficient
OrderedItem
BookletPage
9
26
46
11
30
46
15
29
47
17
33
56
16
30
52
15
29
49
StandardSettingTechnicalReport
Theta
0.48
0.41
1.55
0.19
0.59
1.51
0.69
0.09
1.15
0.69
0.03
1.27
1.37
0.58
0.96
1.49
0.78
0.57
EstimatedPercentage
ofStudentsAtor
AbovePerformance
Standard
62
32
11
52
30
13
57
32
13
55
32
9
53
30
6
53
29
6
Note:Followingthestandardsettingworkshop,recommendationsaresubmittedtoArizonasStateBoardof
Education.PerformancestandardsarenotfinalpriortoapprovalandadoptionbytheBoard.
23
AzMERIT
StandardSettingTechnicalReport
Table5showstheestimatedpercentageofstudentclassifiedateachperformancelevelbased
onfinalpanelistrecommendedstandardsforthestudentpopulationoverallacrossgradelevels
andcoursesfortheELAandmathassessments.TheresultsofTable5arerepresented
graphicallyinFigure2,forELA,andFigure3formath.AppendixNpresentstheestimated
percentageofstudentsclassifiedateachperformanceleveldisaggregatedbygenderand
ethnicity.
Table5.PercentageofStudentsatEachPerformanceLevelbasedonFinalRecommended
PerformanceStandards
Test
Grade3ELA
Grade4ELA
Grade5ELA
Grade6ELA
Grade7ELA
Grade8ELA
Grade9ELA
Grade10ELA
Grade11ELA
Grade3Math
Grade4Math
Grade5Math
Grade6Math
Grade7Math
Grade8Math
AlgebraI
Geometry
AlgebraII
MinimallyProficient PartiallyProficient
ELA
44%
15%
43%
19%
37%
33%
39%
27%
41%
26%
40%
27%
47%
26%
49%
21%
54%
20%
Math
27%
31%
29%
29%
29%
31%
38%
30%
48%
22%
43%
24%
45%
23%
47%
24%
47%
24%
Proficient
HighlyProficient
31%
33%
27%
30%
29%
26%
21%
22%
17%
10%
5%
3%
4%
4%
6%
6%
8%
8%
27%
32%
27%
21%
18%
20%
23%
24%
23%
15%
10%
13%
11%
13%
13%
9%
6%
6%
24
AzMERIT
StandardSettingTechnicalReport
Figure2.PercentageofStudentsatEachPerformanceLevelbasedonFinalRecommended
PerformanceStandardsAzMERITELA
5
10
27
33
30
29
26
21
22
17
33
20
19
13
44
43
G3ELA
G4ELA
33
26
39
41
40
G5ELA
G6ELA
G7ELA
G8ELA
PartiallyProficient
25
21
47
49
27
37
MinimallyProficient
27
26
G9ELA
Proficient
54
G10ELA G11ELA
HighlyProficient
AzMERIT
StandardSettingTechnicalReport
Figure3.PercentageofStudentsatEachPerformanceLevelbasedonFinalRecommended
PerformanceStandardsAzMERITMath
15
27
10
32
13
11
13
13
21
18
20
23
24
23
43
45
30
29
48
29
24
23
24
24
47
47
31
38
27
27
22
31
29
PartiallyProficient
26
Proficient
HighlyProficient
AzMERIT
StandardSettingTechnicalReport
ADEintendstoreportstudentperformanceontheontheverticallylinkedAzMERITscale.
Becauseabilityestimatesofextremelylowandhighscoringstudentsarelessprecise,test
scoresforverylowandhighperformingstudentswillbemorepronetofluctuateovertime.To
minimizescalescoreinstabilityforverylowandhighscoringstudents,abilityestimateswillbe
truncatedat+3.5onthewithingradescalebeforebeingtransformedtotheverticallylinked
scale.
StudentabilityestimateswillthenbetransformedfromtheverticallylinkedRaschthetascale
tothesubjectspecificAzMERITreportingscale:
2500
30
3500
30
ApplyingtheAzMERITscalescoretransformationstotheperformancestandardsrecommended
bytheworkshoppanelsresultsinthesystemofscalescorerangesforeachoftheAzMERIT
performancelevelclassificationsidentifiedinTable6.
Table6.AzMERITScaleScoreRangesBasedonFinalRecommendedPerformanceStandards
Test
MinimallyProficient
PartiallyProficient
Proficient
HighlyProficient
ELA
Grade3ELA
23952496
24972508
25092540
25412605
Grade4ELA
24002509
25102522
25232558
25592610
Grade5ELA
24192519
25202542
25432577
25782629
Grade6ELA
24312531
25322552
25532596
25972641
Grade7ELA
24382542
25432560
25612599
26002648
Grade8ELA
24482550
25512571
25722603
26042658
Grade9ELA
24542554
25552576
25772605
26062664
Grade10ELA
24582566
25672580
25812605
26062668
Grade11ELA
24652568
25692584
25852607
26082675
Math
Grade3Math
33953494
34953530
35313572
35733605
Grade4Math
34353529
35303561
35623605
36063645
Grade5Math
34783562
35633594
35953634
36353688
Grade6Math
35123601
36023628
36293662
36633722
Grade7Math
35293628
36293651
36523679
36803739
Grade8Math
35663649
36503672
36733704
37053776
AlgebraI
35773660
36613680
36813719
37203787
Geometry
36093672
36733696
36973742
37433819
AlgebraII
36293689
36903710
37113750
37513839
27
AzMERIT
StandardSettingTechnicalReport
Disagree
Agree
Strongly
Agree
IamconfidentthatstudentsclassifiedasProficient
demonstrateafundamentalunderstandingofand
abilitytoapplythecontentknowledgeandskills
neededtobeontracktowardsArizonasCollegeand
CareerReadinessStandards(ACCRS)inMathematics
andEnglishLanguageArtsStandards.(Level3)
35
44
IamconfidentthatstudentsclassifiedasPartially
Proficientdemonstrateapartialunderstandingof
andabilitytoapplythecontentknowledgeandskills
neededtobeontracktowardsArizonasCollegeand
CareerReadinessStandards(ACCRS)inMathematics
andEnglishLanguageArtsStandards.(Level2)
34
45
IamconfidentthatstudentsclassifiedasHighly
Proficientdemonstrateanadvancedunderstanding
ofandabilitytoapplythecontentknowledgeand
skillsneededtobeontracktowardsArizonasCollege
andCareerReadinessStandards(ACCRS)in
MathematicsandEnglishLanguageArtsStandards.
(Level4)
30
49
WorkshopEvaluationQuestion
28
AzMERIT
StandardSettingTechnicalReport
29
AzMERIT
StandardSettingTechnicalReport
References
Ferrara,S.,Perie,M.,&Johnson,E.(2008).Matchingthejudgmentaltaskwithstandardsetting
panelistexpertise:TheItemDescriptor(ID)Matchingprocedure.JournalofApplied
TestingTechnology,9(1).
McLaughlin,D.,Scarloss,B.A.,Stancavage,F.B.,&Blankenship,C.D.(2005).UsingState
AssessmentstoImputeAchievementofStudentsAbsentfromNAEP:AnEmpiricalStudyin
FourStates.Washington,DC:AmericanInstitutesforResearch.Retrievedfrom
www.air.org/files/McLaughlin_AbsentStudents.pdf
Mitzel,H.C.,Lewis,D.M.,Patz,R.J.,&Green,D.R.(2001).TheBookmarkprocedure:
Psychologicalperspectives.InG.Cizek(Ed.),Settingperformancestandards:Concepts,
methods,andperspectives.Mahwah,NJ:Erlba
30
AzMERIT
Appendix
StandardSettingTechnicalReport
AzMERIT
Document A1. AzMERIT Mathematics & ELA Grades 3-8 Standard Setting Agenda
July 14 - 16, 2015
(Grade 3-8 Panels)
Tuesday, July 14, 2015
7:30 8:00
7:30 8:00
8:00 8:15
8:15 9:30
9:30 9:45
9:45 10:00
10:00 11:00
11:00 12:00
Review Performance Level Descriptors and develop Just Barely PLDs Grades
4, 6, and 8
12:00 1:00
Lunch
1:00 2:30
Review PLDs and develop Just Barely PLDs Grades 4, 6, and 8 (continued)
2:30 2:45
Break
2:45 4:45
4:45
Adjourn
Wednesday, July 15, 2015
7:30 8:00
8:00 9:00
AzMERIT
9:00 10:15
10:15 10:30
10:30 11:30
11:30 12:30
Lunch
12:30 1:30
1:30 3:30
Review Performance Level Descriptors and develop Just Barely PLDs Grades
3, 5, and 7
3:30 3:45
Break
3:45 4:45
4:45
10:00 10:15
Panelist Break
10:15 10:45
A-2
AzMERIT
12:00 1:00
Lunch
1:00 2:00
2:00 3:00
3:00 3:30
3:30 4:30
A-3
AzMERIT
Document A2. AzMERIT Mathematics & ELA EOC Standard Setting Agenda July
13 - 16, 2015
High School Panels
Monday, July 13, 2015
7:30 8:00
7:30 8:00
8:00 8:15
8:15 9:30
9:30 9:45
9:45 10:00
10:00 11:00
11:00 12:00
Review Performance Level Descriptors and develop Just Barely PLDs ELA 11/
Algebra II
12:00 1:00
Lunch
1:00 2:30
Review PLDs and develop Just Barely PLDs Algebra ELA/11 II (continued)
2:30 2:45
Break
2:45 4:45
4:45
Adjourn
Tuesday, July 14, 2015
7:30 8:00
A-4
AzMERIT
9:00 10:15
10:15 10:30
10:30 11:30
11:30 12:30
Lunch
12:30 1:30
1:30 3:30
Review Performance Level Descriptors and develop Just Barely PLDs ELA 10/
Geometry
3:30 3:45
Break
3:45 4:45
4:45
Adjourn
Wednesday, July 15, 2015
7:30 8:00
8:00 9:00
9:00 10:15
A-5
AzMERIT
10:15 10:30
Panelist Break
10:30 11:30
11:30 12:30
Lunch
12:30 1:30
1:30 3:30
Review Performance Level Descriptors and develop Just Barely PLDs ELA 9/
Algebra I
3:30 3:45
Break
3:45 4:45
4:45
Adjourn
Thursday, July 16, 2015
7:30 8:00
8:00 10:00
10:00 10:15
Panelist Break
10:15 10:45
10:45 12:00
12:00 1:00
Lunch
A-6
AzMERIT
2:00 3:00
3:00 3:30
3:30 4:30
A-7
AzMERIT
Appendix
StandardSettingTechnicalReport
AzMERIT
StandardSettingTechnicalReport
TableB1.CompositionofELAGrades34Panels
Table
Table
Leader
Yes
Rural
ArizonaNavajoCentral
Male
n/a
Urbanized
PeoriaUnifiedSchoolDistrict
n/a
Urbanized
Yes
Rural
n/a
Urbanized
n/a
UrbanClusters
n/a
Urbanized
Yes
Urbanized
n/a
Urbanized
n/a
Suburban
Urban/Rural
District
CAFAINC.LearningFoundation
andPerformingArts
LegacyTraditionalSchoolsand
AthlosTraditionalAcademy
MaricopaCountyEducation
ServiceAgency
J.O.CombsUnifiedSchool
District
MadisonElementaryDistrict
WashingtonElementarySchool
District
CAFA,Inc.dbaLearning
FoundationPerformingArts
School
DeerValleyUnifiedDistrict
Gender
Ethnicity
GradeMost
Frequently
Taught
ElementaryEducation
Female Asian
ElementaryEducation
Female White,nonHispanic
SecondaryEducation
Female HispanicorLatino
Elementary,Administrative
Principal,Superintendent
Female HispanicorLatino
Elementary,Secondary
Female White,nonHispanic
ElementaryEducation
Female White,nonHispanic
ElementaryEducation
Female White,nonHispanic
Elementary,Administrative
Principal,Superintendent
Female HispanicorLatino
ElementaryEducation
Female White,nonHispanic
Elementary,Administrative
B-1
NativeAmerican
CurrentPosition
AzMERIT
StandardSettingTechnicalReport
TableB2.CompositionofELAGrades56Panels
GradeMost
Frequently
Taught
Table
Table
Leader
Yes
UrbanClusters
MesaUnifiedDistrict
Female Black
ElementaryEducation
n/a
Rural
SuperiorUnifiedSchoolDistrict
Female White,nonHispanic
Elementary,Secondary
n/a
Suburban
MesaUnifiedDistrict
Female White,nonHispanic
ElementaryEducation
Yes
UrbanClusters
MayerUnifiedSchoolDistrict
Female White,nonHispanic
ElementaryEducation
n/a
Urbanized
LibertyElementaryDistrict
Female White,nonHispanic
ElementaryEducation
n/a
Urbanized
ChandlerUnifiedDistrict
Female White,nonHispanic
ElementaryandSpecialEducation
Yes
Urbanized
ParadiseValleyUnifiedDistrict
Female White,nonHispanic
ElementaryandSpecialEducation
n/a
Urbanized
AvondaleElementaryDistrict
Female White,nonHispanic
ElementaryEducation
n/a
Urbanized
PeoriaUnifiedSchoolDistrict
Female White,nonHispanic
Elementary,Administrative
Principal,Superintendent
Urban/Rural
District
Gender
Ethnicity
CurrentPosition
B-2
AzMERIT
StandardSettingTechnicalReport
TableB3.CompositionofELAGrades78Panels
GradeMost
Frequently
Taught
Table
Table
Leader
Yes
Suburban
PeoriaUnifiedSchoolDistrict
Female
White,nonHispanic ElementaryEducation
n/a
Urbanized
AlhambraElementaryDistrict
Female
White,nonHispanic
n/a
UrbanClusters
J.O.CombsUnifiedSchool
District
Male
Yes
Urban
GeorgeGervinPrepAcademy
Female
n/a
UrbanClusters
DysartUnifiedDistrict
Female
White,nonHispanic SecondaryEducation
n/a
Urbanized
MesaUnifiedDistrict
Female
White,nonHispanic ElementaryandSpecialEducation
Yes
Suburban
PeoriaUnifiedSchoolDistrict
Female
White,nonHispanic Elementary,JuniorHigh
n/a
UrbanClusters
KyreneElementaryDistrict
Female
White,nonHispanic SpecialEducation
n/a
Urbanized
LaveenElementaryDistrict
Female
White,nonHispanic SecondaryEducation
Urban/Rural
District
Gender
Ethnicity
CurrentPosition
AdministrativePrincipal,
Superintendent
Secondary,Administrative
White,nonHispanic
Principal,Superintendent
ElementaryK8,SpecialEdK8,
HispanicorLatino
NBCTEnglishLanguageArts
7
8
8
7
B-3
AzMERIT
StandardSettingTechnicalReport
TableB4.CompositionofELAGrades911Panels
Table
Table
Leader
Urban/Rural
Yes
Urbanized
n/a
Urbanized
n/a
Rural
n/a
District
AmericanCharterSchools
Foundationd.b.a.WestPhoenix
HighSchool
AmericanCharterSchools
Foundationd.b.a.SunValleyHigh
School
Gender
Ethnicity
CurrentPosition
GradeMost
Frequently
Taught
Male
White,nonHispanic Secondary,AdministrativeDuties
Female
White,nonHispanic
RedMesaUnifiedSchoolDistrict
Female
White,nonHispanic SecondaryEnglish&Art
11
UrbanClusters
PrescottUnifiedDistrict
Female
MultiRacial
SecondaryEducation
Yes
Rural
VailUnifiedDistrict
Male
White,nonHispanic SecondaryEducation
10
n/a
UrbanClusters
TucsonUnifiedDistrict
Female
White,nonHispanic SecondaryEducation
11
n/a
Urbanized
GlendaleUnionHighSchool
District
Female
White,nonHispanic SecondaryEducation
10
11
Secondary,Administrative
Principal,Superintendent
10
Yes
Rural
J.O.CombsUnifiedSchoolDistrict
Female
SecondaryEducation,Adult
White,nonHispanic Education,APLanguage&
Composition
n/a
Urbanized
TollesonUnionHighSchool
District
Female
White,nonHispanic
n/a
Urbanized
PimaPreventionPartnership
Female
Asian
11
SecondaryEducation
B-4
AzMERIT
StandardSettingTechnicalReport
TableB5.CompositionofMathematicsGrades34Panels
Table
Table
Leader
Yes
Urbanized
n/a
Urban/Rural
District
CurrentPosition
GradeMost
Frequently
Taught
Gender
Ethnicity
RodelFoundationofArizona
Female
White,nonHispanic
Urbanized
ScottsdaleUnifiedDistrict
Female
White,nonHispanic ElementaryEducation
n/a
Urbanized
RodelFoundationofArizona
Female
White,nonHispanic
Yes
Rural
PimaUnifiedDistrict
Female
White,nonHispanic ElementaryEducation
n/a
Urbanized
GilbertUnifiedDistrict
Female
White,nonHispanic ElementaryEducation
n/a
Urbanized
DeerValleyUnifiedDistrict
Female
White,nonHispanic ElementaryEducation
Yes
Urbanized
MesaUnifiedDistrict
Female
White,nonHispanic ElementaryEducation
n/a
Urbanized
CartwrightElementaryDistrict
Female
White,nonHispanic (notprovided)
n/a
Urbanized
MadisonElementaryDistrict
Female
White,nonHispanic ElementaryEducation
n/a
Rural
LakeHavasuUnifiedDistrict
Female
White,nonHispanic ElementaryEducation
Elementary,Administrative
Principal,Superintendent
Elementary,Administrative
Principal,Superintendent
4
3
3
B-5
AzMERIT
StandardSettingTechnicalReport
TableB6.CompositionofMathematicsGrades56Panels
GradeMost
Frequently
Taught
Table
Table
Leader
Yes
Urbanized
MesaUnifiedDistrict
Female
n/a
Urbanized
AvondaleElementarySchool
District
Female
n/a
Urbanized
ScottsdaleUnifiedDistrict
Female
White,nonHispanic ElementaryEducation
n/a
UrbanClusters
J.O.CombsUnifiedSchoolDistrict
Female
White,nonHispanic ElementaryEducation
Yes
Rural
WashingtonElementarySchool
District
Male
White,nonHispanic ElementaryEducation
n/a
Urbanized
DeerValleyUnifiedDistrict
Female
White,nonHispanic ElementaryEducation
n/a
Urbanized
FowlerElementaryDistrict
Female
White,nonHispanic ElementaryEducation
n/a
Urbanized
KyreneElementaryDistrict
Female
Black
ElementaryEducation
Yes
Urbanized
TanqueVerdeUnifiedDistrict
Female
White,nonHispanic
Elementary,Administrative
Principal,Superintendent
n/a
UrbanClusters
GlendaleElementaryDistrict
Female
White,nonHispanic ElementaryEducation
n/a
Suburban
ChandlerUnifiedDistrict
Female
White,nonHispanic ElementaryEducation
Urban/Rural
District
Gender
Ethnicity
CurrentPosition
Elementary,Administrative
Principal,Superintendent
Elementary,Administrative
White,nonHispanic
Principal,Superintendent
HispanicorLatino
5
6
B-6
AzMERIT
StandardSettingTechnicalReport
TableB7.CompositionofMathematicsGrades78Panels
GradeMost
Frequently
Taught
Table
Table
Leader
Yes
Urban
DeerValleyUnifiedDistrict
Male
White,nonHispanic SecondaryEducation
n/a
Urbanized
OsbornElementaryDistrict
Female
White,nonHispanic Elementary,Secondary
n/a
Urbanized
DeerValleyUnifiedDistrict
Female
White,nonHispanic SecondaryEducation
n/a
UrbanClusters
LitchfieldElementarySchool
District
Female
White,nonHispanic
Secondary,Biology,MiddleGrades
Mathematics
Yes
Suburban
MesaUnifiedDistrict
Female
HispanicorLatino
Elementary,SecondaryMathematics
n/a
Urbanized
ArizonaSchoolfortheArts
Female
White,nonHispanic ElementaryEducation
n/a
Suburban
ChandlerUnifiedDistrict
Female
White,nonHispanic SecondaryMathematics
n/a
Urbanized
CartwrightElementaryDistrict
Male
HispanicorLatino
ElementaryEducation
Yes
Urbanized
TucsonUnifiedDistrict
Female
White,nonHispanic ElementaryEducation
n/a
UrbanClusters
BuckeyeElementaryDistrict
Male
White,nonHispanic SecondaryEducation
n/a
Urbanized
MesaUnifiedDistrict
Female
White,nonHispanic SpecialEducation
Urban/Rural
District
Gender
Ethnicity
CurrentPosition
B-7
AzMERIT
StandardSettingTechnicalReport
TableB8.CompositionofMathematicsEOCPanels
Table
Table
Leader
Yes
n/a
Urbanized
n/a
Urbanized
Yes
Urbanized
n/a
Rural
n/a
Urban/Rural
District
Gender
Ethnicity
CurrentPosition
GradeMost
Frequently
Taught
White,nonHispanic Elementary,Secondary
10
Female
White,nonHispanic SecondaryEducation
Female
White,nonHispanic SecondaryEducation
Female
White,nonHispanic
Female
White,nonHispanic SecondaryMathematics
10
UrbanClusters LeadingEdgeAcademy
Female
White,nonHispanic SecondaryEducation
n/a
UrbanClusters DysartUnifiedDistrict
Female
Asian
10
Yes
Rural
LakeHavasuUnifiedDistrict
Female
White,nonHispanic SecondaryMathematics
n/a
Urbanized
ChandlerUnifiedDistrict
Female
White,nonHispanic SecondaryEducation
11
n/a
Urbanized
PrimaveraTechnicalLearning
Center
Female
White,nonHispanic SecondaryEducation
10
n/a
Urbanized
DeerValleyUnifiedDistrict
Male
White,nonHispanic SecondaryMathematics
11
AguaFriaUnionHighSchool
District
AmericanCharterSchools
Foundationd.b.a.EstrellaHigh
School
GlendaleUnionHighSchool
District
FlorenceUnifiedDistrict
Secondary,GiftedEndorsement,
NBPT
SecondaryEducation
11
B-8
AzMERIT
Appendix
StandardSettingTechnicalReport
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
Thepurposeofthisworkshopistorecommendasystemofperformancestandardstothe
stateboard ofeducation.ForeachofthenewAzMERIT assessments,theworkshoppanels
willrecommendthreeperformancestandardsorcutscores:PartiallyProficient,Proficient
andHighlyProficient.Thesewillbeused toclassifystudentsintooneoffourperformance
levels: MinimallyProficient,PartiallyProficient,Proficient,andHighlyProficient
Tosetvalid,meaningfulcutscores,thatarepubliclyverifiable,standardsettingworkshops
areconducted.Thestandardsettingworkshopsemployresearchbasedproceduresthatare
usedbycommitteesofeducatorstoestablishcutscoresonastate'sassessments.
Performancestandardsimpactstudentsandtheeducationsystemstatewide.The
proceduresyouwillengageinaredesignedtogiveyouthetoolstomakeinformed
judgmentsthatyielddefensiblerecommendationsthatcanbesubmittedtostateboardof
educationforadoption.
C-1
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
Inthisworkshop,wewillberecommendingperformancestandardsforELAgrades3 11
and Mathgrade38,AlgebraI,GeometryandAlgebraII.Thereare8 separatepanelswhich
willworkindependently.Thepanelswillbesplitupbygradebands,ELAgrade34,56,78
and911andMathgrades34,56,78andAlgebraI,GeometryandAlgebraII.
ArizonasMathematics andEnglishLanguageArtsandLiteracystandardswereadoptedin
2010andaddressthemathematics,reading,writing,language,andspeakingandlistening
skillsthateachstudentwillworktomasterashe/sheprogressesthroughschooland
towardscollegeandacareer.
Eachpaneliscomprisedofabout 12panelists,splitintothreetables.
Eachtablehasadesignatedtableleaderwhowillhelptodistributeandcollectmaterials,
andwhocanserveasaliaisonbetweenyourtableandtheworkshopstaff.Pleasemake
suretoleaveallsecurematerialsintheroomsorturn intoyourtableleaderif directedby
theworkshopleader.
C-2
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
Following finalrecommendations,wewillconductadebriefingandwewillaskyouto
completeaworkshopevaluationform beforeyouleave.Theevaluationformsyouwill
receivethroughouttheprocessareanimportantpartofthestandardsettingandyouare
askedtocompletethemthoroughlyandthoughtfully.
Wewillbegintheworkshopwithanoverviewofthestandardsettingprocess.Thepanels
willemploytheBookmarkproceduretorecommendstandards.Youwillbetrainedonthe
specificsofthesemethodsasyougothrougheachstepoftheprocesswithinyourown
groups.
Followingthisintroduction,eachofyouwillhaveanopportunitytoparticipateinthesame
assessmentsadministeredtostudentsthisspring.Youwilltakethegradeandsubjecttest
foryourassignedcommitteeintheonlinetestingenvironmentthatstudentsexperienced.
Followingthat,youwillworkwithothermembersatyourtabletoreviewthePerformance
LevelDescriptorswhichdefinetheknowledgeandskillrequirementsofstudentsateach
level.
Next,youwillreviewabookoftestitemsorderedfromeasiesttomostdifficultbasedon
actualstudentperformancetorecommendperformancestandards,thinkingaboutwhat
studentshavetoknowandbeabletodoinordertorespondsuccessfullytoeachitem.This
isreferredtoasyourOrderedItemBookletorOIB.Youllthenrecommendperformance
standardsbyidentifyingpagesintheOIBthatserveascutsfordifferentlevelsof
achievement.Youllreceiveanddiscussfeedbackonyourinitialrecommendationswith
yourfellowpanelists,andthenmakeanotherindividualrecommendation.Then,youll
receivefurtherfeedbackandotherperformanceinformationtoprovideadditionalcontext
toyourrecommendations.
C-3
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
Standardsettingrefersgenerallytotheprocessofidentifyingapassingscoreonatest.The
centralquestionofthestandardsettingprocessistoidentifythelevelofperformanceona
testthatindicatesapassing,orgoodenough,performance.
FacilitatorNote:Pleasestresstheimportanceofsecurity.Theseareoperationalitemsthat
willbeusedonfutureadministrations.Absolutelynopicturetaking,cellphonesaretobe
putawayandnotoutatthetable,notextingwhileworking.Weunderstandemergencies
mayhappen,pleasetakeallcallsoutsidethemeetingroom.Donotsurfotherwebsites
whileusingthelaptops.
Apassingorgoodenoughperformanceisdeterminedbythepurposeoftheassessment.
Testsmay,forexample,certifyminimumcompetenceorselectoutonlythehighest
performers.
Wecantstresstheimportanceofsecurityenough.Wellbeworkingwithlivetestitems
thatwillbeadministeredtostudentsagaininthefuture,anditsimportantfromatest
scorevalidityperspectivethatitemsremainsecure.Thatmeansthatweaskthatyoukeep
cellphones,tablets,laptopsaway,andstepoutsideifyouneedtotakeacall.
TheAzMERIT arecriterionreferencedtests,meaningthattheydirectlymeasurea
representativesampleoftheknowledgeandskillsthatstudentsareexpectedtoachieveby
theendofeachschoolyear. Therefore,wewillemployatestcenteredapproachtosetting
performancestandards.Intestcenteredapproaches,cutscoresareestablishedbasedon
thedegreetowhichstudentsdemonstrateachievementofknowledgeandskillsmeasured
directlyintheassessment.Forthisreason,testcenteredapproachesdependcriticallyon
havingparticipantsinthestandardsettingwhoareveryknowledgeableaboutthestate's
contentstandardsandwillingtohelpthestatedefinethelevelofknowledgeandskill
expectedofastudentateachperformanceleveldemonstratedbythecutscores.
C-4
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
Performance levelsareregionsontheachievementscaledemarcatedbytheperformance
standards.Theyclassifystudentsbyhowmuchofthecontentstandardstheyknowandare
abletodo.Thethreeperformancestandardswillresultinfourperformance levels.
Thestandardsettingprocessthatwewillbeengagedinduringthenextseveraldaysis
designedtotranslatetheArizonaacademiccontentstandardsinEnglish andlanguagearts
and mathematic intoasetofperformancestandards,orcutscores.Twoimportant
documents,theOrderedItemBookletandthePerformanceLevelDescriptors,willbeyour
primarytoolsfortranslatingtheacademiccontentstandardsintoperformancestandards.
Throughoutthisworkshop,wewillrefertodifferenttypesofstandards.
Academiccontentstandardsspecifywhatstudentsshouldknowandbeabletodobyend
ofeachacademicyear.
Performancestandardsspecifyhowmuchofthecontentstandardsstudentsmustknow
andbeabletodoinordertomeeteachperformancelevel.Youwillrecommendthree
performancestandards,orcutscores,for eachanchorgrade(i.e.Grade4)andinterpolated
(adjacent)grade(i.e.Grade3).
C-5
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
YouwilldiscussthemechanicsoftheBookmark proceduresinmuchgreaterdetailwithin
yourowngroups.
Therearemanymethodsforsettingperformancestandards,includingexamineecentered
andtestcentered.Insomeemploymentapplications,forexample,testsmaybe
administeredtogroupsofpeoplewhoaremoreorlesssuccessful,andacutscoreis
identifiedthatbestdifferentiatesthetwogroups. Thisisanexampleofanexaminee
centeredapproach.
PerformanceLevelDescriptors,orPLDs,aredetaileddescriptionsoftheknowledgeand
skillsstudentsareabletodemonstratewithrespecttotheacademiccontentstandardsat
eachlevel.Inparticular,wellbeconcernedwithaspecialgroup ofstudents,thosewhojust
barelymeettheperformanceleveldescriptors.
However,becausetheAzMERIT arecriterionreferencedassessments,meaningthatthey
measurearepresentativesampleoftheacademiccontentthatstudentsareexpectedto
knowandbeabletodobytheendofeachschoolyear,weareemployingatestcentered
approachtorecommendedperformancestandards.Inotherwords,successful
performanceofitemsonthetestspeaksdirectlytostudentsperformanceofthe
standards.
TheOrderedItemBooklet,orOIB,containsoperationalandothertestitemsthatwere
administeredinspring2015 aswellasotheritemstofillininformationgaps,orderedfrom
easiesttomostdifficult.
OnceyouhavedevelopeddescriptionsofstudentswhojustbarelymeetthePLDsand
completeyourreviewoftheOIB,youwillbereadytorecommendperformancestandards
foreachoftheproficiencylevels.Youwillrecommendperformancestandardsinmultiple
rounds.
Modernstandardsettingapproachesgenerallyuseof anOrderedItemBooklet,orOIB,
withtestitemsorderedfromeasiesttomostdifficult tohelppanelistsandtostreamline
thestandardsettingprocess.
TheBookmarkmethodiswidelyusedformanyyearsinstatewideassessmentprograms,
andhasbeenusedtosetperformancestandardsforvariousotherstateassessments
includingtheAIMSsysteminArizona.
Althoughyouwillhaveplentyofopportunitiestodiscussbookmarkplacementswithour
fellowpanelists,yourbookmarkplacementsrepresentyouindividualrecommendations
andyouwillmakethoserecommendationsindependentlyfromtheotherpanelists.After
yourinitialbookmarkplacements,youwillhaveanopportunitytodiscussyour
recommendationsincontextofyourfellowpanelistsrecommendations,andaffirmor
reviseyourownrecommendationsinroundtwo.
C-6
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
Forexample,ingrade4math,thePLDdescribesaProficientstudent.Someskillsdescribed
inthePLDinclude:
PerformanceLevelDescriptorswillserveasyourguideforidentifyingperformance
standards.The PLDsdescribewhatskillsstudentsineachlevelareexpectedtohave.When
yourecommendastandard,youareassertingthatstudentswhomeetthatlevelof
performancefitthedescriptionofthestudentsabilitiesprovidedinthePLDs.Thislinkis
criticalbecauseitallowsteachersandfamiliestounderstandwhatastudentstestresults
mean.
TothoroughlyreviewthePLDs,itishelpfultoparsethestandards.Youmayfind,for
example,performancelevelsaredifferentiatedbytheverbsusedinthePLDs forexample,
studentsmayrecognize,identify,understand,explain,andsoon.
Youwillbeaskedtopaycarefulattentiontothecontentandskilldemandsrequiredateach
performancelevel.Itiscriticalforyoutounderstandthatwhenyourecommendacut
score,youareassertingthatstudentswhoperformatthatachievementlevelmeetthe
contentandskillrequirementsdescribedinthePLD.
C-7
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
OIBistheother primarytoolyouwilluse.TheOrderedItemBookletswillpresentyouwith
theitemsfromthespring2015assessments.Thecontentoftheitemsisproportionalto
thetestblueprint.
Wewillcomparetheperformanceleveldescriptors acrossperformancelevels.
TheOIBconsistsofall operationalitemsaswellas1520fieldtestitemstofillin
informationgap.Whatthatmeansisthatweaddeditemswheretherewasalargegapin
itemdifficultybetweenoperationalitemssothattheitemsintheOIBappearmorefluidin
termsofdifficulty.
Allitemswillbepresentedinorderofdifficulty;page1willpresenttheeasiestitem,and
thelastpagewillpresentthehardestitem.Someitemswillberepresentedmorethanonce.
Theseitemsaremoreengagingthanothersandareworthmorethanasinglescorepoint.
Eachpage intheordereditembookletwillrefertospecific scorepointoftheitem,In
eachroomyou willreviewtheseriesofitemsinanonlineenvironment.
C-8
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
Itemsareorderedfromeasiesttomostdifficult.TheOIBprovidesapictureofthe
rangeofknowledgeandskillsencompassedbytheitemsonthetest, andisa
vehicleusetomakecutscorejudgments.
WhenstudyingtheOIB,itisimportanttounderstandthedifferencebetweenitemsin
contextofthewholeOIB.Itemsthatappearearlierinthebookareeasier,despite
perceptionsotherwise,thanitemsthatappearlaterinthebook.
TheOIBshouldprovideusefulinformationaboutnaturalbreaksintheknowledge
andskillrequirementsnecessarytoconsistentlyperformsuccessfullyacrossa
rangeofitemcontent.
For eachitem,askyourselftwoquestions:
1) Whatdostudentsneedtoknowandbeabletodotorespondsuccessfullytothisitem?
2) Whyisthisitemmoredifficultthanthepreviousitems?
Foreachperformancestandard,you willplaceabookmarkonthepagethatdivides
theOIBintotwosetsofpageranges:pagesthatstudentsataparticularlevelcan
reliablyrespondcorrectlyto,andthepagesthatthestudentsatthatlevelcannot
respondcorrectlyto.
Whiletheitemswillbepresentedtoyouonline, youwillbeabletorecordyournotes
aboutthesequestionstorefertoasyoudecidewheretoplaceyourbookmark.
C-9
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
Thedifficultyoftheseitemsisbasedonstudents performanceduringthe2015
operationalassessment.Sowhileaparticularitemmayseemeasierorhardertoyou,the
placementintheordereditembookreflectshoweasyorharditactuallywasforstudents
toperformsuccessfullyontheseitems.
Ifanitemseemsoutofordertoyou,rememberthatanitemmaynotmeasurewhatyou
thinkitmeasures.Forexample,anitemmayintendforastudenttohavetoknowa
particularpieceofinformation,butperhapsthestudentswereabletoanswerusingrecall
fromalessonthatwastaughtrecently.
Insteadoffocusingononeitemthatmayseemoutofplacetoyou,trytoidentifynatural
breaksorthresholdsforgroupsofitems.
C-10
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
JustBarely
Evenwithin eachperformancelevel,studentsvaryinthedegreetowhichtheyhave
masteredtheArizonaStatestandards.Somestudentshavejustbarelycrossedtheline
betweenPartiallyProficientandProficient,whileothersaregettingreadytocrosstheline
betweenProficientandHighlyProficient.Ingeneral,thePLDsarewrittentodescribethe
performanceofstudentsinthemiddleofthecategory.However,weactuallywanttofocus
ourattentiononaspecificsubsetofstudentswithineachperformancelevel,thosewho
havejustbarelyentered intotheperformance level.Theyarenotthe typicalexampleof
aProficientstudent,andmaynotbewhatyoupicturewhenaskedtodescribeaProficient
student,buttheydostilljustmeetthecriteriadescribedbythePLD,andareaProficient
student.
There aretwoimportantconceptsthatyouwilldiscussinordertounderstandyour
bookmarktask:
1.Theideaofjustbarelymeetingastandard,orastudentthatisjustbarelydescribed
byaperformanceleveldescriptor,and
2.Acommonunderstandingofwhatmasterymeans.
Wewilldiscusseachoftheseinturn.
C-11
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
You willspendtimeinyourworkshoproomsreviewingthePLDs,andthinkingaboutwhat
knowledgeandskillsstudentsthatarejustbarelydescribedbyPLDhavetohave,andwhat
separatesthemfromstudentswhoarenotdescribedbythePLD.
Toplacebookmarks,youwillfindthelocationintheOIBthatdifferentiatesstudentswho
arejustbarelyfromthosethatarenot.Todothis,youwillevaluatewhetherjust
barelystudentscanrespondsuccessfullytoeachitemintheOIB.
Toframe this,wellthinkabout:
1. Studentswhofallneareachperformancestandardorlevel whatcharacterizesthese
students?
2. Whatdifferentiatesstudentswhojustmeettheperformancestandardfromthosethat
donot whatcantheydo,ornotdo,thatcategorizesthemoneithersideofthe
standard?
Inordertomakethisjudgment,weneedtodevelopacommonunderstandingofwhatit
meanstoperformsuccessfullyonanitem.Whenwesaythatjustbarelystudentscan
performsuccessfullyonanitem,dowereallymeanthatsuchstudentswillalwaysgetthe
itemcorrect?Wedonttypicallyoperateinabsolutes.Studentsdontalwaysgetitems
correct,foravarietyofreasons.Instead,wesaythatstudentsconsistentlyperform
successfullyonitemsortasks.Inasimilarvein,forthepurposeofthisworkshop,wewill
definesuccessfulperformanceasaresponseprobabilityof67%,whichisreferredtoas
RP67,meaningthatwewishtoidentifythelocationintheOIBwherestudentswhoarejust
barelyProficienthavea2/3chanceofrespondingcorrectlytotheitem.Youcanthink
aboutthisasawaytodefinewhatitmeanstosaythatastudentcanreliablyansweran
itemcorrectly theywontalwaysansweritcorrectly,buttheycanreliablyanswerit.
Eachroomwillproduceasummaryofjustbarelyskillsforeachperformancelevel.
Wecanthinkaboutthisconceptintwodifferentways ifyoupictureonejustbarely
student,theyhavea67%chanceofrespondingcorrectlytotheitem.Alternatively,ifyou
visualizeagroupof100justbarely students,twothirdsofthegroupwillrespondtothe
itemcorrectly.
Whenyouplacebookmarks,youwillworkthrougheachpageoftheOIBanddetermine
whether2/3ofjustbarelyProficientstudents,forexample,canrespondsuccessfullytothe
C-12
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
itemoneachpage.Thisjudgmentwillbethebasisforrecommendingabookmark.
IneachroomyouwillreviewtheOrderedItemBookwhichpresentsalongseriesof
items,orderedfromeasiesttomostdifficult.Whilereviewing,rememberyour
focuswillbetodeterminewhatstudentsneedtoknowandbeabletodoinorder
torespondtoeachitemsuccessfully,andwhyeachitemismoredifficultfor
studentsthantheitemsbefore.
Inthecomingdaysyouwillmakeperformancestandardsrecommendationsby
identifyingapagenumberoftheOIBthatwillserveasthecut.
Foreachperformancelevel,youwillworkthroughtheOIBandconsiderwhether
2/3ofjustbarelystudentscanrespondsuccessfullytotheitem.Youwillplace
yourbookmarkonthelastpagewhere2/3ofstudentswhojustbarelymeetthe
performancestandardwillanswercorrectly.Thismeansthatfewerthan2/3ofjust
barelymeetsstudentswouldbeexpectedtorespondsuccessfullytothenextitem
intheOIB.
C-13
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
C-14
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
Youwillalsobepresentedwithimpactdataforeachsubjectafterthe firstroundofcuts.
Thisisthepercentageofstudentswhowouldreachorexceedthestandardbasedonthe
item pageintheOrderedItemBooklet.Withthisinformation,youwillaskyourselfifthe
outcomeseemsreasonable.Whileimpactdatacanbeinformative,placementofyour
bookmarksshouldalwaysbeguidedbycontentconsiderationstoensurethatstudents
meetingtheperformancestandardareaccuratelydescribedbythePLDforeachlevel.
Afteryoucompleteyourinitialbookmarkplacement,youwillbeprovidedfeedbackabout
howotherpanelistsplacedtheirbookmarks.Youwillreceivefeedbackaboutthebookmark
placementsforyourtableandalsoseehowthebookmarkplacementsacrosstables
compare.
Thisdatacanserveasastartfordiscussionaboutbookmarkplacementsandhelppanelists
todevelopcommonunderstandingsofthe skills ajustbarely studenthas,takinginto
accountthevariedbackgroundsandexpertiseofyourfellowpanelists.Onceyouhavehad
achancetoreviewthefeedbackdatawithinyourtable,wewillexpandthediscussionto
othertablesinyourgrade.
Whenyoureceivetheimpactdata,youwillwanttoaskyourselfwhethertheimpactofthe
currentcutscoreplacementseemsreasonableandintheneighborhoodofwhatyouwere
expecting.Iftheimpactdataseemsoutoflinewithyourexpectations,considerwhythat
mightbe.Iftheimpactisthatfewer studentsmeetthestandards thanyouexpected,might
itbe,forexample,thatthenewacademiccontentstandardsaremorerigorousandrequire
studentstodemonstrategreaterknowledgeandskillsthanpreviously?Iftheimpactisthat
morestudents meetthestandardsthanyou expected,coulditbethatyouunderestimated
theknowledgeandskillsthatstudentscanreliablydemonstrate?
Fromthesediscussions,panelistsmayrevisetheirjudgmentsandchoosetomovetheir
bookmarkplacementinRound2,butthereisnoexpectationthatpanelistswillmove
bookmarks.Generally,wedoseeconvergencefromRound1toRound2,butconsensusis
notagoal.
Consideryourcutscore recommendationsinthelightoftheimpactdata,anddiscussthe
implicationsofthecurrentcutscoreplacementswithyourfellowpanelists.Remember,
whileyoumaychoosetomodifyyourcutscoresinlightoftheimpactdata,yourrationale
formakingeachcutscoreshouldbebasedoncontentconsiderations.
C-15
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
Whenwetalkaboutstandardsbeingarticulatedacrossgrades,werefertotheideathat
thereshouldnotbewidefluctuationsintheproportionofstudentsmeetingeach
performancestandardacrossgrades.Itisunlikely,forexample,thatif60%ofGrade4
studentsareconsideredtohaveachievedendofyearstandardsforreadingandare
academicallypreparedtobenefitfromGrade5readinginstruction,thatonly40%ofGrade
5studentsmeetendofyearstandardsinreading.
WhilethisverticalarticulationisincorporatedintothedevelopmentoftheArizona
AcademicContentStandardsaswellasthetestspecificationsfortheAzMERIT
assessments,maintainingthecrossgradearticulationinthesettingofmeaningful
performancestandardsisimportant,especiallyforreadingandmathematics,where
studentsareassessedannually.Lackofarticulationinthesesubjectscanresultin
confusion,withunreasonablylargeshiftsinstudentperformancelevelclassifications
occurringfromyeartoyear,resulting,forexample,inwidespreadmisidentificationofpoor
performingteachersacrossgradelevelswithinschools.
Forthisreason weconductmoderationsessions.
C-16
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
WewillcalculateproposedAdjacentGradePerformanceStandardscutscoreswillbe
presentedtobeforebeginningtheBookmarkplacementactivitiesfortheadjacentgrades.
Afteryourpanelsrecommendperformance standardsintheinitialgrade,tableleaderswill
beaskedtoparticipateinaModerationsession.Thisactivitygivesanopportunityfor
representativestoreviewtherecommendedstandardsacrossgradesinlightofthe
discussionofcontentdemandsandtherelativeimpactofstudentperformanceacross
grades.Allpanelistsareinvitedtositin,buttableleaderswillbeaskedtomake
recommendationformoderatingtherecommendations.Tableleaderswillrepresenttheir
tablesviewsinthediscussion.
Moderationwillservetwopurposes
1) Providingabroaderviewofrecommendationsandanopportunityforpaneliststo
benefitfromthedeliberationsandexperiencesofothergradelevelpanels
2) Produceasetofreadingperformancestandardsthatarearticulatedacrossgrades.
Similartocontentstandardsbeingarticulatedacrossgrades,werefertotheideathatthere
shouldnotbewidefluctuationsintheproportionofstudentsmeetingeachperformance
standardacrossgrades.Itisunlikely,forexample,thatif60%ofGrade4studentsare
consideredtohaveachievedendofyearstandardsforreadingandareacademically
preparedtobenefitfromGrade5readinginstruction,thatonly40%ofGrade5students
meetendofyearstandardsinreading.
Forthisreason,weconvenetableleaderstoreviewthestandardsinlightofeachindividual
panelsexpertjudgment,aswellasallpanelsjudgmentstogether.Wewillmoderate
standardsatthisstage,andagainattheendoftheworkshop.
C-17
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
C-18
AzMERIT
Presentation C.1. Large Group Training Presentation and Script (Grades 3-8)
Thisconcludesourlargegroup trainingsession.Pleasebreakintoyourassignedgroups.
Yourpanelassignmentsshouldbeincludedinyourfoldersaswellasroomnumbers,which
arealsocurrentlydisplayedonthescreen.PleaselocateanAIRorADEemployee,as
indicatedbyourbadge,ifyourequireanyassistance.Thankyou.
C-19
AzMERIT
Note for facilitator: Introduce workshop staff, and have panelists introduce
themselves to the group. Encourage panelists to share names, school
district/region, and what grades and subjects each panelist works with.
Lets go around the room and introduce yourself, and share what school
district or area in the state you are coming from, and what students you
primarily work with.
C-20
AzMERIT
C-21
AzMERIT
You will now have the opportunity to take a test that was administered to
students this spring.
You cannot see your scores for hand scored items because they are
scored at a later time
There is only an hour reserved for experiencing the Online assessment
The purpose is not to complete the test, but to get an idea of what the
students experienced
C-22
AzMERIT
C-23
AzMERIT
Once you are in the testing environment, work through the test, and take a
break as needed. At around 11am, we will move on to the next activity as a
group.
C-24
AzMERIT
The High School panels have started and set standards for their grade
bands 9 - 11
The standard setting process that we will be engaged in during the next two
days is designed to translate the Arizona State standards in Math 3-4 into a
set of performance standards, or cut scores, on each of the assessments.
Two important documents, the Ordered Item Booklet and the Performance
Level Descriptors, will be your primary tools for translating the academic
content standards into performance standards.
Throughout this workshop, we will refer to different types of standards.
Arizona State standards specify what students should know and be able to
do by end of each academic year.
You will use two tools, OIB and PLDs
C-25
AzMERIT
The Ordered Item Book, or OIB, is the other primary tool you will use. The
OIB contains operational test items administered in Spring 2015 ordered
from easiest to most difficult. Each page is a score point on an item.
Certain items appear multiple times in the OIB, once for each score point.
The number of pages in the book is equal to the number of points in the OIB,
not the number of items on the OIB.
You will identify how much a student should know and be able to do to meet
the description for each performance level in the PLDs by placing a
bookmark in the OIB that divides the book into two groups: items that
students described by the performance level descriptor can respond
successfully to, and items that students in that performance level cannot
respond successfully to
You will have two different opportunities to make individual recommendations
youll make an initial judgment, and then you will receive feedback showing
the bookmarks of your fellow panelists. Well discuss everybodys
bookmarks, and well also look at the percentage of students in the state
who would meet or exceed each of the recommended standards, or impact.
Then, youll make individual recommendations again you can change your
bookmarks, but you dont have too.
C-26
AzMERIT
C-27
AzMERIT
Even within each performance level, students vary in the degree to which
they have mastered the Arizona State standards. Some students have just
barely crossed the line between Partially Proficient and Proficient, while
others are getting ready to cross the line between Proficient and Highly
Proficient. In general, the PLDs are written to describe the performance of
students in the middle of the category. However, we actually want to focus
our attention on a specific subset of students within each performance level,
those who have just barely entered into the performance level.
To frame this, well think about:
1. Students who fall near each performance standard what characterizes
these students?
2. What differentiates students who just meet the performance standard
from those that do not what can they do, or not do, that categorizes
them on either side of the standard?
3. Descriptions of how much of the content standards students who just
barely meet the performance standard have to know and be able to do in
order to be categorized in each performance level.
C-28
AzMERIT
When thinking about what a just barely Proficient student can do, ensure you are
not describing a Partially Proficient student.
Facilitator start with the reporting category that you made examples for
and ask panelists to review that reporting category individually then as a
group write just barely statements
Choose a reporting category you feel comfortable with to do as a group
As we go through and review the PLDs we will think about what high level
skills are necessary for a student just entering each performance level.
Remember, the student has just barely crossed into the performance level.
They demonstrate just enough to be considered Partially Proficient,
Proficient or Highly Proficient.
Lets review the PLDs in the BLANK reporting category as a group to come
up with a summary of the overarching skills necessary for the just barely
students in each performance level.
Then we will assign different strands to each table to produce their own just
barely summary statements, then come back together as a group and share
what each table has produced and discuss any questions.
C-29
AzMERIT
This activity will be completed by each individual table. Each table will be
assigned 1 to 2 reporting categories. The table leader will type a few
statements for each reporting category for each just barely performance
level.
C-30
AzMERIT
C-31
AzMERIT
Now well turn our attention to your next task: review the Ordered Item Book.
OIB is the other primary tool you will use. The Ordered Item Booklets will
present you with the items from the spring 2015 assessments. The content
of the items is proportional to the test blueprint.
The Ordered Item Booklets will present you with a subset of items from the spring
2015 assessments. All items will be presented in order of difficulty; page 1 will
present the easiest item, and the last page will present the hardest item. Each
page in the ordered item booklet refers to an item.
The OIB consists of all operational items as well as 15-20 field test items to
fill in information gap. What that means is that we added items where there
was a large gap in item difficulty between operational items so that the items
in the OIB appear more fluid in terms of difficulty.
Typically, the OIB has been presented literally as a bound paper book. However,
because the AzMERIT includes technology enhanced items that cannot be
represented well on paper, you will use an electronic OIB. The OIB is ordered from
the easiest to most difficult item, so the first item is the easiest, and the last item is
the most difficult. You page forward to see increasingly more difficult items, and you
can page backward to see progressively easier items. You will page through the
OIB from easiest to the most difficult item. For each item, you will ask what students
need to know and be able to do to respond successfully to the item, and what
makes this item more difficult than the preceding items.
All items will be presented in order of difficulty; page 1 will present the
easiest item, and the last page will present the hardest item. Some items will
be represented more than once. These items are more engaging than others
and are worth more than a single score point. Each page in the ordered
item booklet will refer to specific score point of the item. We will review the
series of items in an online environment.
C-32
AzMERIT
On the table are the public test blueprints which can also be found on ADEs
website. All tests administered to students met these blueprint requirements.
The OIB, which contained all operational items and were augmented with
field test items to fill in gaps, meets or very closely meets the public
blueprints.
C-33
AzMERIT
C-34
AzMERIT
C-35
AzMERIT
The item plot shows a graphical representation of the difficulty of each page
in the OIB. This is just another way to view the OIB.
The ITS ID is shown on both the item map and in your online OIB. You
can jump to an OIB page by selecting the ITS ID from the dropdown in the
top right portion of the screen.
You can use this map to see where pages are clustered together, versus
spread out, in terms of the ability level they correspond to. The clustered
pages indicates that the difference in performance impact between adjacent
pages is smaller, whereas difference in bookmarks on non-clustered
adjacent pages may be more substantial. The item numbers correspond to
the page numbers that are included in the OIB map.
The AzCCRS column shows you each items alignment to the AzCCRS.
This corresponds to the content specified within the tests blueprint.
Item format displays whether an item is multiple choice, indicated by
MC, or an item that requires a student to construct a response, such as
GI meaning grid item or EQ meaning equation. As you review the
OIB, items that are not multiple choice will contain instructions on how
students are to answer.
Space for notes as you review each item in the OIB, remember to think
about two questions 1) What do students need to know and be able to
do in order to respond successfully to this question?, and 2) Why is this
question more difficult than the one before?
C-36
AzMERIT
C-37
AzMERIT
C-38
AzMERIT
C-39
AzMERIT
Panelist computers will be logged into the ITS and OIB prior to meeting start.
Once panelists arrive, they can immediately start re-reviewing the OIB,
checking their notes and filling in any notes they missed. As needed, assist
panelists with logging into ITS and display password at front of room. Once
all panelists arrive, review the activities for the morning.
To place bookmarks, you will find the location in the OIB that differentiates
students who are just barely from those that are not. To do this, you will
evaluate whether just barely students can respond successfully to each
item in the OIB.
In order to make this judgment, we need to develop a common
understanding of what it means to perform successfully on an item. When
we say that just barely students can perform successfully on an item, do
we really mean that such students will always get the item correct? We
dont typically operate in absolutes. Students dont always get items
correct, for a variety of reasons. Instead, we say that students consistently
perform successfully on items or tasks. In a similar vein, for the purpose of
this workshop, we will define successful performance as a response
probability of 67%, which is referred to as RP67, meaning that we wish to
identify the location in the OIB where students who are just barely Proficient
have a 2/3 chance of responding correctly to the item. You can think about
this as a way to define what it means to say that a student can reliably
answer an item correctly they wont always answer it correctly, but they
can reliably answer it.
We will spend the morning working through the Ordered Item Book.
Following review of the OIB, well discuss how to locate the just barely in
the OIB and recommend cut scores. We will recommend cut scores and
spend time reviewing feedback discussion our recommendations as a group
before making another round of recommendations. Follow the second round
of recommendations, you will receive performance information such as the
percent of students estimated to meet performance standards based on the
rooms median recommended bookmark page numbers. We will discuss the
implications of the performance information, and you will again make a final
round of recommendations.
Anchor Grade Moderation is required for Table Leaders but all other
panelists are invited to attend.
We can think about this concept in two different ways if you picture one
C-40
AzMERIT
just barely student, they have a 67% chance of responding correctly to the item.
Alternatively, if you visualize a group of 100 just barely students, two thirds of the
group will respond to the item correctly.
When you place bookmarks, you will work through each page of the OIB and
determine whether 2/3 of just barely Proficient students, for example, can respond
successfully to the item on each page. This judgment will be the basis for
recommending a bookmark.
The OIB is ordered from easiest to most difficult. This fosters an integrated
concept of how the test reflects the performance standards. The OIB is the
vehicle to make cut score judgments and communicates how the trait
increases in difficulty as items ascend the scale.
C-41
AzMERIT
Yesterday,wereviewedtheOrderedItemBookwhichpresentedalongseriesof
items,orderedfromeasiesttomostdifficult.Whilereviewing,rememberour
focuswasdeterminingwhatstudentsneedtoknowandbeabletodoinorderto
respondtoeachitemsuccessfully,andwhyeachitemwasmoredifficultfor
studentsthantheitemsbefore.
In Round 1, you will make your initial recommendations, and write in your
panelist ID in the appropriate box on the form before turning it in. You will
receive the form back and use the same form to make recommendations in
subsequent rounds.
Today,wewillmakeperformancestandardsrecommendationsbyidentifyinga
pagenumberoftheOIBthatwillserveasthecut.
For example, in the starred box, you write your Round 1 recommended page
number for the Proficient cut. You will identify the last page in the OIB that
2/3 of just barely Proficient students can successfully respond to; fewer
than 2/3 of just barely students will be able to successfully respond to the
very next item.
Foreachperformancelevel,youwillworkthroughtheOIBandconsiderwhether
2/3ofjustbarelystudentscanrespondsuccessfullytotheitem.Youwillplace
yourbookmarkonthelastpagewhere2/3ofstudentswhojustbarelymeetthe
performancestandardwillanswercorrectly.Thismeansthatfewerthan2/3ofjust
barelymeetsstudentswouldbeexpectedtorespondsuccessfullytothenextitem
intheOIB.
In the Partially Proficient box, you will write the page number of the last page
in the OIB that 2/3 of students of just barely Partially Proficient students
can respond successfully to. Fewer than 2/3 of those students who just
barely approach Partially Proficient will be able to respond successfully to
the next item.
Recordthebookmarkedpagenumberinthebookmarkplacementsheet.
C-42
AzMERIT
And finally, in the Highly Proficient box, you will write the page number of the last
page in the OIB that 2/3 of the students that just barely Highly Proficient students
can respond successfully to.
Remember that you will have an opportunity to discuss your recommendations
among your group after everyone has completed this task, and you will have a
chance to then change your recommendation.
It is important to understand that a page number in the OIB does not equate
to a number of items a student must get correct to meet a standard at that
bookmark. There is no relationship between the pages in the OIB and the
number of points needed to achieve a standard.
C-43
AzMERIT
As necessary, review that just barely means they are just barely
categorized as being described by the performance level descriptors. Key
idea: These are not the average student.
C-44
AzMERIT
The item on page 6 is MORE DIFFICULT than the item on page 5. Review
with panelists as necessary:
- Items are presented from easiest to most difficult.
- Difficulty is based on student performance on 2015 operational
assessments. It is not based on test developers judgments.
C-45
AzMERIT
Review that bookmark should be placed on the last page where 2/3 of
students described by the just barely PLD can be expected to respond
successfully to the item. On the following page, less than 2/3 of just barely
students would respond successfully. (Or just barely students would
respond successfully less than 2/3 of the time).
C-46
AzMERIT
C-47
AzMERIT
Remove the readiness form from your folders. This form should say
Preparation for Round 1 Partially Proficient, Proficient, and Highly
Proficient near the top.
Review the specific bullets on the form, and please indicate whether you feel
you understand, and are ready to place your bookmark. If you answer No
to any questions, please notify a workshop staff member before continuing.
Lets take a minute to complete this form. Please turn them into your table
leaders.
(Note: In the event that a panelist indicates they are not ready, the facilitator
will work with the individual(s) to ensure they understand the procedures.)
C-48
AzMERIT
Note: Continue to display this slide while panelists are placing their bookmarks.
Remember, you are seeking to divide the OIB into two sets of items, so
dont get hung up if you find what appears to be a particularly difficult item in
the middle of otherwise relatively easy items. You are seeking to identify the
set of items that students who just barely within the performance level can
respond to successfully from those items that students who may not meet
the standards can also respond to successfully. You will identify the last page
in the OIB that 2/3 of the just barely students at the performance level can
successfully respond to; fewer than 2/3 of just barely students will be able
to successfully respond to the very next item.
It is important that everyone start with the Proficient standard, then move to
the Partially Proficient standard and finish your bookmark placement with the
Highly Proficient standard.
When you have completed placing your bookmarks and have initialed the
bookmark placement sheet, please hand it to your table leader. Table
leaders, when you have all of your tables sheets please alert myself or the
room assistant.
We will take a short 15 minute break after everyone has completed placing
their bookmarks.
C-49
AzMERIT
C-50
AzMERIT
NOTE: Facilitate discussion within the room. Panelists should share what
knowledge and skills required by the items or the PLDs led to
recommendations.
From these discussions, you may revise your judgment about the bookmark
placement and choose to move your bookmark placement in Round 2.
However, there is no requirement or expectation that you will move your
bookmarks. From experience, we do expect convergence from Round 1 to
Round 2, but consensus is not a goal.
This can serve as a good jumping off point for discussion; for example,
panelists who placed their bookmarks at the lowest and highest pages can
share why they felt those were the right cut points. After discussing the
feedback with your table members, you will discuss your bookmarks with the
room as a whole.
NOTE: Have panelists discuss their findings within their tables. They should
be able to see the cuts set by the other panelists at their table, all of the
table medians and room medians.
C-51
AzMERIT
You will also be presented with impact data for each subject. This is the
percentage of students who would reach or exceed the standard based on
the item page in the Ordered Item Booklet. With this information, you will
ask yourself if the outcome seems reasonable. While impact data can be
informative, placement of your bookmarks should always be guided by
content considerations to ensure that students meeting the performance
standard are accurately described by the PLD for each level.
C-52
AzMERIT
C-53
AzMERIT
C-54
AzMERIT
C-55
AzMERIT
C-56
AzMERIT
Only the Table Leaders are required to participate in the anchor grade
vertical moderation but all other panelists are invited to sit in.
C-57
AzMERIT
(LeaveslideupwhilepanelistsreviewOIB)
Rememberthat
EachOIBconstitutesanaugmentedtest
Pagesareorderedbydifficulty
Eachpageisascorepointonanitem
Multipointitemsappearmultipletimes(onceforeachscorepoint)
Itemorderisbasedonstudentperformance
Itemsmayseemoutoforderbecausetheyareorderedbydifficultynotby
contentorcognitiveprocess
Ifyoubelievesomethingiswrongwithanitem,telltheworkshopleader,
thenskipovertheitemasyoureviewtherestoftheOIB
C-58
AzMERIT
C-59
AzMERIT
C-60
AzMERIT
C-61
AzMERIT
C-62
AzMERIT
C-63
AzMERIT
C-64
AzMERIT
Insert adjacent grade page numbers. Have panelists mark this page on their
Item Map.
C-65
AzMERIT
Note: Continue to display this slide while panelists are placing their
bookmarks.
After bookmark placement, we will break for lunch at 12:00
C-66
AzMERIT
C-67
AzMERIT
NOTE: Facilitate discussion within the room. Panelists should share what
knowledge and skills required by the items or the PLDs led to
recommendations.
From these discussions, you may revise your judgment about the bookmark
placement and choose to move your bookmark placement in Round 2.
However, there is no requirement or expectation that you will move your
bookmarks. From experience, we do expect convergence from Round 1 to
Round 2, but consensus is not a goal.
C-68
AzMERIT
C-69
AzMERIT
C-70
AzMERIT
Following this meeting, another panel will convene that includes the table
leaders. The purpose of this final meeting is to allow table leaders to review
the system of standards as a whole so that they can review the
appropriateness of the recommended cut scores as they relate to the
performance level descriptors and their impact on students who meet each
performance standard.
Thank you for your participation and hard work these past two days. Please
remember to keep the content of the test items and the discussions about
specific recommendations secure, and please feel free to share information
about the standard setting process and your experience with colleagues and
other individuals.
Please take your time to fill out the workshop evaluation. We know that you
all often have to fill out evaluations to conclude meetings or trainings, but
please take the time to thoughtfully fill out the evaluation. The results of the
evaluation will be included in the Standard Setting Technical Report that will
be available to the public. Filling out the evaluation also provides us with
feedback to improve the standard setting process and to assure the validity
of the whole process.
C-71
AzMERIT
StandardSettingTechnicalReport
Appendix
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
EnglishLanguageArts
Grade3
Standard
MinimallyProficient
Forgradeappropriate,low
complexitytexts,theMinimally
Proficientstudent
Detailed
3.RL.2
identifiesdetailsthatrecount
identifieskeydetailsthatrecount
stories;identifiesexplicitlystated stories;determinescentral
messages,lessons,ormoral.
centralmessages,lessons,or
moral.
Detailed
3.RL.3
Detailed
3.RL.4
Detailed
3.RL.5
useseasilylocated,explicitly
stateddetailsinorderto
determinethemeaningsof
familiarwordsandphrasesas
they are used in a text.
referstoeasilyidentifiedpartsof
stories,dramas,andpoems,
usingtermssuchaschapter,
scene,andstanza.
Detailed
PartiallyProficient
Proficient
HighlyProficient
Forgradeappropriate,lowto
Forgradeappropriate,moderateto Forgradeappropriate,high
moderatecomplexitytexts,the
highcomplexitytexts,theProficient complexitytexts,theHighly
Proficientstudent
PartiallyProficientstudent
student
Reading:Literature
asksandanswersexplicitquestions asksandanswersquestionsto
3.RL.1 asksandanswersquestionsto
asksandanswerscomplexquestions
demonstrateunderstandingofa todemonstrateunderstandingofa demonstrateunderstandingofatext, todemonstrateunderstandingofa
text,referringtothetextasthebasis referringexplicitlytothetextasthe text,referringexplicitlytothetextas
text.
foranswers.
thebasisforanswersandmaking
basisforanswers.
inferenceswherenecessary.
AzMERITPerformanceLevelDescriptors
recountsstories,includingfables,
folktales,andmythsfromdiverse
cultures;determinesthecentral
message,lesson,ormoraland
explainshowitisconveyedthrough
keydetailsinthetext.
usesdetailsfromthetextinorderto determinesthemeaningofwords
determinethemeaningofwordsand andphrasesastheyareusedina
text,distinguishingliteralfrom
phrasesastheyareusedinatext.
nonliterallanguage.
provideskeydetailsthatcompletely
recountstories;determinesimplicitly
statedcentralmessages,lessons,or
morals;andexplainshowtheseare
conveyedthroughkeydetailsinthe
text.
determinesthemeaningofunfamiliar
wordsandphrasesastheyareused
inatext,distinguishingliteralfrom
nonliterallanguage.
referstopartsofstories,dramas,
referstopartsofstories,dramas,
referstointricatepartsofstories,
andpoems,usingtermssuchas
andpoemswhenwritingorspeaking dramas,andpoemswhenwritingor
chapter,scene,andstanza;identifies aboutatext,usingtermssuchas
speakingaboutatext,usingterms
howonepartbuildsonanearlier
chapter,scene,andstanza;describes suchaschapter,scene,andstanza;
section.
howeachsuccessivepartbuildson explainshoweachsuccessivepart
earliersections.
buildsonearliersections.
D-1
AzMERIT - 2015
EnglishLanguageArts
Grade3
3.RL.7
Detailed
Detailed
3.RL.8
3.RL.9
usesspecificaspectsofatext's usesspecificaspectsofatext's
simpleillustrationstounderstand illustrationstounderstandthetext
thetextandidentifiesexplicit
andmakeslowerlevelinferences
detailsabouthowthe
abouthowtheillustrationsreflect
illustrationsreflectcharacters,
characters,setting,ormood.
setting,ormood.
analyzeshowspecificaspectsofa
explainshowspecificaspectsofa
text'sillustrationscontributetowhat complextext'sillustrationscontribute
isconveyedbythewordsinastory toamorethoroughunderstandingof
(e.g.,emphasizeaspectsofa
thetext;makeshigherlevel
characterorsetting,createmood). inferencesabouthowthe
illustrationsreflectcharacters,
setting or mood
N/A
N/A
N/A
N/A
describesexplicitlystatedthemes, comparesandcontraststhethemes, comparesandcontrastshighly
identifiessimpleandexplicit
settings,andplotsofstorieswritten settings,andplotsofstorieswritten complex,implicitlystatedthemes,
themes,settings,andplotsof
bythesameauthoraboutthesame bythesameauthoraboutthesame settings,andplotsofstorieswritten
storieswrittenbythesame
authoraboutthesameorsimilar orsimilarcharacters(e.g.,inbooks orsimilarcharacters(e.g.,inbooks bythesameauthoraboutthesame
orsimilarcharacters(e.g.,inbooks
fromaseries).
characters(e.g.,inbooksfroma fromaseries).
series).
fromaseries);makesinferencesto
identifysupportusedbyauthors.
AzMERITPerformanceLevelDescriptors
D-2
AzMERIT - 2015
EnglishLanguageArts
Grade3
3.RI.2
Detailed
3.RI.3
Detailed
3.RI.4
Detailed
3.RI.5
Detailed
3.RI.6
determinesanimplicitlystatedmain
ideaofatext;recountskeydetails
andexplainshowtheysupportthe
main idea.
describestherelationshipbetweena analyzescomplexrelationships
describessimplerelationships
identifieshistoricalevents,
scientificideas,orsomestepsin betweenhistoricalevents,scientific seriesofhistoricalevents,scientific betweenaseriesofhistoricalevents,
ideasorconcepts,orstepsin
scientificideasorconcepts,orsteps
technicalproceduresinatext,
ideasorconcepts,orstepsin
usinglanguagewithanattempt technicalproceduresinatext,using technicalproceduresinatext,using intechnicalproceduresinatextwith
vaguelanguagethatpertainsto
immergingapplication,using
attimeorsequence.
languagethatpertainstotime,
time,sequence,andcause/effect.
sequence,andcause/effect.
academiclanguagethatpertainsto
time,sequence,andcause/effect.
determinesthemainideaofatext; determinesthemainideaofatext;
identifiesanexplicitlystated
mainideaofatext;identifieskey identifieskeydetailstorecountthe recountskeydetailsandexplains
howtheysupportthemainidea.
detailstorecountthemainidea. mainidea.
useseasilylocated,explicitly
stateddetailsinorderto
determinethemeaningofbasic
academicanddomainspecific
wordsandphrasesinatext
relevanttoagrade3topicor
subject area
usesbasictextfeaturesand
searchtools(e.g.,keywords,
sidebars,hyperlinks)tolocate
informationexplicitlystatedin
thetext.
usesdetailsfromthetextinorderto determinesthemeaningofgeneral
academicanddomainspecificwords
determinethemeaningofbasic
academicanddomainspecificwords andphrasesinatextrelevanttoa
andphrasesinatextrelevanttoa grade3topicorsubjectarea.
grade3topicorsubjectarea.
usesbasictextfeaturesandsearch
tools(e.g.,keywords,sidebars,
hyperlinks)tolocateinformation
relevanttoagiventopic.
determinesthemeaningofadvanced
academicanddomainspecificwords
andphrasesinatextrelevanttoa
grade3topicorsubjectarea.
usestextfeaturesandsearchtools usescomplextextfeaturesand
(e.g.,keywords,sidebars,hyperlinks) advancedsearchtools(e.g.,key
tolocateinformationrelevanttoa words,sidebars,hyperlinks)to
analyzeandinterpretinformation
giventopicefficiently.
relevanttoagiventopicefficiently.
AzMERITPerformanceLevelDescriptors
D-3
AzMERIT - 2015
EnglishLanguageArts
Grade3
Proficient
HighlyProficient
usesinformationgainedfrom
analyzesinformationgainedfrom
complexillustrations(e.g.,maps,
illustrations(e.g.,maps,
photographs)andthewordsinatext photographs)andtheinferences
todemonstrateunderstandingofthe withinatexttodemonstrate
understandingofthetext.
text(e.g.,where,when,why,and
howkeyeventsoccur).
describesthelogicalconnections
betweenparticularsentencesand
paragraphsinatext(e.g.,
comparison,cause/effect,
first/second/thirdinasequence).
Detailed
3.RI.8
identifiesthesimpleconnections identifiesthelogicalconnections
betweenparticularsentencesina betweenparticularsentencesand
paragraphsinatext(e.g.,
text(e.g.,comparison,
cause/effect,first/second/thirdin comparison,cause/effect,
first/second/thirdinasequence).
asequence).
Detailed
3.RI.9
describesthemostimportantpoints comparesandcontraststhemost
identifiesthemostimportant
pointsandkeydetailspresented andkeydetailspresentedintwo
importantpointsandkeydetails
textsonthesametopic.
inatext.
presentedintwotextsonthesame
topic.
AzMERITPerformanceLevelDescriptors
D-4
describesthecomplexconnections
betweenparticularsentencesand
paragraphsinatextusingtextual
evidence(e.g.,comparison,
cause/effect,first/second/thirdina
sequence).
comparesandcontraststhemost
importantpointsandkeydetails
presentedintwotextsonthesame
topicandprovidestextualevidence
tosupportthesecomparisons.
AzMERIT - 2015
Detailed
Detailed
EnglishLanguageArts
Grade3
Proficient
HighlyProficient
writesawellorganized,multi
writesawellorganizedopinionpiece
paragraphopinionpiecethat
thatintroducesthetopic,provides
effectivelyintroducesthetopic,
reasonsthatsupportthe
providesevidencethateffectively
opinion,useslinkingwordsand
supportstheopinion,useslinking
phrases,andprovidesaconcluding
wordsandphrases,andprovidesan
statement.
effectiveconcludingstatement.
writesawellorganized,multi
3.W.2 writesanexplanatorypiecethat
writesawellorganizedexplanatory paragraphexplanatorypiecethat
writesalooselyorganized
lacksorganization;doesnot
piecethatintroducesthetopic;
effectivelyintroducesthetopic;
explanatorypiecewithasimple
includeanintroductionor
providesfacts,definitions,and
providesfacts,definitions,anddetails
introductionandconclusion;and
conclusionorincludesan
detailstosupportthetopic;uses
thateffectivelysupportthetopic;
provideslimitedfacts,definitions,
ineffectiveone;andprovides
linkingwordsandphrases;and
useslinkingwordsandphrases;and
irrelevantfacts,definitions,and anddetailstosupportthetopic.
providesaconcludingstatement.
providesaneffectiveconcluding
detailstosupportthetopic.
statement.
3.W.46 produceswritingwithguidance produceswritingwithguidanceand produceswritingwithguidanceand produceswritingwithguidanceand
supportthatincludesandexhibits
andsupportthatincludes
supportthatincludesincompleteor supportthatincludesandexhibits
complexdevelopment,concise
incompleteandinsufficient
insufficientdevelopment,minimal development,revision,and
revision,andcollaborativeelements.
development,incomplete
revision,andcollaborativeelements. collaborativeelements.
revision,andcollaborative
elements
3.W.78 conductsminimalresearchand conductssomeresearchandrecalls conductsresearchandrecalls
conductsfocusedresearchandrecalls
recallssomeinformationfrom
someinformationfromexperiences informationfromexperiencesand applicableinformationfrom
experiencesandsources,sorting
experiencesandsources,sorting andsources,sortingevidenceinto sources,sortingrelevantevidence
relevantevidenceintoprovided
evidenceintoprovidedcategories providedcategorieswhileproviding intoprovidedcategories.
categories.
whileprovidingevidencethatis someevidencethatmaynotbe
sortedintotheprovidedcategories.
notrelevanttothecategories.
AzMERITPerformanceLevelDescriptors
D-5
AzMERIT - 2015
EnglishLanguageArts
Grade3
3.SL.3
3.L.1
demonstratescommandof
grammarinsimplesentences.
AzMERITPerformanceLevelDescriptors
Language
demonstratescommandofgrammar
insimpleandcompoundsentences
includingalimitedunderstandingof
thefunctionofcommonand
straightforwardnouns,pronouns,
adjectives,adverbs,and
conjunctions.
D-6
demonstratescommandofgrammar
insimple,compound,andcomplex
sentences,includingthefunctionof
nouns(pluralandabstract),
pronouns,adjectives(comparative
andsuperlative),adverbs
(comparativeandsuperlative),
conjunctions(coordinatingand
subordinating),verbs(regularand
irregular)andsimpleverbtenses,
andsubjectverbandpronoun
antecedentagreement.
HighlyProficient
accuratelysummarizesthemain
ideasandsupportingdetailsofatext
readaloudorinformationpresented
indiversemediaandformats,
includingvisually,quantitatively,and
orally
asksandanswerscomplexquestions
aboutinformationfromaspeaker,
offeringrelevantandeffective
elaborationanddetail.
demonstratesstrongcommandof
grammarinsimple,compound,and
complexsentences,includingthe
functionofnouns(pluraland
abstract),pronouns,adjectives
(comparativeandsuperlative),
adverbs(comparativeand
superlative),conjunctions
(coordinatingandsubordinating),
verbs(regularandirregular)andverb
tenses,andsubjectverband
pronounantecedentagreement.
AzMERIT - 2015
EnglishLanguageArts
Grade3
Proficient
demonstratescommandof
capitalizationconventionsintitles,
commasinaddresses,commasand
quotationmarksindialogue,and
howtoformandusepossessives;
spellshighfrequencywords
correctly;usesspellingpatternsand
generalizationsinwritingunknown
wordsandforaddingsuffixesto
bases.
Detailed
3.L.3
chooseswords/phraseswithout chooseswords/phrasesforeffect
chooseswords/phrasesforeffect
concernforeffect.
andrecognizesthedifferences
andrecognizesandobservesthe
betweenspokenandwrittenEnglish. differencesbetweenspokenand
writtenEnglish.
carefullychooseswords/phrasesfor
effectandtostrengthenthemessage
ofthewriting;recognizesand
observesthedifferencesbetween
spokenandwrittenEnglish.
Detailed
3.L.4
clarifiesthemeaningofunknown clarifiesthemeaningofmultiple
clarifiesthemeaningofunknown
wordsusingimmediate,explicit meaningwordsusingsentencelevel andmultiplemeaningwordsusing
contextclues.
contextclues;clarifiesthemeaning sentencelevelcontextclues,
ofunknownwordsusingmorphology morphology(gradelevelrootsand
(gradelevelrootsandaffixes)and/or affixes),and/orreferenceresources.
referenceresources.
clarifiesthemeaningofunknownand
multiplemeaningwordsusing
sentenceandparagraphlevel
contextclues,morphology(rootsand
affixes),and/orreferenceresources.
AzMERITPerformanceLevelDescriptors
D-7
AzMERIT - 2015
EnglishLanguageArts
Grade3
AzMERITPerformanceLevelDescriptors
D-8
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
EnglishLanguageArts
Grade4
Standard
MinimallyProficient
Forgradeappropriate,low
complexitytexts,theMinimally
Proficientstudent
PartiallyProficient
Forgradeappropriate,lowto
moderatecomplexitytexts,the
PartiallyProficientstudent
Detailed
4.RL.1
identifiesdetailsandexamples
fromthetextanddrawssimple
inferences.
Reading:Literature
explainswhatthetextsaysexplicitly referstodetailsandexamplesina
textwhenexplainingwhatthetext
anddrawssimpleinferences;
identifieskeydetailsandexamplesin saysexplicitlyandwhendrawing
inferencesfromthetext.
thetext.
Detailed
4.RL.2
identifiesanexplicitlystated
themeinastory,drama,or
poem;identifiessomedetails
fromthetext.
Detailed
4.RL.3
identifiesaspectsofacharacter, describesacharacter,setting,or
eventinastoryordrama,using
setting,oreventinastoryor
explicitdetailsinthetext.
drama,drawingonexplicitly
stateddetailsinthetext.
Detailed
4.RL.4
Detailed
4.RL.5
Detailed
4.RL.6
determinesthemeaningofwords
identifiesthemeaningoffamiliar usesdetailsfromthetextto
understandthegeneralmeaningof andphrasesastheyareusedina
wordsandphrasesastheyare
wordsandphrasesastheyareused text,includingthosethatalludeto
usedinatext.
inatext,recognizingthosethat
significantcharactersfoundin
alludetosignificantcharactersfound mythology.
in mythology
identifiesbasicdifferences
explainsmajordifferencesbetween
describesdifferencesbetween
betweenpoems,drama,and
poems,drama,andprose,andrefers
poems,drama,andprose,and
prose,andidentifiescommon
recognizesthestructuralelements. tothestructuralelements.
structural elements.
identifiesthenarrator'spointof determinesthepointofviewfrom comparesandcontraststhepointof
whichdifferentstoriesarenarrated, viewfromwhichdifferentstoriesare
viewinastory;identifiesfirst
narrated,includingthedifference
includingdistinguishingbetween
andthirdpersonnarrations.
firstandthirdpersonnarrations. betweenfirstandthirdperson
narrations.
AzMERITPerformanceLevelDescriptors
Proficient
HighlyProficient
Forgradeappropriate,moderateto Forgradeappropriate,high
highcomplexitytexts,theProficient complexitytexts,theHighly
Proficientstudent
student
quotesaccuratelyfromatextand
referstokeydetailsandexamples
whenexplainingwhatthetextsays
explicitlyandwhendrawingcomplex
inferencesfromthetext.
determinesanimplicitlystated
theme,ormultiplethemes,ofa
story,drama,orpoem;
comprehensivelysummarizesthe
text.
describesindepthandanalyzesa
describesindepthacharacter,
setting,oreventinastoryordrama, complexcharacter,setting,orevent
inastoryordrama,drawingon
drawingonspecificdetailsinthe
implicit,specificdetailsinthetext.
text.
recognizesastatedthemeofastory, determinesthethemeofastory,
drama,orpoem;determinesthekey drama,orpoem;summarizesthe
text.
detailsinthetext.
D-9
analyzesthemeaningofunfamiliar
wordsandphrasesastheyareused
inatext,includingthosethatallude
tosignificantcharactersfoundin
mythology.
analyzesmajorhowdifferences
betweenpoems,drama,andprose
affectmeaning,andrefersto
complex structural elements.
comparesandcontrasts,then
analyzes,thepointofviewfrom
whichdifferentstoriesarenarrated,
includingthedifferencebetweenfirst
andthirdpersonnarrations.
AzMERIT - 2015
EnglishLanguageArts
Grade4
Detailed
4.RL.9
describesthetreatmentofsimilar
identifiessimilarthemesand
topicsandpatternsofeventsin themesandtopicsandpatternsof
eventsinstories,myths,and
stories,myths,andtraditional
literaturefromdifferentcultures. traditionalliteraturefromdifferent
cultures.
AzMERITPerformanceLevelDescriptors
D-10
Proficient
makesconnectionsbetweenthetext
ofastoryordramaandthevisualor
oralpresentationofthetext,
identifyingwhereeachversion
reflectsspecificdescriptionsand
directionsinthetext.
HighlyProficient
analyzescomplexconnections
betweenthetextofastoryordrama
andthevisualororalpresentationof
thetext,determiningwhereeach
versionreflectsspecificdescriptions
anddirectionsinthetext.
comparesandcontraststhe
treatmentofsimilarthemesand
topicsandpatternsofeventsin
stories,myths,andtraditional
literature from different cultures.
analyzesthedifferenttreatmentof
similarthemesandtopicsand
patternsofeventsinstories,myths,
andtraditionalliteraturefrom
different cultures.
AzMERIT - 2015
EnglishLanguageArts
Grade4
4.RI.2
identifiesanexplicitlystated
mainideaandkeydetailsofa
text.
Detailed
4.RI.3
identifiesevents,procedures,
ideas,orconceptsinahistorical,
scientific,ortechnicaltextbased
onspecificinformationinthe
text.
Detailed
4.RI.4
Detailed
4.RI.5
Detailed
4.RI.6
recognizesastatedmainideaofa
textanddetermineskeydetails;
providesasimplesummaryofthe
text.
determinesthemainideaofatext
andexplainshowitissupportedby
keydetails;summarizesthetext.
explainsevents,procedures,ideas, analyzesevents,procedures,ideas,or
orconceptsinahistorical,scientific, conceptsinahistorical,scientific,or
technicaltext,includingwhat
ortechnicaltext,includingwhat
happenedandwhy,basedonspecific happenedandwhy,usingevidence
fromthetexttojustifythe
informationinthetext.
explanation
identifiestheloosemeaningof determinestheapproximate
determinesthemeaningofgeneral determinesandanalyzesthe
frequentlyusedacademicand
meaningofbasicacademicand
academicanddomainspecificwords meaningofacademicanddomain
specificwordsorphrasesinatext.
domainspecificwordsand
domainspecificwordsorphrasesin orphrasesinatext.
phrases in a text.
a text.
describestheoverallstructure(e.g., analyzestheoverallstructure(e.g.,
determinestheoverallstructure
identifiesthestructure(e.g.,
chronology,comparison,
chronology,comparison,
(e.g.,chronology,comparison,
chronology,comparison,
cause/effect,problem/solution) cause/effect,problem/solution)of cause/effect,problem/solution)of cause/effect,problem/solution)of
events,ideas,concepts,or
events,ideas,concepts,or
events,ideas,concepts,or
ofevents,ideas,concepts,or
informationinatextorpartofatext. informationinatextorpartofatext,
informationinatextorpartofa
informationinpartofatext.
includinghowitcontributestothe
text.
meaning of the text
identifieswhethertextswritten determinesthedifferencesbetween comparesandcontrastsafirsthand comparesandcontrasts,then
onthesameeventortopicarea afirsthandandsecondhandaccount andsecondhandaccountofthesame analyzes,afirsthandandsecondhand
accountofthesameeventortopic,
eventortopic;describesthe
firsthandorsecondhandaccount; ofthesameeventortopic;
includingthedifferenceinfocusand
differenceinfocusandthe
recognizesthedifferenceinfocus
determinesthefocusofthe
theinformationprovided.
informationprovided.
andtheinformationprovided.
account.
AzMERITPerformanceLevelDescriptors
describesevents,procedures,ideas,
orconceptsinahistorical,scientific,
ortechnicaltext,includingwhat
happenedandwhy,basedon
specificinformationinthetext.
D-11
AzMERIT - 2015
EnglishLanguageArts
Grade4
AzMERITPerformanceLevelDescriptors
D-12
Proficient
interpretsinformationpresented
visually,orally,orquantitativelyand
explainshowtheinformation
contributestoanunderstandingof
thetextinwhichitappears.
HighlyProficient
analyzesinformationpresented
visually,orally,orquantitativelyand
explainshowtheinformation
contributestotheoverall
understandingofthetextinwhichit
appears
explainshowanauthorusesreasons analyzeshowanauthorusesreasons
andevidencetosupportparticular andevidencetosupportparticular
pointsinatext.
pointsinatext.
synthesizescomplexinformationand
integratesinformationfromtwo
textsonthesametopicinorderto textualevidencefromtwotextson
thesametopicinordertowriteor
writeorspeakaboutthesubject
speakaboutthesubject
knowledgeably.
knowledgeably.
AzMERIT - 2015
AzMERITPerformanceLevelDescriptors
EnglishLanguageArts
Grade4
D-13
Proficient
HighlyProficient
writeswellorganizedopinionpieces
writesopinionpiecesontopicsor
texts,supportingapointofviewwith ontopicsortexts,fullysupportinga
pointofviewwithreasonsand
reasonsandinformation.
information.
a.introducesatopicortextclearly,
a.effectivelyintroducesatopicor
statesanopinion,andcreatesan
textclearly,statesanopinion,and
organizationalstructureinwhich
relatedideasaregroupedtosupport createsanorganizationalstructurein
whichrelatedideasarelogically
thewriter'spurpose.
groupedtosupportthewriter's
purpose.
b.providesreasonsthatare
supportedbyfactsanddetails.
b.provideslogicallyorderedreasons
thataresupportedbyfactsand
c.linksopinionandreasonsusing
details.
wordsandphrases(e.g., for
instance,inorderto,inaddition).
c.smoothlylinksopinionandreasons
d.providesaconcludingstatement usingwordsandphrases(e.g.,for
instance,inorderto,inaddition).
orsectionrelatedtotheopinion
presented.
d.providesarelevantandeffective
concludingstatementorsection
relatedtotheopinionpresented.
AzMERIT - 2015
EnglishLanguageArts
Grade4
Proficient
HighlyProficient
writesinformative/explanatorytexts writesinformative/explanatorytexts
toexamineatopicandconveyideas tothoroughlyexamineatopicand
conveyideasandinformationclearly
andinformationclearly.
andcompletely.
a.introducesatopicclearlyand
a.clearlyandeffectivelyintroduces
grouprelatedinformationin
thetopicandgroupsrelated
paragraphsandsections;includes
informationlogicallyinparagraphs
formatting(e.g.,headings),
illustrations,andmultimediawhen andsections;includeseffective
formatting(e.g.,headings),
usefultoaidcomprehension.
illustrations,andmultimediathat
b.supportsthetopicwithfacts,
enhancecomprehension.
b.developsthetopicwithfacts,
definitions,concretedetails,
quotations,orotherinformationand definitions,concretedetails,
quotations,orotherinformationand b.fullydevelopsthetopicwith
examples.
relevantfacts,definitions,concrete
examplesrelatedtothetopic.
details,quotations,orother
c.linksideaswithincategoriesof
informationandexamplesrelatedto
informationusingsimpletransitional c.linksideaswithincategoriesof
informationusingwordsandphrases thetopic.
wordsorphrases.
(e.g.,another,forexample,also,
c.smoothlylinksideaswithin
d.usesdomainspecificvocabularyin because).
categoriesofinformationusing
anattempttoexplainthetopic.
d.usespreciselanguageanddomain purposefultransitionalwordsand
e.providesaconcludingstatement. specificvocabularytoinformabout phrases.
orexplainthetopic.
d.usespreciselanguageanddomain
e.providesaconcludingstatement specificvocabularyefficientlyand
orsectionrelatedtotheinformation effectivelytoinformorexplainabout
thetopic.
orexplanationpresented.
e.providesarelevantandeffective
l d
l d
h
AzMERITPerformanceLevelDescriptors
D-14
AzMERIT - 2015
EnglishLanguageArts
Grade4
4.W.78 conductsshortresearchprojects
aboutatopic;recallssome
informationfromexperiences
andsources;providesnotes
regardinginformation.
AzMERITPerformanceLevelDescriptors
conductsshortresearchprojects
thatuseseveralsourcestodiscussa
topic;recallssomeinformationfrom
experiencesandgathersinformation
fromsources;providesbriefnotes
aboutinformation.
D-15
conductsshortresearchprojectsthat conductsresearchprojectsthatuse
severalhighqualitysourcestobuild
buildknowledgethrough
investigationofdifferentaspectsofa knowledgebyfullyinvestigatinga
topic;usesrelevantinformationfrom
topic;recallsrelevantinformation
fromexperiencesorgathersrelevant experiencesandgatheredfromprint
anddigitalsources;fullysummarizes
informationfromprintanddigital
sources;takesnotesandcategorizes orparaphrasesinformationinnotes
andefficientlycategorizes
information.
information.
AzMERIT - 2015
EnglishLanguageArts
Grade4
4.SL.3
Detailed
4.L.1
HighlyProficient
clearly,coherently,andefficiently
paraphrasesportionsofatextread
aloudorinformationpresentedin
diversemediaandformats,including
visually,quantitatively,andorally.
AzMERITPerformanceLevelDescriptors
D-16
AzMERIT - 2015
EnglishLanguageArts
Grade4
Detailed
4.L.3
usesabasicknowledgeof
languageanditsconventions
whenwriting,speaking,reading,
orlistening;chooseswordsand
phrasestoformsentences;uses
somepunctuation.
AzMERITPerformanceLevelDescriptors
usesabasicknowledgeoflanguage
anditsconventionswhenwriting,
speaking,reading,orlistening;
chooseswordsandphrasesto
conveyideas;usesappropriate
punctuation;usesaconsistently
formalorinformaltone.
D-17
Proficient
demonstratescommandofthe
conventionsofstandardEnglish
capitalization,punctuation,and
spellingwhenwriting;usescommas
andquotationmarkstomarkdirect
speechandquotationsfromatext;
usesacommabeforeacoordinating
conjunctioninacompound
sentence;spellswordscorrectly,
consultingreferencesasneeded.
usesknowledgeoflanguageandits usesdeepknowledgeoflanguage
conventionswhenwriting,speaking, anditsconventionswhenwriting,
reading,orlistening;chooseswords speaking,reading,orlistening;
chooseswordsandphrasestoconvey
andphrasestoconveyideas
precisely;choosespunctuationfor ideasprecisely;choosespunctuation
foreffect;differentiatesbetween
effect;differentiatesbetween
contextsthatcallforformalEnglish contextsthatcallforformalEnglish
(e.g.,presentingideas)andsituations (e.g.,presentingideas)andsituations
whereinformaldiscourseis
whereinformaldiscourseis
appropriate(e.g.,smallgroup
appropriate(e.g.,smallgroup
discussion).
discussion).
AzMERIT - 2015
EnglishLanguageArts
Grade4
Detailed
4.L.5
recognizessimplefigurative
language,simpleword
relationships,andnuancesin
wordmeanings;recognizes
simplesimilesandmetaphors;
recognizescommonidioms,
adages,andproverbs;
understandsthatwordshave
directopposites(antonyms)and
somewordshavesimilarbutnot
identicalmeanings(synonyms).
AzMERITPerformanceLevelDescriptors
demonstratesunderstandingof
demonstratesunderstandingof
simplefigurativelanguage,simple figurativelanguage,word
wordrelationships,andnuancesin relationships,andnuancesinword
meanings;explainsthemeaningof
wordmeanings;identifiesthe
simplesimilesandmetaphors(e.g.,
meaningofsimplesimilesand
asprettyasapicture)incontext;
metaphors(e.g.,asprettyasa
picture)incontext;recognizesand recognizesandexplainsthemeaning
identifiesthemeaningofcommon, ofcommonidioms,adages,and
simpleidioms,adages,andproverbs; proverbs;demonstrates
understandingofwordsbyrelating
demonstratesalimited
understandingofwordsbyrelating themtotheiropposites(antonyms)
themtotheiropposites(antonyms) andtowordswithsimilarbutnot
identicalmeanings(synonyms).
andtowordswithsimilarbutnot
identicalmeanings(synonyms).
D-18
HighlyProficient
determinesorclarifiesandapplies
themeaningofunknownand
multiplemeaningwordsandphrases,
choosingstrategicallyfromarangeof
strategies;usessentenceand
paragraphlevelcontextasaclueto
themeaningofawordorphrase;
usesGreekandLatinaffixesandroots
ascluestothemeaningofaword;
consultsreferencematerials(e.g.,
dictionaries,glossaries,thesauruses),
bothprintanddigital,tofindthe
pronunciationanddetermineor
clarifytheprecisemeaningofkey
wordsandphrases.
demonstratesunderstandingof
complexfigurativelanguage,complex
wordrelationships,andsubtle
nuancesinwordmeanings;explains
themeaningofcomplexandimplicit
similesandmetaphorsincontext;
recognizesandexplainsthemeaning
ofidioms,adages,andproverbs;
demonstratesdeepunderstandingof
wordsbyrelatingthemtotheir
opposites(antonyms)andtowords
withsimilarbutnotidentical
meanings(synonyms).
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
EnglishLanguageArts
Grade5
Standard
MinimallyProficient
Forgradeappropriate,low
complexitytexts,theMinimally
Proficientstudent
Detailed
5.RL.1
explainswhatthetextsays
explicitlyanddrawssimple
inferences.
Detailed
5.RL.2
identifiesanexplicitlystated
themeofastory,drama,or
poem;providesabasiclistof
eventsinatext.
identifiesathemeofastory,drama, determinesathemeofastory,
determinesimplicitlystatedthemes
orpoem;identifiesthekeyeventsor drama,orpoemfromdetailsinthe ofastory,drama,orpoem,including
detailsinatext.
text,includinghowcharactersina howcharactersinastoryordrama
storyordramarespondtochallenges respondtochallengesorhowthe
orhowthespeakerinapoem
speakerinapoemreflectsupona
reflectsuponatopic;summarizesthe topic;comprehensivelysummarizes
text.
thetext.
Detailed
5.RL.3
identifiesdifferencesor
similaritiesbetweentwo
characters,settings,oreventsin
astoryordrama,drawingon
simple,explicitdetailsinthetext.
determinesdifferencesorsimilarities comparesandcontraststwoormore
betweentwoormorecharacters,
characters,settings,oreventsina
storyordrama,drawingonspecific
settings,oreventsinastoryor
drama,usingexplicitdetailsinthe detailsinthetext(e.g.,how
charactersinteract).
text.
analyzesthesimilaritiesand
differencesbetweentwoormore
characters,settings,oreventsina
storyordrama,drawingonimplicitly
stateddetailsinthetext(e.g.,how
charactersinteract).
Detailed
5.RL.4
identifiestheliteralmeaningof
familiarwordsandphrasesas
theyareusedinatext.
determinesthemeaningofwords
andphrasesastheyareusedina
text,includingfigurativelanguage
suchasmetaphorsandsimiles.
analyzesthemeaningofunfamiliar
wordsandphrasesastheyareused
inatext,includingfigurative
languagesuchasmetaphorsand
similes.
Detailed
5.RL.5
identifiesaparticularchapter,
scene,orstanzathatprovides
structuretoaparticularstory,
drama,orpoem.
distinguishesbetweenliteraland
figurativemeaningsofwordsand
phrasesastheyareusedinatext,
includingrecognizingfigurative
languagesuchasmetaphorsand
similes
explainshowaseriesofchapters,
scenes,orstanzasaffectsthebasic
structureofaparticularstory,
drama,orpoem.
explainshowaseriesofchapters,
scenes,orstanzasfitstogetherto
providetheoverallstructureofa
particularstory,drama,orpoem.
analyzeshowaseriesofchapters,
scenes,orstanzasfitstogetherand
interactstoprovidetheoverall
structureofaparticularstory,drama,
orpoem.
AzMERITPerformanceLevelDescriptors
PartiallyProficient
Proficient
Forgradeappropriate,moderateto
Forgradeappropriate,lowto
highcomplexitytexts,theProficient
moderatecomplexitytexts,the
student
PartiallyProficientstudent
Reading:Literature
quotesaccuratelyfromatextwhen
paraphrasespartsofthetextto
explainwhatthetextsaysexplicitly explainingwhatthetextsays
andwhendrawinginferencesfrom explicitlyandwhendrawing
inferencesfromthetext.
thetext.
D-19
HighlyProficient
Forgradeappropriate,high
complexitytexts,theHighly
Proficientstudent
accuratelyquotesstrongtextual
evidencewhenexplainingwhatthe
textsaysexplicitlyandwhendrawing
complexinferencesfromthetext.
AzMERIT - 2015
EnglishLanguageArts
Grade5
5.RL.7
Detailed
Detailed
RL.5.8
5.RL.9
identifieshowvisualand
describeshowvisualandmultimedia
multimediaelementssupportthe elementscontributetothemeaning
meaningofaportionofthetext ofatext(e.g.,graphicnovel,
(e.g.,graphicnovel,multimedia multimediapresentationoffiction,
presentationoffiction,folktale, folktale,myth,poem).
myth poem)
N/A
N/A
identifiesvariousgenrespecific determinesvariousgenrespecific
characteristicsofstoriesinthesame
characteristicsofstoriesinthe
samegenre(e.g.,mysteriesand genre(e.g.,mysteriesandadventure
adventurestories),butwithlittle stories)withsimilarthemesand
ornoconnectiontothethemes topics.
andtopics.
AzMERITPerformanceLevelDescriptors
D-20
analyzeshowvisualandmultimedia analyzes,thenevaluates,howvisual
elementscontributetothemeaning, andmultimediaelementscontribute
tone,orbeautyofatext(e.g.,
tothemeaning,tone,orbeautyofa
graphicnovel,multimedia
text(e.g.,graphicnovel,multimedia
presentationoffiction,folktale,
presentationoffiction,folktale,
myth poem)
myth poem)
N/A
N/A
comparesandcontrastsstoriesinthe compares,contrasts,and
samegenre(e.g.,mysteriesand
analyzes/evaluatesstoriesinthe
samegenre(e.g.,mysteriesand
adventurestories)ontheir
adventurestories)ontheir
approachestosimilarthemesand
approachestosimilarthemesand
topics.
topics.
AzMERIT - 2015
EnglishLanguageArts
Grade5
HighlyProficient
accuratelyquotesstrongtextual
evidencewhenexplainingwhatthe
textsaysexplicitlyandwhendrawing
complexinferencesfromthetext.
Detailed
5.RI.2
identifiestwoormoreexplicitly
statedmainideasofatext;
identifiesrelevantdetailsfrom
thetext;providesabasiclistof
eventsorfactsfromthetext.
determinestwoormoreexplicitly
statedmainideasofatextand
explainshowtheyarerelatedto
relevantdetails;providesasimple
summaryofthetext.
determinestwoormoremainideas
ofatextandexplainshowtheyare
supportedbykeydetails;
summarizesthetext.
analyzestherelationshipbetween
twoormoremainideasofatextand
explainshowtheyaresupportedby
keydetails;providesa
comprehensivesummaryofthetext.
Detailed
5.RI.3
identifiesstraightforward
relationshipsorinteractions
betweentwoindividuals,events,
ideas,orconceptsinahistorical,
scientific,ortechnicaltext.
describestherelationshipsor
interactionsbetweentwo
individuals,events,ideas,or
conceptsinahistorical,scientific,or
technicaltext,relyingonageneral
understandingofthetext.
explainstherelationshipsor
interactionsbetweentwoormore
individuals,events,ideas,or
conceptsinahistorical,scientific,or
technicaltextbasedonspecific
informationinthetext.
analyzescomplexrelationshipsor
interactionsbetweentwoormore
individuals,events,ideas,orconcepts
inahistorical,scientific,ortechnical
text,providingevidencebasedon
specificinformationinthetext.
Detailed
5.RI.4
Detailed
5.RI.5
identifiestheloosemeaningof
frequentlyusedacademicand
domainspecificwordsand
phrases in a text.
identifiestheoverallstructure
(e.g.,chronology,comparison,
cause/effect,problem/solution)
ofevents,ideas,concepts,or
informationintwoormoretexts.
determinestheapproximate
determinesthemeaningofgeneral
meaningofbasicacademicand
academicanddomainspecificwords
domainspecificwordsandphrases andphrasesinatext.
in a text.
explainstheoverallstructure(e.g., comparesandcontraststheoverall
structure(e.g.,chronology,
chronology,comparison,
cause/effect,problem/solution)of comparison,cause/effect,
problem/solution)ofevents,ideas,
events,ideas,concepts,or
informationintwoormoretexts.
concepts,orinformationintwoor
moretexts.
Detailed
5.RI.6
identifiesthepointofviewin
multipleaccountsofthesame
eventortopic.
determinessimilaritiesand
differencesinthepointsofviewin
multipleaccountsofthesameevent
ortopic.
AzMERITPerformanceLevelDescriptors
D-21
determinesandanalyzesthe
meaningandeffectofadvanced
academicanddomainspecificwords
and phrases in a text.
comparesandcontrasts,then
analyzes,theoverallstructure(e.g.,
chronology,comparison,
cause/effect,problem/solution)of
events,ideas,concepts,or
informationintwoormoretexts,
includinghowthatstructure
contributestotheoverallmeaning.
analyzesmultipleaccountsofthe
analyzesmultipleaccountsofthe
sameeventortopic,explains
sameeventortopic,noting
importantsimilaritiesanddifferences importantsimilaritiesanddifferences
inthepointofviewtheyrepresent. inthepointofviewtheyrepresent,
andevaluatestheeffectivenessofthe
accounts.
AzMERIT - 2015
EnglishLanguageArts
Grade5
HighlyProficient
drawsonrelevantinformationfrom
reliablemultipleprintordigital
sources,demonstratingtheabilityto
fullyanswercomplexquestionsorto
solveacomplexproblemefficiently.
Detailed
5.RI.8
identifieswhichreasonsor
evidencesupportaparticular
pointinatext.
explainshowanauthorusesreasons
describeshowanauthoruses
andevidencetosupportparticular
reasonsandevidencetosupport
particularpointsinatext,identifying pointsinatext,identifyingwhich
reasonsandevidencesupportwhich
relevantsupportingdetails.
point(s).
evaluatesthestrengthofthereasons
andevidenceanauthorusesto
supportparticularpointsinatext,
explaininghowthereasonsand
evidencesupportthepoint(s).
Detailed
5.RI.9
identifiesinformationfromone
ortwotextsandprovidesan
incompleteresponsewhen
writingorspeakingaboutthe
subject.
findsrelevantinformationfrom
severaltextsonthesametopicin
ordertowriteorspeakaboutthe
subject.
integratescomplexorinferred
informationfromseveraltextsonthe
sametopicinordertowriteorspeak
aboutthesubjectknowledgably,
usingtextualevidenceassupport.
AzMERITPerformanceLevelDescriptors
D-22
integratesinformationfromseveral
textsonthesametopicinorderto
writeorspeakaboutthesubject
knowledgably.
AzMERIT - 2015
EnglishLanguageArts
Grade5
AzMERITPerformanceLevelDescriptors
D-23
AzMERIT - 2015
EnglishLanguageArts
Grade5
Proficient
HighlyProficient
writesinformative/explanatorytexts writesinformative/explanatorytexts
toexamineatopicandconveyideas tothoroughlyexamineatopicand
conveycomplexideasand
andinformationclearly.
informationclearly.
a.introducesatopicclearly,provides
ageneralobservationandfocus,and a.clearlyandeffectivelyintroduces
groupsrelatedinformationlogically; thetopic,providesaspecific
includesformatting(e.g.,headings), observationandclearfocus,and
illustrations,andmultimediawhen groupsrelatedinformationlogically;
usefultoaidingcomprehension.
includeseffectiveandpurposeful
formatting(e.g.,headings),
illustrations,andmultimediato
b.developsthetopicwithfacts,
b.supportsthetopicwithfacts,
enhancecomprehension.
definitions,concretedetails,
definitions,concretedetails,
quotations,orotherinformationand quotations,orotherinformationand
examplesrelatedtothetopic.
b.fullydevelopsthetopicwith
examples.
relevantfacts,definitions,concrete
details,quotations,orother
c.linksideaswithinandacross
c.linksideaswithincategoriesof
informationusingsimpletransitional categoriesofinformationusing
informationandexamplesrelatedto
wordsorphrases.
words,phrases,andclauses(e.g.,in thetopic.
contrast,especially).
d.usesdomainspecificvocabularyin
c.smoothlylinkssupportedideas
anattempttoexplainthetopic.
d.usespreciselanguageanddomain withinandacrosscategoriesof
specificvocabularytoinformabout informationusingpurposeful
transitionalphrasesandclauses,
e.providesaconcludingstatement. orexplainthetopic.
e.providesaconcludingstatement d.usespreciselanguageanddomain
orsectionrelatedtotheinformation specificvocabularyefficientlyand
effectivelytoinformorexplainabout
orexplanationpresented.
thetopic.
d
AzMERITPerformanceLevelDescriptors
D-24
d ff
AzMERIT - 2015
EnglishLanguageArts
Grade5
Detailed
5.W.78 conductsshortresearchprojects
aboutatopic;recallssome
informationfromexperiences
andsources;providesan
incompletesummaryorlistof
informationinnotes.
AzMERITPerformanceLevelDescriptors
conductsshortresearchprojectsthat conductsresearchprojectsthatuse
conductsshortresearchprojects
thatuseseveralsourcestodiscussa useseveralsourcestoinvestigatea severalhighqualitysourcestofully
investigateatopic;usesrelevant
topic;recallssomeinformationfrom topic;recallsrelevantinformation
informationfromexperiencesand
experiencesandgathersinformation fromexperiencesandgathers
fromsources;providesabrief
relevantinformationfromsources; gatheredfromsources;fully
summaryofinformationinnotesand summarizesorparaphrases
summarizesorparaphrases
finishedwork.
informationinnotesandfinished
informationinnotesandfinished
work.
work.
D-25
AzMERIT - 2015
5SL.3
Detailed
5.L.1
identifiesthepointsaspeaker
makes.
Proficient
HighlyProficient
summarizeawrittentextreadaloud
orinformationpresentedindiverse
mediaandformats,including
visually,quantitatively,andorally.
clearlyandcoherentlysummarizesa
writtentextreadaloudor
informationpresentedindiverse
mediaandformats,includingvisually,
quantitatively,andorally.
determinesthepointsaspeaker
summarizesthepointsaspeaker
makesandidentifieskeydetailsthat makesandexplainshoweachclaim
supportthepoints.
issupportedbyreasonsand
evidence.
Language
demonstratesabasic
demonstratesanunderstandingof
understandingoftheconventions theconventionsofstandardEnglish
ofstandardEnglishgrammarand grammarandusagewhenwritingor
usagewhenwritingorspeaking; speaking,understandingthe
functionofconjunctions,
attemptstoformandusethe
perfectverbtenses;attemptsto prepositions,andinterjectionsin
usecorrelativeconjunctions(e.g., generalandtheirfunctionin
particularsentences;formsanduses
either/or,neither/nor).
theperfectverbtenses,usesverb
tensetoconveyvarioustimes,
sequences,states,andconditions,
andrecognizesinappropriateshifts
inverbtense;usescorrelative
conjunctions(e.g.,either/or,
neither/nor).
AzMERITPerformanceLevelDescriptors
EnglishLanguageArts
Grade5
D-26
providesacomprehensivesummary
ofthepointsaspeakermakesand
evaluateshoweachclaimis
supportedbyreasonsandevidence.
demonstratesstrongcommandof
demonstratescommandofthe
theconventionsofstandardEnglish
conventionsofstandardEnglish
grammarandusagewhenwritingor grammarandusagewhenwritingor
speaking,explainingthefunctionof speaking,explainingthefunctionof
conjunctions,prepositions,and
conjunctions,prepositions,and
interjectionsingeneralandtheir
interjectionsingeneralandtheir
functioninparticularsentences;
functioninparticularsentences;
formsandusestheperfectverb
formsandusestheperfectverb
tenses,usesverbtensetoconvey
tenses,usesverbtensetoconvey
varioustimes,sequences,states,and variousspecifictimes,sequences,
states,andconditions,and
conditions,andrecognizesand
correctsinappropriateshiftsinverb recognizesandcorrectsinappropriate
tense;usescorrelativeconjunctions shiftsinverbtense;usescorrelative
(e.g.,either/or,neither/nor).
conjunctions(e.g.,either/or,
neither/nor).
AzMERIT - 2015
EnglishLanguageArts
Grade5
Detailed
5.L.3
AzMERITPerformanceLevelDescriptors
D-27
AzMERIT - 2015
EnglishLanguageArts
Grade5
5.L.5
recognizesfigurativelanguage,
basicwordrelationships,and
nuancesinwordmeanings;
recognizescommonidioms,
adages,andproverbs;
understandstherelationship
betweenparticularwords(e.g.,
synonyms,antonyms,
homographs).
AzMERITPerformanceLevelDescriptors
demonstratesunderstandingofbasic demonstratesunderstandingof
figurativelanguage,basicword
figurativelanguage,word
relationships,andnuancesinword relationships,andnuancesinword
meanings;interpretsbasicfigurative meanings;interpretsfigurative
language,includingsimilesand
language,includingsimilesand
metaphors,incontext;recognizes
metaphors,incontext;recognizes
commonidioms,adages,and
andexplainsthemeaningof
proverbs;recognizesthatthe
commonidioms,adages,and
relationshipbetweenparticular
proverbs;usestherelationship
words(e.g.,synonyms,antonyms, betweenparticularwords(e.g.,
homographs)canincrease
synonyms,antonyms,homographs)
understandingofeachofthewords. tobetterunderstandeachofthe
words.
D-28
demonstratesastrongunderstanding
ofcomplexfigurativelanguage,
complexwordrelationships,and
subtlenuancesinwordmeanings;
interpretscomplexfigurative
language,includingsimilesand
metaphors,incontext;recognizes
andanalyzesthemeaningofidioms,
adages,andproverbs;usesthe
relationshipbetweenparticular
words(e.g.,synonyms,antonyms,
homographs)tofullyunderstand
eachofthewords.
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
MinimallyProficient
Forgradeappropriate,low
complexitytexts,theLevel1
student
EnglishLanguageArts
Grade6
Proficient
HighlyProficient
PartiallyProficient
Forgradeappropriate,moderateto Forgradeappropriate,high
Forgradeappropriate,lowto
complexitytexts,theLevel4student
moderatecomplexitytexts,theLevel highcomplexitytexts,theLevel3
student
2student
Reading:Literature
looselyreferstothetextto
citestextualevidencetosupport
identifiestextualevidencethat
analysisofwhatthetextsays
supportanalysisofwhatthetext supportsanalysisofwhatthetext
explicitlyaswellasinferencesdrawn
saysexplicitly.
saysexplicitly.
from the text.
identifiesathemeorcentralidea identifiesathemeorcentralideaof determinesathemeorcentralidea
ofatext;providesabasiclistof atext;providesasimplesummaryof ofatextandhowitisconveyed
atextdistinctfrompersonal
eventsinatext.
throughparticulardetails;providesa
opinionsorjudgments.
summaryofthetextdistinctfrom
personalopinionsorjudgments.
Detailed
6.RL.1
Detailed
6.RL.2
Detailed
6.RL.3
identifiesabasicplotofa
particularstoryordramaand
recognizesthatthecharacters
changeduringthestory.
Detailed
6.RL.4
identifiestheliteralmeaningof distinguishesbetweenliteral,
determinesthemeaningofwords
simplewordsandphrasesasthey figurative,andconnotativemeanings andphrasesastheyareusedina
ofwordsandphrasesastheyare
areusedinatext.
text,includingfigurativeand
usedinatext;identifiestheimpact connotativemeanings;analyzesthe
ofspecificwordchoiceonmeaning impactofspecificwordchoiceon
meaningandtone.
andtone.
AzMERITPerformanceLevelDescriptors
describeshowtheplotofa
particularstoryordramaunfolds
andhowthecharacterschange
overall.
D-29
appliesstrongtextualevidencein
supportingacomplexinferenceor
analysisofthetext.
evaluatesthemesorcentralideasin
regardtomajor/minorthemesand
howtheyareconveyedthrough
particulardetails;providesa
comprehensivesummaryofatext
distinctfrompersonalopinionsor
judgments.
describeshowtheplotofaparticular analyzeshowtheplotofaparticular
storyordramaunfoldsinaseriesof storyordramaunfoldsinaseriesof
episodes,aswellashowthe
episodes,aswellashowthe
charactersrespondorchangeasthe responsesandchangesofcomplex
plotmovestowardaresolution.
characterscontributetotheplotasit
movestowardaresolution.
analyzesthemeaningofwordsand
phrasesastheyareusedinatext,
includingfigurativeandconnotative
meanings,andassessestheir
effectiveness;evaluatestheimpactof
specificwordchoiceonmeaningand
tone.
AzMERIT - 2015
EnglishLanguageArts
Grade6
6.RL.6
identifiesthepointofviewofthe describesthepointofviewofthe
narratororspeakerinatext.
narratororspeakerinatext.
explainshowanauthordevelopsthe analyzeshowanauthordevelopsthe
pointofviewofthenarratoror
pointofviewofthenarratoror
speakerinatext,citingevidenceto
speakerinatext.
supporttheanalysis.
Detailed
6.RL.7
determinesthesimilaritiesinthe comparesandcontraststhe
experienceofreadingastory,
experienceofreadingastory,
drama,orpoemandlisteningto drama,orpoemtolisteningtoor
orviewinganaudio,video,orlive viewinganaudio,video,orlive
versionofthetext.
versionofthetext.
comparesandcontrasts,then
comparesandcontraststhe
experienceofreadingastory,drama, analyzes,theexperienceofreadinga
orpoemtolisteningtoorviewingan story,drama,orpoemtolisteningto
orviewinganaudio,video,orlive
audio,video,orliveversionofthe
text,includingcontrastingwhats/he versionofthetext.Analyzeswhat
seesandhearswhenreadingthe s/he"sees"and"hears"whenreading
thetextcomparedtowhats/he
texttowhats/heperceiveswhen
perceiveswhenlisteningorwatching.
listeningorwatching.
Detailed
6.RL.9
identifiesvarioustextual
elementsindifferentformsor
genreswithsimilarthemesor
topics.
AzMERITPerformanceLevelDescriptors
comparesandcontraststextsin
determinesdifferingtextual
elementsindifferentformsorgenres differentformsorgenres(e.g.,
(e.g.,storiesandpoems;historical storiesandpoems;historicalnovels
novelsandfantasystories)with
andfantasystories)intermsoftheir
similarthemesortopics.
approachestosimilarthemesand
topics.
D-30
compares,contrasts,and
analyzes/evaluatestextsindifferent
formsorgenres(e.g.,storiesand
poems;historicalnovelsandfantasy
stories)intermsoftheirapproaches
tosimilarthemesandtopics.
AzMERIT - 2015
EnglishLanguageArts
Grade6
HighlyProficient
appliesstrongtextualevidencein
supportingacomplexinferenceor
analysisofthetext.
evaluatescentralideasandhowthey
areconveyedthroughparticular
details;providesacomprehensive
summaryofatextdistinctfrom
personalopinionsorjudgments.
Detailed
6.RI.3
Detailed
6.RI.4
Detailed
6.RI.5
explainshowaparticularsentence,
locatesaparticularsentence,
paragraph,chapter,orsection
paragraph,chapter,orsection
thatcontributestothe
contributestotheoverallstructure
developmentofthekeyideasofa ofatextandcontributestothe
text.
developmentoftheideas.
Detailed
6.RI.6
identifiesanauthorsexplicit
identifiesanauthorspointofview determinesanauthorspointofview analyzesanauthorspointofview
and purposeinatext;provides
pointofvieworpurposeinatext. orpurposeinatextandidentifies orpurposeinatextandexplains
textualevidencetoshowhowthe
anexampleofwhereitisconveyed howitisconveyedinthetext.
author'spointofviewandpurpose
inthetext.
areconveyedinthetext.
analyzesindetailhowakey
individual,event,orideais
introduced,illustrated,and
elaboratedinatext(e.g.,through
examplesoranecdotes)andanalyzes
relationshipsamongkeyindividuals,
events or ideas
analyzesthemeaningofwordsand
identifiestheliteralmeaningof distinguishesbetweensomeliteral, determinesthemeaningofwords
phrasesastheyareusedinatext,
simplewordsandphrasesasthey figurative,andconnotativemeanings andphrasesastheyareusedina
text,includingfigurative,
ofwordsandphrasesastheyare
includingfigurative,connotative,and
areusedinatext.
usedinatext.
connotative,andtechnicalmeanings. technicalmeanings;evaluatesthe
impactofspecificwordchoice.
AzMERITPerformanceLevelDescriptors
D-31
analyzeshowaparticularsentence,
paragraph,chapter,orsectionfits
intotheoverallstructureofatext
andcontributestothedevelopment
oftheideas.
articulateswhytheauthorusesa
particularsentence,paragraph,
chapter,orsection,andanalyzeshow
itaffectstheoverallstructureofa
textandcontributestothe
developmentoftheideas.
AzMERIT - 2015
EnglishLanguageArts
Grade6
Proficient
integratesinformationpresentedin
differentmediaorformats(e.g.,
visually,quantitatively)aswellasin
wordstodevelopacoherent
understandingofatopicorissue.
HighlyProficient
evaluatesandsynthesizes
informationpresentedindifferent
mediaorformats(e.g.,visually,
quantitatively)aswellasinwordsto
developacomprehensive
understandingofatopicorissue.
tracesandevaluatestheargument
andspecificclaimsinatext,
distinguishingclaimsthatare
supportedbyreasonsandevidence
fromclaimsthatarenot.
tracesandevaluatestheargument
andspecificclaimsinatext,analyzing
howthereasoningandevidence
supportordonotsupporttheclaim.
Detailed
6.RI.8
identifiesspecificclaims,
determinestheargumentand
reasoning,andevidenceinatext. specificclaims,reasoning,and
evidenceinatext.
Detailed
6.RI.9
AzMERITPerformanceLevelDescriptors
D-32
AzMERIT - 2015
EnglishLanguageArts
Grade6
AzMERITPerformanceLevelDescriptors
D-33
AzMERIT - 2015
EnglishLanguageArts
Grade6
AzMERITPerformanceLevelDescriptors
Proficient
writesinformative/explanatorytexts
toexamineatopicandconveyideas,
concepts,andinformationthrough
theselection,organization,and
analysisofrelevantcontent.
HighlyProficient
writesinformative/explanatorytexts
toexamineatopicandconveyideas,
concepts,andinformationthrough
theselection,organization,and
analysisofrelevantcontent.
a.introducesatopic;organizesideas, a.clearlyintroducesatopic;logically
concepts,andinformation,using
organizesideas,concepts,and
strategiessuchasdefinition,
information,usingstrategiessuchas
classification,comparison/contrast, definition,classification,
andcause/effect;includesformatting comparison/contrast,and
(e.g.,headings)andgraphics(e.g.,
cause/effect;includesformatting
charts,tables)andmultimediawhen (e.g.,headings)andgraphics(e.g.,
usefultoaidingcomprehension.
charts,tables)inawaythatenhances
theexplanation.
b.developsthetopicwithfacts,
b.developsthetopicwithrelevant
definitions,details,quotations,or
facts,definitions,concretedetails, b.developsthetopicwithsignificant
quotations,orotherinformationand facts,definitions,concretedetails,
otherinformationandexamples.
examples.
insightfulquotations,orother
informationandexamples.
c.usesappropriatetransitionsto
c.usesappropriatetransitionsto
connectideasandconcepts.
clarifytherelationshipsamongideas c.usesappropriatetransitionsto
clarifyandelaborateonthe
d.usessomepreciselanguageand andconcepts.
relationshipsamongideasand
domainspecificvocabularytoinform
d.usespreciselanguageanddomain concepts.
aboutorexplainthetopic.
specificvocabularytoinformabout
d.usespreciselanguageanddomain
e.establishesaformalstylebutdoes orexplainthetopic.
specificvocabularytoenhancethe
notconsistentlymaintainit.
e.establishesandmaintainsaformal explanationofthetopic.
style.
f.providesabasicconcluding
i
h
i ll
bli h
d
i i
f
l
D-34
AzMERIT - 2015
Proficient
HighlyProficient
e.establishesandmaintainsaformal
f.providesaconcludingstatementor style.
sectionthatfollowsfromthe
informationorexplanation
f.providesawelldeveloped
presented.
concludingstatementorsectionthat
clearlyandlogicallyfollowsfromthe
informationorexplanation
presented.
Detailed
6.W.46 producesclearwritinginwhich
thedevelopment,organization,
andstyleareevident;develops
writingwithsomeplanning,
revising,andediting,including
editingforconventions;
demonstratesbasiccommandof
keyboardingskills.
Detailed
AzMERITPerformanceLevelDescriptors
EnglishLanguageArts
Grade6
D-35
conductsshortresearchprojectsto
answeraquestion,drawingon
severalsourcesandrefocusingthe
inquirywhenappropriate;gathers
relevantinformationfrommultiple
sources;assessesthecredibilityof
sourcesasappropriate;quotesor
paraphrasesthedataand
conclusionsofotherswhileavoiding
plagiarism.
conductsresearchprojectstoanswer
animportantquestion,drawingon
severalsourcesandrefocusingthe
inquirywhenappropriate;gathers
relevant,highqualityinformation
frommultiplesources;assessesthe
credibilityofsourcesasappropriate;
citesthedataandconclusionsof
otherswhileavoidingplagiarismand
usingstandardformatforcitation.
AzMERIT - 2015
Detailed
6.SL.3
6.L.1
identifiesaspeaker'sargument
andspecificclaims.
Proficient
HighlyProficient
interpretsinformationpresentedin
diversemediaandformatsand
explainshowitcontributestoa
topic,text,orissueunderstudy.
interpretsandevaluatesinformation
presentedindiversemediaand
formatsandexplainshowit
contributestoatopic,text,orissue
under study.
identifiesaspeaker'sargumentand delineatesaspeaker'sargumentand delineatesaspeaker'sargumentand
specificclaimsandrecognizesthat specificclaims,distinguishingclaims specificclaims,critiquingclaimsand
someclaimsarenotsupportedby thataresupportedbyreasonsand evaluatingwhetherornottheyare
evidencefromclaimsthatarenot.
reasonsandevidence.
supportedbyreasonsandevidence.
Language
demonstratesunderstandingofthe
demonstratesbasic
understandingoftheconventions conventionsofstandardEnglish
ofstandardEnglishgrammarand grammarandusagewhenwritingor
usagewhenwritingorspeaking: speaking:ensuresthatpronounsare
inconsistentlyusespronounsin inthepropercase;usesintensive
thecorrectcase;inconsistently pronouns;recognizesinappropriate
recognizesinappropriateshiftsin shiftsinpronounnumberand
person;recognizesvaguepronouns;
pronounnumberandperson;
andidentifiesvariationsfrom
andidentifiessomevariations
fromstandardEnglish,using
standardEnglishandusesstrategies
basicstrategiestoimprove
toimproveexpressionin
expressioninconventional
conventionallanguage.
language.
AzMERITPerformanceLevelDescriptors
EnglishLanguageArts
Grade6
D-36
demonstratescommandofthe
conventionsofstandardEnglish
grammarandusagewhenwritingor
speaking:ensuresthatpronounsare
inthepropercase;usesintensive
pronouns;recognizesandcorrects
inappropriateshiftsinpronoun
numberandperson;recognizesand
correctsvaguepronouns;and
recognizesvariationsfromstandard
Englishandusesstrategiesto
improveexpressioninconventional
language.
demonstratesstrongcommandof
theconventionsofstandardEnglish
grammarandusagewhenwritingor
speaking:ensuresthatpronounsare
inthepropercase;usesintensive
pronouns;recognizesandcorrects
inappropriateshiftsinpronoun
numberandperson;andrecognizes
andcorrectsvaguepronouns;and
identifiesvariationsfromstandard
Englishandusesspecificstrategiesto
significantlyimproveexpressionin
conventionallanguage.
AzMERIT - 2015
EnglishLanguageArts
Grade6
Proficient
demonstratescommandofthe
conventionsofstandardEnglish
capitalization,punctuation,and
spellingwhenwriting:uses
punctuation(commas,parentheses,
dashes)tosetoff
nonrestrictive/parenthetical
elements;spellscorrectly.
Detailed
6.L.3
usesbasicknowledgeoflanguage usesknowledgeoflanguageandits
anditsconventionswhenwriting, conventionswhenwriting,speaking,
speaking,reading,orlistening, reading,orlistening,generally
applyingbasicvariationsin
varyingsentencepatternsfor
sentencepatternsformeaning, meaning,interest,reader/listener
interest,reader/listenerinterest, interest,andstylewhile
andstylewhileattemptingsome demonstratingsomeconsistencyin
consistencyinstyleandtone.
styleandtone.
Detailed
6.L.4
AzMERITPerformanceLevelDescriptors
D-37
HighlyProficient
demonstratesstrongandstrategic
commandoftheconventionsof
standardEnglishcapitalization,
punctuation,andspellingwhen
writing:usespunctuation(commas,
parentheses,dashes)tosetoff
nonrestrictive/parenthetical
elements;spellscorrectly.
usesknowledgeoflanguageandits strategicallyusesknowledgeof
conventionswhenwriting,speaking, languageanditsconventionswhen
reading,orlistening,varying
writing,speaking,reading,or
sentencepatternsformeaning,
listening,varyingsentencepatterns
interest,reader/listenerinterest,and formeaning,interest,reader/listener
stylewhilemaintainingconsistency interest,andstylewhilemaintaining
instyleandtone.
strongconsistencyinstyleandtone.
definitivelydeterminesorclarifiesthe
meaningofunknownandmultiple
meaningwordsandphrases,
choosingfromarangeofstrategies;
usessentenceandpassagelevel
contextasacluetothemeaningofa
wordorphrase;usescommonGreek
andLatinaffixesandrootsascluesto
themeaningoftheword;consults
specificandappropriatereference
materialsasneeded;andverifiesthe
preliminarydeterminationofthe
meaningofawordorphrase.
AzMERIT - 2015
EnglishLanguageArts
Grade6
AzMERITPerformanceLevelDescriptors
D-38
HighlyProficient
demonstratescommandoffigurative
language,wordrelationships,and
nuancesinwordmeanings,including
interpretingcomplexfiguresof
speechincontext,evaluatingthe
relationshipbetweenparticular
wordstobetterunderstandeachof
thewords,anddistinguishingamong
theconnotationsofwordswith
similardenotationsandapplying
theminspeakingandwriting.
AzMERIT - 2015
EnglishLanguageArts
Grade7
Detailed
7.RL.2
Detailed
7.RL.3
identifiesparticularelementsofa explainshowparticularelementsof
astoryordramainteract(e.g.,how
storyordrama(e.g.,settingor
settingshapesthecharactersor
characters).
plot).
Detailed
7.RL.4
identifiestheliteralorfigurative
meaningofwordsandphrasesas
theyareusedinatext;identifies
rhymesandotherrepetitionsof
soundsinaspecificverseor
stanzaofapoemorsectionofa
storyordrama.
Detailed
7.RL.5
describesadramasorpoemsform analyzeshowadramasorpoems
identifiesadramasorpoems
formorstructure(e.g.,soliloquy, orstructure(e.g.,soliloquy,sonnet) formorstructure(e.g.,soliloquy,
sonnet)contributestoitsmeaning.
andhowitcontributestothe
sonnet).
meaningofthetext.
AzMERITPerformanceLevelDescriptors
Forgradeappropriate,high
complexitytexts,theHighly
Proficientstudent
appliesnumerous,strongpiecesof
textualevidenceinsupportinga
complexinferenceoranalysisofthe
text.
evaluatesthemesorcentralideasof
atextandanalyzestheir
developmentoverthecourseofa
text;providesacomprehensive,
objectivesummaryofatext.
evaluatestherelationshipsbetween
particularelementsofastoryor
drama(e.g.,howsettingshapesthe
charactersorplot)andanalyzesthe
impact.
determinesthemeaningand
determinesthemeaningofwords
distinguishesbetweenliteral,
analyzestheimpactofwordsand
figurative,andconnotativemeanings andphrasesastheyareusedina
phrasesastheyareusedinatext,
text,includingfigurativeand
ofwordsandphrasesastheyare
usedinatext;describestheimpact connotativemeanings;analyzesthe includingfigurativeandconnotative
meanings,andassessestheir
ofrhymesandotherrepetitionsof impactofrhymesandother
effectiveness;analyzesandevaluates
repetitionsofsounds(e.g.,
sounds(e.g.,alliteration)ona
theimpactofrhymesandother
specificverseorstanzaofapoemor alliteration)onaspecificverseor
repetitionsofsounds(e.g.,
stanzaofapoemorsectionofa
sectionofastoryordrama.
alliteration)onaspecificverseor
storyordrama.
stanzaofapoemorsectionofastory
ordrama.
D-39
analyzeshowparticularelementsof
astoryordramainteract(e.g.,how
settingshapesthecharactersor
plot).
analyzesandevaluateshowa
dramasorpoemsformorstructure
(e.g.,soliloquy,sonnet)contributes
toitsmeaningandimpact.
AzMERIT - 2015
EnglishLanguageArts
Grade7
Detailed
7.RL.7
identifiessimilaritiesor
differencesbetweenawritten
story,drama,orpoemtoits
audio,filmed,staged,or
multimediaversion.
Detailed
7.RL.9
comparesandcontrastsafictional
identifiessimilaritiesor
differencesbetweenafictional portrayalofatime,place,or
characterandahistoricalaccountof
portrayalofatime,place,or
characterandahistoricalaccount thesameperiod;identifieshowan
authoroffictionaltershistory.
ofthesameperiod.
AzMERITPerformanceLevelDescriptors
comparesandcontrastsawritten
story,drama,orpoemtoitsaudio,
filmed,staged,ormultimedia
version,andidentifiesthe
techniquesuniquetoeachmedium
(e.g.,lighting,sound,color,or
camerafocusandanglesinafilm).
D-40
comparesandcontrastsawritten
story,drama,orpoemtoitsaudio,
filmed,staged,ormultimedia
version,analyzingtheeffectsof
techniquesuniquetoeachmedium
(e.g.,lighting,sound,color,or
camerafocusandanglesinafilm).
analyzesandevaluatesthe
effectivenessofhowanauthor
developsandcontraststhepointsof
viewofdifferentcomplexcharacters
ornarratorsinatext.
analyzesandcritiquesanaudio,
filmed,staged,ormultimediaversion
ofawrittenstory,dramaorpoemas
comparedtoitswrittenversion;
evaluatestheimpactand
effectivenessoftechniquesuniqueto
eachmedium(e.g.,lighting,sound,
color,orcamerafocusandanglesina
film)
comparesandcontrastsafictional comparesandcontrasts,then
analyzes,afictionalportrayalofa
portrayalofatime,place,or
characterandahistoricalaccountof time,place,orcharacteranda
historicalaccountofthesameperiod
thesameperiodasameansof
understandinghowauthorsoffiction tounderstandandevaluatehow
authorsoffictionuseoralterhistory.
useoralterhistory.
AzMERIT - 2015
EnglishLanguageArts
Grade7
Highly Proficient
appliesnumerous,strongpiecesof
textualevidenceinsupportinga
complexinferenceoranalysisofthe
text.
Detailed
7.RI.2
identifiestwoormorecentralideas determinestwoormorecentral
identifiesacentralideaofthe
text;providesabasicsequenceof ofatext;providesasummaryofa ideasinatextandanalyzestheir
developmentoverthecourseofthe
text.
eventsorideasinatext.
text;providesanobjectivesummary
ofatext.
evaluatestwoormorecentralideas
andanalyzestheirdevelopmentover
thecourseofthetext;providesa
comprehensive,objectivesummary
ofatext.
Detailed
7.RI.3
analyzestheinteractionsbetween
individuals,events,andideasina
text(e.g.,howideasinfluence
individualsorevents,orhow
individualsinfluenceideasorevents).
analyzesandevaluatescomplex
relationshipsbetweenindividuals,
events,andideasinatext(e.g.,how
ideasinfluenceindividualsorevents,
orhowindividualsinfluenceideasor
events).
Detailed
7.RI.4
identifiessomeofthe
relationshipsbetween
individuals,events,andideasina
text(e.g.,howideasinfluence
individualsorevents,orhow
individualsinfluenceideasor
events).
identifiestheliteralorfigurative
meaningofwordsandphrasesas
theyareusedinatext;
recognizesthataspecificword
choicehasanimpactonmeaning
andtone.
Detailed
7.RI.5
determinestherelationships
betweenindividuals,events,and
ideasinatext(e.g.,howideas
influenceindividualsorevents,or
howindividualsinfluenceideasor
events).
analyzesthemeaningofwordsand
determinesthemeaningofwords
distinguishesbetweenliteral,
phrasesastheyareusedinatext,
figurative,connotative,andtechnical andphrasesastheyareusedina
includingfigurative,connotative,and
meaningsofwordsandphrasesas text,includingfigurative,
theyareusedinatext;describesthe connotative,andtechnicalmeanings; technicalmeanings;evaluatesthe
effectofaspecificwordchoiceon
impactofaspecificwordchoiceon analyzestheimpactofaspecific
wordchoiceonmeaningandtone. meaningandtone.
meaningandtone.
AzMERITPerformanceLevelDescriptors
D-41
AzMERIT - 2015
EnglishLanguageArts
Grade7
Proficient
Highly Proficient
determinesanauthorspointofview
orpurposeinatextandanalyzes
howtheauthordistinguisheshisor
herpositionfromthatofothers.
analyzesanauthorspointofview
andpurposeinatext;evaluateshow
effectivelytheauthordistinguishes
hisorherpositionfromthatofothers
toaccomplishhisorherpurpose.
comparesandcontrastsatexttoan
audio,video,ormultimediaversion
ofthetext,analyzingeachmediums
portrayalofthesubject(e.g.,how
thedeliveryofaspeechaffectsthe
impactofthewords).
evaluatestheeffectivenessand
impactofatextascomparedtoan
audio,filmed,staged,ormultimedia
version,analyzingeachmediums
portrayalofthesubject(e.g.,howthe
deliveryofaspeechaffectsthe
impactofthewords).
Detailed
7.RI.7
identifiessimilarities or
differencesbetweenatextand
anaudio,video,ormultimedia
versionofthetext.
Detailed
7.RI.8
Detailed
7.RI.9
explicatesandevaluatesthe
argumentandspecificclaimsina
complextext;citesspecificlanguage
orexamplesinthetextinan
assessmentofwhetherornotthe
reasoningissoundandtheevidence
isrelevantandsufficienttosupport
the claims
describeshowtwoormoreauthors analyzeshowtwoormoreauthors citestextualevidenceinan
describeshowtwoormore
authorswritingaboutthesame writingaboutthesametopicshape writingaboutthesametopicshape evaluationofthedifferentrhetorical
effectsusedbytwoormoreauthors
theirpresentationsofkey
topicshapetheirpresentationsof theirpresentationsofkey
informationbyemphasizingdifferent informationbyemphasizingdifferent writingaboutthesametopicshape
keyinformation.
theirpresentationsofkey
evidenceoradvancingdifferent
evidence.
informationbyemphasizingdifferent
interpretationsoffacts.
evidenceoradvancingdifferent
interpretationsoffacts.
tracestheargumentandaclaim
inatext,identifyingthe
reasoningandevidenceusedto
supporttheclaim.
AzMERITPerformanceLevelDescriptors
comparesandcontrastsatexttoan
audio,video,ormultimediaversion
ofthetext,identifyinghoweach
mediumportraysthesubject(e.g.,
howthedeliveryofaspeechaffects
theimpactofthewords).
tracesandevaluatestheargument
andclaimsinatext,describingthe
reasoningandevidenceusedto
supporttheclaims.
D-42
tracesandevaluatestheargument
andspecificclaimsinatext,
assessingwhetherthereasoningis
soundandtheevidenceisrelevant
andsufficienttosupporttheclaims.
AzMERIT - 2015
EnglishLanguageArts
Grade7
a.introducesclaim(s)and
organizesthereasonsand
evidence.
AzMERITPerformanceLevelDescriptors
D-43
AzMERIT - 2015
EnglishLanguageArts
Grade7
Proficient
Highly Proficient
writesinformative/explanatorytexts
toexamineatopicandconveyideas,
concepts,andinformationthrough
theselection,organization,and
analysisofrelevantcontent.
writesinformative/explanatorytexts
toexamineatopicandconvey
complexideas,concepts,and
informationwithastrongly
developedfocusthroughthe
selection,organization,andanalysis
ofrelevantcontent.
a.introducesatopic;attemptsan a.introducesatopicclearly;
a.introducesatopicclearly,
organizationofideas,concepts, organizesideas,concepts,and
andinformationusingstrategies information,usingstrategiessuchas previewingwhatistofollow;
suchasdefinition,classification, definition,classification,
organizesideas,concepts,and
comparison/contrast,and
comparison/contrast,and
information,usingstrategiessuchas
cause/effect;includesformatting
cause/effect.
definition,classification,
(e.g.,headings)andgraphics(e.g., comparison/contrast,and
cause/effect;includesformatting
b.describesthetopicwithfacts, charts,tables)whenusefultoaid
comprehension.
(e.g.,headings)andgraphics(e.g.,
definitions,concretedetails,
charts,tables)whenusefultoaiding
quotations,orotherinformation
b.developsthetopicwithfacts,
comprehension.
andexamples.
definitions,concretedetails,
quotations,orotherinformationand b.developsthetopicwithrelevant
c.usesbasictransitionstolink
examples.
facts,definitions,concretedetails,
ideasandconcepts.
quotations,orotherinformationand
c.usesappropriatetransitionsto
examples.
d.usestopicappropriate
createcohesion.
languageandvocabularyto
c.usesappropriatetransitionsto
informaboutordescribethe
d.usestopicappropriatelanguage createcohesionandclarifythe
topic.
andvocabularytoinformaboutor relationshipsamongideasand
explainthetopic.
concepts.
e.usesaninformalstyle.
f.providesaconcluding
statementorsection.
AzMERITPerformanceLevelDescriptors
a.introducesatopicwithastrongly
developedfocususingappropriate
strategiessuchasdefinition,
classification,comparison/contrast,
andcauseandeffect;includesformal
formatting(e.g.,headings)and
graphics(e.g.,charts,tables)to
enhancecomprehension.
b.developsthetopicwithanalysisof
relevantfacts,complexideas,
definitions,concretedetails,
quotations,orotherinformationand
examplesappropriatetothe
audience'sknowledgeofthetopic.
c.usesappropriateandvaried
transitionstocreatecohesionand
clarifytherelationshipsamongideas
e.establishesformalstyle,butdoes d.usespreciselanguageanddomain andconcepts.
notconsistentlymaintainit.
specificvocabularytoinformabout
d.usespreciselanguageanddomain
orexplainthetopic.
f
d
l d
f
b l
h
D-44
AzMERIT - 2015
EnglishLanguageArts
Grade7
AzMERITPerformanceLevelDescriptors
D-45
produceswelldevelopedand
cohesivewritinginwhichthe
development,organization,andstyle
areappropriatetotask,purpose,and
audience;developsandstrengthens
writingasneededbyplanning,
revising,editing,rewriting,ortryinga
newapproach,successfully
addressingtheintendedpurposeand
audience;editingshould
demonstrateskillfulcommandof
Languagestandards13uptoand
includinggrade7;usestechnologyto
producewritingandcitesourcesas
wellasconnectideasefficiently.
AzMERIT - 2015
Detailed
7.SL.2
identifiesthemainideasand
supportingdetailspresentedin
diversemediaandformats.
Detailed
7.SL.3
identifiesaspeaker'sargument
andspecificclaims.
AzMERITPerformanceLevelDescriptors
EnglishLanguageArts
Grade7
Listening
explainsthemainideasand
supportingdetailspresentedin
diversemediaandformatsandhow
theyrelatetothetopic.
explainsaspeakersargumentand
specificclaims,identifyingthe
relevanceoftheevidence
introduced.
D-46
Proficient
conductsshortresearchprojectsto
answeraquestion,drawingon
severalsourcesandgenerating
additionalrelated,focusedideas;
gathersrelevantinformationfrom
multiplesources;assessesthe
credibilityandaccuracyofeach
source;andquotesorparaphrases
thedataandconclusionsofothers
whileavoidingplagiarismand
followingastandardformatfor
citation.
Highly Proficient
conductsshortresearchprojectsto
answeranimportantquestion,
drawingonseveralsourcesand
generatingadditionalrelated,
focused,andevaluativeideas;
gathersrelevantinformationfrom
multiplesources;evaluatesthe
credibilityandaccuracyofeach
source;andjudiciouslyquotesor
paraphrasesthedataandconclusions
ofotherswhileavoidingplagiarism
andfollowingastandardformatfor
citation.
analyzesthemainideasand
analyzesthemainideasand
supportingdetailspresentedin
supportingdetailspresentedin
diversemediaandformatsand
diversemediaandformats(e.g.,
visually,quantitatively,orally)and evaluateshowwelltheideasclarifya
explainshowtheideasclarifyatopic, topic,text,orissueunderstudy.
text,orissueunderstudy.
delineatesaspeaker'sargumentand
specificclaims,evaluatingthe
soundnessofthereasoningandthe
relevanceandsufficiencyofthe
evidence.
delineatesaspeaker'sargumentand
specificclaims,evaluatingthe
soundnessofreasoningandthe
relevanceandsufficiencyofthe
evidenceusingrealworldapplication,
rhetoricalanalysis,orexaminationof
discoursestyle.
AzMERIT - 2015
AzMERITPerformanceLevelDescriptors
EnglishLanguageArts
Grade7
D-47
Proficient
Highly Proficient
demonstratescommandofthe
conventionsofstandardEnglish
grammarandusagewhenwritingor
speaking:
demonstratescorrectapplicationand
commandoftheconventionsof
standardEnglishgrammarandusage
whenwritingorspeaking:
a.explainsthefunctionofphrases
andclausesingeneralandtheir
functioninspecificsentences.
a.analyzesthefunctionofphrases
andclausesingeneralandexplains
theirfunctioninspecificsentences.
b.choosesamongsimple,
compound,complex,andcompound
complexsentencestosignaldiffering
relationshipsamongideas.
b.makesinformedchoicesamong
simple,compound,complex,and
compoundcomplexsentencesto
signaldifferingrelationshipsamong
ideas.
c.placesphrasesandclauseswithina
sentence,recognizingandcorrecting c.effectivelyplacesphrasesand
clauseswithinasentence,
misplacedanddanglingmodifiers.
recognizingandcorrectingmisplaced
anddanglingmodifiers.
AzMERIT - 2015
EnglishLanguageArts
Grade7
Proficient
demonstratescommandofthe
conventionsofstandardEnglish
capitalization,punctuation,and
spellingwhenwriting:
a.usesacommatoseparate
coordinateadjectives(e.g.,Itwasa
fascinating,enjoyablemovie;but
not:Heworeanold[,]greenshirt).
7.L.3
a.usesacommatoseparate
coordinateadjectives(e.g.,Itwasa
fascinating,enjoyablemovie;butnot:
Heworeanold[,]greenshirt).
b.spellsabovegradelevelwords
correctly.
usesknowledgeoflanguageandits usesknowledgeoflanguageandits
usesabasicknowledgeof
conventionswhenwriting,speaking, conventionswhen
languageanditsconventions
writing,speaking,reading,or
whenwriting,speaking,reading, reading,orlistening:
listening:
orlistening:
a.chooseslanguagethatexpresses
a.chooseslanguagethatexpresses
ideaspreciselyandconcisely,
a.inconsistentlychooses
ideaspreciselyandconcisely,
occasionallyrecognizingand
languagethatexpressesideas
recognizingandeliminating
eliminatingwordinessand
withoutwordinessand
wordinessandredundancy.
redundancy.
redundancy.
AzMERITPerformanceLevelDescriptors
demonstratescorrectapplicationand
commandoftheconventionsof
standardEnglishcapitalization,
punctuation,andspellingwhen
writing:
b.spellscorrectly.
b.spellsgradelevelwords
correctly.
Detailed
Highly Proficient
D-48
usescomprehensiveknowledgeof
languageanditsconventionswhen
writing,speaking,reading,or
listening:
a.strategicallychooseslanguagethat
expressesideaspreciselyand
concisely,consciouslyrecognizing
andeliminatingwordinessand
redundancy.
AzMERIT - 2015
EnglishLanguageArts
Grade7
AzMERITPerformanceLevelDescriptors
D-49
AzMERIT - 2015
EnglishLanguageArts
Grade7
a.inconsistentlyidentifiesfigures a.identifiesfiguresofspeech(e.g.,
ofspeech(e.g.,literary,biblical, literary,biblical,mythological
allusions)incontext.
mythologicalallusions)in
context.
b.identifiestherelationship
betweenparticularwords(e.g.,
b.inconsistentlyidentifiesthe
relationshipbetweenparticular synonym/antonym,analogy)to
betterunderstandeachofthe
basicwords(e.g.,
synonym/antonym,analogy)to words.
betterunderstandeachofthe
c.identifiestheconnotations
words.
(associations)ofwordswithsimilar
denotations(definitions)(e.g.,
c.inconsistentlyidentifiesthe
refined,respectful,polite,
connotations(associations)of
wordswithsimilardenotations diplomatic,condescending).
(definitions)(e.g.,refined,
respectful,polite,diplomatic,
condescending).
AzMERITPerformanceLevelDescriptors
D-50
a.interpretsfiguresofspeech(e.g.,
literary,biblical,andmythological
allusions)incontext.
demonstratesdeepunderstandingof
figurativelanguage,word
relationships,andnuancesinword
meanings:
a.interpretsfiguresofspeech(e.g.,
literary,biblical,mythological
allusions)incontexttoevaluatethe
effectofdictionuponthetext.
b.usestherelationshipbetween
b.usestherelationshipbetween
particularwords(e.g.,
particularwords(e.g.,
synonym/antonym,analogy)to
betterunderstandeachofthewords. synonym/antonym,analogy)to
evaluatetheeffectofdictionupon
thetext.
c.distinguishesamongthe
connotations(associations)ofwords
withsimilardenotations(definitions) c.distinguishesamongthe
connotations(associations)ofwords
(e.g.,
withsimilardenotations(definitions)
refined,respectful,polite,
(e.g.,refined,respectful,polite,
diplomatic,condescending).
diplomatic,condescending)to
evaluatetheeffectofdictionupon
thetext.
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
EnglishLanguageArts
Grade8
Proficient
MinimallyProficient
PartiallyProficient
Forgradeappropriate,lowto
Forgradeappropriate,moderateto
Forgradeappropriate,low
complexitytexts,theMinimally moderatecomplexitytexts,the highcomplexitytexts,theProficient
PartiallyProficientstudent
student
Proficientstudent
Reading:LiteraryText
citestextualevidencetosupport citestextualevidencetosupport citesthetextualevidencethatmost
ananalysisofwhatthetextsays ananalysisofwhatthetextsays stronglysupportsananalysisofwhat
thetextsaysexplicitlyaswellas
explicitlyaswellasinferences
explicitly.
inferencesdrawnfromthetext.
drawnfromthetext.
HighlyProficient
Forgradeappropriate,highcomplexity
texts,theHighlyProficientstudent
appliesthoroughtextualevidenceto
stronglysupportadeepanalysisofthe
textaswellascomplexinferences
drawnfromthetext.
Detailed
8.RL.1
Detailed
8.RL.2
identifiesathemeorcentral
ideaofatext;identifies
characters,setting,andplot;
providesalistofeventsfrom
thetext.
Detailed
8.RL.3
Detailed
8.RL.4
analyzesandevaluatesthe
effectivenessofanauthor'suseof
dialogueorincidentsinastoryor
dramatopropeltheaction,reveal
aspectsofthecharacter,orprovokea
decision
determinesthemeaningofwordsand determinesthemeaningandevaluates
identifiestheliteralorfigurative distinguishesbetweenliteral,
theimpactofwordsandphrases,
phrases,includingfigurativeand
meaningofwordsandphrases figurative,andconnotative
meaningsofwordsandphrases connotativemeanings;analyzesthe includingfigurativeandconnotative
astheyareusedinatext;
meanings;analyzesandevaluatesthe
impactofspecificwordchoiceson
astheyareusedinatext;
identifieswordsthatimpact
determinestheeffectofspecific meaningandtone,includinganalogies impactofspecificwordchoiceson
meaningandtone.
meaningandtone,includinganalogies
orallusionstoothertexts.
wordchoicesonmeaningand
orallusionstoothertexts.
tone,includinganalogiesor
allusionstoothertexts.
identifiesspecificlinesof
dialogueorincidentsinastory
ordramathatpropeltheaction
andrevealaspectsofthe
character.
AzMERITPerformanceLevelDescriptors
identifiesathemeorcentralidea determinesathemeorcentralideaof
ofatextanddeterminesdetails atextandanalyzesitsdevelopment
oreventsthatdevelopit;explains overthecourseofatext,includingits
relationshiptothecharacters,setting,
characters,setting,andplot;
andplot;providesanobjective
providesasimple,objective
summaryofthetext.
summaryofthetext.
describeshowspecificlinesof
dialogueorincidentsinastoryor
dramapropeltheactionand
revealaspectsofthecharacter.
D-51
analyzeshowspecificlinesofdialogue
orincidentsinastoryordramapropel
theaction,revealaspectsofthe
character,orprovokeadecision.
determinestwoormorethemesor
centralideasandanalyzestheir
developmentoverthecourseofatext;
evaluatesthetheme(s)orcentral
idea(s)andtherelationshiptonarrative
elements;providesaconciseand
comprehensiveobjectivesummaryof
thetext.
AzMERIT - 2015
EnglishLanguageArts
Grade8
Detailed
8.RL.6
identifiesthatdifferencesinthe describeshowdifferencesinthe
pointsofviewofthecharacters pointsofviewofthecharacters
orthereaderaffectthemeaning orthereadercontributetoan
understandingofthetext.
ofthetext.
analyzeshowdifferencesinthepoints evaluatestheimpactofdifferencesin
ofviewofthecharactersorthereader thepointsofviewofthecharactersor
thereader(e.g.,createdthroughthe
(e.g.,createdthroughtheuseof
dramaticirony)createsucheffectsas useofdramaticirony)andthe
effectivenessofcreatingsuspenseor
suspenseorhumorinthetext.
humorinthetext.
Detailed
8.RL.7
Detailed
8.RL.9
describestheextenttowhicha
filmofastoryordramastays
faithfultoordepartsfromthe
textorscript,identifyingthe
choicesmadebythedirectoror
actors
determineshowamodernwork
identifiesarelationship
offictiondrawsonexplicit
betweenamodernworkof
fictionandpatternsofeventsor themes,patternsofevents,or
charactertypesfrommyths,
charactertypesfrommyths,
traditionalstories,orreligious traditionalstories,orreligious
works,describinghowthe
works.
materialisrenderednew.
evaluatestheextenttowhichafilmof
astoryordramastaysfaithfultoor
departsfromthetextorscript;
critiquesthechoicesmadebythe
directororactorsandproposes
alternate treatments
analyzeshowamodernworkoffiction evaluateshowamodernworkoffiction
drawsonthemes,patternsofevents, drawsonthemes,patternsofevents,
orcharactertypesfrommyths,
orcharactertypesfrommyths,
traditionalstories,orreligiousworks, traditionalstories,orreligiousworks;
includinghowthematerialisrendered evaluatestheimpactofthenewly
renderedmaterial.
new.
identifiestheextenttowhicha
filmofastoryordramastays
faithfultoordepartsfromthe
textorscript.
AzMERITPerformanceLevelDescriptors
D-52
analyzestheextenttowhichafilmof
astoryordramastaysfaithfultoor
departsfromthetextorscript,
evaluatingthechoicesmadebythe
directororactors.
AzMERIT - 2015
EnglishLanguageArts
Grade8
8.RI.2
Detailed
8.RI.3
Detailed
8.RI.4
Detailed
8.RI.5
AzMERITPerformanceLevelDescriptors
identifiesthestructureofa
specificparagraphinatextand
describesitseffectonatext;
describestheroleofparticular
sentencesindevelopingand
refiningakeyconcept.
D-53
evaluatestheeffectofthestructureof
analyzesindetailthestructureofa
specificparagraphinatext,including aspecificparagraphinatextandits
roleinthetextasawhole,including
theroleofparticularsentencesin
developingandrefiningakeyconcept. theroleofparticularsentencesin
developingandrefiningakeyconcept.
AzMERIT - 2015
EnglishLanguageArts
Grade8
Proficient
determinesanauthorspointofview
orpurposeinatextandanalyzeshow
theauthoracknowledgesand
respondstoconflictingevidenceor
viewpoints.
evaluatesandcritiquestheuseof
evaluatestheadvantagesand
disadvantagesofusingdifferentmedia differentmedia(e.g.,printordigital
text,video,multimedia)topresenta
(e.g.,printordigitaltext,video,
particulartopicoridea,providing
multimedia)topresentaparticular
specificevidenceassupport.
topicoridea.
Detailed
8.RI.8
identifiestheargumentor
specificclaimsinatext,
describingthereasoningand
evidenceusedtosupportthe
argumentorclaims.
describestheargumentand
specificclaimsinatext,
discussingwhetherthereasoning
issoundandtheevidenceis
relevantandsufficient.
delineatesandevaluatesthe
argumentandspecificclaimsinatext,
assessingwhetherthereasoningis
soundandtheevidenceisrelevant
andsufficient;recognizewhen
irrelevantevidenceisintroduced.
Detailed
8.RI.9
identifiesacaseinwhichtwoor
moretextsprovideconflicting
informationonthesametopic,
andidentifieswherethetexts
disagree.
describesacaseinwhichtwoor
moretextsprovideconflicting
informationonthesametopic,
andidentifieswherethetexts
disagreeonmattersoffact.
analyzesacaseinwhichtwoormore analyzesandevaluatesacaseinwhich
textsprovideconflictinginformation twoormoretextsprovideconflicting
informationonthesametopic,and
onthesametopic,andidentifies
wherethetextsdisagreeonmattersof identifieswherethetextsdisagreeon
mattersoffactorinterpretation,
factorinterpretation.
evaluatingthestrengthorreliabilityof
each.
AzMERITPerformanceLevelDescriptors
D-54
synthesizestheargumentandspecific
claimsinatext,citingspecificlanguage
toevaluatewhetherthereasoningis
soundandtheevidenceisrelevantand
sufficient;recognizesirrelevant
evidenceandprovesitsirrelevancy.
AzMERIT - 2015
EnglishLanguageArts
Grade8
8.W.1
writesargumentstosupport
claimswithreasonsand
evidence.
Proficient
Writing
writesargumentstosupportclaims
writesargumentstosupport
claimswithreasonsandrelevant withclearreasonsandrelevant
evidence.
evidence.
a.introducesclaim(s),states
a.introducesclaim(s),states
opposingclaims,andorganizes alternateoropposingclaims,and
organizesthereasonsand
reasonsandevidence.
evidencelogically.
b.supportsclaimswith
b.supportsclaimswithreasoning
extratextualevidence,and
andevidence,usingsourcesand
demonstratingabasic
demonstratinganunderstanding
understandingofthetopicor
ofthetopicortext.
text.
a.introducesclaim(s),acknowledges
anddistinguishestheclaim(s)from
alternateoropposingclaims,and
organizesthereasonsandevidence
logically.
b.supportsclaim(s)withlogical
reasoningandrelevantevidence,
usingaccurate,crediblesourcesand
demonstratinganunderstandingof
thetopicortext.
c.usestransitionwordstolink c.useswords,phrases,and
claim(s),counterclaims,reasons, clausestoclarifytherelationships
amongclaim(s),counterclaims, c.useswords,phrases,andclausesto
andevidence.
createcohesionandclarifythe
reasons,andevidence.
relationshipsamongclaim(s),
d.attemptstoestablishaformal
counterclaims,reasons,andevidence.
d.establishesaformalstyle.
style.
e.providesaconcluding
statementorsection.
AzMERITPerformanceLevelDescriptors
d.establishesandmaintainsaformal
d.establishesandmaintainsaformal styleandobjectivetonethatenhances
theargument.
style.
e.providesaconcluding
statementorsectionthat
supportstheargument
presented.
e.providesaconcludingstatementor e.providesacompellingconcluding
sectionthatfollowsfromandsupports statementorsectionthatfollowsfrom
andsupportstheargumentpresented.
theargumentpresented.
D-55
AzMERIT - 2015
EnglishLanguageArts
Grade8
AzMERITPerformanceLevelDescriptors
D-56
AzMERIT - 2015
EnglishLanguageArts
Grade8
Detailed
AzMERITPerformanceLevelDescriptors
D-57
conductsshortresearchprojectsto
answeraquestion(includingaself
generatedquestion),drawingon
severalsourcesandgenerating
additionalrelated,focusedquestions
thatallowformultipleavenuesof
explorationandevaluation;gathers
andsynthesizesrelevantinformation
frommultiplesources;assessesthe
credibilityandaccuracyofeachsource;
andjudiciouslyquotesorparaphrases
thedataandconclusionsofothers
whileavoidingplagiarismandfollowing
astandardformatforcitation.
AzMERIT - 2015
EnglishLanguageArts
Grade8
AzMERITPerformanceLevelDescriptors
D-58
AzMERIT - 2015
EnglishLanguageArts
Grade8
AzMERITPerformanceLevelDescriptors
D-59
AzMERIT - 2015
EnglishLanguageArts
Grade8
8.L.3
HighlyProficient
demonstratesstrongandpurposeful
commandoftheconventionsof
standardEnglishcapitalization,
punctuation,andspellingwhenwriting:
a.judiciouslyusespunctuation
(comma,ellipsis,dash)toindicatea
pauseorbreak.
b.usesanellipsistoindicatean
omission.
c.spellsunfamiliarandabovegrade
levelwordscorrectly.
c.spellsgradelevelwords
correctly.
demonstratesbasicknowledgeof usesknowledgeoflanguageandits
conventionswhenwriting,speaking,
languageanditsconventions
whenwriting,speaking,reading, reading,orlistening:
orlistening:
a.usesverbsintheactiveandpassive
voiceandintheconditionaland
a.inconsistentlyusesverbsin a.usesverbsintheactiveand
subjunctivemoodtoachieve
theactiveandpassivevoiceand passivevoiceandinthe
particulareffects(e.g.,emphasizing
conditionalandsubjunctive
intheconditionaland
theactororthe
moodtoachieveparticular
subjunctivemoodtoachieve
action;expressinguncertaintyor
effects(e.g.,emphasizingthe
particulareffects(e.g.,
describingastate
actororthe
emphasizingtheactororthe
action;expressinguncertainty action;expressinguncertaintyor contrarytofact).
ordescribingastatecontraryto describingastate
contrarytofact).
fact).
attemptstoapplyofthe
conventionsoflanguagewhen
writing,speaking,reading,or
listening:
AzMERITPerformanceLevelDescriptors
D-60
usescomprehensiveknowledgeof
languageanditsconventionswhen
writing,speaking,reading,orlistening:
a.strategicallyusesverbsintheactive
andpassivevoiceandintheconditional
andsubjunctivemoodtoachieve
particulareffects(e.g.,emphasizingthe
actorortheaction;expressing
uncertaintyordescribingastate
contrarytofact).
AzMERIT - 2015
EnglishLanguageArts
Grade8
Proficient
determinesorclarifiesthemeaningof
unknownand
multiplemeaningwordsorphrases,
choosingflexiblyfromarangeof
strategies:
a.usescontext(e.g.,theoverall
meaningofasentenceorparagraph;a
a.usescontext(e.g.,theoverall
meaningofasentenceorparagraph;a wordspositionorfunctionina
sentence)asacluetothemeaningofa
wordspositionorfunctionina
sentence)asacluetothemeaningof wordorphrase.
awordor
b.usescommon,gradeappropriate
phrase.
GreekorLatinaffixesandrootsasclues
b.usescommon,belowgrade b.usescommon,grade
b.usescommon,gradeappropriate tothemeaningofaword(e.g.,
precede,recede,secede).
GreekorLatinaffixesandroots appropriateGreekorLatinaffixes GreekorLatinaffixesandrootsas
ascluestothemeaningofa
androotsascluestothemeaning cluestothemeaningofaword
c.consultsgeneralandspecialized
word.
ofaword
(e.g.,precede,recede,secede).
referencematerials(e.g.,dictionaries,
(e.g.,precede,recede,secede).
glossaries,thesauruses),bothprintand
c.consultsgeneraland
c.consultsgeneralandspecialized
specializedreferencematerials c.consultsgeneraland
referencematerials(e.g.,dictionaries, digital,tofindthepronunciationofa
wordordetermineorclarifyitsprecise
(e.g.,dictionaries,glossaries,
specializedreferencematerials glossaries,thesauruses),bothprint
thesauruses),bothprintand
(e.g.,dictionaries,glossaries,
anddigital,tofindthepronunciation meaningoritspartofspeech.
digital,tofindthepronunciation thesauruses),bothprintand
ofawordordetermineorclarifyits
ofawordordetermineorclarify digital,tofindthepronunciation precisemeaningoritspartofspeech. d.verifiesthepreliminary
determinationofthemeaningofa
itsprecisemeaningoritspartof ofawordordetermineorclarify
wordorphrase(e.g.,bycheckingthe
speech.
itsprecisemeaningoritspartof d.verifiesthepreliminary
inferredmeaningincontextorina
speech.
determinationofthemeaningofa
d.verifiesthepreliminary
wordorphrase(e.g.,bycheckingthe dictionary).
determinationofthemeaningof d.verifiesthepreliminary
inferredmeaningincontextorina
awordorphrase(e.g.,by
determinationofthemeaningof dictionary).
h k
h f
d
d
h
(
b
a.usescontext(e.g.,theoverall
meaningofasentenceor
paragraph;awordspositionor
functioninasentence)asaclue
tothemeaningofawordor
phrase.
AzMERITPerformanceLevelDescriptors
a.usescontext(e.g.,theoverall
meaningofasentenceor
paragraph;awordspositionor
functioninasentence)asaclue
tothemeaningofawordor
phrase.
D-61
AzMERIT - 2015
EnglishLanguageArts
Grade8
a.interpretsfiguresofspeech
(e.g.,verbalirony,puns)in
context.
a.interpretsfiguresofspeech(e.g.,
verbalirony,puns)incontext.
b.usestherelationshipbetween
particularwordsto
b.usestherelationshipbetween
betterunderstandeachofthewords.
b.usestherelationshipbetween b.usestherelationshipbetween particularwordsto
betterunderstandeachofthewords.
particularbasicwordstobetter particularwordstobetter
c.distinguishesandevaluatesthe
understandeachofthewords. understandeachofthewords.
connotations(associations)ofwords
c.distinguishesamongthe
connotations(associations)ofwords withsimilardenotations(definitions)
c.generallydistinguishesamong c.distinguishesamongthe
withsimilardenotations(definitions) (e.g.,bullheaded,willful,firm,
theconnotations(associations) connotations(associations)of
persistent,resolute).
wordswithsimilardenotations (e.g.,bullheaded,willful,firm,
ofwordswithsimilar
persistent,resolute).
denotations(definitions)(e.g., (definitions)(e.g.,bullheaded,
willful,firm,persistent,resolute).
bullheaded,willful,firm,
persistent,resolute).
AzMERITPerformanceLevelDescriptors
D-62
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Detailed
Standard
EnglishLanguageArts
Grades910
Proficient
PartiallyProficient
Forgradeappropriate,lowto
Forgradeappropriate,moderateto
moderatecomplexitytexts,the
highcomplexitytexts,theProficient
PartiallyProficientstudent
student
Reading:Literature
citesstrongandthoroughtextual
9
citestextualevidencetosupport citestextualevidencetosupport
evidencetosupportanalysisofwhat
analysisofwhatthetextsays
10.RL.1 analysisofwhatthetextsays
explicitlyaswellasinferencesdrawn thetextsaysexplicitlyaswellas
explicitly.
inferencesdrawnfromthetext.
fromthetext.
MinimallyProficient
Forgradeappropriate,low
complexitytexts,theMinimally
Proficientstudent
Detailed
9
identifiesathemeorcentralidea determinesathemeorcentralidea
ofatextanddescribesindetailits
10.RL.2 ofatextanddescribesits
developmentoverthecourseofa developmentoverthecourseofa
text;providesarestatementof text;providesabasicsummaryof
thetext.
thetext.
Detailed
9
identifieshowcharacters
10.RL.3 develop,interactwithother
characters,andadvancetheplot
ordevelopthetheme.
AzMERITPerformanceLevelDescriptors
describeshowcharactersdevelop
overthecourseofthetext,interact
withothercharacters,andadvance
theplotordevelopthetheme.
D-63
determinesathemeorcentralidea
ofatextandanalyzesindetailits
developmentoverthecourseofa
text,includinghowitemergesandis
shapedandrefinedbyspecific
details;providesanobjective
summaryofthetext.
HighlyProficient
Forgradeappropriate,high
complexitytexts,theHighly
Proficientstudent
citesstrongandthoroughtextual
evidencetosupportadeepanalysis
ofwhatthetextsaysexplicitlyaswell
ascomplexinferencesdrawnfrom
thetext.
determinesandevaluatesathemeor
centralideaofatextandanalyzesin
detailitsdevelopmentoverthe
courseofatext,includinghowit
emergesandisshapedandrefinedby
specificdetails;providesa
comprehensive,objectivesummary
ofthetext.
analyzestheeffectivenessofthe
analyzeshowcomplexcharacters
author'sdevelopmentofcomplex
(e.g.,thosewithmultipleor
conflictingmotivations)developover characters(e.g.,thosewithmultiple
thecourseofthetext,interactwith orconflictingmotivations)overthe
othercharacters,andadvancethe courseofthetext,includinghowthey
interacttoadvancetheplotorshape
plotordevelopthetheme.
thetheme.
AzMERIT - 2015
EnglishLanguageArts
Grades910
Proficient
determinesthemeaningofwords
andphrasesastheyareusedinthe
text,includingfigurativeand
connotativemeanings;analyzesthe
cumulativeimpactofspecificword
choicesonmeaningandtone(e.g.,
howthelanguageevokesasenseof
timeandplace;howitsetsaformal
orinformaltone).
HighlyProficient
determinesthemeaningofcomplex
wordsandphrasesastheyareused
inthetext,includingfigurativeand
connotativemeanings;analyzesand
evaluatesthecumulativeimpactof
specificwordchoicesonmeaningand
tone(e.g.,howthelanguageevokesa
senseoftimeandplace;howitsetsa
formalorinformaltone).
Detailed
9
identifiesanauthorschoices
10.RL.5 concerninghowtostructurea
text,ordereventswithinit(e.g.,
parallelplots),andmanipulate
time(e.g.,pacing,flashbacks).
describesanauthorschoices
concerninghowtostructureatext,
ordereventswithinit(e.g.,parallel
plots),andmanipulatetime(e.g.,
pacing,flashbacks).
analyzeshowanauthorschoices
concerninghowtostructureatext,
ordereventswithinit(e.g.,parallel
plots),andmanipulatetime(e.g.,
pacing,flashbacks)createsuch
effectsasmystery,tension,or
surprise.
analyzeshowanauthorschoices
concerninghowtostructureatext,
ordereventswithinit(e.g.,parallel
plots),andmanipulatetime(e.g.,
pacing,flashbacks)createsuch
effectsasmystery,tension,or
surprise,andevaluatestheirimpact
onthetextasawhole.
Detailed
9
identfiesaparticularpointof
10.RL.6 vieworculturalexperience
reflectedinaworkofliterature
fromoutsidetheUnitedStates.
describesaparticularpointofview
orculturalexperiencereflectedina
workofliteraturefromoutsidethe
UnitedStates,drawingongeneral
knowledgeofworldliterature.
analyzesaparticularpointofviewor
culturalexperiencereflectedina
workofliteraturefromoutsidethe
UnitedStates,drawingonawide
readingofworldliterature.
analyzescompetingpointsofviewor
culturalexperiencesreflectedina
workofliteraturefromoutsidethe
UnitedStates,drawingonadeep
understandingofworldliterary
traditions.
Detailed
9
identifiesthedifferencesina
10.RL.7 depictionofasubjectorakey
sceneintwodifferentartistic
media(e.g.,AudensMusedes
BeauxArtsandBreughels
LandscapewiththeFallofIcarus).
comparesandcontraststhe
analyzestheeffectofthe
analyzestherepresentationofa
differencesinadepictionofa
representationofasubjectorakey
subjectorakeysceneintwo
subjectorakeysceneintwo
sceneintwodifferentartisticmedia,
differentartisticmedia,including
differentartisticmedia,including
whatisemphasizedorabsentineach includingwhatisemphasizedor
whatisemphasizedorabsentin
treatment(e.g.,AudensMusedes absentineachtreatment(e.g.,
eachtreatment(e.g.,Audens
AudensMusedesBeauxArtsand
BeauxArtsandBreughels
MusedesBeauxArtsand
BreughelsLandscapewiththeFallof
LandscapewiththeFallofIcarus).
BreughelsLandscapewiththeFallof
Icarus).
Icarus)
AzMERITPerformanceLevelDescriptors
D-64
AzMERIT - 2015
EnglishLanguageArts
Grades910
AzMERITPerformanceLevelDescriptors
D-65
Proficient
HighlyProficient
analyzestheeffectivenessofhowan
analyzeshowanauthordrawson
andtransformssourcematerialina authordrawsonandtransforms
specificwork(e.g.,howShakespeare sourcematerialinaspecificwork
treatsathemeortopicfromOvidor (e.g.,howShakespearetreatsa
theBibleorhowalaterauthordraws themeortopicfromOvidortheBible
orhowalaterauthordrawsonaplay
onaplaybyShakespeare).
byShakespeare)inademonstration
ofdeeperunderstandingofthetext.
AzMERIT - 2015
EnglishLanguageArts
Grades910
9
identifiesacentralideaofatext determinesacentralideaofatext
10.RI.2 anddescribesitsdevelopment; anddescribesitsdevelopmentover
thecourseofatext;providesa
providesarestatementofthe
summaryofthetext.
text.
Detailed
9
identifieshowtheauthorunfolds describeshowtheauthorunfoldsan analyzeshowtheauthorunfoldsan
analysisorseriesofideasorevents,
10.RI.3 ananalysisorseriesofideasor analysisoraseriesofideasor
events,includingtheorderinwhich includingtheorderinwhichthe
events,includingtheorderin
whichthepointsaremadeand thepointsaremade,howtheyare pointsaremade,howtheyare
introducedanddeveloped,andthe introducedanddeveloped,andthe
howtheyareintroducedand
connectionsthataredrawnbetween connectionsthataredrawnbetween
developed.
them.
them.
Detailed
withtextualsupport(e.g.,context
9
withtextualsupport(e.g.,
clues,embeddeddefinition,etc.),
10.RI.4 contextclues,embedded
definition,etc.),determinesthe determinesthemeaningofwords
meaningofwordsandphrasesas andphrasesastheyareusedina
theyareusedinatext;identifies text,includingfigurative,
connotative,andtechnical
theimpactofspecificword
meanings;describesthecumulative
choicesonmeaningandtone
(e.g.,howthelanguageofacourt impactofspecificwordchoiceson
meaningandtone(e.g.,howthe
opiniondiffersfromthatofa
languageofacourtopiniondiffers
newspaper).
fromthatofanewspaper).
AzMERITPerformanceLevelDescriptors
D-66
determinesacentralideaofatext
andanalyzesitsdevelopmentover
thecourseofthetext,includinghow
itemergesandisshapedandrefined
byspecificdetails;providesan
objectivesummaryofthetext.
HighlyProficient
citesstrongandthoroughtextual
evidencetosupportadeepanalysis
ofwhatthetextsaysexplicitlyaswell
ascomplexinferencesdrawnfrom
thetext.
determinesandevaluatesacentral
ideaofatextandanalyzesindetail
itsdevelopmentoverthecourseofa
text,includinghowitemergesandis
shapedandrefinedbyspecific
details;providesacomprehensive,
objectivesummaryofthetext.
evaluatestheeffectofhowthe
authorunfoldsananalysisorseriesof
ideasorevents,includingtheorderin
whichthepointsaremade,howthey
areintroducedanddeveloped,and
theconnectionsthataredrawn
betweenthem.
analyzesthemeaningofwordsand
determinesthemeaningofwords
phrasesastheyareusedinatext,
andphrasesastheyareusedina
includingfigurative,connotative,and
text,includingfigurative,
connotative,andtechnicalmeanings; technicalmeanings;evaluatesthe
cumulativerhetoricaleffectof
analyzesthecumulativeimpactof
specificwordchoicesonmeaningand
specificwordchoicesonmeaning
andtone(e.g.,howthelanguageofa tone(e.g.,howthelanguageofa
courtopiniondiffersfromthatofa courtopiniondiffersfromthatofa
newspaper).
newspaper).
AzMERIT - 2015
EnglishLanguageArts
Grades910
Proficient
analyzesindetailhowanauthors
ideasorclaimsaredevelopedand
refinedbyparticularsentences,
paragraphs,orlargerportionsofa
text(e.g.,asectionorchapter).
HighlyProficient
evaluateshowanauthordevelopshis
orherideasorclaimsandrefines
themwithparticularsentences,
paragraphs,orlargerportionsofa
text(e.g.,asectionorchapter).
Detailed
9
identifiesanauthorspointof
10.RI.6 vieworpurposeinatext;
identifiestheauthor'suseof
rhetorictoadvancethatpointof
vieworpurpose.
identifiesanauthorspointofview
orpurposeinatextanddescribes
howanauthorusesrhetoricto
advancethatpointofviewor
purpose.
determinesanauthorspointofview
orpurposeinatextandanalyzes
howanauthorusesrhetoricto
advancethatpointofviewor
purpose.
analyzesanauthorspointofviewor
purposeinatextandevaluatesthe
effectivenessofanauthor'suseof
rhetorictoadvancethatpointofview
orpurpose.
Detailed
9
describesvariousaccountsofa
10.RI.7 subjecttoldindifferentmedia
(e.g.,apersonslifestoryinboth
printandmultimedia).
comparesandcontrastsvarious
accountsofasubjecttoldin
differentmedia(e.g.,apersonslife
storyinbothprintandmultimedia),
identifyingwhichdetailsare
emphasizedineachaccount.
analyzesvariousaccountsofa
subjecttoldindifferentmedia(e.g.,
apersonslifestoryinbothprintand
multimedia),determiningwhich
detailsareemphasizedineach
account.
analyzesvariousaccountsofa
subjecttoldindifferentmedia(e.g.,a
personslifestoryinbothprintand
multimedia),evaluatingtheeffectof
theemphasisofdifferentdetailsin
eachaccount.
Detailed
9
delineatesandevaluatesthe
10.RI.8 argumentandclaimsinatext,
describingthereasoningand
evidenceusedtosupportthe
claim.
delineatesandevaluatesthe
delineatesandevaluatesthe
argumentandspecificclaimsina
argumentandspecificclaimsina
text,assessingwhetherthe
text,assessingwhetherthe
reasoningisvalidandtheevidenceis reasoningisvalidandtheevidenceis
relevantandsufficient;identifies
relevantandsufficient.
falsestatementsandfallacious
reasoning.
explicatesandevaluatesthe
argumentandspecificclaimsina
text,citingspecificlanguagefromthe
textinanassessmentofwhetherthe
reasoningisvalidandtheevidenceis
relevantandsufficient;identifies
subtleinstancesoffalsestatements
andfallaciousreasoning.
Detailed
9
describesspecificaspectsof
10.RI.9 seminalU.S.documentsof
historicalandliterarysignificance
(e.g.,WashingtonsFarewell
Address,theGettysburgAddress,
RooseveltsFourFreedoms
speech,KingsLetterfrom
BirminghamJail).
AzMERITPerformanceLevelDescriptors
D-67
AzMERIT - 2015
EnglishLanguageArts
Grades910
AzMERITPerformanceLevelDescriptors
D-68
AzMERIT - 2015
EnglishLanguageArts
Grades910
AzMERITPerformanceLevelDescriptors
D-69
Proficient
createcohesion,andclarifythe
relationshipsbetweenclaim(s)and
reasons,betweenreasonsand
evidence,andbetweenclaim(s)and
counterclaims.
HighlyProficient
c.usesprecisewords,phrases,and
clausestolinkthemajorsectionsof
thetext,createcohesion,andclarify
therelationshipsbetweenclaim(s)
andreasons,betweenreasonsand
evidence,andbetweenclaim(s)and
d.establishesandmaintainsaformal counterclaims.
styleandobjectivetonewhile
d.establishesandmaintainsa
attendingtothenormsand
rhetoricallyappropriateformalstyle
conventionsofthedisciplinein
andobjectivetonewhileattendingto
whichheorsheiswriting.
thenormsandconventionsofthe
e.providesaconcludingstatement disciplineinwhichheorsheis
writing.
orsectionthatfollowsfromand
supportstheargumentpresented.
e.providesaneffectiveconcluding
statementorsectionthatfollows
fromandsupportstheargument
presented.
AzMERIT - 2015
EnglishLanguageArts
Grades910
AzMERITPerformanceLevelDescriptors
D-70
AzMERIT - 2015
EnglishLanguageArts
Grades910
AzMERITPerformanceLevelDescriptors
D-71
AzMERIT - 2015
EnglishLanguageArts
Grades910
Detailed
9
conductsshortresearchprojects conductsshortaswellasmore
sustainedresearchprojectsto
10.W.7 toansweragivensimple
questionorsolveagivensimple answerasimplequestion(including
aselfgeneratedquestion)orsolvea
problem;usesdiscrete
informationfromsourcesonthe simpleproblem;narrowsor
broadenstheinquirywhen
subject,demonstratinga
developingunderstandingofthe appropriate;synthesizessourceson
thesubject,demonstrating
subjectunderinvestigation.
understandingofthesubjectunder
investigation.
AzMERITPerformanceLevelDescriptors
D-72
Proficient
producesclearandcoherentwriting
inwhichthedevelopment,
organization,andstyleare
appropriatetotask,purpose,and
audience;developsandstrengthens
writingasneededbyplanning,
revising,editing,rewriting,ortrying
anewapproach,focusingon
addressingwhatismostsignificant
foraspecificpurposeandaudience;
usestechnology,includingthe
Internet,toproduce,publish,and
updateindividualorsharedwriting
products,takingadvantageof
technology'scapacitytolinktoother
informationandtodisplay
informationflexiblyanddynamically.
HighlyProficient
producesclearandcoherentwriting
inwhichthedevelopment,
organization,andstylearehighly
effectiveforthetask,purpose,and
audience;developsandstrengthens
writingbyplanning,revising,editing,
rewriting,ortryinganewapproach,
focusingonaddressingwhatismost
significantforaspecificpurposeand
audience;usestechnology,including
theInternet,toproduce,publish,and
updateindividualorsharedwriting
products,takingadvantageof
technology'scapacitytolinktoother
informationandtodisplay
informationflexiblyanddynamically.
conductsshortaswellasmore
sustainedresearchprojectsto
answeraquestion(includingaself
generatedquestion)orsolvea
problem;narrowsorbroadensthe
inquirywhenappropriate;
synthesizesmultiplesourcesonthe
subject,demonstrating
understandingofthesubjectunder
investigation.
conductsshortaswellasmore
sustainedresearchprojectstoanswer
acomplexquestion(includingaself
generatedquestion)orsolvea
complexproblem;narrowsor
broadenstheinquirywhen
appropriate;synthesizesmultiple
highqualitysourcesonthesubject,
demonstratingcomplete
understandingofthesubjectunder
investigation.
AzMERIT - 2015
EnglishLanguageArts
Grades910
AzMERITPerformanceLevelDescriptors
D-73
Proficient
gathersrelevantinformationfrom
multipleauthoritativeprintand
digitalsources,usingadvanced
searcheseffectively;assessesthe
usefulnessofeachsourcein
answeringtheresearchquestion;
integratesinformationintothetext
selectivelytomaintaintheflowof
ideas,avoidingplagiarismand
followingastandardformatfor
citation.
AzMERIT - 2015
EnglishLanguageArts
Grades910
HighlyProficient
effectivelyintegratesmultiple
sourcesofinformationpresentedin
diversemediaorformats(e.g.,
visually,quantitatively,orally)to
meettheneedsofaspecifictask,
audience,andpurpose,while
evaluatingthecredibilityand
accuracyofeachsource.
Detailed
9
summarizesaspeakerspointof evaluatesaspeaker'spointofview, evaluatesaspeaker'spointofview, thoroughlyevaluatesaspeaker's
reasoning,anduseofevidenceand pointofview,reasoning,anduseof
reasoning,anduseofevidence,
10.SL.3 view,reasoning,anduseof
evidenceandrhetoric,analyzingany
identifyinganyfallaciousreasoning. rhetoric,identifyinganyfallacious
evidence.
fallaciousreasoningorexaggerated
reasoningorexaggeratedor
ordistortedevidence.
distortedevidence.
Detailed
9
10.L.1
Language
demonstratesstrongcommandof
demonstratesbasicunderstandingof demonstratescommandofthe
attemptstomeetthe
theconventionsofstandardEnglish
conventionsofstandardEnglish theconventionsofstandardEnglish conventionsofstandardEnglish
grammarandusagewhenwriting grammarandusagewhenwritingor grammarandusagewhenwritingor grammarandusagewhenwritingor
speaking.
speaking.
orspeaking:usesvarioustypes speaking.
ofphrases(noun,verb,adjectival,
a.usesparallelstructure.
a.usesparallelstructure.
a.usesparallelstructure.
adverbial,participial,
prepositional,absolute)and
b.usesvarioustypesofphrases
b.usesvarioustypesofphrases
b.usesvarioustypesofphrases
clauses(independent,
(noun,verb,adjectival,adverbial,
(noun,verb,adjectival,adverbial,
(noun,verb,adjectival,adverbial,
dependent,noun,relative,
participial,prepositional,absolute) participial,prepositional,absolute) participial,prepositional,absolute)
adverbial)toaddinterestto
andclauses(independent,
andclauses(independent,
andclauses(independent,
writingorpresentations.
dependent,noun,relative,adverbial) dependent,noun,relative,adverbial) dependent,noun,relative,adverbial)
toconveymeaningsandaddinterest toconveyspecificmeaningsandadd toconveyspecificmeaningsandadd
variety,craft,style,depthof
varietyandinteresttowritingor
towritingorpresentations.
meaning,andinteresttowritingor
presentations.
presentations.
AzMERITPerformanceLevelDescriptors
D-74
AzMERIT - 2015
EnglishLanguageArts
Grades910
9
10.L.3
usesknowledgeoflanguagefor
comprehensionwhenreadingor
listeningandmakeschoicesfor
meaningorstyle.
AzMERITPerformanceLevelDescriptors
usesknowledgeoflanguagefor
comprehensionwhenreadingor
listeningandmakeschoicesfor
meaningorstyle;writesandedits
worktoconformtoaformalor
informalstyle.
D-75
a.usesasemicolontolinktwoor
morecloselyrelatedindependent
clauses.
HighlyProficient
demonstratesstrongcommandof
theconventionsofstandardEnglish
capitalization,punctuation,and
spellingwhenwriting,usingthat
commandtoenhancestyleand
meaning.
a.usesasemicolontolinktwoor
morecloselyrelatedindependent
b.usesacolontointroducealistor clauses.
quotation.
b.usesacolontointroducealistor
quotation.
c.spellscorrectly.
appliesknowledgeoflanguageto
understandhowlanguagefunctions
indifferentcontexts,tomake
effectivechoicesformeaningor
style,andtocomprehendmorefully
whenreadingorlistening.Writes
andeditsworksothatitconformsto
theguidelinesinastylemanual(e.g.,
MLAHandbook,Turabian'sManual
forWriters)appropriateforthe
disciplineandwritingtype.
appliesknowledgeoflanguageto
demonstratehowlanguagefunctions
indifferentcontexts,tomakehighly
effectivechoicesformeaningorstyle,
andtofullycomprehendwhen
readingorlistening;writesandedits
worksothatitconformstothe
guidelinesinastylemanual(e.g.,
MLAHandbook,Turabian'sManual
forWriters)appropriateforthe
disciplineandwritingtype.
AzMERIT - 2015
EnglishLanguageArts
Grades910
9
10.L.5
recognizesfigurativelanguage
andwordrelationshipsby
identifyingfiguresofspeechand
nuancesinwordmeanings.
AzMERITPerformanceLevelDescriptors
demonstratesunderstandingof
straightforwardfigurativelanguage,
clearwordrelationships,and
nuancesinwordmeaningsby
identifyingandattemptingto
interpretfiguresofspeechintexts
andrecognizingnuancesinthe
meaningofwords.
D-76
demonstratesunderstandingof
figurativelanguage,word
relationships,andnuancesinword
meanings.
demonstratesunderstandingof
compexfigurativelanguage,complex
wordrelationships,andsubtle
nuancesinwordmeanings.
a.interpretsfiguresofspeechin
contextandanalyzestheirrolein
texts.
a.interpretsandusesfiguresof
speechincontextandanalyzestheir
roleintexts.
b.analyzesnuancesinthemeaning
ofwordswithsimilardenotations.
b.analyzesandusesnuancesinthe
meaningofwordswithsimilar
denotations.
AzMERIT - 2015
EnglishLanguageArts
Grade11
determinestwoormorethemesor determinestwoormoresubtle
centralideasofatextandanalyzes themesorcentralideasofatext;
theirdevelopmentoverthecourseof analyzesandevaluatestheir
thetext,includinghowtheyinteract developmentoverthecourseofthe
andbuildononeanothertoproduce text,includinghowtheyinteractand
buildononeanothertoproducea
acomplexaccount;providesan
complexaccount;providesa
objectivesummaryofthetext.
comprehensiveobjectivesummaryof
thetext.
Detailed
analyzestheimpactoftheauthor's
11.RL.3 describestheauthor'schoices
choicesregardinghowtodevelop
regardinghowtodevelopand
relatebasicelementsofastoryor andrelatebasicelementsofastory
drama(e.g.,setting,characters, ordrama(e.g.,setting,characters,
plot).
plot).
analyzestheimpactoftheauthor's analyzesandevaluatestheimpactof
theauthor'schoicesregardinghowto
choicesregardinghowtodevelop
developandrelateelementsofa
andrelateelementsofastoryor
drama(e.g.,whereastoryisset,how storyordrama(e.g.,whereastoryis
set,howtheactionisordered,how
theactionisordered,howthe
thecharactersareintroducedand
charactersareintroducedand
developed).
developed).
AzMERITPerformanceLevelDescriptors
D-77
AzMERIT - 2015
EnglishLanguageArts
Grade11
analyzeshowanauthorschoices
describesanauthorschoices
11.RL.5 identifiesanauthorschoices
concerninghowtostructurespecific concerninghowtostructurespecific
concerninghowtostructure
partsofatext(e.g.,thechoiceof
specificpartsofatext(e.g.,the partsofatext(e.g.,thechoiceof
choiceofwheretobeginorenda wheretobeginorendastory,the wheretobeginorendastory,the
choicetoprovideacomedicortragic choicetoprovideacomedicortragic
story,thechoicetoprovidea
resolution)contributetoitsoverall
resolution).
comedicortragicresolution).
structureandmeaningaswellasits
aestheticimpact.
analyzesandevaluatesthe
effectivenessofanauthorschoices
concerninghowtostructurespecific
partsofatext(e.g.,thechoiceof
wheretobeginorendastory,the
choicetoprovideacomedicortragic
resolution),includinghowthey
contributetoitsoverallstructureand
meaningaswellasitsaesthetic
impact.
Detailed
11.RL.6 identifiesaclearcaseinwhich
graspingpointofviewrequires
distinguishingwhatisdirectly
statedinatextfromwhatis
reallymeant(e.g.,satire,
sarcasm,irony,or
understatement).
analyzesacaseinwhichgrasping
pointofviewrequiresdistinguishing
whatisdirectlystatedinatextfrom
whatisreallymeant(e.g.,satire,
sarcasm,irony,orunderstatement).
analyzesacaseinwhichgrasping
pointofviewrequiresdistinguishing
whatisdirectlystatedinatextfrom
whatisreallymeant(e.g.,satire,
sarcasm,irony,orunderstatement),
andevaluatesitsrhetoricaleffectand
aestheticimpact.
AzMERITPerformanceLevelDescriptors
identifiesasubtlecaseinwhich
graspingpointofviewrequires
distinguishingwhatisdirectlystated
inatextfromwhatisreallymeant
(e.g.,satire,sarcasm,irony,or
understatement).
D-78
AzMERIT - 2015
EnglishLanguageArts
Grade11
AzMERITPerformanceLevelDescriptors
D-79
Proficient
HighlyProficient
analyzesmultipleinterpretationsofa analyzesmultiple,subtlydifferent
interpretationsofastory,drama,or
story,drama,orpoem(e.g.,
recordedorliveproductionofaplay poem(e.g.,recordedorlive
productionofaplayorrecorded
orrecordednovelorpoetry),
novelorpoetry),evaluatingeach
evaluatinghoweachversion
version'sinterpretationofthesource
interpretsthesourcetext.
textandhowthatinterpretation
affectstheoverallmeaning.
demonstratesknowledgeof
eighteenth,nineteenthandearly
twentiethcenturyfoundational
worksofAmericanliterature,
includinghowtwoormoretexts
fromthesameperiodtreatsimilar
themesortopics.
demonstratesthoroughknowledgeof
eighteenth,nineteenthandearly
twentiethcenturyfoundational
worksofAmericanliterature,
analyzingandevaluatinghowtwoor
moretextsfromthesameperiodin
ananalysisoftheirtreatmentof
similarthemesortopics.
AzMERIT - 2015
EnglishLanguageArts
Grade11
Detailed
11.RI.3 describesasetofideasor
sequenceofeventsandidentifies
howspecificindividuals,ideas,or
eventsinteractanddevelopin
specificsectionsofthetext.
analyzesasetofideasorsequence
ofeventsandidentifieshowspecific
individuals,ideas,oreventsinteract
anddevelopinspecificsectionsof
thetext.
evaluatestheeffectofthe
analyzesacomplexsetofideasor
sequenceofeventsandexplainshow presentationofacomplexsetof
specificindividuals,ideas,orevents ideasorsequenceofeventsand
interactanddevelopoverthecourse explainshowspecificindividuals,
ideas,oreventsinteractanddevelop
ofthetext.
overthecourseofthetext.
Detailed
11.RI.4 withtextualsupport(e.g.,
contextclues,embedded
definitions),determinesthe
meaningofwordsandphrasesas
theyareusedinatext;identifies
howanauthorusesandrefines
themeaningofakeytermor
termsoverthecourseofatext
(e.g.,howMadisondefines
factioninFederalist No.10).
withtextualsupport(e.g.,context
clues,embeddeddefinitions),
determinesthemeaningofwords
andphrasesastheyareusedina
text,includingfigurative,
connotative,andtechnical
meanings;describeshowanauthor
usesandrefinesthemeaningofa
keytermortermsoverthecourseof
atext(e.g.,howMadisondefines
factioninFederalist No.10).
analyzesthemeaningofwordsand
determinesthemeaningofwords
phrasesastheyareusedinatext,
andphrasesastheyareusedina
includingfigurative,connotative,and
text,includingfigurative,
connotative,andtechnicalmeanings; technicalmeanings;evaluatesthe
rhetoricaleffectofhowanauthor
analyzeshowanauthorusesand
refinesthemeaningofakeytermor usesandrefinesthemeaningofakey
termsoverthecourseofatext(e.g., termortermsoverthecourseofa
text(e.g.,howMadisondefines
howMadisondefinesfactionin
factioninFederalist No.10).
Federalist No.10).
AzMERITPerformanceLevelDescriptors
D-80
determinestwoormorecentral
ideasofatextandanalyzestheir
developmentoverthecourseofthe
text,includinghowtheyinteractand
buildononeanothertoprovidea
complexanalysis;providesan
objectivesummaryofthetext.
determinestwoormoresubtle
centralideasofatext;analyzesand
evaluatestheirdevelopmentoverthe
courseofthetext,includinghowthey
interactandbuildononeanotherto
produceacomplexanalysis;provides
acomprehensive,objectivesummary
ofthetext.
AzMERIT - 2015
EnglishLanguageArts
Grade11
Detailed
identifiesanauthor'spointofview
11.RI.6 identifiesanauthor'spointof
vieworpurposeinatextinwhich orpurposeinatextinwhichthe
rhetoricisparticularlyeffective,
therhetoricisparticularly
describinghowstyleandcontent
effective;identifiesthe
contributetothepower,
contributionofthetext'sstyle
persuasiveness,orbeautyofthe
andcontent.
text.
Detailed
11.RI.7 usesinformationpresentedin
differentmediaorformats(e.g.,
visually,quantitatively)aswellas
inwordsinordertoaddressa
questionorsolveaproblem.
AzMERITPerformanceLevelDescriptors
integratesmultiplesourcesof
informationpresentedindifferent
mediaorformats(e.g.,visually,
quantitatively)aswellasinwordsin
ordertoaddressaquestionorsolve
aproblem.
D-81
Proficient
analyzesandevaluatesthe
effectivenessofthestructurean
authorusesinhisorherexposition
orargument,includingwhetherthe
structuremakespointsclear,
convincing,andengaging.
HighlyProficient
analyzesandevaluatesthe
effectivenessofboththestructurean
authorusesinhisorherexpositionor
argumentandalternatestructures,
includingwhetherthestructure
makespointsclear,convincing,and
engaging.
determinesanauthor'spointofview
orpurposeinatextinwhichthe
rhetoricisparticularlyeffective,
analyzinghowstyleandcontent
contributetothepower,
persuasiveness,orbeautyofthetext.
analyzesanauthor'spointofviewor
purposeinatextinwhichthe
rhetoricisparticularlyeffective;
evaluatestheeffectivenessofthe
author'sstyleandcontent,including
theircontributiontothepower,
persuasiveness,orbeautyofthetext.
integratesandevaluatesmultiple
sourcesofinformationpresentedin
differentmediaorformats(e.g.,
visually,quantitatively)aswellasin
wordsinordertoaddressaquestion
orsolveaproblem.
synthesizes,integrates,andevaluates
multiplesourcesofinformation
presentedindifferentmediaor
formats(e.g.,visually,quantitatively)
aswellasinwordsinorderto
addressaquestionorsolvea
problem;evaluatestheeffectofthe
proposedanswerorsolution.
AzMERIT - 2015
EnglishLanguageArts
Grade11
AzMERITPerformanceLevelDescriptors
D-82
analyzesseventeenth,eighteenth, referstospecifictextualevidencein
andnineteenthcenturyfoundational ananalysisofseventeenth,
eighteenth,andnineteenthcentury
U.S.documentsofhistoricaland
foundationalU.S.documentsof
literarysignificance(includingthe
historicalandliterarysignificance
DeclarationofIndependence,the
PreambletotheConstitution,theBill (includingtheDeclarationof
Independence,thePreambletothe
ofRights,andLincolnsSecond
InauguralAddress)fortheirthemes, Constitution,theBillofRights,and
LincolnsSecondInauguralAddress),
purposes,andrhetoricalfeatures.
evaluatingtheimplicationsoftheir
themes,purposes,andrhetorical
features.
AzMERIT - 2015
EnglishLanguageArts
Grade11
AzMERITPerformanceLevelDescriptors
D-83
AzMERIT - 2015
EnglishLanguageArts
Grade11
Proficient
tolinkthemajorsectionsofthetext,
createcohesion,andclarifythe
relationshipsbetweenclaim(s)and
reasons,betweenreasonsand
evidence,andbetweenclaim(s)and
counterclaims.
HighlyProficient
c.usesprecisewords,phrases,and
clausestolinkthemajorsectionsof
thetext,createcohesion,andclarify
therelationshipsbetweenclaim(s)
andreasons,betweenreasonsand
evidence,andbetweenclaim(s)and
d.establishesandmaintainsaformal counterclaims.
styleandobjectivetonewhile
d.establishesandmaintainsa
attendingtothenormsand
rhetoricallyappropriateformalstyle
conventionsofthedisciplinein
andobjectivetonewhileattendingto
whichheorsheiswriting.
thenormsandconventionsofthe
e.providesaconcludingstatement disciplineinwhichheorsheis
writing.
orsectionthatfollowsfromand
supportstheargumentpresented.
e.providesaneffectiveconcluding
statementorsectionthatfollows
fromandsupportstheargument
presented.
f.evaluatesandreflectsonthe
writingandhowwellitaddressesthe
purpose,audience,andtask.
AzMERITPerformanceLevelDescriptors
D-84
AzMERIT - 2015
EnglishLanguageArts
Grade11
HighlyProficient
writeshighlyeffective
informative/explanatorytextsto
examineandconveycomplexideas,
concepts,andinformationclearlyand
accuratelythroughtheeffective
selection,organization,andanalysis
ofcontent.
a.introducesatopic;organizes
a.introducesatopic;organizes
a.clearlyintroducesatopic;
ideas,concepts,andinformationto complexideas,concepts,and
strategicallyorganizescomplexideas,
makeconnectionsanddistinctions; informationsothateachnew
concepts,andinformationtomake
includesformatting(e.g.,headings), elementbuildsonthatwhich
graphics(e.g.,figures,tables),and precedesittocreateaunifiedwhole; importantconnectionsand
includesformatting(e.g.,headings) distinctions;includesimportant
b.developsthetopicbyselecting multimediainanattempttoaid
formatting(e.g.,headings)and
comprehension.
andgraphics(e.g.,figures,tables)
relevantfacts,extended
graphics(e.g.,figures,tables)when
whenusefultoaiding
definitions,concretedetails,
usefultoaidingcomprehension.
comprehension.
quotations,orotherinformation b.developsthetopicbyselecting
significantandrelevantfacts,
andexamples.
extendeddefinitions,concrete
b.developsthetopicthoroughlyby b.developsthetopicstrategicallyby
selectingthemostsignificantand
selectingthemostsignificantand
c.usesappropriatetransitionsto details,quotations,orother
informationandexamples
linkthemajorsectionsofthe
relevantfacts,extendeddefinitions, relevantfacts,extendeddefinitions,
text,createcohesion,andclarify appropriatetotheaudience.
concretedetails,quotations,orother concretedetails,quotations,orother
informationandexamples
therelationshipsamongcomplex
informationandexamples
appropriateandrelevanttothe
ideasandconcepts.
c.usesappropriatetransitionstolink appropriatetotheaudience's
audience'sknowledgeofthetopic.
themajorsectionsofthetext,create knowledgeofthetopic.
cohesion,andclarifythe
d.usestopicappropriate
c.consistentlyandeffectivelyuses
relationshipsamongcomplexideas c.usesappropriateandvaried
language,vocabulary,and
andconcepts.
techniquessuchasmetaphor,
transitionstolinkthemajorsections appropriateandvariedtransitionsto
linkthemajorsectionsofthetext,
simile,andanalogytodescribe
ofthetext,createcohesion,and
createscohesion,andclarifiesthe
thetopic.
d.usestopicappropriatelanguage, clarifytherelationshipsamong
relationshipsamongcomplexideas
domainspecificvocabulary,and
complexideasandconcepts.
f
l l
d
h i
h
h
i il
d
AzMERITPerformanceLevelDescriptors
D-85
AzMERIT - 2015
EnglishLanguageArts
Grade11
AzMERITPerformanceLevelDescriptors
D-86
AzMERIT - 2015
EnglishLanguageArts
Grade11
Detailed
11.W.7 conductsshortresearchprojects
toansweragivensimple
questionorsolveagivensimple
problem;usesdiscrete
informationfromsourcesonthe
subject,demonstratinga
developingunderstandingofthe
subjectunderinvestigation.
AzMERITPerformanceLevelDescriptors
conductsshortaswellasmore
sustainedresearchprojectsto
answerasimplequestion(including
aselfgeneratedquestion)orsolvea
simpleproblem;narrowsor
broadenstheinquirywhen
appropriate;synthesizessourceson
thesubject,demonstratingan
understandingofthesubjectunder
investigation.
D-87
Proficient
producesclearandcoherentwriting
inwhichthedevelopment,
organization,andstyleare
appropriatetotask,purpose,and
audience.Developsandstrengthens
writingasneededbyplanning,
revising,editing,rewriting,ortrying
anewapproach,focusingon
addressingwhatismostsignificant
foraspecificpurposeandaudience.
Usestechnology,includingthe
Internet,toproduce,publish,and
updateindividualorsharedwriting
productsinresponsetoongoing
feedback,includingnewarguments
orinformation.
HighlyProficient
producesclearandcoherentwriting
inwhichthedevelopment,
organization,andstylearehighly
effectiveforthetask,purpose,and
audience.Developsandstrengthens
writingbyplanning,revising,editing,
rewriting,ortryinganewapproach,
focusingonaddressingwhatismost
significantforaspecificpurposeand
audience.Usestechnology,including
theInternet,toproduce,publish,and
effectivelyupdateindividualor
sharedwritingproductsinresponse
toongoingfeedback,includingnew
argumentsorinformation.
conductsshortaswellasmore
sustainedresearchprojectsto
answeraquestion(includingaself
generatedquestion)orsolvea
problem;narrowsorbroadensthe
inquirywhenappropriate;
synthesizesmultiplesourcesonthe
subject,demonstrating
understandingofthesubjectunder
investigation.
conductsshortaswellasmore
sustainedresearchprojectstoanswer
acomplexquestion(includingaself
generatedquestion)orsolvea
complexproblem;narrows,
broadens,orreformulatestheinquiry
whenappropriate;synthesizes
multiplehighqualitysourcesonthe
subject,demonstratingcomplete
understandingofthesubjectunder
investigation.
AzMERIT - 2015
EnglishLanguageArts
Grade11
AzMERITPerformanceLevelDescriptors
D-88
AzMERIT - 2015
11.SL.3 describesaspeaker'spointof
view,reasoning,anduseof
evidenceandrhetoric.
Detailed
11.L.1
describesaspeaker'spointofview,
reasoning,anduseofevidenceand
rhetoric,includingthestance,
premises,linksamongideas,word
choice,pointsofemphasis,andtone
used.
Language
demonstratesawarenessofthe
attemptstomeetthe
conventionsofstandardgradelevel
conventionsofstandardgrade
levelEnglishgrammarandusage Englishgrammarandusagewhen
writingorspeaking:(a)
whenwritingorspeaking:(a)
demonstratestheunderstanding demonstratestheunderstanding
thatusageisamatterofconvention,
thatusageisamatterof
convention;(b)clarifiesissuesof canchangeovertime,andis
sometimescontested;(b)resolves
usage,consultingreferences
issuesofcomplexorcontested
(e.g.,MerriamWebster's
usage,consultingreferences(e.g.,
DictionaryofEnglishUsage ,
MerriamWebster'sDictionaryof
Garner'sModernAmerican
EnglishUsage ,Garner'sModern
Usage )asneeded.
AmericanUsage )asneeded.
AzMERITPerformanceLevelDescriptors
EnglishLanguageArts
Grade11
D-89
Proficient
HighlyProficient
integratesmultiplesourcesof
informationpresentedindiverse
formatsandmedia(e.g.,visually,
quantitatively,orally)inorderto
makeinformeddecisionsandsolve
problems,evaluatingthecredibility
andaccuracyofeachsourceand
notinganydiscrepanciesamongthe
data.
effectivelyintegratesmultiple
sourcesofinformationpresentedin
diverseformatsandmedia(e.g.,
visually,quantitatively,orally)in
ordertomakeinformeddecisions
andsolveproblems,evaluatingthe
credibilityandaccuracyofeach
sourceandnotinganydiscrepancies
amongthedata.
evaluatesaspeaker'spointofview,
reasoning,anduseofevidenceand
rhetoric,assessingthestance,
premises,linksamongideas,word
choice,pointsofemphasis,andtone
used.
evaluatesandcritiquesaspeaker's
pointofview,reasoning,anduseof
evidenceandrhetoric,assessingand
analyzingthestance,premises,links
amongideas,wordchoice,pointsof
emphasis,andtoneused.
demonstratesstrongcommandof
demonstratescommandofthe
conventionsofstandardgradelevel theconventionsofstandardgrade
levelEnglishgrammarandusage
Englishgrammarandusagewhen
writingorspeaking:(a)appliesthe whenwritingorspeaking:(a)applies
understandingthatusageisamatter theunderstandingthatusageisa
ofconvention,canchangeovertime, matterofconvention,canchange
overtime,andissometimes
andissometimescontested;(b)
contested;(b)resolvesissuesof
resolvesissuesofcomplexor
complexorcontestedusage,
contestedusage,consulting
references(e.g.,MerriamWebster's consultingreferences(e.g.,Merriam
DictionaryofEnglishUsage ,Garner's Webster'sDictionaryofEnglish
ModernAmericanUsage )asneeded. Usage ,Garner'sModernAmerican
Usage )asneeded.
AzMERIT - 2015
EnglishLanguageArts
Grade11
11.L.3
appliesdeepknowledgeoflanguage
usesknowledgeoflanguagefor usesknowledgeoflanguagetomake appliesknowledgeoflanguageto
understandhowlanguagefunctions tounderstandhowlanguage
comprehensionwhenreadingor effectivechoicesformeaningor
functionsindifferentcontexts,to
style,andtocomprehendmorefully indifferentcontexts,tomake
listening.
makehighlyeffectivechoicesfor
effectivechoicesformeaningor
whenreadingorlistening.Varies
style,andtocomprehendmorefully meaningorstyle,andtoaiddeep
syntaxforeffect,consulting
comprehensionwhenreadingor
whenreadingorlistening.Varies
references(e.g.,Tufte'sArtful
listening.Variessyntaxforeffect,
Sentences )forguidanceasneeded. syntaxforeffect,consulting
consultingreferences(e.g.,Tufte's
references(e.g.,Tufte'sArtful
Sentences )forguidanceasneeded; ArtfulSentences )forguidanceas
appliesanunderstandingofsyntax needed;appliesathorough
tothestudyofcomplextextswhen understandingofsyntaxtothestudy
ofcomplextextswhenreading.
reading.
AzMERITPerformanceLevelDescriptors
D-90
AzMERIT - 2015
EnglishLanguageArts
Grade11
Detailed
11.L.5
recognizesfigurativelanguage
andwordrelationships.
Recognizesfiguresofspeechin
context.Recognizesnuancesin
themeaningofwordswith
similardenotations.
AzMERITPerformanceLevelDescriptors
demonstratesunderstandingof
straightforwardfigurativelanguage,
clearwordrelationships,and
nuancesinwordmeanings.
Interpretsfiguresofspeechin
context.Recognizesnuancesinthe
meaningofwordswithsimilar
denotations.
D-91
demonstratesunderstandingof
figurativelanguage,word
relationships,andnuancesinword
meanings.Interpretsfiguresof
speechincontextandanalyzestheir
roleinthetext.Analyzesnuancesin
themeaningofwordswithsimilar
denotations.
HighlyProficient
determinesorclarifiesthemeaning
ofunknownandmultiplemeaning
wordsandphrases,includingabove
gradelevelcontent,byusingcontext
cluesasacluetothemeaningofa
wordorphrase;identifyingand
correctlyusingpatternsofword
changesthatindicatedifferent
meaningsorpartsofspeech;
consultinggeneralandspecialized
referencematerials,bothprintand
digital,tofindthepronunciationofa
wordordetermineorclarifyits
precisemeaning,itspartofspeech,
itsetymology,oritsstandardusage;
andverifyingthepreliminary
determinationofthemeaningofa
wordorphrase.
demonstratesadeepunderstanding
offigurativelanguage,complexword
relationships,andcomplexnuances
inwordmeanings.Interprets
complexfiguresofspeechincontext
andanalyzestheirroleinthetext.
Analyzesnuancesinthemeaningof
wordswithsimilardenotations.
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
The Minimally Proficient student
Detailed
Detailed
3.OA.A [1 to
4]
3.OA.B [5 to
6]
Mathematics
Grade 3
Partially Proficient
Proficient
The Proficient student
D-92
Highly Proficient
The Highly Proficient student
Interprets products and quotients of
whole numbers within 100,
representing context using pictures,
numbers, and words. Multiplies and
divides within 100 to solve multi-step
word problems involving equal
groups, arrays, and measurement
quantities. Determines an unknown
whole number in a multiplication and
division equation. Students will use
the given context to generate an
equation or create a word problem.
Mathematics
Grade 3
AzMERIT - 2015
Detailed
3.OA.D [8 to
9]
D-93
AzMERIT - 2015
PLD
Detailed
Detailed
3.NF.A [1 to
2b]
Mathematics
Grade 3
Partially Proficient
Proficient
Number and Operations in Base Ten
Uses place value understanding to Uses place value
round a three-digit number to the understanding to round
nearest 100. Adds and subtracts
whole numbers (up to 1,000)
numbers within 1,000 using visual to the nearest 10 or 100.
models or support. Uses grouping Fluently adds and subtracts
strategies (associative property) to within 1,000 using any
multiply single-digit whole numbers strategy. Multiplies singleby multiples of 10 in the range 10- digit whole
90.
numbers by multiples of 10
in the range 10-90 using any
of a variety of strategies.
D-94
AzMERIT - 2015
Mathematics
Grade 3
D-95
Highly Proficient
Explains why two fractions are
equivalent. Identifies equivalent
fractions by creating fraction models
to compare fractions with different
denominators that pertain to the
same whole. Compares two fractions
that have the same numerator or
same denominator using symbols.
AzMERIT - 2015
PLD
Detailed
Detailed
3.MD.A [1 to
2]
3.MD.B [3 to
4]
Mathematics
Grade 3
Partially Proficient
Measurement and Data
Tells, writes, and measures time to Solves one-step word problems
the nearest minute. Using grams, involving addition or subtraction of
kilograms or liters, measures and time intervals in minutes with
estimates liquid volumes and
scaffolding. Using grams, kilograms
masses of objects using models.
or liters, solves simple one-step
measurement word problems using
either addition or subtraction.
D-96
Highly Proficient
Mathematics
Grade 3
AzMERIT - 2015
Detailed
3.MD.D [8]
D-97
Highly Proficient
Finds the area of 2 plane figures by
counting the square units or
multiplying their side lengths and
compares their sizes. Creates a word
problem using the distributive
property to find the area of
rectangles.
AzMERIT - 2015
PLD
Detailed
Mathematics
Grade 3
Partially Proficient
Geometry
Identifies examples of
Understands the properties of
quadrilaterals; recognizes that
quadrilaterals and the
examples of quadrilaterals have
subcategories of quadrilaterals.
shared attributes, and that the
Partitions shapes into parts with
shared attributes can define a
equal areas and expresses the area
larger category. Partitions shapes as a unit fraction of the whole
into parts with equal areas and
(limited to halves, quarters, and
expresses the area as a unit
eighths).
fraction
of
the
whole
(limited
to
3.G.A [1 to 2]
halves and quarters).
D-98
Highly Proficient
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
The Minimally Proficient student
Detailed
4.OA.A [1 to 3.1]
Mathematics
Grade 4
Partially Proficient
The Partially Proficient student
Proficient
The Proficient student
D-99
Highly Proficient
The Highly Proficient student
Recognizes that any two factors and
their product can be read as a
comparison; uses multiple strategies
and creates his or her own to
represent and describe those
comparisons. Creates own context
for multiplicative comparison. Solves
complex multi-step word problems
with multiple possible solutions and
determines which would be the most
reasonable based upon given criteria.
Analyzes relationships between any
two representations of a counting
problem and makes connections to
the multiplication principle.
Mathematics
Grade 4
AzMERIT - 2015
PLD
Detailed
Detailed
4.OA.B [4]
4.OA.C [5]
D-100
AzMERIT - 2015
PLD
Detailed
Detailed
4.NBT.A [1 to 3]
4.NBT.B [4 to 6]
Mathematics
Grade 4
Partially Proficient
Proficient
Highly Proficient
Number and Operations in Base Ten
With numbers within 100,000,
With numbers within
Uses place value strategies,
recognizes that a digit in one
1,000,000, recognizes that a comparisons of two numbers, and
place represents 10 times as
digit in one place represents rounding in a real-world context.
much as it represents in the place 10 times as much as it
to its right, reads and writes multi- represents in the place to its
digit whole numbers in a variety right, reads and writes multidigit whole numbers in a
of forms, and uses place value
variety of forms, and uses
understanding to round multidigit whole numbers.
place value understanding to
round multi-digit whole
numbers.
Fluently adds and subtracts multidigit whole numbers using the
standard algorithm with supports.
Finds products of a whole
number (of up to four digits) by a
single-digit whole number and
whole number quotients and
remainders (with up to three-digit
dividends and single-digit
divisors).
D-101
AzMERIT - 2015
PLD
Detailed
Detailed
4.NF.A [1 to 2]
4.NF.B [3]
Mathematics
Grade 4
Partially Proficient
Proficient
Number and Operations - Fractions
Uses area fraction models to
Uses area fraction models
represent equivalent fractions by and double number lines to
partitioning unit fraction pieces generate and explain why
into smaller pieces (and
fraction a /b is equivalent to
understands that this is the
a fraction (n x a)/(n x b),
same), and multiplies by 1
where n is a non-negative
represented as a fraction.
whole number. Compares
two fractions with different
numerators and different
denominators and justifies
answers using visual fraction
models.
D-102
Highly Proficient
Uses a variety of strategies to
generate and explain why fraction
a/b is equivalent to a fraction (n x
a)/(n x b), where n is a non-negative
whole number. Extends
understanding to compare and order
fractions with different numerators
and different denominators.
Mathematics
Grade 4
AzMERIT - 2015
Detailed
4.NF.C [5 to 7]
D-103
Highly Proficient
Understands and solves more
complex word problems by
recognizing that fraction a/b is a
multiple of 1/b , and uses that
construct to multiply a fraction by a
whole number (in general, n x a/b is
(n x a)/b ).
AzMERIT - 2015
PLD
Detailed
Mathematics
Grade 4
Partially Proficient
Measurement and Data
Knows relative size of
Expresses measurements in a
measurement units, within one
larger unit in terms of a smaller
system of units. Uses the four
unit, within a single system, using
operations to solve word problems supports and adjacent units. Uses
(involving distance, liquid volumes, the four operations to solve word
problems (involving distance,
masses of objects, intervals of
liquid volumes, masses of objects,
time and money), including
intervals of time and money,
problems involving whole
numbers, using supports. Applies area, and perimeter), including
the area and perimeter formulas problems involving simple
fractions or decimals, using
when given all side
supports.
measurements, using supports.
4.MD.A [1 to 3]
D-104
Highly Proficient
Expresses measurements in a
larger unit in terms of a
variety of smaller units,
within a single system, and
records that data in a twocolumn table. Uses the four
operations to solve word
problems (involving distance,
liquid volumes, masses of
objects, intervals of time and
money), including problems
involving simple fractions or
decimals, and problems that
require expressing
measurements given in a
larger unit in terms of a
smaller unit. Represents
measurement quantities
using diagrams. Applies the
area and perimeter formulas
for rectangles in real-world
and mathematical problems,
including those where the
area/perimeter and one
factor (length or width) are
known.
Mathematics
Grade 4
AzMERIT - 2015
Detailed
4.MD.C [5 to 7]
D-105
AzMERIT - 2015
PLD
Detailed
4.G.A [1 to 3]
Mathematics
Grade 4
Partially Proficient
Geometry
Identifies points, lines, line
Identifies and draws points, lines,
segments, rays, perpendicular and line segments, rays, angles (right,
parallel lines, two-dimensional
acute, obtuse), and perpendicular
figures, including right triangles, and parallel lines. Classifies twoand line-symmetric regular figures; dimensional figures based on the
presence or absence of parallel or
classifies angles (right, acute,
perpendicular lines; identifies
obtuse).
triangles. Draws lines of
symmetry for regular twodimensional figures.
D-106
Highly Proficient
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
The Minimally Proficient student
Detailed
Detailed
5.OA.A [1 to
2]
5.OA.B [3]
Mathematics
Grade 5
Partially Proficient
Proficient
Highly Proficient
D-107
AzMERIT - 2015
Mathematics
Grade 5
Detailed
D-108
Highly Proficient
Recognizes (in any multi-digit
number, including decimals to
thousandths) that a digit in one place
represents 10 times as much as it
represents in the place to its right
and 1/10 of what it represents in the
place to its left, in real-world or
mathematical context problems.
Interprets a multiplication problem
to identify the factor of 10 by which
one number is greater or lesser than
another.
Mathematics
Grade 5
AzMERIT - 2015
5.NBT.B [7]
D-109
AzMERIT - 2015
PLD
Detailed
Detailed
5.NF.B [3]
Mathematics
Grade 5
Partially Proficient
Proficient
Number and Operations - Fractions
Adds/subtracts fractions with Adds and subtracts fractions with
unlike denominators, where
unlike denominators (including
one denominator is a multiple mixed numbers). Solves word
of the other denominator.
problems involving addition and
Solves word problems involving subtraction of fractions with
unlike denominators (including
addition and subtraction of
mixed numbers). Assesses and
fractions with unlike
justifies reasonableness of the
denominators, where one
answer by using benchmark
denominator is a multiple of
fractions, visual models, or
the other denominator.
equations.
D-110
Highly Proficient
Adds or subtracts at least 3 or more
fractions with unlike denominators
(including mixed numbers). Solves
word problems involving addition or
subtraction with at least 3 or more
fractions with unlike denominators
(including mixed numbers).
AzMERIT - 2015
Mathematics
Grade 5
Detailed
D-111
Highly Proficient
Creates a real-world context and
models representing multiplication of
fractions. Demonstrates reasoning
about fractions in both an additive
and multiplicative sense with
different wholes, and displays the
quantities with visual models.
Interprets multiplication scaling by
comparing the size of a product to
the size of one factor on the basis of
the size of the second factor by
performing the indicated
multiplication with 2 fractions.
AzMERIT - 2015
PLD
Detailed
Detailed
Detailed
5.MD.A [1]
5.MD.B [2]
Mathematics
Grade 5
Partially Proficient
Highly Proficient
Creates real-world multi-step
problems. Chooses the appropriate
measurement unit based on the
given context.
5.MD.C [3 to
5]
D-112
AzMERIT - 2015
PLD
Detailed
Detailed
Mathematics
Grade 5
Partially Proficient
Geometry
Identifies the key components of Interprets coordinate values of
the coordinate plane (x -axis, x points in the first quadrant
coordinate, y -axis, y -coordinate (e.g., reading line graphs), in
and origin). Locates given points in context.
5.G.A [1 to 2] the first quadrant of the
coordinate plane.
5.G.B [3 to 4]
D-113
Highly Proficient
Draws or constructs
specific two-dimensional figures
according to the definitions provided,
attributes described, or categories
given.
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
Mathematics
Grade 6
Partially Proficient
Detailed
Detailed
6.RP.A [1 to 2]
Proficient
The Proficient student
Identifies proportional
relationships presented in
graphical, tabular, or verbal
formats, knows the meaning of
a percent of a quantity as a rate
per hundred, and finds missing
6.RP.A.3 [a to dvalues in tables and plots values
on the coordinate plane using
whole numbers.
6.NS.A [1]
D-114
Highly Proficient
The Highly Proficient student
Uses and connects between
representation for ratio situations
and finds unit rates requiring
multiple steps.
Mathematics
Grade 6
AzMERIT - 2015
Detailed
6.NS.B [4]
D-115
Highly Proficient
Solves real world problems by
adding, subtracting, multiplying and
dividing multi-digit numbers
including multi-digit decimals using
the standard algorithm for each
operation and assesses the
reasonableness of the result.
AzMERIT - 2015
Mathematics
Grade 6
D-116
AzMERIT - 2015
PLD
Detailed
Detailed
Detailed
6.EE.C [9]
Mathematics
Grade 6
Partially Proficient
Highly Proficient
Evaluates multi-step problems and
generates equivalent expression
involving rational numbers and
whole number exponents in real
world contexts.
D-117
AzMERIT - 2015
PLD
Detailed
Detailed
6.G.A [4]
Detailed
Mathematics
Grade 6
Partially Proficient
Proficient
Highly Proficient
Geometry
Finds the area given some
measures for triangles or polygons
by decomposing into rectangles
and triangles, finds the volume of
a right rectangular prism with one
fractional edge, and uses
coordinates to find the length of a
side joining points with the same
first or second coordinate.
D-118
AzMERIT - 2015
Mathematics
Grade 6
D-119
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
Mathematics
Grade 7
Partially Proficient
Detailed
Detailed
Detailed
Proficient
The Proficient student
D-120
Highly Proficient
The Highly Proficient student
Computes unit rates with ratios of
two mixed numbers having like or
different units. Ratios include areas.
Extends the given representation or
creates a different representation
that would represent the same
proportional relationship.
Creates a representation with a
context that would represent a given
proportional equation.
Identifies a point (x,y) on the same
graph as the point (1,r) for a
proportional relationship and
interprets the meaning of (x,y) in
terms of the situation.
AzMERIT - 2015
PLD
Mathematics
Grade 7
Detailed
7.NS.A
[1a to 2d]
Detailed
D-121
Highly Proficient
Interprets the sums of rational
numbers in real-world contexts.
Justifies the steps taken to add or
subtract rational numbers. Interprets
products and quotients of rational
numbers in a real-world context.
AzMERIT - 2015
Mathematics
Grade 7
Detailed
Detailed
Detailed
Detailed
Geometry
Finds actual lengths given two
geometric figures with some
unknown side measure when given
the scale factor that relates the two
figures.
D-122
Highly Proficient
Applies properties of operations as
strategies to add, subtract, factor,
and expand linear expressions (with
complex rational coefficients).
Creates equivalent expressions given
a problem context and explains key
terms and factors of the problem for
each expression.
AzMERIT - 2015
Mathematics
Grade 7
Detailed
Detailed
Highly Proficient
Understands how and why the
formulas for area and circumference
of a circle work. Explains the
relationship between area of a circle
and area of a parallelogram.
Identifies supplementary,
complementary, vertical and
7.G.B [5] adjacent angles.
D-123
Mathematics
Grade 7
AzMERIT - 2015
Detailed
Detailed
Detailed
7.SP.C [6]
Makes approximations of
probability for a chance event.
7.SP.C [7a
to 7b]
Detailed
Highly Proficient
Identifies and justifies the most
representative sampling method for
a situation. Chooses or creates a
method of generating multiple
samples to gauge variations in
estimates or predictions.
Compares two visual representations
of data to make comparative
inferences about the central
tendency and variability of two
populations in context.
Compares probabilities of two or
more events and justify the
likelihood of each event.
D-124
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
The Minimally Proficient student
Detailed
Detailed
8.EE.A [1 to 2]
8.EE.A [3 to 4]
Mathematics
Grade 8
Partially Proficient
Proficient
Highly Proficient
D-125
Mathematics
Grade 8
AzMERIT - 2015
8.EE.C [7 to
8c]
D-126
Highly Proficient
Generates a representation of a
proportional relationship with
specific qualities. Compares and
contrasts situations in which similar
triangles would and would not yield
lines with the same slope.
AzMERIT - 2015
PLD
Detailed
Detailed
8.F.A [1 to 3]
8.F.B [4 to 5]
Mathematics
Grade 8
Partially Proficient
Functions
Identifies whether a relation is a Identifies whether a relation is a
function from a graph or a
function from any representation.
mapping. Creates a graph from a Given a representation of a
function expressed as an equation. function, creates another
Determines whether a function is representation of that function.
linear or nonlinear from a graph. Determines whether a function is
linear or nonlinear from an
equation.
Geometry
D-127
Highly Proficient
Mathematics
Grade 8
AzMERIT - 2015
Detailed
Detailed
8.G.A [5]
Highly Proficient
Recognizes and explains the
properties of transformations in
real-world graphic illustrations and
visual representations, including
whether the transformations lead
to similar or congruent figures.
D-128
AzMERIT - 2015
PLD
Mathematics
Grade 8
Detailed
8.G.C [9]
D-129
Highly Proficient
Describes the relationship between
the formulas for volumes of cones,
cylinders, or spheres. Explains the
derivation of the formulas for
cones, cylinders, and spheres.
AzMERIT - 2015
PLD
Detailed
Mathematics
Grade 8
Partially Proficient
Statistics and Probability
Constructs a scatter plot.
Constructs a scatter plot and
Recognizes a straight line can be describes the pattern as positive,
used to describe a linear
negative or no relationship. Draws
association on a scatter plot.
a straight line on a scatter plot
Identifies the slope and ythat closely fits the data points.
intercept of a linear model on a
Identifies possible data points
scatter plot. Completes a partially given a linear model. Constructs a
8.SP.A [1 to 4]
filled-in two-way table and
two-way table of categorical data.
interpret the table by row or
column.
D-130
Highly Proficient
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
Mathematics
Algebra I
Partially Proficient
Detailed
Detailed
Detailed
Detailed
Detailed
N-RN.B [3]
Highly Proficient
The Highly Proficient student
A-SSE.A [2]
A-SSE.B [3b]
Proficient
Algebra
Identifies some of the basic
Identifies all of the basic terms
terms (base, exponent,
(base, exponent, coefficient, and
coefficient, and factor) of a linear factor) of linear and exponential
A-SSE.A [1a to
or exponential expression.
expressions.
1b]
A-SSE.B [3a]
D-131
Mathematics
Algebra I
AzMERIT - 2015
PLD
Detailed
A-SSE.B [3c]
Identifies polynomial
expressions.
Detailed
Detailed
Detailed
Detailed
A-APR.A [1]
A-APR.B [3]
Highly Proficient
Interprets properties of
exponential functions by
transforming them into equivalent
expressions that reveal properties
within a context.
Factor a quadratic function and use Identify zeros from the graph and
zeroes to sketch a graph of the
use zeroes to construct the
function.
quadratic function.
A-CED.A [1
and 4];
AREI.B [3]
D-132
Mathematics
Algebra I
AzMERIT - 2015
Detailed
Detailed
A-REI.A [1]
Highly Proficient
Defends and justifies solutions
or non-solutions in a modeling
context.
A-REI.B. [4a
to 4b]
D-133
AzMERIT - 2015
PLD
Mathematics
Algebra I
Detailed
Detailed
A-REI.C [5 to
6]
D-134
Highly Proficient
Proves that, given a system of two
equations in two variables,
replacing one equation by the sum
of that equation and a multiple of
the other produces a system with
the same solutions. Analyzes the
system of
equations and is able to solve
exactly and approximately given a
context or real-world situation.
Solves a system of equations and
manipulates one of the equations
to provide additional information
or an additional given solution.
AzMERIT - 2015
PLD
Detailed
Detailed
Detailed
Partially Proficient
Functions
Evaluates a function for inputs in
the domain, and writes functions
using function notation (without
context).
F-IF.A [1 to 2];
F-IF.B [5]
F-IF.B [4]
F-IF.B [6]
Highly Proficient
Determines the rate of change of Determines the rate of change of Calculates and interprets the
Describes the different rates of
a linear function presented
an exponential function presented average rate of change of a
change over given intervals of the
algebraically.
algebraically, over a given interval. function presented symbolically or graph .
as a table over a specified interval.
Evaluates linear, quadratic,
piecewise, step, and absolute
value functions
Detailed
Mathematics
Algebra I
F-IF.C [7a to
7b, and 8a]
D-135
Mathematics
Algebra I
AzMERIT - 2015
Detailed
Detailed
F-BF.A [1];
F-IF.A [3];
F-LE.A [2]
F-BF.B [3]
Highly Proficient
Constructs a linear, quadratic,
square root, cube root, piecewisedefined functions (including step
functions and absolute value
functions), and exponential
functions with domains in the
integers that has a characteristic
(i.e. slope, intercept, maximum)
that is greater than or lesser than
a given function.
D-136
Mathematics
Algebra I
AzMERIT - 2015
Detailed
Detailed
F-LE.A [3]
Highly Proficient
Describes the rate of change per
unit as constant or the growth
factor as a constant percentage.
Proves that linear functions grow
by equal differences over equal
intervals; exponential functions
grow by equal factors over equal
intervals.
Compares the values of linear and Observes, using graphs and tables,
exponential functions over various that a quantity increasing
intervals.
exponentially eventually exceeds a
quantity that is increasing linearly
or quadratically.
F-LE.B [5]
D-137
AzMERIT - 2015
PLD
Detailed
Detailed
Detailed
Mathematics
Algebra I
Partially Proficient
Statistics
Graphs numerical data on a real
number line using dot plots,
histograms, and box plots.
S-ID.A [1]
Proficient
Highly Proficient
S-ID.A [2 to 3]
S-ID.B [5]
S-ID.B [6a to
6c]
D-138
Mathematics
Algebra I
AzMERIT - 2015
S-ID.C [8 to 9]
D-139
Supports or refutes a
hypothesized correlation between
two sets of data. Supports or
refutes claims of
causation with the understanding
that a strong correlation does not
imply causation.
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
Mathematics
Geometry
Partially Proficient
Detailed
Detailed
Detailed
G-CO.A [1]
G-CO.A [2
and 4]
G-CO.A [3]
Congruence
Informally defines an angle,
circle, perpendicular line, parallel
line, and line segment using
examples and non- examples.
Proficient
Highly Proficient
D-140
Mathematics
Geometry
AzMERIT - 2015
Detailed
Detailed
Detailed
Detailed
Detailed
G-CO.B [7]
G-CO.B [8]
G-CO.C [9]
Proficient
Highly Proficient
Identifies a sequence of
Performs rotations, reflections,
Explains how the order of a sequence
transformations that will carry a and translations using a variety of of transformations is performed may
given figure onto another.
methods and specifies the
result in different outcomes.
sequence of transformations that
will carry a given figure onto
another.
Explains transformations of a
given figure based on
descriptions of rigid motion.
G-CO.A [5]
G-CO.B [6]
D-141
Proves theorems about lines and Applies theorems about lines and
angles.
angles to a real-life context.
Mathematics
Geometry
AzMERIT - 2015
Detailed
Detailed
Detailed
G-CO.D [12
to 13]
Proficient
Highly Proficient
G-CO.C [10]
G-CO.C [11]
D-142
Mathematics
Geometry
AzMERIT - 2015
Detailed
Detailed
Detailed
Detailed
Detailed
G-SRT.A [1a
to 1b]
G-SRT.A [2]
Proficient
Highly Proficient
Explains that two given figures are Proves or disproves that two given
similar in terms of similarity
figures are similar, using
transformations.
transformations and the definitions
of similarity.
Establishes the AA criterion for
Proves that two triangles are similar
two triangles to be similar by
if two angles of one triangle are
using the properties of similarity congruent to two angles of the other
transformations.
triangle, using the properties of
similarity transformations.
Identifies similarity
transformations.
G-SRT.A [3]
G-SRT.B [4]
G-SRT.B [5]
D-143
Mathematics
Geometry
AzMERIT - 2015
Detailed
Detailed
Detailed
G-SRT.C [6]
G.SRT.C [7]
Highly Proficient
Determines the similarity of right
triangles by comparing the
trigonometric ratios of the
corresponding sides. Solves for
missing angles of right triangles using
sine and cosine.
G-SRT.C [8]
D-144
Mathematics
Geometry
AzMERIT - 2015
Detailed
Detailed
Detailed
Detailed
G-C.A [1]
G-C.A [2]
G-C.A [3]
G-C.B [5]
Circles
Recognizes that all circles are
similar.
Highly Proficient
Solves applied math problems, using
the fact that all circles are similar.
D-145
Mathematics
Geometry
AzMERIT - 2015
Detailed
Detailed
Detailed
Detailed
Detailed
G-GPE.A [1]
G-GPE.B [4]
G-GPE.B [5]
G-GPE.B [6]
Highly Proficient
G-GPE.B [7]
D-146
Mathematics
Geometry
AzMERIT - 2015
Detailed
Detailed
Detailed
Detailed
Detailed
Detailed
Highly Proficient
Justifies the formulas for the
circumference of a circle, area of a
circle, volume of a cylinder, pyramid,
and cone.
G-MG.A [1]
G-MG.A [2]
G-MG.A [3]
Identifies a three-dimensional
object generated by rotations of
a simple two-dimensional object
about a line of symmetry of the
object.
Compares quantitatively
Designs a structure to meet
different proposed solutions to a constraints and optimization
design problem, using geometric requirements.
properties of the solution.
D-147
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
The Minimally Proficient
student
Detailed
Detailed
N-RN.A [1 to
2]
N-CN.A [1 to
2]
Mathematics
Algebra II
Partially Proficient
Proficient
The Proficient student
D-148
Highly Proficient
The Highly Proficient student
Proves, uses, and explains the
properties of rational exponents
(which are an extension of the
properties of integer exponents),
and extends to real world context.
Compares contexts where radical
form is preferable to rational
exponents, and vice versa.
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
Mathematics
Algebra II
Partially Proficient
Algebra
Identifies structure used to
Identifies structure used to rewrite
rewrite polynomial expressions. rational, polynomial, and
exponential expressions with
rational or real exponents.
Detailed
Detailed
Detailed
Detailed
Detailed
A-SSE.A [2];
A-SSE.B [3c]
A-SSE.B [4];
F-BF.A [2]
Recognizes if a sequence is
arithmetic, geometric, or
neither.
Highly Proficient
A-APR.B [2]
A-APR.B [3]
Identifies a polynomial
identity.
A-APR.C [4]
D-149
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
Detailed
Detailed
Detailed
Detailed
A-APR.D [6]
A-CED.A [1]
A-REI.A [1]
A-REI.A [2]
Mathematics
Algebra II
Partially Proficient
Proficient
Highly Proficient
D-150
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
Detailed
A-REI.B [4b];
N-CN.C [7]
Detailed
A-REI.C [6 to
7]
Mathematics
Algebra II
Partially Proficient
Proficient
Highly Proficient
A-REI.D [11]
D-151
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
Detailed
Detailed
Detailed
Detailed
Partially Proficient
Functions
Interprets key features of graphs
and tables that model a quadratic
function. Sketches graphs showing
key features, given a verbal
description of a quadratic
relationship.
Highly Proficient
F-IF.B [6]
Mathematics
Algebra II
D-152
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
Detailed
Detailed
Detailed
F-BF.B [3]
F-BF.B [4a]
F-IF.A [3];
F-LE.A [2]
Partially Proficient
Highly Proficient
Mathematics
Algebra II
F-LE.A [4]
D-153
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
Knows that a full rotation of a
circle is 2 radians.
Detailed
Detailed
Detailed
Detailed
Mathematics
Algebra II
Partially Proficient
F-TF.A [1]
F-TF.A [2]
Identifies the sine and cosine of Identifies the sine and cosine of
angles in the first quadrant of a angles on the unit circle.
unit circle. Recognizes that the
coordinates of any point on the
unit circle may be defined as
(cos , sin ) .
Writes an appropriate
trigonometric function to model a
real-world context (where the
information about amplitude,
frequency, and midline are given
clearly).
F-TF.B [5]
F-TF.C [8]
Highly Proficient
D-154
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
Detailed
Detailed
Detailed
Detailed
Detailed
G-GPE.A [2]
S-ID.A [4]
Partially Proficient
Geometry
Identifies the directrix and
Identifies the directrix and focus of Derives the equation of a
focus of a parabola when given a parabola when given the
parabola, given a focus and
its graph.
equation.
directrix.
Statistics
Labels a blank normal
Uses the Empirical Rule to label a
distribution curve with the
blank normal distribution curve
appropriate mean and standard with the appropriate percentages
(68%-95%-99.7%).
deviations.
Highly Proficient
Justifies conditions for when a
point is or is not part of a parabola,
given information about the focus
and directrix.
Additionally, recognizes that there
are data sets for which such a
procedure is not appropriate. Uses
technology or tables to estimate
areas under the normal curve.
Determines if a plotted data set is Creates a scatter plot of bivariate Compares the fit of different
data and estimates an exponential functions to data and determines
approximately linear.
(with domains not in the integers) which function has the best fit.
or trigonometric function that fits
the data. Uses this function to
solve problems in the context of
the data.
S-ID.B [6a]
S-IC.A [1]
S-IC.A [2]
Mathematics
Algebra II
D-155
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
Detailed
Detailed
Detailed
Detailed
S-IC.B [3]
S-IC.B [4]
S-IC.B [5]
S-IC.B [6]
Mathematics
Algebra II
Partially Proficient
Proficient
Highly Proficient
S-CP.A [1]
D-156
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
Detailed
Detailed
Detailed
Detailed
Detailed
Mathematics
Algebra II
Partially Proficient
S-CP.A [4]
S-CP.A [5]
Proficient
Highly Proficient
Understands conditional
probability and how it applies
to real life events.
Calculates conditional
probabilities.
Approximates conditional
probabilities using two-way
frequency tables.
S-CP.A [2]
S-CP.A [3]
Expresses conditional
Interprets conditional probabilities Recognizes and explains the
probabilities and independence and independence in context.
concepts of conditional probability
using probability notation.
and independence, in everyday
language and everyday situations.
Distinguishes between
compound and conditional
probability scenarios.
S-CP.B [6]
D-157
AzMERIT - 2015
Appendix D. Performance Level Descriptors (PLDs)
PLD
Standard
Minimally Proficient
Recalls the Addition Rule.
Detailed
S-CP.B [7]
Mathematics
Algebra II
Partially Proficient
D-158
Highly Proficient
AzMERIT
Appendix
StandardSettingTechnicalReport
AzMERIT
AzMERIT
Grade 3
Strands
Reading Standards for
Literature
Reading Standards for
Informational Text
Listening Comprehension
(Informational)
Language
Writing
Min
Max
26%
35%
26%
35%
0%
13%
13%
17%
19%
19%
Grade 4
Strands
Reading Standards for
Literature
Reading Standards for
Informational Text
Listening Comprehension
(Informational)
Language
Writing
Grade 6
Strands
Reading Standards for
Literature
Reading Standards for
Informational Text
Listening Comprehension
(Informational)
Language
Writing
Grade 9
Strands
Reading Standards for
Literature
Reading Standards for
Informational Text
Listening Comprehension
(Informational)
Language
Writing
Min
Max
26%
35%
26%
35%
0%
13%
13%
17%
19%
19%
Grade 7
Min
Max
24%
31%
30%
38%
0%
13%
13%
17%
19%
19%
Min
Max
23%
30%
31%
40%
0%
13%
13%
16%
18%
18%
Strands
Reading Standards for
Literature
Reading Standards for
Informational Text
Listening Comprehension
(Informational)
Language
Writing
Grade 10
Strands
Reading Standards for
Literature
Reading Standards for
Informational Text
Listening Comprehension
(Informational)
Language
Writing
Grade
Min
Max
24%
31%
30%
38%
0%
13%
13%
17%
19%
19%
Min
Max
23%
30%
31%
40%
0%
13%
13%
16%
18%
18%
10%-20%
E-1
Max
26%
35%
26%
35%
0%
13%
13%
17%
19%
19%
Min
Max
24%
31%
30%
38%
0%
13%
13%
17%
19%
19%
Min
Max
23%
30%
31%
40%
0%
13%
13%
16%
18%
18%
Grade 8
Strands
Reading Standards for
Literature
Reading Standards for
Informational Text
Listening Comprehension
(Informational)
Language
Writing
Grade 11
Strands
Reading Standards for
Literature
Reading Standards for
Informational Text
Listening Comprehension
(Informational)
Language
Writing
3-11
Min
50%-60%
15%-25%
DOK Level 4
16%-19% (Writing)
AzMERIT
AzMERIT
Grade 4
Grade 3
Domain
Min.
Max.
49%
53%
18%
22%
26%
30%
Domain
Operations and Algebraic
Thinking
Number and Operations in Base
Ten
Grade 5
Min.
Max.
22%
26%
24%
28%
29%
33%
15%
19%
Grade 6
Domain
Mathematics
Assessment Blueprint
Domain
Min.
Max.
31%
35%
38%
42%
24%
28%
Min.
Max.
Grade 7
Min.
Max.
Domain
Grade 8
Min.
Max.
Domain
19%
23%
Functions
21%
25%
19%
23%
29%
33%
19%
23%
32%
36%
Geometry &
Statistics and Probability
21%
23%
27%
Geometry
23%
27%
Geometry
12%
16%
25%
29%
15%
19%
15%
19%
Min.
Max.
Algebra
34%
38%
Functions
32%
36%
Statistics
27%
31%
Algebra I
Conceptual Categories
Algebra
Functions
Statistics
Geometry
Min.
Max.
40%
44%
36%
17%
40%
21%
Domain
Congruence
Similarity, Right Triangles, and
Trigonometry
Circles & Geometric
Measurement & Geometric
Properties with Equations
Modeling with Geometry
Algebra II
Min.
Max.
23%
27%
27%
31%
23%
27%
17%
21%
Conceptual Categories
Within a test, approximately 70% of the assessment will be on major content within that grade or course.
E-2
AzMERIT
StandardSettingTechnicalReport
Appendix
AzMERIT
TableF.SummaryofOrderedItemBookletsbyTest
Test
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
Overall
Percent of
Students At
or Above
Standard
-1.79
0.02
98
-1.37
0.04
93
-1.19
0.01
90
-1.00
0.03
85
-0.92
0.01
82
-0.86
0.01
81
-0.77
0.01
78
-0.75
0.01
78
-0.73
0.01
77
10
-0.65
0.01
74
11
-0.48
0.01
70
12
-0.46
0.01
68
13
-0.40
0.01
67
14
-0.30
0.04
62
15
-0.19
0.01
59
16
-0.19
0.01
59
17
-0.17
0.01
59
18
-0.09
0.01
56
19
-0.01
0.01
53
20
0.05
0.01
49
21
0.12
0.01
48
22
0.15
0.01
46
23
0.22
0.01
43
24
0.26
0.01
43
25
0.29
0.01
41
26
0.33
0.01
40
27
0.36
0.01
38
28
0.42
0.01
36
29
0.46
0.03
35
30
0.51
0.01
33
31
0.57
0.01
30
32
0.60
0.01
30
33
0.60
0.01
30
34
0.61
0.03
30
35
0.65
0.05
29
F-1
Locationof
External
Benchmarks
AIMSApproaches;
AIMSMeets
SBACLevel2;
SBACLevel3;
AzMERIT
Test
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
Overall
Percent of
Students At
or Above
Standard
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
Grade3ELA
36
0.76
0.01
24
37
0.79
0.01
24
38
0.88
0.01
21
39
0.92
0.01
20
40
0.93
0.01
20
41
0.98
0.01
18
42
0.99
0.01
18
43
1.10
0.01
15
44
1.14
0.01
15
45
1.21
0.01
12
46
1.27
0.01
12
47
1.31
0.01
11
48
1.35
0.01
10
49
1.36
0.01
10
50
1.43
0.05
51
1.50
0.01
52
1.51
0.01
53
1.58
0.05
54
1.70
0.01
55
1.72
0.01
56
1.75
0.01
57
1.76
0.01
58
1.77
0.01
59
1.90
0.01
60
1.92
0.01
61
2.07
0.06
62
2.39
0.06
63
2.91
0.07
64
3.16
0.02
65
3.60
0.03
66
3.62
0.03
67
5.54
0.05
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
-1.59
0.05
98
-1.47
0.02
97
-1.22
0.01
95
-1.11
0.01
93
F-2
Locationof
External
Benchmarks
SBACLevel4;
AIMSExceeds;
AIMSApproaches;
AzMERIT
Test
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
Overall
Percent of
Students At
or Above
Standard
Locationof
External
Benchmarks
-0.85
0.01
89
-0.62
0.01
83
-0.61
0.01
82
-0.56
0.01
82
-0.54
0.01
81
10
-0.45
0.03
79
11
-0.30
0.06
75
12
-0.20
0.01
71
13
-0.09
0.01
67
14
-0.06
0.01
67
15
-0.03
0.01
16
0.07
0.01
SBACLevel2
61 NAEPBasic;
17
0.09
0.01
61
18
0.10
0.05
61
19
0.14
0.01
57
20
0.16
0.03
57
21
0.20
0.01
56
22
0.31
0.01
51
23
0.33
0.01
51
24
0.33
0.01
51
25
0.43
0.01
47
26
0.45
0.01
46
27
0.47
0.01
44
28
0.50
0.01
44
29
0.52
0.01
42
30
0.54
0.01
42
31
0.55
0.01
41
32
0.60
0.01
39
33
0.66
0.01
37
34
0.67
0.01
37
35
0.74
0.01
34
36
0.80
0.01
32
37
0.83
0.01
30
38
0.88
0.01
28
39
0.89
0.01
27
40
0.90
0.01
27
F-3
AIMSMeets;
64
SBACLevel3
NAEPProficient;
AzMERIT
Test
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade4ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
Overall
Percent of
Students At
or Above
Standard
41
0.96
0.01
25
42
1.09
0.01
20
43
1.09
0.01
20
44
1.13
0.03
18
45
1.20
0.01
17
46
1.21
0.01
17
47
1.27
0.01
16
48
1.30
0.01
14
49
1.32
0.01
13
50
1.32
0.01
13
51
1.39
0.01
13
52
1.45
0.05
10
53
1.56
0.01
54
1.68
0.01
55
1.77
0.03
56
1.79
0.01
57
1.80
0.01
58
1.89
0.05
59
2.21
0.06
60
2.39
0.01
61
2.48
0.01
62
2.73
0.02
63
2.80
0.04
64
3.06
0.02
65
3.82
0.02
66
4.94
0.06
67
5.16
0.06
-3.14
0.04
100
-1.36
0.01
96
-1.20
0.01
93
-1.06
0.01
90
-0.90
0.01
87
-0.78
0.04
84
-0.73
0.03
82
-0.70
0.01
82
-0.49
0.01
75
F-4
Locationof
External
Benchmarks
SBACLevel4
AIMSExceeds;
NAEPAdvanced
AIMSApproaches;
AIMSMeets;
AzMERIT
Test
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
Overall
Percent of
Students At
or Above
Standard
10
-0.37
0.01
70
11
-0.37
0.06
70
12
-0.29
0.01
69
13
-0.25
0.01
66
14
-0.15
0.01
63
15
-0.13
0.01
63
16
-0.10
0.01
59
17
-0.08
0.01
59
18
-0.03
0.04
59
19
0.10
0.05
52
20
0.14
0.01
51
21
0.30
0.01
44
22
0.33
0.01
44
23
0.35
0.01
42
24
0.35
0.01
42
25
0.40
0.01
40
26
0.40
0.01
40
27
0.45
0.01
37
28
0.46
0.01
37
29
0.51
0.01
37
30
0.51
0.01
37
31
0.63
0.01
30
32
0.63
0.01
30
33
0.63
0.01
30
34
0.69
0.01
28
35
0.69
0.01
27
36
0.76
0.05
25
37
0.82
0.01
24
38
0.83
0.01
24
39
0.85
0.01
22
40
0.91
0.01
20
41
0.94
0.01
19
42
0.95
0.01
19
43
1.00
0.01
18
44
1.06
0.01
16
45
1.15
0.01
14
F-5
Locationof
External
Benchmarks
SBACLevel2
SBACLevel3
AzMERIT
Test
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade5ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
RP67/
RP50
(EOC
Math)
Overall
Percent of
Students At
or Above
Standard
46
1.15
0.01
Locationof
External
Benchmarks
14 SBACLevel4
47
1.18
0.03
12
48
1.33
0.01
49
1.45
0.05
50
1.61
0.05
51
1.64
0.01
52
1.70
0.01
53
1.80
0.01
54
1.85
0.01
55
1.86
0.01
56
1.86
0.01
57
1.96
0.01
58
1.97
0.01
59
2.01
0.01
60
2.04
0.01
61
2.12
0.06
62
2.38
0.02
63
2.46
0.02
64
2.76
0.02
65
2.87
0.02
66
3.81
0.10
67
4.08
0.04
68
4.13
0.04
-1.81
0.02
99
-1.67
0.06
99
-1.28
0.05
95
-1.11
0.01
91
-1.04
0.04
89
-0.92
0.01
87
-0.89
0.01
87
-0.86
0.01
85
-0.69
0.01
80
10
-0.64
0.04
78
11
-0.55
0.01
76
12
-0.39
0.05
70
13
-0.29
0.01
Item
Map
Order
Item
Score
Category
F-6
SE
AIMSExceeds;
AIMSApproaches;
AIMSMeets;
SBACLevel2
67 NAEPBasic;
AzMERIT
Test
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
Overall
Percent of
Students At
or Above
Standard
14
-0.21
0.01
64
15
-0.17
0.01
62
16
-0.12
0.01
61
17
-0.11
0.01
61
18
-0.07
0.01
59
19
0.04
0.01
54
20
0.06
0.01
53
21
0.07
0.01
53
22
0.12
0.01
51
23
0.17
0.01
50
24
0.27
0.01
47
25
0.32
0.01
43
26
0.33
0.01
43
27
0.36
0.01
43
28
0.49
0.01
37
29
0.56
0.01
35
30
0.58
0.01
34
31
0.63
0.01
34
32
0.66
0.01
31
33
0.68
0.01
31
34
0.69
0.01
31
35
0.78
0.01
28
36
0.80
0.01
28
37
0.81
0.01
28
38
0.93
0.01
23
39
0.96
0.01
22
40
0.97
0.04
22
41
0.99
0.01
22
42
1.00
0.01
22
43
1.00
0.04
22
44
1.01
0.01
21
45
1.02
0.01
21
46
1.02
0.01
21
47
1.05
0.01
19
48
1.16
0.01
17
49
1.19
0.01
17
F-7
Locationof
External
Benchmarks
SBACLevel3
NAEPProficient;
AzMERIT
Test
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade6ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
Overall
Percent of
Students At
or Above
Standard
50
1.23
0.04
15
51
1.26
0.01
14
52
1.32
0.01
14
53
1.43
0.05
54
1.59
0.01
55
1.74
0.01
56
1.76
0.01
57
1.88
0.04
58
2.03
0.01
59
2.11
0.01
60
2.20
0.01
61
2.22
0.01
62
2.51
0.02
63
2.69
0.02
64
2.72
0.07
65
3.85
0.03
66
3.87
0.03
67
5.40
0.05
-1.58
0.02
97
-1.42
0.01
96
-1.14
0.04
91
-1.11
0.01
91
-0.83
0.04
85
-0.77
0.01
83
-0.60
0.01
79
-0.59
0.01
78
-0.38
0.01
71
10
-0.37
0.01
71
11
-0.27
0.01
68
12
-0.18
0.06
65
13
-0.17
0.06
65
14
-0.11
0.01
62
15
-0.07
0.01
59
16
-0.04
0.01
59
17
-0.03
0.01
59
18
-0.02
0.01
59
F-8
Locationof
External
Benchmarks
AIMSExceeds
12 SBACLevel4
NAEPAdvanced
AIMSApproaches
AIMSMeets;
SBACLevel2
AzMERIT
Test
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
Overall
Percent of
Students At
or Above
Standard
19
0.00
0.01
56
20
0.05
0.01
56
21
0.11
0.01
52
22
0.12
0.01
52
23
0.17
0.01
49
24
0.18
0.01
49
25
0.24
0.01
47
26
0.27
0.01
46
27
0.32
0.01
44
28
0.38
0.03
42
29
0.45
0.01
39
30
0.48
0.01
37
31
0.51
0.01
36
32
0.53
0.01
36
33
0.57
0.05
34
34
0.58
0.01
34
35
0.58
0.01
34
36
0.61
0.01
33
37
0.61
0.03
33
38
0.72
0.05
30
39
0.74
0.01
28
40
0.77
0.01
27
41
0.79
0.01
27
42
0.80
0.05
27
43
0.86
0.01
25
44
0.87
0.05
24
45
0.95
0.01
22
46
1.04
0.01
19
47
1.07
0.01
18
48
1.08
0.01
18
49
1.09
0.03
18
50
1.21
0.01
15
51
1.21
0.01
14
52
1.23
0.01
14
53
1.35
0.05
12
54
1.45
0.01
10
F-9
Locationof
External
Benchmarks
SBACLevel3
AIMSExceeds;
AzMERIT
Test
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade7ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
Overall
Percent of
Students At
or Above
Standard
55
1.56
0.01
56
1.59
0.01
57
1.66
0.01
58
1.71
0.01
59
1.82
0.01
60
1.84
0.01
61
1.90
0.01
62
1.91
0.01
63
1.93
0.01
64
2.09
0.01
65
2.19
0.01
66
2.49
0.01
67
3.86
0.03
68
3.88
0.03
-1.66
0.02
98
-1.64
0.02
98
-1.58
0.02
97
-1.52
0.07
97
-1.47
0.02
97
-1.24
0.01
94
-1.16
0.04
93
-1.04
0.04
90
-0.92
0.01
88
10
-0.89
0.01
87
11
-0.82
0.01
85
12
-0.73
0.04
82
13
-0.62
0.06
80
14
-0.56
0.06
77
15
-0.42
0.01
73
Locationof
External
Benchmarks
SBACLevel4
AIMSApproaches;
16
-0.36
0.05
NAEPBasic;AIMS
Meets;SBACLevel
72 2;
17
-0.16
0.01
63
18
-0.10
0.01
61
19
-0.06
0.01
60
20
-0.05
0.01
60
F-10
AzMERIT
Test
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
Overall
Percent of
Students At
or Above
Standard
21
-0.04
0.01
60
22
-0.02
0.01
58
23
0.02
0.01
57
24
0.17
0.01
50
25
0.18
0.01
50
26
0.19
0.01
50
27
0.20
0.01
49
28
0.27
0.01
47
29
0.33
0.01
44
30
0.34
0.01
44
31
0.36
0.05
42
32
0.43
0.03
41
33
0.46
0.05
39
34
0.50
0.05
37
35
0.57
0.01
36
36
0.60
0.01
34
37
0.64
0.01
33
38
0.64
0.01
33
39
0.67
0.01
31
40
0.69
0.01
29
41
0.73
0.01
29
42
0.74
0.01
29
43
0.77
0.01
28
44
0.77
0.01
28
45
0.82
0.01
27
46
0.83
0.01
27
47
0.89
0.01
24
48
0.94
0.01
24
49
1.02
0.01
21
50
1.05
0.03
19
51
1.06
0.01
18
52
1.08
0.01
18
53
1.12
0.01
18
54
1.16
0.01
15
55
1.25
0.01
15
56
1.35
0.01
13
F-11
Locationof
External
Benchmarks
SBACLevel3;
NAEPProficient;
AzMERIT
Test
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade8ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
Overall
Percent of
Students At
or Above
Standard
57
1.37
0.01
13
58
1.46
0.01
10
59
1.49
0.01
10
60
1.59
0.01
61
1.69
0.01
62
1.72
0.01
63
1.75
0.01
64
1.87
0.01
65
2.11
0.01
66
2.45
0.06
67
3.27
0.02
68
4.02
0.02
69
4.05
0.03
70
4.41
0.03
-1.53
0.02
95
-1.53
0.02
95
-1.14
0.02
87
-0.81
0.04
78
-0.51
0.01
68
-0.50
0.03
67
-0.48
0.01
67
-0.34
0.01
61
-0.33
0.01
60
10
-0.32
0.08
60
11
-0.28
0.01
58
12
-0.26
0.01
58
13
-0.22
0.01
57
14
-0.17
0.03
55
15
-0.17
0.01
55
16
-0.15
0.01
53
17
-0.12
0.01
53
18
-0.04
0.01
50
19
0.05
0.03
47
20
0.14
0.01
43
21
0.16
0.01
41
22
0.24
0.01
40
F-12
Locationof
External
Benchmarks
SBACLevel4
AIMSExceeds;
NAEPAdvacned
AzMERIT
Test
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
Overall
Percent of
Students At
or Above
Standard
23
0.26
0.01
38
24
0.31
0.01
37
25
0.38
0.01
33
26
0.43
0.01
33
27
0.49
0.01
30
28
0.50
0.01
30
29
0.53
0.01
28
30
0.54
0.01
27
31
0.56
0.01
27
32
0.59
0.01
27
33
0.63
0.01
24
34
0.63
0.01
24
35
0.72
0.01
21
36
0.77
0.01
21
37
0.84
0.01
18
38
0.87
0.01
18
39
0.89
0.01
18
40
0.99
0.01
16
41
1.06
0.01
14
42
1.08
0.01
14
43
1.09
0.01
14
44
1.16
0.01
11
45
1.24
0.07
10
46
1.26
0.07
47
1.34
0.01
48
1.36
0.01
49
1.37
0.01
50
1.39
0.01
51
1.46
0.01
52
1.49
0.01
53
1.49
0.01
54
1.51
0.01
55
1.54
0.01
56
1.57
0.01
57
1.62
0.01
58
1.69
0.04
F-13
Locationof
External
Benchmarks
AzMERIT
Test
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade9ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
Overall
Percent of
Students At
or Above
Standard
59
1.71
0.08
60
1.75
0.08
61
2.01
0.04
62
2.11
0.04
63
2.21
0.02
64
2.27
0.02
65
2.44
0.09
66
2.65
0.02
67
3.05
0.02
68
4.29
0.07
69
4.41
0.06
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
-1.60
-1.50
-1.27
-1.14
-0.98
-0.77
-0.57
-0.49
-0.39
-0.31
-0.26
-0.24
0.11
0.15
0.17
0.18
0.20
0.26
0.29
0.32
0.38
0.39
0.39
0.39
0.44
0.45
0.47
0.50
F-14
0.02
0.02
0.02
0.02
0.02
0.07
0.07
0.08
0.07
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.06
0.01
0.01
0.01
0.07
0.07
0.01
0.01
0.01
0.07
0.01
97
96
94
92
88
83
77
74
71
66
66
65
51
48
48
48
46
45
42
42
39
39
39
39
36
36
36
33
Locationof
External
Benchmarks
PISALevel1;AIMS
Approaches;
PISALevel2;
AIMSMeets;
PISALevel3;
AzMERIT
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Grade10ELA
Item
Map
Order
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
Item
Score
Category
1
1
1
2
1
1
1
1
1
1
1
1
1
1
2
1
1
1
1
2
1
2
1
1
1
2
1
1
2
1
1
2
2
1
2
1
2
2
3
3
RP67/
RP50
(EOC
Math)
0.53
0.54
0.57
0.58
0.59
0.61
0.64
0.65
0.72
0.73
0.74
0.76
0.78
0.79
0.79
0.82
0.87
0.88
0.90
0.92
0.94
0.98
1.00
1.02
1.18
1.23
1.24
1.31
1.33
1.38
1.42
1.46
1.56
1.60
1.62
1.87
2.49
2.67
3.17
3.20
Grade10ELA
-1.60
Test
F-15
SE
0.01
0.01
0.01
0.01
0.01
0.01
0.07
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.01
0.07
0.01
0.01
0.02
0.02
0.02
0.03
0.03
0.02
Overall
Percent of
Students At
or Above
Standard
33
33
31
30
30
30
29
29
26
25
25
25
23
23
23
22
20
20
20
20
18
17
17
16
13
12
12
10
10
9
8
7
6
6
5
3
1
0
0
Locationof
External
Benchmarks
PISALevel4;
AIMSExceeds;
PISALevel5;
0
PISALevel1;AIMS
97 Approaches;
AzMERIT
Test
Grade10ELA
Grade10ELA
Grade10ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
SE
0.02
0.02
0.02
Overall
Percent of
Students At
or Above
Standard
96
94
92
Item
Map
Order
2
3
4
Item
Score
Category
1
1
1
RP67/
RP50
(EOC
Math)
-1.50
-1.27
-1.14
-2.08
0.03
96
-1.50
0.06
93
-1.15
0.02
85
-0.96
0.02
81
-0.88
0.07
78
-0.71
0.02
72
-0.61
0.02
69
-0.46
0.02
62
-0.46
0.01
62
10
-0.37
0.01
59
11
-0.25
0.02
54
12
-0.11
0.02
49
13
-0.02
0.01
46
14
-0.02
0.02
46
15
0.00
0.02
44
16
0.01
0.06
44
17
0.10
0.01
41
18
0.13
0.01
40
19
0.21
0.04
37
20
0.30
0.01
34
21
0.32
0.01
34
22
0.34
0.04
32
23
0.36
0.01
32
24
0.36
0.01
32
25
0.40
0.01
31
26
0.42
0.01
31
27
0.43
0.01
29
28
0.50
0.01
28
29
0.52
0.01
26
30
0.61
0.01
23
31
0.62
0.01
23
32
0.63
0.01
23
33
0.64
0.01
22
34
0.67
0.01
22
35
0.69
0.01
22
36
0.69
0.01
22
F-16
Locationof
External
Benchmarks
PISALevel2;
SBACLevel2
ACTCollegeReady;
SBACLevel3
AzMERIT
Test
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
11ELA
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
37
0.71
0.01
Overall
Percent of
Students At
or Above
Standard
20
38
0.71
0.01
20
39
0.82
0.01
17
40
0.83
0.01
17
41
0.84
0.01
17
42
0.92
0.06
15
43
0.93
0.06
15
44
1.02
0.06
12
45
1.04
0.06
12
46
1.08
0.01
12
47
1.08
0.01
12
48
1.19
0.02
10
49
1.22
0.01
50
1.23
0.01
51
1.23
0.01
52
1.27
0.02
53
1.28
0.02
54
1.41
0.02
55
1.53
0.02
56
1.61
0.02
57
1.75
0.07
58
1.84
0.02
59
1.87
0.02
60
1.92
0.02
61
2.13
0.02
62
2.26
0.02
63
2.52
0.06
64
2.72
0.02
65
2.73
0.02
66
3.75
0.05
67
3.89
0.05
-1.31
0.02
96
-0.95
0.01
90
-0.75
0.01
86
-0.62
0.01
83
-0.38
0.01
78
-0.30
0.01
76
-0.30
0.01
76
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
F-17
SE
Locationof
External
Benchmarks
SBACLevel4
AIMSApproaches
AzMERIT
Test
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
-0.24
0.01
Overall
Percent of
Students At
or Above
Standard
75
-0.20
0.01
74
10
-0.16
0.06
73
11
-0.12
0.01
73
12
-0.02
0.01
70
13
-0.02
0.01
70
14
0.02
0.01
69
15
0.06
0.01
67
16
0.13
0.01
66
17
0.15
0.01
66
18
0.34
0.01
60
19
0.39
0.01
59
20
0.45
0.01
57
21
0.50
0.01
57
22
0.56
0.05
54
23
0.59
0.05
54
24
0.65
0.05
51
25
0.78
0.01
48
26
0.79
0.01
48
27
0.83
0.01
48
28
0.88
0.01
47
29
0.90
0.01
45
30
0.91
0.01
45
31
0.94
0.01
45
32
0.95
0.01
45
33
1.04
0.01
42
34
1.09
0.01
42
35
1.11
0.01
42
36
1.14
0.01
38
37
1.18
0.01
38
38
1.25
0.01
37
39
1.31
0.01
35
40
1.34
0.01
35
41
1.47
0.01
32
42
1.52
0.05
32
43
1.63
0.01
28
44
1.72
0.05
25
45
1.83
0.01
25
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
F-18
SE
Locationof
External
Benchmarks
SBACLevel2
AIMSMeets
SBACLevel3
AIMSExceeds;
AzMERIT
Test
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade3Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
46
1.93
0.01
Overall
Percent of
Students At
or Above
Standard
21
47
1.96
0.05
21
48
1.99
0.05
21
49
2.09
0.01
18
50
2.14
0.01
18
51
2.37
0.01
15
52
2.43
0.05
15
53
2.55
0.01
11
54
2.56
0.01
11
55
2.68
0.05
11
56
2.79
0.06
10
57
2.91
0.06
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
58
3.23
0.06
-1.50
0.02
97
-1.22
0.06
93
Locationof
External
Benchmarks
SBACLevel4
-0.73
0.05
NAEPBasic;AIMS
82 Approaches;
-0.58
0.01
77
-0.57
0.01
77
-0.49
0.01
77
-0.47
0.01
74
-0.44
0.01
74
-0.34
0.01
71
10
-0.31
0.01
71
11
-0.30
0.01
71
12
-0.28
0.01
71
13
-0.24
0.01
68
14
-0.22
0.05
68
15
-0.14
0.01
65
16
-0.03
0.01
62
17
0.02
0.01
62
18
0.14
0.01
58
19
0.17
0.01
58
20
0.18
0.01
57
21
0.24
0.05
55
22
0.27
0.01
55
23
0.30
0.01
52
24
0.39
0.01
52
F-19
SBACLevel2
AzMERIT
Test
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade4Math
25
0.40
0.01
Overall
Percent of
Students At
or Above
Standard
52
26
0.42
0.01
49
27
0.50
0.01
49
28
0.54
0.01
45
29
0.54
0.01
45
30
0.60
0.05
45
31
0.60
0.05
45
32
0.65
0.05
43
33
0.72
0.05
42
34
0.74
0.05
42
35
0.76
0.05
42
36
0.78
0.05
38
37
0.89
0.01
36
38
0.89
0.01
36
39
0.91
0.05
35
40
0.95
0.01
35
41
0.97
0.01
35
42
1.01
0.01
35
43
1.02
0.01
33
44
1.15
0.05
31
45
1.24
0.01
28
46
1.35
0.01
25
47
1.38
0.05
25
48
1.44
0.01
25
49
1.45
0.01
22
50
1.45
0.01
22
51
1.47
0.01
22
52
1.55
0.05
22
53
1.66
0.01
19
54
1.73
0.05
19
55
1.85
0.05
16
56
2.07
0.05
AIMSExceeds;
13 SBACLevel4
57
2.11
0.05
13
58
2.20
0.01
10
59
2.21
0.05
10
60
2.23
0.01
10
61
2.33
0.01
10
62
2.39
0.01
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
F-20
SE
Locationof
External
Benchmarks
AIMSMeets;
NAEPProficient
SBACLevel3
AzMERIT
Test
Grade4Math
Grade4Math
Grade4Math
Grade4Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
63
2.41
0.01
Overall
Percent of
Students At
or Above
Standard
7
64
2.66
0.01
65
3.34
0.07
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
66
3.68
0.02
-1.83
0.02
97
-1.52
0.07
92
-1.13
0.01
85
-0.65
0.05
71
-0.53
0.01
66
-0.40
0.01
61
-0.38
0.05
61
-0.35
0.01
61
-0.29
0.01
58
10
-0.20
0.01
56
11
-0.18
0.01
55
12
-0.15
0.01
55
13
-0.11
0.01
55
14
-0.06
0.01
52
15
-0.02
0.01
52
16
-0.01
0.01
52
17
-0.01
0.01
52
18
0.05
0.05
48
19
0.07
0.05
48
20
0.09
0.04
48
21
0.27
0.05
43
22
0.28
0.05
43
23
0.31
0.01
43
24
0.35
0.01
41
25
0.37
0.05
40
26
0.38
0.01
40
27
0.41
0.01
40
28
0.48
0.01
37
29
0.57
0.01
35
30
0.63
0.05
34
31
0.68
0.01
33
32
0.72
0.01
31
33
0.74
0.01
31
34
0.75
0.01
31
F-21
Locationof
External
Benchmarks
NAEPAdvanced
AIMSApproaches;
SBACLevel2;
AIMSMeets;
SBACLevel3;
AzMERIT
Test
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade5Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
35
0.87
0.01
Overall
Percent of
Students At
or Above
Standard
29
36
0.90
0.01
27
37
0.93
0.01
26
38
0.98
0.01
26
39
0.99
0.01
26
40
1.02
0.01
25
41
1.08
0.01
24
42
1.16
0.05
22
43
1.26
0.01
21
44
1.26
0.01
20
45
1.28
0.05
20
46
1.34
0.01
19
47
1.37
0.05
19
48
1.46
0.01
16
49
1.51
0.01
16
50
1.62
0.01
14
51
1.71
0.05
13
52
1.74
0.01
13
53
1.81
0.05
12
54
1.81
0.05
12
55
1.82
0.01
12
56
1.87
0.05
12
57
1.95
0.01
10
58
2.01
0.01
10
59
2.16
0.01
60
2.16
0.01
61
2.29
0.01
62
2.41
0.01
63
2.52
0.06
64
2.67
0.06
65
3.01
0.07
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
Locationof
External
Benchmarks
AIMSExceeds;
SBACLevel4;
66
3.24
0.07
-1.42
0.01
91
-1.02
0.06
80
-0.86
0.01
AIMSApproaches;
73 NAEPBasic;
-0.73
0.01
69
-0.65
0.01
66
-0.64
0.01
66
F-22
AzMERIT
Test
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
-0.58
0.05
Overall
Percent of
Students At
or Above
Standard
66
-0.52
0.05
62
-0.48
0.01
62
10
-0.34
0.01
55
11
-0.31
0.05
55
12
-0.28
0.01
55
13
-0.26
0.01
55
14
-0.23
0.01
51
15
-0.12
0.01
48
16
-0.03
0.01
45
17
0.00
0.01
45
18
0.02
0.05
45
19
0.02
0.01
45
20
0.03
0.01
45
21
0.19
0.05
38
22
0.28
0.01
35
23
0.30
0.01
35
24
0.33
0.01
35
25
0.35
0.01
35
26
0.41
0.01
32
27
0.47
0.01
31
28
0.52
0.01
29
29
0.53
0.01
29
30
0.60
0.01
27
31
0.67
0.01
27
32
0.74
0.01
24
33
0.78
0.01
24
34
0.79
0.01
24
35
0.81
0.01
23
36
0.90
0.01
22
37
0.97
0.01
19
38
0.99
0.01
19
39
1.00
0.01
19
40
1.02
0.01
19
41
1.15
0.01
17
42
1.18
0.05
16
43
1.35
0.01
13
44
1.36
0.01
13
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
F-23
SE
Locationof
External
Benchmarks
SBACLevel2;
AIMSMeets;
NAEPProficient;
SBACLevel3;
AIMSExceeds;
AzMERIT
Test
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade6Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
45
1.43
0.01
Overall
Percent of
Students At
or Above
Standard
13
46
1.55
0.05
11
47
1.66
0.01
48
1.69
0.01
49
1.85
0.06
50
1.85
0.01
51
1.98
0.01
52
2.10
0.01
53
2.14
0.01
54
2.39
0.01
55
2.56
0.07
56
3.64
0.02
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
57
4.04
0.02
-1.37
0.01
86
-0.98
0.01
76
-0.94
0.01
76
-0.73
0.01
69
-0.60
0.01
66
-0.57
0.01
62
-0.53
0.01
62
-0.52
0.05
62
-0.47
0.01
59
10
-0.41
0.01
59
11
-0.19
0.01
52
12
-0.07
0.05
49
13
-0.06
0.05
49
14
-0.06
0.01
47
15
-0.03
0.01
46
16
0.00
0.05
46
17
0.04
0.01
46
18
0.11
0.01
43
19
0.12
0.01
43
20
0.14
0.01
43
21
0.17
0.01
41
22
0.18
0.01
41
23
0.25
0.01
39
24
0.30
0.01
38
25
0.30
0.01
36
F-24
Locationof
External
Benchmarks
SBACLevel4;
NAEPAdvanced
AIMSApproaches;
SBACLevel2;
AIMSMeets
AzMERIT
Test
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade7Math
Grade8Math
Grade8Math
26
0.32
0.01
Overall
Percent of
Students At
or Above
Standard
36
27
0.41
0.01
33
28
0.44
0.01
33
29
0.45
0.01
33
30
0.59
0.05
30
31
0.71
0.01
27
32
0.72
0.05
27
33
0.73
0.01
27
34
0.81
0.01
25
35
0.82
0.01
25
36
0.83
0.01
25
37
0.84
0.01
25
38
0.87
0.05
23
39
0.87
0.01
23
40
0.89
0.01
23
41
0.98
0.05
22
42
1.06
0.06
20
43
1.25
0.01
17
44
1.29
0.01
16
45
1.42
0.05
14
46
1.51
0.06
13
47
1.53
0.01
13
48
1.54
0.01
13
49
1.64
0.01
11
50
1.71
0.01
11
51
1.89
0.06
52
1.95
0.01
53
1.99
0.01
54
2.20
0.06
55
2.23
0.01
56
2.35
0.01
57
2.63
0.07
58
2.87
0.02
59
3.24
0.02
60
3.40
0.02
61
3.43
0.02
-2.04
0.02
93
-1.93
0.02
93
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
F-25
SE
Locationof
External
Benchmarks
SBACLevel3;
AIMSExceeds
SBACLevel4
AzMERIT
Test
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
-1.85
0.06
Overall
Percent of
Students At
or Above
Standard
91
-1.56
0.01
84
-1.54
0.01
84
-1.29
0.07
77
-1.24
0.01
77
-1.21
0.05
73
-1.15
0.05
73
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
SE
Locationof
External
Benchmarks
10
-1.03
0.01
NAEPBasic;AIMS
69 Approaches;
11
-0.89
0.01
65
12
-0.89
0.01
65
13
-0.88
0.05
65
14
-0.74
0.01
61
15
-0.69
0.01
57
16
-0.60
0.01
53
17
-0.53
0.01
53
18
-0.40
0.01
49
19
-0.36
0.01
45
20
-0.31
0.05
45
21
-0.30
0.05
45
22
-0.27
0.06
42
23
-0.19
0.01
42
24
-0.16
0.01
38
25
-0.08
0.05
38
26
-0.01
0.01
35
27
0.03
0.01
35
28
0.04
0.01
35
29
0.09
0.01
32
30
0.09
0.01
NAEPProficient;
32 SBACLevel3;
31
0.20
0.01
30
32
0.23
0.04
30
33
0.34
0.06
27
34
0.36
0.01
27
35
0.38
0.05
24
36
0.43
0.05
24
37
0.46
0.06
24
38
0.47
0.05
24
39
0.59
0.01
22
F-26
SBACLevel2;
AIMSMeets;
AzMERIT
Test
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
Grade8Math
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
40
0.68
0.01
Overall
Percent of
Students At
or Above
Standard
20
41
0.70
0.01
20
42
0.77
0.05
18
43
0.79
0.01
18
44
0.81
0.05
18
45
0.94
0.01
16
46
1.11
0.06
13
47
1.15
0.05
13
48
1.26
0.01
11
49
1.29
0.01
11
50
1.37
0.01
10
51
1.37
0.01
10
52
1.41
0.01
10
53
1.41
0.01
10
54
1.42
0.01
55
1.53
0.01
56
1.58
0.01
57
1.67
0.01
58
1.67
0.01
59
1.85
0.01
60
1.93
0.01
61
2.13
0.01
62
2.32
0.02
63
2.39
0.02
64
2.51
0.07
65
2.52
0.02
66
2.60
0.02
67
2.70
0.02
68
2.87
0.02
69
3.37
0.02
70
3.91
0.02
-1.57
0.01
88
-1.42
0.06
84
-1.24
0.06
79
-1.18
0.01
74
-1.18
0.01
74
-1.14
0.01
74
-1.12
0.06
74
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
F-27
SE
Locationof
External
Benchmarks
AIMSExceeds
SBACLevel4
NAEPAdvanced
AzMERIT
Test
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
-1.01
0.01
Overall
Percent of
Students At
or Above
Standard
69
-0.99
0.01
67
10
-0.98
0.01
64
11
-0.87
0.01
59
12
-0.80
0.01
59
13
-0.78
0.01
59
14
-0.77
0.06
55
15
-0.70
0.06
55
16
-0.69
0.01
55
17
-0.69
0.01
55
18
-0.64
0.01
51
19
-0.57
0.01
51
20
-0.57
0.01
51
21
-0.57
0.01
50
22
-0.53
0.01
48
23
-0.53
0.01
48
24
-0.50
0.01
48
25
-0.33
0.01
41
26
-0.32
0.01
41
27
-0.29
0.01
41
28
-0.29
0.01
41
29
-0.28
0.01
41
30
-0.19
0.01
38
31
-0.12
0.06
35
32
-0.03
0.01
32
33
-0.03
0.01
32
34
0.00
0.01
32
35
0.06
0.01
30
36
0.09
0.01
30
37
0.10
0.01
30
38
0.18
0.01
27
39
0.23
0.06
25
40
0.27
0.01
25
41
0.28
0.01
25
42
0.33
0.06
23
43
0.41
0.01
23
44
0.41
0.01
23
45
0.42
0.01
22
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
F-28
SE
Locationof
External
Benchmarks
AzMERIT
Test
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
AlgebraI
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
46
0.47
0.01
Overall
Percent of
Students At
or Above
Standard
21
47
0.53
0.01
20
48
0.62
0.07
18
49
0.82
0.07
16
50
0.94
0.01
14
51
0.95
0.01
14
52
0.99
0.02
12
53
1.03
0.02
12
54
1.04
0.07
12
55
1.16
0.02
11
56
1.27
0.08
57
1.45
0.08
58
1.51
0.08
59
1.60
0.08
60
1.70
0.09
61
1.81
0.09
62
1.97
0.09
63
2.06
0.09
64
2.08
0.09
65
2.15
0.02
66
2.20
0.02
67
2.30
0.10
68
2.33
0.10
69
2.77
0.02
70
2.81
0.02
-2.35
0.02
89
-2.17
0.06
84
-2.17
0.02
84
-1.99
0.06
79
-1.79
0.06
PISALevel2
69 AIMSApproaches
-1.68
0.01
67
-1.64
0.01
64
-1.64
0.06
64
-1.64
0.01
64
10
-1.61
0.06
64
11
-1.59
0.06
62
12
-1.54
0.01
62
13
-1.44
0.06
57
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
F-29
SE
Locationof
External
Benchmarks
PISALevel1;
AzMERIT
Test
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
14
-1.39
0.06
Overall
Percent of
Students At
or Above
Standard
57
15
-1.37
0.01
53
16
-1.37
0.01
53
17
-1.34
0.01
53
18
-1.30
0.01
52
19
-1.26
0.01
52
20
-1.16
0.01
47
21
-1.15
0.01
47
22
-1.12
0.06
44
23
-1.02
0.01
43
24
-1.02
0.01
43
25
-0.95
0.01
39
26
-0.86
0.01
37
27
-0.83
0.01
36
28
-0.76
0.01
34
29
-0.75
0.06
34
30
-0.58
0.02
30
31
-0.50
0.02
28
32
-0.40
0.02
25
33
-0.33
0.02
24
34
-0.30
0.06
23
35
-0.27
0.02
23
36
-0.27
0.07
23
37
-0.15
0.02
20
38
-0.14
0.06
20
39
-0.12
0.02
20
40
-0.10
0.02
20
41
0.10
0.06
16
42
0.16
0.02
14
43
0.24
0.02
14
44
0.27
0.02
13
45
0.27
0.02
13
46
0.33
0.02
12
47
0.48
0.07
11
48
0.61
0.02
49
0.78
0.02
50
0.85
0.08
51
0.87
0.02
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
F-30
SE
Locationof
External
Benchmarks
AIMSMeets
PISALevel3
AIMSExceeds
PISALevel4
PISALevel5;
AzMERIT
Test
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
Geometry
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
52
0.96
0.02
Overall
Percent of
Students At
or Above
Standard
6
53
1.12
0.02
54
1.14
0.02
55
1.15
0.02
56
1.44
0.02
57
1.50
0.02
58
1.65
0.02
59
1.80
0.03
60
1.81
0.03
61
2.00
0.03
62
2.28
0.03
63
2.38
0.03
64
2.66
0.04
65
2.95
0.05
66
3.04
0.06
-2.47
0.02
86
-2.36
0.06
82
-2.32
0.02
82
-2.31
0.06
82
-2.29
0.02
82
-2.25
0.06
76
-2.02
0.02
70
-1.99
0.02
70
-1.98
0.06
70
10
-1.98
0.02
70
11
-1.96
0.06
70
12
-1.71
0.02
58
13
-1.53
0.06
53
14
-1.50
0.02
53
15
-1.49
0.06
53
16
-1.43
0.02
48
17
-1.36
0.06
48
18
-1.31
0.02
47
19
-1.25
0.06
44
20
-1.20
0.06
42
21
-1.18
0.01
42
22
-1.17
0.02
42
23
-1.15
0.02
40
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
F-31
SE
Locationof
External
Benchmarks
PISALevel6
AIMSApproaches
AIMSMeets
SBACLevel2
AzMERIT
Test
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
24
-1.02
0.02
Overall
Percent of
Students At
or Above
Standard
36
25
-0.98
0.06
36
26
-0.94
0.02
35
27
-0.90
0.02
32
28
-0.85
0.02
SBACLevel3
32 AIMSExceeds
29
-0.78
0.07
29
30
-0.77
0.02
29
31
-0.70
0.06
28
32
-0.68
0.02
28
33
-0.60
0.02
26
34
-0.57
0.02
25
35
-0.55
0.02
25
36
-0.52
0.06
23
37
-0.46
0.07
23
38
-0.40
0.07
21
39
-0.30
0.02
18
40
-0.19
0.02
18
41
-0.18
0.02
16
42
-0.14
0.07
16
43
0.06
0.02
12
44
0.09
0.02
12
45
0.22
0.02
11
46
0.24
0.08
11
47
0.34
0.02
48
0.45
0.08
49
0.57
0.02
50
0.70
0.09
51
0.80
0.02
52
0.84
0.02
53
0.97
0.02
54
0.98
0.02
55
1.13
0.03
56
1.17
0.03
57
1.17
0.03
58
1.18
0.03
59
1.41
0.03
60
1.67
0.03
61
1.72
0.03
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
F-32
SE
Locationof
External
Benchmarks
ACTCollegeReady
SBACLevel4
AzMERIT
Test
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
AlgebraII
62
1.83
0.03
Overall
Percent of
Students At
or Above
Standard
1
63
1.96
0.03
64
2.03
0.03
65
2.07
0.04
66
2.07
0.04
67
2.22
0.04
68
3.01
0.05
Item
Map
Order
Item
Score
Category
RP67/
RP50
(EOC
Math)
F-33
SE
Locationof
External
Benchmarks
AzMERIT
Appendix
StandardSettingTechnicalReport
AzMERIT
StandardSettingTechnicalReport
FigureG1.OIBItemDataPlotGrade3ELA
G-1
AzMERIT
StandardSettingTechnicalReport
FigureG2.OIBItemDataPlotGrade4ELA
G-2
AzMERIT
StandardSettingTechnicalReport
FigureG3.OIBItemDataPlotGrade5ELA
G-3
AzMERIT
StandardSettingTechnicalReport
FigureG4.OIBItemDataPlotGrade6ELA
G-4
AzMERIT
StandardSettingTechnicalReport
FigureG5.OIBItemDataPlotGrade7ELA
G-5
AzMERIT
StandardSettingTechnicalReport
FigureG6.OIBItemDataPlotGrade8ELA
G-6
AzMERIT
StandardSettingTechnicalReport
FigureG7.OIBItemDataPlotGrade9ELA
G-7
AzMERIT
StandardSettingTechnicalReport
FigureG8.OIBItemDataPlotGrade10ELA
G-8
AzMERIT
StandardSettingTechnicalReport
FigureG9.OIBItemDataPlotGrade11ELA
G-9
AzMERIT
StandardSettingTechnicalReport
FigureG10.OIBItemDataPlotGrade3Math
G-10
AzMERIT
StandardSettingTechnicalReport
FigureG11.OIBItemDataPlotGrade4Math
G-11
AzMERIT
StandardSettingTechnicalReport
FigureG12.OIBItemDataPlotGrade5Math
G-12
AzMERIT
StandardSettingTechnicalReport
FigureG13.OIBItemDataPlotGrade6Math
G-13
AzMERIT
StandardSettingTechnicalReport
FigureG14.OIBItemDataPlotGrade7Math
G-14
AzMERIT
StandardSettingTechnicalReport
FigureG15.OIBItemDataPlotGrade8Math
G-15
AzMERIT
StandardSettingTechnicalReport
FigureG16.OIBItemDataPlotAlgebraI
G-16
AzMERIT
StandardSettingTechnicalReport
FigureG17.OIBItemDataPlotGeometry
G-17
AzMERIT
StandardSettingTechnicalReport
FigureG18.OIBItemDataPlotAlgebraII
G-18
AzMERIT
StandardSettingTechnicalReport
Appendix
AzMERIT
StandardSettingTechnicalReport
Subject: ____________________________
Panelist ID number _____________
Yes
No
a.
b.
The training fully explained the concept of a student who just barely
meets the criteria described in the Arizona Performance Level
Descriptors.
c.
The workshop training has prepared me to review the Ordered Item Book
(OIB).
d.
I have answered, Yes to the above questions and I understand what I need to do to place my
Bookmarks.
Yes _____
No _____
Initials __________
No _____
Initials __________
Following the additional training, I now feel sufficiently trained on what I need to do to place my
Bookmarks.
Yes _____
No _____
Initials __________
H-1
AzMERIT
StandardSettingTechnicalReport
Test ____________________________
Panelist ID number _____________
Yes
No
a.
b.
The training fully explained the concept of a student who just barely
meets the criteria described in the Arizona Performance Level
Descriptors.
c.
The workshop training has prepared me to review the Ordered Item Book
(OIB).
d.
e.
The training fully explained the panel feedback data that was presented.
f.
The training fully explained the student impact data that was presented.
I have answered, Yes to the above questions and I understand what I need to do to place my
Bookmarks.
Yes _____
No _____
Initials __________
No _____
Initials __________
Following the additional training, I now feel sufficiently trained on what I need to do to place my
Bookmarks.
Yes _____
No _____
Initials __________
H-2
AzMERIT
StandardSettingTechnicalReport
Appendix
AzMERIT
StandardSettingTechnicalReport
I-1
AzMERIT
StandardSettingTechnicalReport
itemswereusedtoassessthesamestandardsbetweentheonlineandpapertestforms.Thetest
characteristiccurvesinAppendixI.1showthatthedistributionoftestinformationacrosstheonline
andpapertestformswasnearlyidentical,indicatingthatalthoughtheonlineandpapertestforms
werenotidentical,theformsmeasuredstudentachievementequivalentlyacrosstheability
distribution.Themodecomparabilityanalyseswerebasedonlyontheitemscommontobothforms.
Table 1: Number of Common Items Between Online and Paper Test Forms
Grade
Subject
3
4
5
6
7
8
9
10
11
ELA
ELA
ELA
ELA
ELA
ELA
ELA
ELA
ELA
3
4
5
6
7
8
Math
Math
Math
Math
Math
Math
AlgebraI
Geometry
AlgebraII
NumberOfItems
TotalOperational
CommonItems
ELA
42
41
42
37
42
41
42
42
42
40
42
40
44
43
44
44
44
42
Math
45
43
45
45
45
45
47
46
47
47
47
46
47
46
47
46
47
46
Matched Samples
Thefollowingprocedureswereusedtodefinethematchedsamplesbetweentheonlineandpapertest
administrationmodes.
1.Forstudentsparticipatinginthepapertestadministration,2015AzMERITrawscoreswereregressed
onpreviousspringachievement,individualleveldemographicvariablesandschoollevelvariables.The
previousachievementindicatorwasthe2014AIMSscore,whereavailable,and/orthepreviousyear
Stanford10scores.Theindividualdemographicvariablesincludedethnicity,gender,freeandreduced
lunch(FRL)eligibility,andEnglishlanguagelearner(ELL)andspecialeducation(SPED)status.School
levelvariablesincludedratioofAfricanAmericanstudents,ratioofHispanicstudents,ratioofmulti
ethnicstudents,ratioofFRL,ratioofELL,ratioofSPEDandaverageachievementasindexedbythe2014
AIMSscores.Theratioofgroupenrollmentinschoolsforthedemographicvariableswascategorizedas
loworhighbymediansplit,whileschoollevelachievementwasclassifiedbyquintile.Variableswere
I-2
AzMERIT
StandardSettingTechnicalReport
enteredintotheequationinastepwisefashionsothatonlyvariablesaccountingforsignificantvariation
inthepredictionof2015AzMERITtestperformancewereincludedinthefinalregressionequation:
whereY isthepredicted2015AzMERITrawscore,nreferstotheestimatedregressionweightfor
covariateXn.
2.Withtheobtainedregressionweights,thepredictionequationwasappliedtoallstudents
participatinginAzMERITacrosstestadministrationmodes,yieldingapredicted2015AzMERITrawscore
foreachstudent.
3.Usingthepredicted2015rawscoredistribution,thesamplewiththesmallernumberofstudentswas
dividedin20equalsizedgroups.Thepredictedrawscoredistributioncutpointsdeterminedbythe
equalsizedgroupswasusedtodividestudentsinthelargersampleintoeachofthe20abilitylevel
groups.Withineachofthe20abilitygroupsinthelargersample,arandomsampleofstudentswas
drawn,equalinsizetothenumberofonlinestudentsineachofthepredictedabilitylevelgroups.Table
2showsthesizeofthematchedsamplesforeachoftheAzMERITassessments.
Subject
3
4
5
6
7
8
9
10
11
ELA
ELA
ELA
ELA
ELA
ELA
ELA
ELA
ELA
3
4
5
6
7
8
Math
Math
Math
Math
Math
Math
AlgebraI
Geometry
AlgebraII
SizeofMatchedSamples
ELA
35220
33380
32880
34420
33080
34360
20420
20400
15680
Math
28400
30700
31140
37420
31780
32140
25760
19520
16360
I-3
AzMERIT
StandardSettingTechnicalReport
Results
IRTparameterestimateswerecalibratedindependentlyforthematchedonlineandpapertest
administrationmodesamples.Thelinkingconstantnecessarytobringthematchedsamplepaperitem
parametersontothematchedsampleonlinescalewasthencomputed.Thelinkageswerecomputedin
twoways.Meanlinkingwastakenasthedifferencebetweentheaverageitemdifficultyestimatesfrom
thematchedsamplepapercalibrationandtheaverageitemdifficultyestimatesfromthematched
sampleonlineitemparameterestimates.Meansigmalinkingequatingwasalsousedtoplacethepaper
itemparametersontheonlinescale.
Table2showsthemeandifficultyoftestitemsresultingfromindependentcalibrationsbasedonthe
matchedsamplesfromtheonlineandpapertestadministrations,aswellasthelinkingconstants
necessarytobringthepaperitemparametersontotheonlinescale.Linkingconstantswerebasedon
thedifferencebetweenthemeanitemdifficultiesbetweentheonlineandpaperformsusingall
commonitemsaslinkingitems.Meansigmaequatingconstantsarealsoprovided.Asthelinking
constantsindicate,parameterestimatesresultingfromtheindependentcalibrationsofthepaperand
onlineassessmentsarequitecomparable.Thelargestidentifiedmodeeffectwasforitemsonthegrade
3ELAassessmentwhichwere,onaverage,slightlymoredifficultforstudentswhowereadministered
theassessmentonline.Examinationofthelinkeditemparameterestimatesindicatedthatitemswith
thegreatestdiscrepancybetweenonlineandpaperwerenotisolatedwithinaparticularcontent
standardoritemtype.Conversely,itemsontheAlgebraIIassessmentwereveryslightlyeasierfor
studentswhenadministeredonlinethanonpaper.Otherwise,however,meandifficultyofitem
parameterestimatesacrossmodesarecomparable,aspresentedinTable3.
I-4
AzMERIT
StandardSettingTechnicalReport
Grade
Subject
MeanItemDifficulties
Online
Paper
3
4
5
6
7
8
9
10
11
ELA
ELA
ELA
ELA
ELA
ELA
ELA
ELA
ELA
0.10
0.14
0.09
0.17
0.01
0.05
0.11
0.06
0.01
0.03
0.18
0.06
0.13
0.01
0.03
0.07
0.07
0.01
3
4
5
6
7
8
Math
Math
Math
Math
Math
Math
AlgebraI
Geometry
AlgebraII
0.01
0.00
0.00
0.03
0.00
0.02
0.01
0.00
0.07
0.04
0.00
0.00
0.03
0.00
0.03
0.03
0.01
0.01
MeanLinking
Constant
ELA
0.13
0.04
0.04
0.04
0.01
0.02
0.03
0.00
0.00
Math
0.03
0.00
0.00
0.00
0.00
0.01
0.01
0.00
0.06
MeanSigmaLinkingConstants
Slope
Intercept
1.02
0.96
0.93
0.94
0.89
0.94
0.91
0.89
0.83
0.13
0.03
0.04
0.05
0.01
0.02
0.04
0.00
0.00
0.96
0.92
0.93
0.95
0.99
1.01
0.99
0.97
1.00
0.03
0.00
0.00
0.00
0.00
0.01
0.01
0.00
0.06
Tohelpevaluatethemagnitudeoftheseresults,Table4presents,foreachtest,theexpectedscale
scoredifferencethatwouldbeobservedifthemodecorrectionconstantwasappliedtothescoringof
paperbasedassessmentsrelativetoscoringpapertestsusingtheonlinebankparameters.Forexample,
becausetheitemsinthegrade3ELAassessmentareslightlyeasierwhenadministeredonpaperthan
online,theabilityofstudentstakingpaperassessmentsisslightlyoverestimatedwhenscoredusingthe
onlinebankitemparameters.Inthiscase,applyingthemodecorrectionwouldeffectivelylowerthe
observedscalescoreforpapertestersbyaboutfourpointsontheAzMERITscale(aboutonerawscore
point),andwouldresultinapproximately1.6%fewerstudents,statewide,notmeetingtheproficient
performancestandard.Conversely,becausetheAlgebraIIitemsare,onaverage,slightlymoredifficult
whenadministeredonpaperthanonline,themodecorrectionwouldeffectivelyaddtwoscalescore
pointstopapertesttakers,butwouldonlyincreasethepercentageofstudentsmeetingthepartially
proficientperformancestandard.
I-5
AzMERIT
StandardSettingTechnicalReport
Table 4: Anticipated Impact of Applying the Mode Correction Constant versus Scoring All
Assessments on the AzMERIT Reference Scale
Grade
Subject
3
4
5
6
7
8
9
10
11
3
4
5
ELA
ELA
ELA
ELA
ELA
ELA
ELA
ELA
ELA
Math
Math
Math
6
7
8
Math
Math
Math
AlgebraI
Geometry
AlgebraII
Correction
Magnitudein
AzMERIT
ScaleScore
4
+1
1
1
0
1
1
0
0
1
0
0
0
0
0
0
0
+2
ApproximateChangeinPercentageofStudentsReaching
EachPerformanceStandard
PartiallyProficient
1.6%
1.6%
1.7%
0.0%
0.0%
1.6%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
Proficient
1.6%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
HighlyProficient
2.0%
0.0%
0.0%
0.7%
0.0%
1.1%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
2.3%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
0.0%
WenotethatADEindependentlyinvestigatedmodecomparabilityusingastrategybasedonthe
operationaltestadministrationstatewide(Scott,2015)andthisstudyisincludedinAppendixI.3.Inher
study,Scott(2015)firstidentifiedwhichArizonaschoolselectedtoadministerAzMERITonlineand
whichonpaper,andthenexaminedthetwosamplesofschoolsforanydifferencesinperformanceon
thespring2014administrationofAIMS.Havingfoundnodifferenceinmean2014performance
betweenthetwogroups,therewouldbenoexpectationforperformancedifferencesonAzMERIT
exceptasafunctionoftestadministrationmode.Followingthespring2015administrationofAzMERIT,
ADEexaminedtheperformanceofschoolsparticipatingonlineandonpaper,andfoundperformanceon
theAzMERITtobecomparablebetweenthetwosetsofschools,asexpectedbasedontheirspring2014
AIMSresults.
I-6
AzMERIT
StandardSettingTechnicalReport
Conclusion
Themodecomparabilitystudydescribedinthisdocumentexaminedthecomparabilityofitem
parametersandresultingtestscoresfromtheonlineandpaperadministrationsofthespring2015
AzMERITassessmentsinELAandmath.Thematchedsamplesanalysesrevealedgenerallythatitem
difficultyestimatesandresultingstudentabilityestimateswerecomparableacrosstestadministration
modes.SmallmodeeffectswereidentifiedforsomegradesintheELAassessments,withitemsinthe
grade3assessmentprovingslightlymoredifficultwhenadministeredonline.Bycontrast,itemsonthe
AlgebraIIassessmentwereslightlyeasierwhenadministeredonline.Evenforthelargesteffectingrade
3ELA,themagnitudeofthemodedifferencewasquitesmall,amountingtojustunderonerawscore
point(approximatelyfourpointontheAzMERITscale),impactingtheproficientratebyabout1.6%.
Giventhegenerallystrongcomparabilityofitemdifficultyacrossmode,ADEmayconsideradoptinga
singlesetofbankparametersforscoringstudentresponsesontheAzMERITacrosstheonlineandpaper
testadministrationmodes.
Reference
Scott,L.(2015).AnalysisofModeComparabilityofAzMERITsOnlineandPaperAdministrationsfor
Spring2015.Unpublishedmanuscript,ArizonaDepartmentofEducation.
Way,W.D.,Davis,L . L.,&Fitzpatrick,S.(2006,April).Scorecomparabilityofonlineandpaper
administrationsoftheTexasAssessmentofKnowledgeandSkills.Paperpresentedatthe
annualmeetingoftheNationalCouncilonMeasurementinEducation,SanFrancisco,CA.
I-7
AzMERIT
StandardSettingTechnicalReport
I-8
AzMERIT
StandardSettingTechnicalReport
FigureI.1.2.TestCharacteristicCurvesforOnlineandPaperFormsGrade4ELA
FigureI.1.3.TestCharacteristicCurvesforOnlineandPaperFormsGrade5ELA
I-9
AzMERIT
StandardSettingTechnicalReport
FigureI.1.4.TestCharacteristicCurvesforOnlineandPaperFormsGrade6ELA
FigureI.1.5.TestCharacteristicCurvesforOnlineandPaperFormsGrade7ELA
I-10
AzMERIT
StandardSettingTechnicalReport
FigureI.1.6.TestCharacteristicCurvesforOnlineandPaperFormsGrade8ELA
FigureI.1.7.TestCharacteristicCurvesforOnlineandPaperFormsGrade9ELA
I-11
AzMERIT
StandardSettingTechnicalReport
FigureI.1.8.TestCharacteristicCurvesforOnlineandPaperFormsGrade10ELA
FigureI.1.9.TestCharacteristicCurvesforOnlineandPaperFormsGrade11ELA
I-12
AzMERIT
StandardSettingTechnicalReport
FigureI.1.10.TestCharacteristicCurvesforOnlineandPaperFormsGrade3Math
FigureI.1.11.TestCharacteristicCurvesforOnlineandPaperFormsGrade4Math
I-13
AzMERIT
StandardSettingTechnicalReport
FigureI.1.12.TestCharacteristicCurvesforOnlineandPaperFormsGrade5Math
FigureI.1.13.TestCharacteristicCurvesforOnlineandPaperFormsGrade6Math
I-14
AzMERIT
StandardSettingTechnicalReport
FigureI.1.14.TestCharacteristicCurvesforOnlineandPaperFormsGrade7Math
FigureI.1.15.TestCharacteristicCurvesforOnlineandPaperFormsGrade8Math
I-15
AzMERIT
StandardSettingTechnicalReport
FigureI.1.16.TestCharacteristicCurvesforOnlineandPaperFormsAlgebraI
FigureI.1.17.TestCharacteristicCurvesforOnlineandPaperFormsGeometry
I-16
AzMERIT
StandardSettingTechnicalReport
FigureI.1.18.TestCharacteristicCurvesforOnlineandPaperFormsAlgebraII
I-17
AzMERIT
StandardSettingTechnicalReport
OnlineSample
0.51
0.49
0.83
0.08
0.04
0.09
0.47
0.01
0.63
0.16
0.11
0.00
27.36
7.99
0.13
1.90
52.69
27.68
PaperSample
0.51
0.49
0.85
0.08
0.04
0.07
0.46
0.01
0.53
0.16
0.12
0.00
27.36
7.99
0.13
1.89
52.58
27.65
I-18
AzMERIT
StandardSettingTechnicalReport
TableI.2.2.ComparisonofMatchedSamplesGrade3Math
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014MathAchievementMean
Spring2014MathAchievementStandardDeviation
OnlineSample
0.51
0.49
0.83
0.07
0.04
0.09
0.46
0.01
0.63
0.16
0.11
0.00
27.83
6.92
0.15
1.97
53.26
29.53
PaperSample
0.50
0.50
0.85
0.07
0.04
0.06
0.47
0.01
0.54
0.16
0.12
0.00
27.81
6.93
0.13
1.95
52.69
29.59
TableI.2.3.ComparisonofMatchedSamplesGrade4ELA
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014ReadingAchievementMean
Spring2014ReadingAchievementStandardDeviation
I-19
OnlineSample
0.51
0.49
0.83
0.07
0.03
0.09
0.46
0.01
0.62
0.11
0.12
0.00
30.06
8.17
0.13
1.93
51.51
29.05
PaperSample
0.51
0.49
0.84
0.07
0.04
0.07
0.46
0.01
0.54
0.11
0.13
0.00
30.06
8.17
0.13
1.94
51.26
28.94
AzMERIT
StandardSettingTechnicalReport
TableI.2.4.ComparisonofMatchedSamplesGrade4Math
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014MathAchievementMean
Spring2014MathAchievementStandardDeviation
OnlineSample
0.51
0.49
0.83
0.07
0.04
0.10
0.46
0.01
0.62
0.11
0.12
0.00
26.07
7.76
0.07
1.88
51.46
28.96
PaperSample
0.50
0.50
0.85
0.07
0.04
0.07
0.45
0.01
0.53
0.11
0.13
0.00
26.08
7.77
0.06
1.88
51.16
28.83
TableI.2.5.ComparisonofMatchedSamplesGrade5ELA
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014ReadingAchievementMean
Spring2014ReadingAchievementStandardDeviation
I-20
OnlineSample
0.51
0.49
0.83
0.07
0.03
0.10
0.45
0.01
0.62
0.11
0.11
0.00
28.57
7.98
0.10
1.92
50.80
29.01
PaperSample
0.51
0.49
0.84
0.07
0.04
0.07
0.46
0.01
0.53
0.11
0.13
0.00
28.57
8.00
0.10
1.92
50.58
28.86
AzMERIT
StandardSettingTechnicalReport
TableI.2.6.ComparisonofMatchedSamplesGrade5Math
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014MathAchievementMean
Spring2014MathAchievementStandardDeviation
OnlineSample
0.51
0.49
0.83
0.07
0.03
0.10
0.45
0.01
0.62
0.11
0.11
0.00
22.93
8.32
0.03
1.84
51.17
29.09
PaperSample
0.51
0.49
0.84
0.07
0.04
0.07
0.46
0.01
0.52
0.11
0.12
0.00
22.93
8.33
0.02
1.85
50.66
28.85
TableI.2.7.ComparisonofMatchedSamplesGrade6ELA
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014ReadingAchievementMean
Spring2014ReadingAchievementStandardDeviation
I-21
OnlineSample
0.51
0.49
0.84
0.07
0.03
0.08
0.46
0.01
0.61
0.08
0.11
0.00
28.67
8.57
0.10
1.92
50.67
27.38
PaperSample
0.51
0.49
0.84
0.07
0.04
0.08
0.45
0.01
0.52
0.08
0.13
0.00
28.68
8.57
0.10
1.93
50.61
27.25
AzMERIT
StandardSettingTechnicalReport
TableI.2.8.ComparisonofMatchedSamplesGrade6Math
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014MathAchievementMean
Spring2014MathAchievementStandardDeviation
OnlineSample
0.51
0.49
0.84
0.07
0.03
0.08
0.45
0.01
0.61
0.08
0.11
0.00
23.20
8.10
0.02
1.86
50.84
28.91
PaperSample
0.50
0.50
0.84
0.07
0.04
0.08
0.44
0.01
0.52
0.08
0.12
0.00
23.20
8.11
0.01
1.87
50.75
28.68
TableI.2.9.ComparisonofMatchedSamplesGrade7ELA
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014ReadingAchievementMean
Spring2014ReadingAchievementStandardDeviation
I-22
OnlineSample
0.51
0.49
0.85
0.07
0.03
0.08
0.46
0.01
0.59
0.05
0.10
0.00
29.61
8.62
0.15
1.98
50.89
27.23
PaperSample
0.51
0.49
0.83
0.07
0.04
0.09
0.45
0.01
0.52
0.06
0.12
0.01
29.62
8.63
0.15
1.99
50.64
27.17
AzMERIT
StandardSettingTechnicalReport
TableI.2.10.ComparisonofMatchedSamplesGrade7Math
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014MathAchievementMean
Spring2014MathAchievementStandardDeviation
OnlineSample
0.51
0.49
0.85
0.07
0.03
0.08
0.46
0.01
0.59
0.05
0.11
0.00
23.05
8.35
0.01
1.88
50.58
28.79
PaperSample
0.50
0.50
0.83
0.07
0.04
0.08
0.45
0.01
0.52
0.05
0.12
0.00
23.05
8.36
0.01
1.89
50.36
28.56
TableI.2.11.ComparisonofMatchedSamplesGrade8ELA
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014ReadingAchievementMean
Spring2014ReadingAchievementStandardDeviation
I-23
OnlineSample
0.51
0.49
0.85
0.07
0.03
0.07
0.45
0.01
0.58
0.05
0.10
0.00
31.30
8.40
0.15
1.95
51.25
27.33
PaperSample
0.51
0.49
0.83
0.07
0.04
0.08
0.44
0.01
0.51
0.04
0.11
0.00
31.30
8.40
0.15
1.96
51.34
27.20
AzMERIT
StandardSettingTechnicalReport
TableI.2.12.ComparisonofMatchedSamplesGrade8Math
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014MathAchievementMean
Spring2014MathAchievementStandardDeviation
OnlineSample
0.51
0.49
0.85
0.07
0.03
0.07
0.45
0.01
0.58
0.05
0.10
0.00
22.38
8.65
0.01
1.84
50.96
28.98
PaperSample
0.51
0.49
0.84
0.07
0.04
0.08
0.45
0.01
0.52
0.04
0.11
0.00
22.39
8.66
0.00
1.85
50.62
28.87
TableI.2.13.ComparisonofMatchedSamplesGrade9ELA
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014ReadingAchievementMean
Spring2014ReadingAchievementStandardDeviation
I-24
OnlineSample
0.51
0.49
0.84
0.07
0.04
0.08
0.38
0.01
0.45
0.02
0.09
0.00
27.69
7.24
0.17
1.98
54.42
28.18
PaperSample
0.50
0.50
0.86
0.07
0.05
0.05
0.48
0.01
0.51
0.03
0.08
0.01
27.69
7.27
0.16
1.99
54.56
28.00
AzMERIT
StandardSettingTechnicalReport
TableI.2.14.ComparisonofMatchedSamplesAlgebraI
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014MathAchievementMean
Spring2014MathAchievementStandardDeviation
OnlineSample
0.51
0.49
0.85
0.07
0.03
0.07
0.41
0.01
0.47
0.02
0.09
0.00
21.46
7.72
0.15
1.87
54.92
28.45
PaperSample
0.50
0.50
0.86
0.06
0.05
0.05
0.47
0.01
0.50
0.02
0.09
0.01
21.46
7.74
0.14
1.87
55.13
28.27
TableI.2.15.ComparisonofMatchedSamplesGrade10ELA
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014ReadingAchievementMean
Spring2014ReadingAchievementStandardDeviation
I-25
OnlineSample
0.51
0.49
0.84
0.08
0.04
0.08
0.38
0.01
0.43
0.01
0.09
0.00
29.75
8.38
0.20
1.97
55.03
26.24
PaperSample
0.50
0.50
0.86
0.07
0.04
0.05
0.46
0.01
0.50
0.02
0.08
0.01
29.74
8.39
0.19
1.97
55.08
26.27
AzMERIT
StandardSettingTechnicalReport
TableI.2.16.ComparisonofMatchedSamplesGeometry
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014MathAchievementMean
Spring2014MathAchievementStandardDeviation
OnlineSample
0.51
0.49
0.84
0.07
0.04
0.08
0.38
0.01
0.44
0.01
0.08
0.00
16.65
6.79
0.07
1.94
55.32
27.26
PaperSample
0.51
0.49
0.86
0.07
0.05
0.05
0.46
0.01
0.49
0.02
0.07
0.01
16.66
6.81
0.06
1.95
55.81
26.95
TableI.2.17.ComparisonofMatchedSamplesGrade11ELA
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014ReadingAchievementMean
Spring2014ReadingAchievementStandardDeviation
I-26
OnlineSample
0.52
0.48
0.84
0.07
0.05
0.09
0.36
0.01
0.40
0.01
0.09
0.00
25.99
7.00
0.27
2.15
57.63
24.57
PaperSample
0.51
0.49
0.86
0.07
0.04
0.05
0.48
0.01
0.49
0.01
0.09
0.01
26.00
7.00
0.26
2.16
57.70
24.55
AzMERIT
StandardSettingTechnicalReport
TableI.2.18.ComparisonofMatchedSamplesAlgebraII
DemographicandAchievementVariables
Male
Female
White
Black
Asian
AmericanIndian
Hispanic
PacificIslander
FreeandReducedLunch(FRL)
EnglishLanguageLearner(ELL)
SpecialEducation(SPED)
Migrant
PredictedScoreMean
PredictedScoreStandardDeviation
PredictedScoreSkewness
PredictedScoreKurtosis
Spring2014MathAchievementMean
Spring2014MathAchievementStandardDeviation
I-27
OnlineSample
0.50
0.50
0.84
0.08
0.05
0.08
0.36
0.01
0.41
0.01
0.06
0.00
14.09
6.13
0.45
2.34
63.26
24.70
PaperSample
0.48
0.52
0.86
0.07
0.05
0.05
0.47
0.01
0.49
0.01
0.05
0.01
14.11
6.14
0.44
2.34
64.22
24.59
AzMERIT
StandardSettingTechnicalReport
I-28
AzMERIT
StandardSettingTechnicalReport
In spring of 2015, the Arizona Department of Education (ADE) instituted a new assessment
(Arizonas Measurement of Educational Readiness to Inform Teaching, AzMERIT) in compliance
with state and federal mandates and aligned with the Arizona State Board of Educations (State
Board) adopted values which in part state that It is essential that the new statewide assessment:
- Use 21st Century technology to deliver the assessment, as available infrastructure allows. The
full March 6, 2014, State Board values document is available at: http://www.azed.gov/state-boardeducation/files/2014/03/adopted-essential-assessment-values-6mar14.pdf. In November 2014, the
State Board adopted AzMERIT as its test to measure student achievement in mathematics (MATH)
and English language arts (ELA) in Grades 3 through 8 and for end-of-course use in Grades 9
through 11 for ELA and Algebra I, Geometry, and Algebra II for MATH.
Since the State Board wanted an on-line testing system but many schools did not have the
infrastructure to administer computer based tests to all of their students, ADE developed, with the
assistance of its vendor (American Institutes for Research, AIR), a dual mode assessment
(computer-based and paper-based) for each grade/subject combination. The question of how the
comparability of these two modes of administration should be analyzed was brought before ADEs
Technical Advisory Committee (TAC) during their February 2015 meeting. AIR proposed a
method to TAC which they approved. The TAC, however, suggested that ADE might also examine
the modes comparability using a different method since ADE/AIR planned for Item Response
Theory (IRT) scaling calibration to be performed using the Rasch model.
TAC recommended that ADE use the methodology presented by Wright (1967) first to compare
the AIMS 2014 scales scores students in schools that were assessing students online with those of
the whole state, to determine any differences between the scale scores of these two groups of
schools on last years tests. The purpose of this initial analysis was to have a baseline comparison
of how much discrepancy to expect when the two groups of school went from taking assessments
in the same mode to different modes. The second analysis that was recommended, using the same
methodology, would be carried out once the data from the spring 2015 administration of AzMERIT
was available. This paper presents the results from the first analysis of AIMS 2014 data, and results
for the second analysis, using all data available for both modes as of 7/13/2015.
Method
The method put forth by Wright (1967) to examine the effect of student sample and item sample on
the calibration of a test is as follows:
First perform IRT scaling separately on the two samples of interest using all items that
contributed to each groups total score.
Organize the resulting scale scores (or student ability estimates, Thetas) from least to
greatest.
Graph the ability estimates or scale scores for both groups by number of raw score points
available on one graph.
Compare the amount of distance there is between the graphs of the two groups.
I-29
AzMERIT
StandardSettingTechnicalReport
Results
The graphs resulting from the first analysis, that comparing AIMS 2014 scales scores from
computer-based schools to that of the whole state, are presented in Figure 1 for MATH and Figure
2 for Reading.1 The examination of the two graphs for every grade/subject combination showed
very little, if any, difference between the independently determined AIMS scales. Where there
were differences, they occurred in the very lowest ranges and in the very highest ranges of the raw
scores where the most measurement error occurs, but even these differences were extremely small.
The graphs resulting from the second analysis, that comparing AzMERIT student ability estimates
(Theta) for each raw score from computer-based schools to that of those from paper-based schools,
are presented in Figure 3 for MATH and Figure 4 for ELA. The examination of the two graphs for
every grade/subject combination showed very little, if any, difference between the independently
determined raw score to Theta estimates. (At this writing, the AzMERIT scales had not been
determined, so the IRT Theta estimates from which the scale scores will be computed were used
for these graphs.) Minor differences were found in some grade/subject combinations (specifically
Grade 3 ELA and Algebra II), however, these differences again were both small and located at the
ends of the raw score continuum where the most measurement error exists.
In both of Grade 3 ELA and Algebra II, while the number of items administered to students was the
same for each mode, there was one less raw score point for the paper mode upon which to estimate
student ability. For Grade 3 ELA, this difference was due to an online two point item, which could
not be translated to paper, being substituted with a single point item aligned to the same content.
For Algebra II, one item was dropped from analysis due to a minor technical issue in the sharing of
data between ADE and the test vendor at the time of the creation of this report. Given these raw
score differences, the resulting raw score/Theta comparisons between the two modes is extremely
small even for these most egregious subject/grade combinations.
__________________
1
For AIMS, only the Reading test was compared using the 2014 data since this test did not have an ELA score, as such.
In 2014 AIMS, as in prior years, writing was only assessed in Grades 5, 6, 7 and high school, so it was never combined
with the reading score to compute an ELA score across all tested Grades 3 through 8 and high school.
References
Wright, B. D. (October, 1967). Sample-free test calibration and person measurement. Paper
presented at the ETS Invitational Conference on Testing Problems, Princeton, NJ, retrieved
from http://www.rasch.org/memo1.htm on 2/18/2015.
I-30
AzMERIT
StandardSettingTechnicalReport
Figure 1. AIMS 2014 MATH raw score/scale score graphs for schools assessing students via
computer as compared to all students in the state.
AIMS2014Grade4Math
700
700
600
600
500
500
ScaleScore
ScaleScore
AIMS2014Grade3Math
400
300
200
400
300
200
100
100
0 5 10 15 20 25 30 35 40 45 50 55 60 65
TestScore
Computer
0 5 10 15 20 25 30 35 40 45 50 55 60 65
TestScore
Computer
All
AIMS2014Grade6Math
700
700
600
600
500
ScaleScore
ScaleScore
AIMS2014Grade5Math
400
300
500
400
300
200
200
100
100
0
0 5 10 15 20 25 30 35 40 45 50 55 60 65
TestScore
Computer
All
0 5 10 15 20 25 30 35 40 45 50 55 60 65
TestScore
Computer
All
I-31
All
AzMERIT
StandardSettingTechnicalReport
AIMS2014Grade8Math
700
700
600
600
500
500
ScaleScore
ScaleScore
AIMS2014Grade7Math
400
300
200
400
300
200
100
100
0 5 10 15 20 25 30 35 40 45 50 55 60 65
TestScore
Computer
0 5 10 15 20 25 30 35 40 45 50 55 60 65
TestScore
Computer
All
All
AIMS2014Cohort16Math
800
ScaleScore
700
600
500
400
300
200
0
10
20
30
40
50
TestScore
Computer
60
70
80
All
I-32
AzMERIT
StandardSettingTechnicalReport
Figure 2. AIMS 2014 Reading raw score/scale score graphs for schools assessing students via
computer as compared to all students in the state.
AIMS2014Grade4Reading
700
700
600
600
ScaleScore
ScaleScore
AIMS2014Grade3Reading
500
400
300
500
400
300
200
200
0
10 15 20 25 30 35 40 45 50
TestScore
Computer
700
700
600
600
ScaleScore
ScaleScore
800
500
400
500
400
300
300
200
200
0
10 15 20 25 30 35 40 45 50
TestScore
Computer
All
AIMS2014Grade6Reading
800
10 15 20 25 30 35 40 45 50
TestScore
Computer
All
AIMS2014Grade5Reading
10 15 20 25 30 35 40 45 50
TestScore
Computer
All
I-33
All
AzMERIT
StandardSettingTechnicalReport
AIMS2014Grade8Reading
800
800
700
700
600
600
ScaleScore
ScaleScore
AIMS2014Grade7Reading
500
400
300
500
400
300
200
200
0
10 15 20 25 30 35 40 45 50
TestScore
Computer
10 15 20 25 30 35 40 45 50
TestScore
Computer
All
All
AIMS2014Cohort16Reading
1000
ScaleScore
900
800
700
600
500
400
0
10 15 20 25 30 35 40 45 50
TestScore
Computer
All
I-34
AzMERIT
StandardSettingTechnicalReport
Figure 3. AzMERIT MATH raw score/student ability (Theta) graphs for schools assessing students
via computer as compared to those using paper-based tests.
Grade4Math
Theta
Theta
Grade3Math
6
0
10
15
20
25
30
TestScore
Computer
35
40
45
10
Theta
Theta
6
15
20
25
TestScore
Computer
30
35
40
45
Paper
10
25
Grade6Math
20
TestScore
Computer
Paper
Grade5Math
15
30
35
40
45
10
15
20
25
TestScore
Computer
Paper
I-35
30
35
40
45
Paper
Grade7Math
Grade8Math
StandardSettingTechnicalReport
Theta
Theta
AzMERIT
6
0
10
15
20
25
30
TestScore
Computer
35
40
45
TestScore
Computer
Paper
Paper
Geometry
AlgebraI
8
Theta
Theta
10 15 20 25 30 35 40 45 50
6
0
10
15
20
25
30
TestScore
Computer
35
40
45
10 15 20 25 30 35 40 45 50
TestScore
Computer
Paper
Paper
AlgebraII
8
6
Theta
4
2
0
2
4
6
0
10
15
20
25
30
TestScore
Computer
35
40
45
Paper
I-36
AzMERIT
StandardSettingTechnicalReport
Figure 4. AzMERIT ELA raw score/student ability (Theta) graphs for schools assessing students
via computer as compared to those using paper-based tests.
Grade4ELA
Theta
Theta
Grade3ELA
4
6
6
0
10 15 20 25 30 35 40 45 50 55
TestScore
Computer
TestScore
Computer
Paper
Theta
Theta
Paper
Grade6ELA
Grade5ELA
4
6
6
0
5 10 15 20 25 30 35 40 45 50 55
TestScore
Computer
10 15 20 25 30 35 40 45 50 55
10 15 20 25 30 35 40 45 50 55
TestScore
Computer
Paper
I-37
Paper
Grade7ELA
StandardSettingTechnicalReport
Grade8ELA
Theta
Theta
AzMERIT
4
6
6
0
10 15 20 25 30 35 40 45 50 55
TestScore
Computer
TestScore
Computer
Paper
Grade9ELA
Paper
Grade10ELA
Theta
Theta
5 10 15 20 25 30 35 40 45 50 55
6
0
10 15 20 25 30 35 40 45 50 55
TestScore
Computer
5 10 15 20 25 30 35 40 45 50 55
TestScore
Computer
Paper
Paper
Grade11ELA
8
6
Theta
4
2
0
2
4
6
0
10 15 20 25 30 35 40 45 50 55
TestScore
Computer
Paper
I-38
AzMERIT
StandardSettingTechnicalReport
Online
328,237
329,691
51.1%
48.9%
83.1%
7.6%
3.6%
9.2%
43.1%
0.9%
3.2%
57.0%
5.5%
11.1%
0.4%
Paper
371,867
372,897
50.6%
49.4%
84.1%
7.5%
4.4%
8.4%
44.6%
0.9%
3.2%
50.4%
4.7%
11.2%
0.8%
Online
318,208
329,289
51.1%
48.9%
83.0%
7.6%
3.5%
9.3%
43.5%
0.8%
3.2%
57.6%
5.6%
11.2%
0.4%
Paper
353,648
365,516
50.4%
49.6%
84.3%
7.5%
4.3%
8.3%
44.9%
0.9%
3.2%
50.7%
4.7%
10.7%
0.7%
Note: Percentages on these tables were computed based on unique students, however since students were sometimes of
multiple ethnicities, they were counted in each. Also, students were allowed to take tests in all grades and/or subjects
for the courses that they were taking resulting in some students taking multiple tests within a subject area. Multiple
course tests taken by students were especially prevalent in mathematics.
I-39
AzMERIT
StandardSettingTechnicalReport
Appendix
AzMERIT
StandardSettingTechnicalReport
AppendixJ.AzMERITVerticalLinkingStudy
Introduction
Thepurposeofthisreportistodocumentresultsoftheverticallinkingstudythatwasimplementedto
developaverticalscaleforscoringandreportingstudentachievementresultsontheAzMERITandthat
allowsformonitoringandevaluationofstudentsgainsovertime.
Toemphasizetheacquisitionofnewknowledgeandskillsinthedevelopmentoftheverticalscale,
operationalitemsfromeachgradelevelassessment(g)wereembeddedinfieldtestslotsofthe
assessmentinthegradebelow(g1).Inthisapproach,theresultinglinkagerepresentsstudent
achievementeachyearonthescaleofthesubsequentgradelevelassessmentforwhichtheyare
preparingtoreceiveinstruction.Assuch,thescalescoresforeachassessmentcanbeinterpretedasa
pretestscoreformeasuringstudentacquisitionofacademiccontentinthesubsequentgradelevel.
Whilethisapproachrisksadministeringtostudents12itemsmeasuringcontentthattheymaynotyet
havehadtheopportunitytolearn,itprovidesamoresensitivemeasureofstudentgrowththancouldbe
obtainedbyalinkingdesigninthelinkagerepresentscontinuedgrowthonacademiccontentassessed
inthepreviousyearsassessment.
Linking Items
SincetheverticalscaleessentiallyplaceseachAzMERITassessmentonthescalefortheassessmentin
thegradeabove,wecanbestassurecomparabilityoftestscoresbetweenthegradesbyestablishingthe
linkageusingallavailableoperationaltestitems.Thus,tolinkthegrade4assessmentstothegrade5
scales,alloperationalitemsinthegrade5assessmentweremadeavailableforadministrationinthe
grade4embeddedfieldtest(EFT)slots.Includingalloperationalitemsintheverticallinkingsetensures
thattheitemsetusedtolinktothetargetadjacentgradescalerepresentsfullythemeasuredconstruct
inthetargetgrade,allowingvalidinferencestobemadewithrespecttostudentbaselineperformance
forachievementinthesubsequentgradelevel.
BecausetheAzMERITassessmentsofEnglishlanguagearts(ELA)inhighschoolcontinueasendof
course(EOC)orgradelevelmeasuresofstudentachievementoftheArizonaCollegeandCareerReady
Standards(ACCRS),eachassessmentcanbelinkedtothegradeaboveusingallavailableoperational
items.
However,AzMERITassessmentsofhighschoolmatharecomposedofasetofEOCteststhatarenotas
consistentlyassociatedwithgradelevelinstructionandwhichmeasurespecificsubsetsofthecontent
domain.Forexample,whilemathematicscourseworkinhighschoolfollowsatypicalprogressionandit
wouldthereforebepossibletoembedgrade9AlgebraIEOCitemsinthegrade8mathassessment,
embedthegrade10GeometryEOCitemsintheAlgebraIEOCexam,andembedthegrade11
AlgebraIItheGeometryexam,theconstructsmeasuredacrossthefourexamsvaryconsiderablyand
haveimplicationsfortheinterpretationofgrowth,orlackthereof,acrossassessments.Forexample,itis
notclearwhattheexpectationforgrowthshouldbeinaverticalscaleestablishedbyembedding
GeometryitemsinanAlgebraIexam,sinceGeometryisnotafocusofinstructioninAlgebraIcourses.
J1
AmericanInstitutesforResearch
AzMERIT
StandardSettingTechnicalReport
Analternativeapproach,andtheoneadoptedbyADE,wastolinkthegrade8mathscaletoboththe
AlgebraIandGeometryEOCscales.BecauseAlgebraIIbuildsontheknowledgeandskillsassessedin
AlgebraI,allAlgebraIIitemswereusedtolinktheAlgebraIassessmentstotheAlgebraIIscale.
Item Administration
AIRsfieldtestenginewasusedtoadministerbothfieldtestandverticallinkingitemsintheembedded
slotsintheonlinetestadministrations.Thefieldtestalgorithmrandomlyassignsboththefieldtest
itemsandthefieldtestitempositionwithintheEFTblock,ensuringthat
Arandomsampleofstudentsisadministeredeachitem;and
Foranygivenitem,thestudentsaresampledwithequalprobability.
Thefieldtestalgorithmyieldsarepresentative,randomizedsampleofstudentresponsesforeachitem.
Thefieldtestalgorithmalsoleadstorandomizationofitempositionandthecontextinwhichitems
appear.Fieldtestingeachiteminmanypositionsandcontextsshouldrendertheresultingstatistics
morerobusttothesefactors.
Linking Analysis
Whenfeasible,itisdesirabletoestablishlinkagesusingbothconcurrentcalibrationsandchainlinking
approachestoensurethatresultsareconsistentacrossmethods.Animportantadvantageofchain
linkingapproachesisthat,becauseitemresponsetheory(IRT)calibrationsproceedbyestablishingthe
withingradescale,theachievementconstructintendedbytheblueprintandenactedintheoperational
testformispreserved.Unfortunately,however,ateachstepinthelinkingchain,thelinkingerror
accumulates,sothatlinkingconstantsforgradesmoredistantfromthereferencegradearelessprecise
thanarelinkingconstantsforgradesincloserproximitytothereferencegrade.Concurrentcalibrations
donotaccruelinkingerroracrossgradelevels,sothatlinkingconstantsaresimilarlyprecisebetweenall
gradelevels.However,thecalibrationsresultingfromthisapproachmeasuretheconstructthatis
commonacrossthelinkedassessments,whichmaybedifferentfromtheintendedachievement
constructateachgradelevel,especiallyforsubjectssuchasmathematicswheretheassessedconstruct
maychangemarkedlyacrossgradelevels.Generally,bothapproachestendtoconvergetoproduce
verticalscalesthatoperatesimilarly(Ito,Sykes,andYao,2008;Karkee,Lewis,Hoskens,Yao,andHaug,
2003),andweviewconvergenceasevidencefortherobustnessoftheverticalscale.
Final Linking Set.Tofacilitatethedevelopmentofaverticalscalethatwillbesensitivetostudent
growthovertime,wefirstevaluatedtheperformanceofverticallinkingitemsbetweenthegradelevels
inwhichtheywereadministeredtoidentifyanyitemsthatweremoredifficultforstudentsinthe
intendedgradethantheywereforstudentsinthelowergrade.Formath,itemsthatshowedproportion
correctscoreslowerintheintendedgradethaninthelowergradeweredroppedfromthefinalvertical
linkingset.Thisresultedindroppingonaveragejustovertwoitemsperlinkingset,withamaximumof
sixitemsdroppedforthelinkagebetweengrade6andgrade7mathassessments.
Forreading,theproportioncorrectvaluesacrossgradesweremuchcloser,especiallyatthehigher
gradelevels,sothateliminationofallitemswheretheproportioncorrectvalueinthelowergrade
J2
AmericanInstitutesforResearch
AzMERIT
StandardSettingTechnicalReport
exceededthehighergradewouldresultindroppingmoreitemsfromtheverticallinkingsetthanwould
bedesirableforexecutingarobustequatingdesign.Thus,wemodifiedtheruleforreadingtoexclude
fromtheverticallinkingsetthoseitemswhichshowedproportioncorrectvaluesmorethantwo
standarderrorsbeyondtheaveragestandarderrorforthetotallinkingset(i.e.,itemsthatwerereliably
lessdifficultatthelowergrade).Thisapproachallowedustoidentifyafinalsetoflinkingitemsthat
wouldmaximizedetectionofgrowth,whileretainingsufficientitemstoestablishastronglinkage
betweenthegradelevelassessments.
Table 1. Number of Items Dropped and Remaining in the Final Vertical Linking Set
Linkage
G3G4
G4G5
G5G6
G6G7
G7G8
G8MAlgI
G8ELAG9ELA
G8MGeometry
G9ELAG10ELA
AlgIAlgII
G10ELAG11ELA
Math
DroppedItems
FinalVLSet
1
44
0
45
1
46
6
41
3
47
ELA
DroppedItems
1
3
0
5
2
FinalVLSet
42
46
47
39
46
28
11
30
31
39
32
10
35
ChainLinking. Thechainlinkingapproachproceedsfromthewithingradeitemparametersidentified
intheinitialcalibrationsoftheoperationalandembeddedfieldtestitems.Becauseoperationaltest
itemsateachgradewereadministeredintheEFTslotsinthegradebelow,eachiteminthevertical
linkingsethastwosetsofitemparameters:ongrade(g)andbelowgrade(g1).Thechainlinking
proceedsbyidentifyingthelinkingconstantsnecessarytoplacethebelowgradeitemparameterson
theongradescalefortheitemsinthefinalverticallinkingset.Thelinkingconstantforeachgradewas
definedasthemeandifferenceoftheitemdifficultyestimatesforthelinkingitemsbetweenthelinked
grades.Thechainlinkingbeganbyplacingthegrade3itemparametersonthegrade4scaleforboth
mathandELAandproceededupwards.FormathEOCassessments,thegrade8mathscalewaslinkedto
boththeAlgebraIandGeometryscales,andtheAlgebraIscalewaslinkedtotheAlgebraIIscale.
Concurrent Calibration. Averticalscaleforeachsubjectareawasalsoestablishedbycalibrating
simultaneouslyallitemsinthefinalverticallinkingset.Aswiththewithingradecalibrations,parameters
wereestimatedusingWinsteps.Tocompareresultsfromthechainlinkingandconcurrentcalibrations,
theconcurrentcalibrationswereplacedonthegrade3referencescale.
Table2showstheverticallinkingconstantsresultingfromchainlinkingthewithingradescalesaswell
asfromconcurrentlycalibratingitemsfromacrossgradelevels.Thelinkingconstantsareappliedto
theirrespectivewithingradescaletoplaceallitemparametersonthegrade3referencescale.Tomore
directlyexaminethemagnitudeofgainsacrossgradelevelassessments,Table3showsthedifference
betweenlinkingconstantsbetweeneachofthegradelevelsassessed.Relativegainsarealso
J3
AmericanInstitutesforResearch
AzMERIT
StandardSettingTechnicalReport
representedgraphicallyinFigure1andFigure2formathandELA,respectively,whichplotthelinking
constantsacrossgradelevelassessments.Asthelinkingconstantsindicate,formaththereisrelatively
largeandsteadygrowthacrossthegradelevelandendofcourseassessments.FortheELAassessments,
thecrossgradegainsaremoremodest,andtendtodiminishinthehighergradelevels.
Table 2. Vertical Linking Constants Resulting from Chain-Linking Within Grade Scales
and Concurrent Calibration of Items Across Grades.
Linkage
G3G4
G4G5
G5G6
G6G7
G7G8
G8MAlgI
G8ELAG9ELA
G8MGeometry
G9ELAG10ELA
AlgIAlgII
G10ELAG11ELA
VerticalLinkingConstants
Mathematics
ELA
ChainLinked
Concurrent
ChainLinked
Concurrent
1.32
1.30
0.18
0.16
2.75
2.67
0.81
0.78
3.90
3.73
1.19
1.15
4.48
4.28
1.44
1.39
5.69
5.39
1.76
1.70
6.07
5.76
1.97
1.88
7.15
6.86
2.12
1.98
7.81
7.45
2.32
2.16
Table 3. Linking Constant Differences between each of the Grade Level Scales.
Linkage
G3G4
G4G5
G5G6
G6G7
G7G8
G8MAlgI
G8ELAG9ELA
G8MGeometry
G9ELAG10ELA
AlgIAlgII
G10ELAG11ELA
VerticalLinkingConstantDifferences
Mathematics
Reading
ChainLinked
Concurrent
ChainLinked
Concurrent
1.32
1.3
0.18
0.16
1.43
1.37
0.63
0.62
1.15
1.06
0.38
0.37
0.58
0.55
0.25
0.24
1.21
1.11
0.32
0.31
0.38
0.37
0.21
0.18
1.08
1.10
0.15
0.10
0.66
0.59
0.20
0.18
Linkingconstantsresultingfromthechainlinkingandconcurrentcalibrationapproacharequite
consistent,indicatingthatbothapproachesconvergeonacommongrowthscale.Althoughthelinking
constantsderivedfromtheconcurrentcalibrationapproachmaybeconsideredmoreprecise,thechain
linkingmethodpreservesthewithingrademeasurementconstruct,andwasthereforeselectedasa
J4
AmericanInstitutesforResearch
AzMERIT
StandardSettingTechnicalReport
preliminaryverticalscaleforthepurposeofrecommendingperformancestandards.Wenotethat
ordereditembooksforthestandardsettingworkshopwerebasedonthewithingradescales,soany
modificationstotheverticalscalewillnotimpacttherecommendedperformancestandards.
Theverticallinkingconstantsalsoindicatemuchgreatergrowthacrossgradesandhighschoolcourses
formathematicsthanisobservedforELA.Inmathematics,growthisontheorderofaboutonestandard
deviationperyear,withtheexceptionofgrade6tograde7,whichshowedjustoverahalfstandard
deviationgain.Similarhalfstandarddeviationgainswereobservedbetweengrade8andAlgebraI,
whichsomestudentstakeconcurrently,andbetweencourseworkinAlgebraIandAlgebraII.Gainsin
ELAarelesspronounced,withsomewhatlargergainsintheelementaryschoolyears,withgrowth
attenuatinginthehighschoolgrades.
9.00
8.00
7.00
6.00
5.00
4.00
Conccurent
3.00
ChainLinked
2.00
1.00
0.00
34
45
56
67
78
J5
8AlgI 8Geo
Alg
IAlgII
AmericanInstitutesforResearch
AzMERIT
StandardSettingTechnicalReport
2.50
2.00
1.50
Concurrent
1.00
ChainLinked
0.50
0.00
34
45
56
67
78
89
910
1011
Dimensionality
Acentralconcerninthedevelopmentofaverticalscaleiswhetherchangesintheassessedconstruct
acrossgradeslimitsthecomparabilityoftestscores.Wedonote,however,thatbecausethelinkages
werelimitedtooneadjacentgrade,thelinkingdesignsimplyallowstheadjacentgrade(g1)item
parameterstoberepresentedonthetargetgrade(g)scale,withcomparisonsoftestscoresleadingto
veryspecificinferences.Inthiscase,theadjacentgrade(g1)scalescoresrepresentthebaselinefor
measuringtheacquisitionofcontenttaughtinsubsequenttargetgrade(g).Inthissense,thederived
verticalscaleisnotadevelopmentalscalemeasuringprogressonacommonunderlyingconstruct,but
ratherasequenceoflinkedadjacentgradescales,withinferencesaboutstudentgrowthlimitedto
directlylinkedscales.
Nevertheless,theconcurrentcalibrationsaffordanopportunitytoevaluatethereasonablenessofthe
unidimensionalityassumptionunderlyingthemeasurementmodel,andthuswhetheracommon
reportingscaleacrossgradelevelsandcoursescanbesupported.
Toevaluatethedegreetowhichmultidimensionalityispresentintheverticallinkingitems,Winsteps
providesprincipalcomponentsanalysisofresidualsfromthecommonunderlyingachievement
dimension.Thevarianceaccountedforbythefirstprincipalcomponentoftheresiduals,thesecondary
dimension,indicatesthepresenceofmultidimensionality.Theeigenvaluesandthepercentofvariance
explainedbycommonfactorunderlyingitemresponsesitemsandthesecondarydimension,
representingthecommonvariationunderlyingtheresiduals,areshowninTable4.Astheresultsofthis
comparisonindicate,evidenceformultidimensionalityisweak,andtheassumptionofunidimensionality
intheachievementitemsacrossgradesissupported.
J6
AmericanInstitutesforResearch
AzMERIT
StandardSettingTechnicalReport
Table 4. Eigenvalues and Percent of Variance Accounted for by Items and the First
Contrast.
DimensionalityComponent
Rawvarianceexplainedbyitems
Unexplainedvariancein1stcontrast
Rawvarianceexplainedbyitems
Unexplainedvariancein1stcontrast
Eigenvalue
ELA
97.1
2.2
Math
121.4
2.1
PercentofVarianceAccountedFor
16.3%
0.4%
18.9%
0.3%
Winstepsalsoplotstheresidualsoftheitemswithrespecttotheunderlyingachievementdimension
andidentifiesclustersofitemsbasedonthiscontrasttoassistintheidentificationofsourcesof
multidimensionality.ForELA,theconstrastisdefinedbyaclusterofwritingdimensionscores,across
gradelevels,versusotheritemtypesintheELAassessment.Althoughevidenceforthe
unidimensionalityofELAtestscoresisstrong,thatreadingandwritingitemswouldexhibitsomedegree
ofmultidimensionalityisnotsurprising,andcouldrepresenteitherdifferencesintheassessedconstruct
ormethodofresponse,orboth.Disattentuatedcorrelationcoefficientsamongtheabilityestimates
derivedfromitemscomprisingthethreeclustersareuniformlyhigh,withvaluesof0.93,1.00,and0.98,
indicatingthattheitemsinthethreeclustersaremeasuringacommonunderlyingdimension.
Formath,itemclustersidentifiedbyresidualsaredefinedbytheequationitemtypesversusotheritems
inthemathassessments,andtheitemstypesdefiningthecontrastextendacrossgradelevels.This
contrastcouldrepresentamethodfactor,giventhedifferentresponsemodeforequationitemtypes,or
couldevenreflectdifferencesinthecognitiveprocessesassessedbytheseitemtypes.Nevertheless,
disattenuatedcorrelationsofabilityestimatesbasedontheitemsidentifiedinthethreeclustersareall
1.0,indicatingthatitemsineachclusteraremeasuringthesameunderlyingconstruct.
J7
AmericanInstitutesforResearch
AzMERIT
StandardSettingTechnicalReport
StudentabilityestimateswillthenbetransformedfromtheverticallylinkedRaschthetascaletothe
subjectspecificAzMERITreportingscale:
2500
30
3500
30
ApplyingtheAzMERITscalescoretransformationstotheperformancestandardsrecommendedbythe
workshoppanelsresultsinthesystemofscalescorerangesforeachoftheAzMERITperformancelevel
classificationsidentifiedinTable5forELAandTable6formath.
Table 5. ELA Scale Score Ranges for AzMERIT Performance Level Classification
ELA
Assessment
Grade3
Minimally
Proficient
23952496
Partially
Proficient
24972508
Proficient
25092540
Highly
Proficient
25412605
Grade4
24002509
25102522
25232558
25592610
Grade5
24192519
25202542
25432577
25782629
Grade6
24312531
25322552
25532596
25972641
Grade7
24382542
25432560
25612599
26002648
Grade8
24482550
25512571
25722603
26042658
Grade9
24542554
25552576
25772605
26062664
Grade10
24582566
25672580
25812605
26062668
Grade11
24652568
25692584
25852607
26082675
Table 6. Math Scale Score Ranges for AzMERIT Performance Level Classification
Math
Assessment
Grade3
Minimally
Proficient
33953494
Partially
Proficient
34953530
Proficient
35313572
Highly
Proficient
35733605
Grade4
34353529
35303561
35623605
36063645
Grade5
34783562
35633594
35953634
36353688
Grade6
35123601
36023628
36293662
36633722
Grade7
35293628
36293651
36523679
36803739
Grade8
35663649
36503672
36733704
37053776
AlgebraI
35773660
36613680
36813719
37203787
Geometry
36093672
36733696
36973742
37433819
AlgebraII
36293689
36903710
37113750
37513839
J8
AmericanInstitutesforResearch
AzMERIT
StandardSettingTechnicalReport
Summary
Verticalscalingwasaccomplishedboththroughchainlinkingofwithingradescales,whichhasthe
advantageofpreservingthemeasurementconstructateachgrade,butmayleadtolessprecisevertical
linkingconstantssincelinkingerroraccumulatesacrosslinkages,aswellasthroughconcurrent
calibrationofallverticallinkingitems,whichmayyieldmorepreciseverticallinkingconstants,butmay
notpreservethemeasurementconstructassessedwithineachgradelevelandEOCassessment.Both
methodsconvergedtoproducehighlycomparableverticallinkingconstants.Withaneyetopreserving
themeasurementconstructineachofthewithingradescales,thepreliminaryverticalscalewas
developedusingresultsfromthechainlinkingapproach.
Theconcurrentcalibrationsaffordedtheopportunitytoevaluatetheverticallinkingsetforevidenceof
multidimensionality.ThevarianceaccountedforbyanysecondarydimensionwasweakforboththeELA
andmathassessments.Moreover,whenthebasisforanymultidimensionalitywasinvestigated,it
appearedrelatedtodifferentiationofreadingandwritingintheELAassessment,whichmaybe
expected,anddifferentiationofequationandotheritemtypesinmath,whichcouldbeduetomethod
factorsorpossiblyevendifferentiationintheunderlyingcognitiveprocessesassessed.Ineitherevent,
themeasurementconstructappearstobepreservedacrossthegradelevelassessments.
References
Ito,K.,Sykes,R.C.,&Yao,L.(2008).Concurrentandseparategradegroupslinkingproceduresfor
verticalscaling.AppliedMeasurementinEducation,21,187206.
Karkee,T.,Lewis,D.M.,Hoskens,M.,Yao,L.,&Haug,C.(2003).SeparateversusConcurrentCalibration
MethodsinVerticalScaling.PaperpresentedattheannualmeetingoftheNationalCouncilon
MeasurementinEducation,Chicago,IL.
J9
AmericanInstitutesforResearch
AzMERIT
StandardSettingTechnicalReport
Appendix
AzMERIT
StandardSettingTechnicalReport
DocumentK.OverallWorkshopEvaluations
Please take your time to carefully complete the information below. It is important that you answer this
evaluation thoroughly as the results will be used to improve the Standard Setting process. The
information gathered from this evaluation will be reported in the Standard Setting Technical Report that
will be available to the public.
Panelist ID Number: __________
1. At the end of the workshop,
Strongly
Disagree
Disagree
Agree
Strongly
Agree
a.
b.
c.
d.
e.
f.
g.
h.
i.
j.
K-1
AzMERIT
StandardSettingTechnicalReport
Strongly
Disagree
Disagree
Agree
Strongly
Agree
k.
l.
m.
n.
Somewhat Somewhat
Unclear
Clear
Very
Clear
a.
b.
c.
d.
e.
K-2
AzMERIT
StandardSettingTechnicalReport
3. How important was each of the following factors in your placement of the bookmarks?
Not
Important
Somewhat
Important
Very
Important
a.
b.
c.
d.
e.
f.
g.
h.
4. How appropriate was the amount of time you were given to complete the following components of
the standard setting process?
Too
Little
About
Right
Too
Much
a.
b.
c.
d.
e.
f.
g.
Round 1 discussion
K-3
AzMERIT
StandardSettingTechnicalReport
5. Please read the following statement carefully and indicate your response.
Strongly
Disagree
Disagree
Agree
Strongly
Agree
a.
b.
c.
6. What suggestions do you have to improve the training or standard setting process?
K-4
AzMERIT
StandardSettingTechnicalReport
K-5
AzMERIT
StandardSettingTechnicalReport
Appendix
AzMERIT
StandardSettingTechnicalReport
TableL.RecommendedCutsByRound
Form
Round
Round1
Grade3ELA
Round2
Moderation
Final
Round1
Grade4ELA
Round2
Final
Round1
Grade5ELA
Round2
Final
Round1
Grade6ELA
Round2
Final
Round1
Grade7ELA
Round2
Grade8ELA
Final
Round1
Panelist
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
PartiallyProficient
16
19
18
16
19
18
18
3
33
19
15
26
19
19
11
15
15
14
15
15
15
9
21
14
13
26
16
16
15
20
18
15
20
18
18
13
L-1
Proficient
22
26
25
24
25
24
25
25
13
58
33
25
38
32
32
28
33
32
32
32
32
32
21
47
28
28
46
30
30
34
39
36
34
39
36
36
30
HighlyProficient
45
50
49
42
49
49
49
52
63
57
50
59
57
57
46
64
53
52
57
53
53
36
64
51
51
61
58
58
58
63
60
58
63
61
61
54
AzMERIT
Form
StandardSettingTechnicalReport
Round
Round2
Final
Round1
Grade9ELA
Round2
Final
Round1
Grade10ELA
Round2
Moderation
Final
Round1
Grade11ELA
Round2
Moderation
Final
Round1
Grade3Math
Round2
Final
Grade4Math
Round1
Round2
Panelist
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
PartiallyProficient
33
17
16
28
19
19
15
18
17
15
18
17
17
7
16
13
12
15
14
13
13
6
15
13
10
16
12
13
13
6
11
10
6
10
10
10
7
20
9
8
L-2
Proficient
46
32
36
42
38
38
27
35
32
27
35
32
32
21
45
27
26
34
32
32
20
46
29
23
31
29
29
29
35
33
30
35
33
33
23
37
32
31
HighlyProficient
63
59
56
65
62
62
51
59
56
51
59
56
56
45
58
53
52
56
53
59
59
44
61
52
47
56
52
52
50
56
52
51
53
52
52
44
61
56
54
AzMERIT
Form
StandardSettingTechnicalReport
Round
Final
Round1
Grade5Math
Round2
Final
Round1
Grade6Math
Round2
Final
Round1
Grade7Math
Round2
Final
Round1
Grade8Math
Round2
Final
Round1
AlgebraI
Round2
Final
Geometry
Round1
Panelist
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
PartiallyProficient
14
10
10
4
10
6
4
6
4
4
3
21
9
7
13
9
9
10
11
11
10
14
11
11
11
17
15
13
25
15
15
15
19
17
16
19
17
17
11
20
L-3
Proficient
36
35
35
26
30
27
26
30
27
27
19
30
26
24
26
26
26
29
33
30
29
30
30
30
24
33
28
28
30
29
29
30
37
30
31
38
33
33
20
31
HighlyProficient
61
58
58
51
58
52
51
58
52
52
42
51
46
45
47
46
46
44
48
46
45
46
46
46
39
52
44
44
51
47
47
51
57
54
53
57
56
56
30
53
AzMERIT
Form
StandardSettingTechnicalReport
Round
Round2
Final
Round1
AlgebraII
Round2
Final
Panelist
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
Minimum
Maximum
Median
PartiallyProficient
13
12
18
16
16
9
30
15
14
16
15
15
L-4
Proficient
21
30
31
30
30
27
43
29
27
33
29
29
HighlyProficient
45
45
54
52
52
48
57
51
48
56
49
49
AzMERIT
StandardSettingTechnicalReport
Appendix
AzMERIT
StandardSettingTechnicalReport
FigureM1.ConvergenceofBookmarksacrossRoundsGrade3ELA
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
55
Grade3ELA
50
45
40
OIBPageNumber
35
30
25
20
15
10
Round1MedianBookmarkPlacement
Round2MedianBookmarkPlacement
Table1HighlyProficient
48
48
Table2HighlyProficient
48
47
Table3HighlyProficient
49
49
Table1Proficient
24
24
Table2Proficient
25
24
Table3Proficient
25
25
Table1PartiallyProficient
17
17
Table2PartiallyProficient
16
18
Table3PartiallyProficient
18
19
M-1
AzMERIT
StandardSettingTechnicalReport
FigureM2.ConvergenceofBookmarksacrossRoundsGrade4ELA
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
65
Grade4ELA
60
55
50
OIBPageNumber
45
40
35
30
25
20
15
10
5
0
Round1MedianBookmarkPlacement
Round2MedianBookmarkPlacement
Table1HighlyProficient
58
53
Table2HighlyProficient
54
57
Table3HighlyProficient
58
58
Table1Proficient
34
32
Table2Proficient
33
33
Table3Proficient
23
32
Table1PartiallyProficient
21
21
Table2PartiallyProficient
18
17
Table3PartiallyProficient
19
19
M-2
AzMERIT
StandardSettingTechnicalReport
FigureM3.ConvergenceofBookmarksAcrossRoundsGrade5ELA
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
60
Grade5ELA
55
50
45
OIBPageNumber
40
35
30
25
20
15
10
5
0
Round1MedianBookmark
Placement
Round2MedianBookmark
Placement
Table1HighlyProficient
55
55
Table2HighlyProficient
53
53
Table3HighlyProficient
53
53
Table1Proficient
33
32
Table2Proficient
32
32
Table3Proficient
28
32
Table1PartiallyProficient
13
15
Table2PartiallyProficient
15
15
Table3PartiallyProficient
15
15
M-3
AzMERIT
StandardSettingTechnicalReport
FigureM4.ConvergenceofBookmarksAcrossRoundsGrade6ELA
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
65
Grade6ELA
60
55
50
OIBPageNumber
45
40
35
30
25
20
15
10
5
0
Round1MedianBookmark
Placement
Round2MedianBookmark
Placement
Table1HighlyProficient
48
60
Table2HighlyProficient
58
58
Table3HighlyProficient
48
54
Table1Proficient
28
37
Table2Proficient
29
30
Table3Proficient
21
30
Table1PartiallyProficient
20
26
Table2PartiallyProficient
11
16
Table3PartiallyProficient
14
14
M-4
AzMERIT
StandardSettingTechnicalReport
FigureM5.ConvergenceofBookmarksAcrossRoundsGrade7ELA
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
70
Grade7ELA
65
60
55
50
OIBPageNumber
45
40
35
30
25
20
15
10
5
0
Round1MedianBookmark
Placement
Round2MedianBookmark
Placement
Table1HighlyProficient
62
62
Table2HighlyProficient
60
61
Table3HighlyProficient
58
58
Table1Proficient
38
38
Table2Proficient
35
35
Table3Proficient
36
36
Table1PartiallyProficient
16
16
Table2PartiallyProficient
18
18
Table3PartiallyProficient
18
18
M-5
AzMERIT
StandardSettingTechnicalReport
FigureM6.ConvergenceofBookmarksacrossRoundsGrade8ELA
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
70
Grade8ELA
65
60
55
50
OIBPageNumber
45
40
35
30
25
20
15
10
5
0
Round1MedianBookmark
Placement
Round2MedianBookmark
Placement
Table1HighlyProficient
55
63
Table2HighlyProficient
62
62
Table3HighlyProficient
61
60
Table1Proficient
31
38
Table2Proficient
44
40
Table3Proficient
32
36
Table1PartiallyProficient
16
17
Table2PartiallyProficient
30
27
Table3PartiallyProficient
16
16
M-6
AzMERIT
StandardSettingTechnicalReport
FigureM7.ConvergenceofBookmarksacrossRoundsGrade9ELA
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
65
Grade9ELA
60
55
50
OIBPageNumber
45
40
35
30
25
20
15
10
5
0
Round1MedianBookmark
Placement
Round2MedianBookmark
Placement
Table1HighlyProficient
55
55
Table2HighlyProficient
56
56
Table3HighlyProficient
58
58
Table1Proficient
32
32
Table2Proficient
30
32
Table3Proficient
32
32
Table1PartiallyProficient
18
18
Table2PartiallyProficient
17
17
Table3PartiallyProficient
17
17
M-7
AzMERIT
StandardSettingTechnicalReport
FigureM8.ConvergenceofBookmarksacrossRoundsGrade10ELA
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
60
Grade10ELA
55
50
45
OIBPageNumber
40
35
30
25
20
15
10
5
0
Round1MedianBookmark
Placement
Round2MedianBookmark
Placement
Table1HighlyProficient
53
53
Table2HighlyProficient
54
53
Table3HighlyProficient
52
52
Table1Proficient
29
32
Table2Proficient
26
31
Table3Proficient
32
33
Table1PartiallyProficient
14
14
Table2PartiallyProficient
13
15
Table3PartiallyProficient
12
13
M-8
AzMERIT
StandardSettingTechnicalReport
FigureM9.ConvergenceofBookmarksacrossRoundsGrade11ELA
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
60
Grade11ELA
55
50
45
OIBPageNumber
40
35
30
25
20
15
10
5
0
Round1MedianBookmark
Placement
Round2MedianBookmark
Placement
Table1HighlyProficient
52
53
Table2HighlyProficient
56
51
Table3HighlyProficient
51
51
Table1Proficient
25
26
Table2Proficient
31
28
Table3Proficient
30
29
Table1PartiallyProficient
13
13
Table2PartiallyProficient
15
15
Table3PartiallyProficient
11
12
M-9
AzMERIT
StandardSettingTechnicalReport
FigureM10.ConvergenceofBookmarksacrossRoundsGrade3Math
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
60
Grade3Math
55
50
45
OIBPageNumber
40
35
30
25
20
15
10
5
0
Round1MedianBookmark
Placement
Round2MedianBookmark
Placement
Table1HighlyProficient
52
52
Table2HighlyProficient
52
52
Table3HighlyProficient
54
53
Table1Proficient
35
33
Table2Proficient
33
33
Table3Proficient
30
32
Table1PartiallyProficient
10
10
Table2PartiallyProficient
11
10
Table3PartiallyProficient
10
M-10
AzMERIT
StandardSettingTechnicalReport
FigureM11.ConvergenceofBookmarksacrossRoundsGrade4Math
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
65
Grade4Math 60
55
50
OIBPageNumber
45
40
35
30
25
20
15
10
5
0
Round1MedianBookmark
Placement
Round2MedianBookmark
Placement
Table1HighlyProficient
58
58
Table2HighlyProficient
55
57
Table3HighlyProficient
57
57
Table1Proficient
34
35
Table2Proficient
23
35
Table3Proficient
29
34
Table1PartiallyProficient
Table2PartiallyProficient
Table3PartiallyProficient
12
11
M-11
AzMERIT
StandardSettingTechnicalReport
FigureM12.ConvergenceofBookmarksacrossRoundsGrade5Math
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
60
Grade5Math
55
50
45
OIBPageNumber
40
35
30
25
20
15
10
5
0
Round1MedianBookmarkPlacement
Round2MedianBookmarkPlacement
Table1HighlyProficient
52
52
Table2HighlyProficient
53
53
Table3HighlyProficient
52
52
Table1Proficient
27
27
Table2Proficient
28
27
Table3Proficient
30
30
Table1PartiallyProficient
Table2PartiallyProficient
Table3PartiallyProficient
10
M-12
AzMERIT
StandardSettingTechnicalReport
FigureM13.ConvergenceofBookmarksacrossRoundsGrade6Math
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
50
Grade6Math
45
40
OIBPageNumber
35
30
25
20
15
10
Round1MedianBookmark
Placement
Round2MedianBookmark
Placement
Table1HighlyProficient
47
46
Table2HighlyProficient
46
46
Table3HighlyProficient
46
46
Table1Proficient
27
26
Table2Proficient
25
26
Table3Proficient
26
26
Table1PartiallyProficient
Table2PartiallyProficient
Table3PartiallyProficient
13
13
M-13
AzMERIT
StandardSettingTechnicalReport
FigureM14.ConvergenceofBookmarksacrossRoundsGrade7Math
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
50
Grade7Math
45
40
OIBPageNumber
35
30
25
20
15
10
Round1MedianBookmarkPlacement
Round2MedianBookmarkPlacement
Table1HighlyProficient
46
46
Table2HighlyProficient
46
46
Table3HighlyProficient
46
46
Table1Proficient
29
29
Table2Proficient
31
30
Table3Proficient
30
30
Table1PartiallyProficient
11
11
Table2PartiallyProficient
11
11
Table3PartiallyProficient
11
11
M-14
AzMERIT
StandardSettingTechnicalReport
FigureM15.ConvergenceofBookmarksacrossRoundsGrade8Math
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
55
Grade8Math
50
45
40
OIBPageNumber
35
30
25
20
15
10
5
0
Round1MedianBookmark
Placement
Round2MedianBookmark
Placement
Table1HighlyProficient
44
47
Table2HighlyProficient
46
47
Table3HighlyProficient
50
49
Table1Proficient
27
29
Table2Proficient
29
29
Table3Proficient
28
28
Table1PartiallyProficient
14
15
Table2PartiallyProficient
15
15
Table3PartiallyProficient
15
16
M-15
AzMERIT
StandardSettingTechnicalReport
FigureM16.ConvergenceofBookmarksacrossRoundsAlgebraI
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
60
AlgebraI
55
50
45
OIBPageNumber
40
35
30
25
20
15
10
5
0
Round1
Round2
Table1HighlyProficient
56
56
Table2HighlyProficient
54
56
Table3HighlyProficient
52
56
Table1Proficient
36
37
Table2Proficient
31
33
Table3Proficient
30
33
Table1PartiallyProficient
17
17
Table2PartiallyProficient
16
17
Table3PartiallyProficient
18
17
M-16
AzMERIT
StandardSettingTechnicalReport
FigureM17.ConvergenceofBookmarksacrossRoundsGeometry
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
60
Geometry
55
50
45
OIBPageNumber
40
35
30
25
20
15
10
5
0
Round1MedianBookmark
Placement
Round2MedianBookmark
Placement
Table1HighlyProficient
45
52
Table2HighlyProficient
38
50
Table3HighlyProficient
53
53
Table1Proficient
21
30
Table2Proficient
22
30
Table3Proficient
26
31
Table1PartiallyProficient
13
18
Table2PartiallyProficient
15
16
Table3PartiallyProficient
13
14
M-17
AzMERIT
StandardSettingTechnicalReport
FigureM18.ConvergenceofBookmarksacrossRoundsAlgebraII
Thefigureillustrateshowvariabilityinpanelistsbookmarkdecisionschangedfromthefirsttothe
secondroundanddisplaysthemedianbookmarkforeachtable,fromRound1ofbookmarkplacement
toRound2ofbookmarkplacement.
AlgebraII
60
55
50
45
OIBPageNumber
40
35
30
25
20
15
10
5
0
Round1MedianBookmark
Placement
Round2MedianBookmark
Placement
Table1HighlyProficient
48
48
Table2HighlyProficient
50
50
Table3HighlyProficient
57
55
Table1Proficient
29
29
Table2Proficient
32
31
Table3Proficient
28
28
Table1PartiallyProficient
12
15
Table2PartiallyProficient
16
16
Table3PartiallyProficient
16
15
M-18
AzMERIT
StandardSettingTechnicalReport
Appendix
AzMERIT
StandardSettingTechnicalReport
TableN.EstimatedPercentageofStudentsatEachPerformanceLevelforPanelistRecommendedPerformanceStandards,Overall
andbyGenderandEthnicity
Test
Grade3
ELA
Grade4
ELA
Grade5
ELA
Grade6
ELA
Grade7
ELA
Grade8
ELA
PerformanceLevel
MinimallyProficient
PartiallyProficient
Proficient
HighlyProficient
MinimallyProficient
PartiallyProficient
Proficient
HighlyProficient
MinimallyProficient
PartiallyProficient
Proficient
HighlyProficient
MinimallyProficient
PartiallyProficient
Proficient
HighlyProficient
MinimallyProficient
PartiallyProficient
Proficient
HighlyProficient
MinimallyProficient
PartiallyProficient
Proficient
HighlyProficient
Overall
Female
Male
White
Black
America
n Indian
Asian
Hispani
c
MultiRacial
Other
44
15
31
10
43
19
33
5
37
33
27
3
39
27
30
4
41
26
29
4
40
27
26
6
40
15
33
12
38
19
36
6
32
34
30
3
34
28
34
5
35
28
32
5
35
29
29
8
48
14
29
9
47
18
31
4
42
32
24
2
45
26
26
3
47
25
25
3
45
26
24
5
28
14
40
18
28
19
45
9
23
33
40
5
25
27
42
6
26
26
41
7
27
28
35
10
57
15
24
4
52
19
27
3
49
32
18
1
49
28
21
2
49
27
22
2
52
26
19
3
68
14
16
2
69
16
15
1
64
26
9
0
66
22
11
1
70
20
9
0
65
22
11
1
22
12
43
23
19
15
47
18
18
28
46
8
19
22
49
11
19
21
46
13
20
23
41
16
55
15
25
5
53
19
26
2
47
34
18
1
50
27
21
1
51
27
20
2
49
28
20
3
35
14
37
14
34
20
39
8
28
35
35
3
31
27
38
4
35
29
31
5
34
28
30
8
56
14
24
5
56
17
23
3
53
28
17
1
51
27
20
2
51
25
22
2
45
24
24
7
N-1
AzMERIT
Test
Grade9
ELA
Grade10
ELA
Grade11
ELA
Grade3
Math
Grade4
Math
Grade5
Math
Grade6
Math
StandardSettingTechnicalReport
PerformanceLevel
MinimallyProficient
PartiallyProficient
Proficient
HighlyProficient
MinimallyProficient
PartiallyProficient
Proficient
HighlyProficient
MinimallyProficient
PartiallyProficient
Proficient
HighlyProficient
MinimallyProficient
PartiallyProficient
Proficient
HighlyProficient
MinimallyProficient
PartiallyProficient
Proficient
HighlyProficient
MinimallyProficient
PartiallyProficient
Proficient
HighlyProficient
MinimallyProficient
PartiallyProficient
Proficient
HighlyProficient
Overall
Female
Male
White
Black
America
n Indian
Asian
Hispani
c
MultiRacial
Other
47
26
21
6
49
21
22
8
54
20
17
8
27
31
27
15
29
29
32
10
29
31
27
13
38
30
21
11
41
28
25
7
44
22
25
10
50
21
19
10
27
33
27
14
29
30
32
9
27
32
29
12
36
31
23
11
52
25
18
4
54
19
20
6
58
19
16
7
28
30
27
15
30
28
32
11
30
30
26
14
40
28
20
11
33
28
30
9
36
22
30
13
41
22
23
13
17
28
33
22
17
26
41
16
17
28
35
21
25
30
28
17
56
25
16
3
61
19
16
3
66
18
13
4
39
33
21
7
41
32
23
4
42
33
20
5
52
29
14
5
70
22
8
1
73
16
9
1
78
15
7
1
44
35
17
4
51
30
17
2
47
33
16
3
59
27
12
3
23
20
36
20
25
19
33
24
30
19
25
25
8
20
33
39
10
18
43
30
11
19
32
37
14
22
30
34
56
26
15
2
59
20
17
4
64
19
13
4
34
34
23
9
38
32
26
5
36
34
23
7
47
31
17
5
39
26
27
8
42
22
25
11
47
21
21
11
22
30
30
19
22
30
35
12
23
31
31
15
32
33
23
12
67
18
12
3
62
18
15
6
52
17
19
12
41
32
19
9
45
29
22
4
30
32
25
12
53
28
13
6
N-2
AzMERIT
Test
PerformanceLevel
MinimallyProficient
PartiallyProficient
Proficient
Grade7
Math
HighlyProficient
MinimallyProficient
PartiallyProficient
Proficient
Grade8
Math
HighlyProficient
MinimallyProficient
PartiallyProficient
Proficient
AlgebraI
HighlyProficient
MinimallyProficient
PartiallyProficient
Proficient
Geometry HighlyProficient
MinimallyProficient
PartiallyProficient
Proficient
AlgebraII HighlyProficient
StandardSettingTechnicalReport
Overall
Female
Male
White
Black
America
n Indian
Asian
Hispani
c
MultiRacial
Other
48
22
18
13
43
24
20
13
45
23
23
9
47
24
24
6
47
24
23
6
48
23
18
12
42
26
21
12
42
24
25
9
46
25
24
5
45
26
23
6
48
21
18
14
45
23
19
13
48
22
21
9
48
22
24
7
48
22
22
7
32
24
24
20
29
26
26
19
32
23
30
15
33
25
33
9
35
25
30
10
65
19
11
5
57
24
14
6
58
22
16
4
61
23
15
2
61
21
15
2
72
16
9
3
67
20
10
3
66
20
12
2
66
21
11
1
70
19
9
1
20
18
24
38
17
18
25
40
17
19
36
28
22
18
40
21
18
21
38
22
59
22
13
6
53
24
16
7
53
24
18
5
58
23
17
2
57
24
17
2
45
23
19
14
39
26
21
14
39
22
26
13
41
26
26
7
42
24
24
9
62
19
12
7
55
17
14
14
69
17
11
2
64
19
13
4
67
17
13
3
N-3
AzMERIT
StandardSettingTechnicalReport
Appendix
AzMERIT
StandardSettingTechnicalReport
DocumentO.SummaryofPanelistEvaluations
1. At the end of the workshop,
Strongly
Disagree
Disagree
Agree
Strongly
Agree
a.
73
b.
24
54
c.
69
d.
14
64
e.
42
33
f.
41
38
g.
11
68
h.
29
50
i.
10
69
j.
71
k.
12
67
l.
23
56
O-1
AzMERIT
StandardSettingTechnicalReport
Strongly
Disagree
Disagree
Agree
Strongly
Agree
m.
72
n.
72
Somewhat Somewhat
Unclear
Clear
Very
Clear
a.
71
b.
18
59
c.
77
d.
75
e.
74
O-2
AzMERIT
StandardSettingTechnicalReport
3. How important was each of the following factors in your placement of the bookmarks?
Not
Important
Somewhat
Important
Very
Important
a.
17
63
b.
17
61
c.
16
64
d.
12
68
e.
46
33
f.
42
36
g.
27
51
h.
41
36
4. How appropriate was the amount of time you were given to complete the following components of
the standard setting process?
Too
Little
About
Right
Too
Much
a.
65
14
b.
64
c.
68
11
d.
59
17
e.
60
19
f.
46
34
g.
Round 1 discussion
71
O-3
AzMERIT
StandardSettingTechnicalReport
5. Please read the following statement carefully and indicate your response.
Strongly
Disagree
Disagree
Agree
Strongly
Agree
a.
35
44
b.
34
45
c.
30
49
O-4
AzMERIT
StandardSettingTechnicalReport
Appendix
AzMERIT
StandardSettingTechnicalReport
DocumentP.IndependentObserverReporttoStateBoardofEducation
TO:
FROM:
StateBoardofEducation
JohnWilson,TempeElementarySchools
JoeOReilly,MesaSchools
JayMidyett,AmphitheatreSchools
StandardSettingObservations
RE:
AsrepresentativestothestatesassessmentTechnicalAdvisoryCommittee,wewereinvitedto
observetheAzMERITstandardsetting.Thethreeofusobservedthroughouttheprocess.At
leastoneofusobservedeachgroup,withmostgroupsbeingvisitedbymultipleobservers.The
firsttwodayswereobservedbyallthreeofus,andoneortwoobserverswerethereforthe
lasttwodays.
THESTANDARDSETTINGPROCESS
Therewereeightgroupsofapproximately12teacherseachthatsetthestandards.Eachgroup
wasdividedintothreetablesandworkedindividually,asatableandasawholegroupasthey
wentthroughtheprocess.Elementarygroups(grades4,6,8)setthecutpointsfortheirgrade
andaninterpolatedgradejustbelow(3,5,7).Highschoolgroupssetthecutpointsforallmath
(AlgebraII,Geometry,AlgebraI)orELA(Grades911)usingasimilarprocesswithninthgrade
beinginterpolated.
Asidefromafewhandouts,thematerialsnecessaryforstandardsettingwerealldeliveredon
computerswhichmadetheprocesseasierandallowedsharingoftableandgroupresults
quickerandclearer.Participantsappearedtofindthesystemeasytouseandintuitive.
Teachersstartedwithalargegroupintroductorytraining.Itwasemphasizedthattheywereto
makedecisionsbasedonthePerformanceLevelDescriptorsandtheirprofessionaljudgment.
TheStateBoardgoalsfortheassessmentwerealsosharedwiththem.
Teachersthenbrokeintogroupsandtookthesameassessmentthestudentstook.Theythen
reviewedthePLDsanddevelopedjustbarelyPLDsordescriptionsofastudentwhowasjust
barelyproficientwouldknowandcando.
Teachersthenfamiliarizedthemselveswiththeonlineordereditembooklet(OIB).TheOIBhad
apageforeachquestionwhichshowedthequestionandresponseoptionsaswellasthe
correctanswer.Theitemsconsistedoftheactualtestitemsandotherfieldtestitemstogivea
fullprogressionoftheitemdifficulties.Tohelpwithcontextforthedifficulty/complexityof
eachitem,thecomparablecutpointsforothertests(AIMS,SmarterBalance,NAEP,ACT
CollegeandCareerReadyIndex,and/orPISAdependingongrade)wereprovided.
P1
AmericanInstitutesforResearch
AzMERIT
StandardSettingTechnicalReport
Next,AIRusedthebookmarkmethodtohavegroupsidentifycutpoints.Teachersdetermined
theitematwhichajustbarelyproficient(orbarelypartiallyproficientorhighlyproficient)
studentwouldgetanitemright,butastudentinthelevelbelowwouldnotbelikelytogetit
right.Teachersthengottoseehowtheothertablesandeachparticipantplacedtheir
bookmarksandtheythendiscussedthebookmarks.Theyweretoldtheexpectationis
convergingjudgements,notnecessarilyconsensus,sotherewasnorequirementthatonehad
toagreewiththegroup.
InRound2theteachersagainplacedtheirbookmarks.Beforestartingtheysawimpactdataor
whatpercentof2015studentswhotookthetestwouldfallineachcategorybasedonthe
roundonecutscores.Theywerethenaskedtosettheirbookmarksasecondtime.
DuringlunchontheseconddaySuperintendentDouglasspokebrieflytothegroupthanking
themfortakingtimefromtheirsummervacationandshetoldthemtheyweredoingimportant
workforallofArizona.Herwordssentamessagetotheparticipantsabouthowcrucialtheir
taskwasandhowimportanttheirprofessionaljudgementwastothesuccessofthestandard
setting.
Attheendoftheprocessparticipantsgatheredinalargeroomandwereabletoseewhere
everygrade/subjectplacedtheircutpointsandtheimpactdata.Atthatpoint,vertical
moderationwasscheduled,butitwasnotneededexceptforonehighschoolgroupthatsetthe
tenthgradestandardslightlyhigherthangradeeleven,andtheydiscussedloweringtenth
gradebyoneitem,whichwasmoreforappearancethanasubstantivechange.
Theprocesswasrepeatedforinterpolatedgrades.Eachgroupwasprovidedacutpointfor
theirgradethatwaspredictedusingapsychometric(statistical)analysis.Thetaskforthese
gradeswastoadjust,asneeded,thepredictedcutpointsothatitreflectedthejustbarely
thresholdbasedoncontent.Again,thedecisionwasguidedbythepsychometricpredictionbut
determinedbyprofessionaljudgementandthinkingaboutthejustbarelystudent.
OBSERVATIONS
Theprocesswasclear,wellorganizedandlogical.Teachersweretrainedtomakedecisions
basedonthePerformanceLevelDescriptorsandthecontentstudentsaresupposedtoknow.
TheywerealsoguidedbytheBoardsgoalsofhavingteststhatcanbecomparedtoother
assessmentsandthatreflectcollegeandcareerreadiness.
Theteachersdrovethedecisions,anditappearedtheyreliedheavilyonthePLDsandthe
Boardsgoals.Teachersweregivenalotofspacetodiscussandmaketheirownchoices.They
werenottoldthatthecutscoreshavetobeatcutpointsforothertestsbuttheyweretherefor
context.InthetrainingtheyweretoldYourdecisionshouldbebasedonyourprofessional
opinion.Therelatedtestsaretogiveyouacontextforyourchoice.Whengivenimpactscores
theyweretoldtheyreallyneedtomakedecisionsbasedoncontent,notbasedonthese
[impact]scores.
P2
AmericanInstitutesforResearch
AzMERIT
StandardSettingTechnicalReport
Teacherstooktheirtrainingtoheart.WeheardthemsaythingstoeachotherlikeIwantto
makesurewearesettingitatcollegeandcareerready,nottoolow,notwhereastudentisnot
reallycollegeandcareerready.Theyalsodiscussedwhytheresultsturnedoutastheydidand
saidthingslikewearesettingthisforwhatwewantstudentstobeabletodo,notwhatthey
candonow,that[itemsresults]isateacherissueandwheretheteacherisonthenew
standards,andthatshouldbeaneasyitemifitwastaughtproperly.
Teachershadveryspiriteddiscussionsaboutitems,whatajustbarelystudentwasandwhat
studentsshouldknowandbeabletodoandwhy.Theytalkedaboutincreasedcognitive
demandandadditionalcomplexityordepthseparatinglevels.Thesewereteacherswhohad
clearlytaughtthesesubjectsandcouldarticulategradientsofperformance.
Inonlyoneinstancedidweseeacasewheretheywereverydisparateratings(e.g.,individual
cutssetfromitem30toitem47).InGeometrytheteacherswouldseeanitemthatonlya
proficientstudentwouldgetrightfollowedbysomeeasieritemsfollowedbyaharditem,and
thatpatternwouldrepeatuntilthesubsequentitemswouldonlybeansweredbyproficient
students.Onceitwasclarifiedthatthecutpointshouldnotbesetatthefirstquestiononlya
proficientstudentwouldgetright,butatthepointatwhichitemswouldconsistentlybethose
onlyaproficientstudentwouldgetright,theratingsbecamemoreconsistentandteachers
wereinagreement.
CONCLUSIONS
Weobservedaverywellorganized,professionallyrunstandardsettingprocess.Itwasavery
goodstandardsettingthatleftus,andtheteacherswetalkedto,withafeelingof
accomplishment.
Thecutpointsweresetbasedonteacherjudgment,andthefinaldecisionwastheirs.The
directionsandtrainingmadethatcleartoteachers.TheteacherstooktheStateBoardsgoals
toheartastheirtargetoutcomeandthecutpointsreflectthat.
AIRandADEshouldbecommendedfortheirhardworkandprofessionalismthatledtoa
productiveandsuccessfulstandardsetting.Theteachersarealsotobecommendedfortheir
hardwork,theirdeepandnuancedknowledgeofstudentperformanceattheirgradelevels,
theiropendiscussions,andtheirengagementthroughouttheprocess.
P3
AmericanInstitutesforResearch
EXECUTIVE SUMMARY
Issue:
Action/Discussion Item
Information Item
EXECUTIVE SUMMARY
Attached are examples of AzMERIT Grade 3 ELA student reports showing how the
Move on When Reading requirement will be reported.
Recommendation to the Board
It is recommended that the Board adopt an AzMERIT Grade 3 Reading score of 2446
as the MOWR cut score.
F A M I LY S C O R E R E P O R T
AzMERIT
SPRING 2015
Maria A. Doe
Grade 3
Front:
Marias overall score for this assessment includes a numeric score and
a proficiency level.
Her numeric score can be compared with the school, district, and
state averages.
The proficiency level indicates how well students understand current
grade-level material and how likely they are to be ready for the next
grade.
Back:
Marias level of mastery is shown for each scoring category.
Scoring categories represent specific knowledge and skills included in
this assessment.
There is a detailed description of the mastery level for each scoring
category.
Marias score is
Minimally Proficient.
Highly Proficient:
Advanced understanding,
highly likely to be ready
2541
Proficient:
2509
Partially Proficient:
Marias
score in ELA is
2482, which is
Minimally
Proficient.
2497
Yes
Minimally Proficient:
Minimal understanding,
highly likely to need support
to be ready
2395
AZED. GOV
Spring 2015 987456-1
AzMERIT
F A M I LY S C O R E R E P O R T
Legend: Scoring Categories
Below Mastery
At/Near Mastery
Above Mastery
The Writing and Language portion of the ELA assessment requires that each student complete an essay. The essay is evaluated on three criteria.
The chart below shows your childs performance on each criteria.
Writing Essay Performance
Statement of Purpose, Focus & Organization
AZED. GOV
F A M I LY S C O R E R E P O R T
AzMERIT
SPRING 2015
Maria A. Doe
Grade 3
Front:
Marias overall score for this assessment includes a numeric score and
a proficiency level.
Her numeric score can be compared with the school, district, and
state averages.
The proficiency level indicates how well students understand current
grade-level material and how likely they are to be ready for the next
grade.
Back:
Marias level of mastery is shown for each scoring category.
Scoring categories represent specific knowledge and skills included in
this assessment.
There is a detailed description of the mastery level for each scoring
category.
Marias score is
Minimally Proficient.
Highly Proficient:
Advanced understanding,
highly likely to be ready
2541
Proficient:
2509
Partially Proficient:
2497
Marias
score in ELA is
2405, which is
Minimally
Proficient.
AZED. GOV
Spring 2015 987456-1
No
Minimally Proficient:
Minimal understanding,
highly likely to need support
to be ready
2395
AzMERIT
F A M I LY S C O R E R E P O R T
Legend: Scoring Categories
Below Mastery
At/Near Mastery
Above Mastery
The Writing and Language portion of the ELA assessment requires that each student complete an essay. The essay is evaluated on three criteria.
The chart below shows your childs performance on each criteria.
Writing Essay Performance
Statement of Purpose, Focus & Organization
AZED. GOV
EXECUTIVE SUMMARY
Issue:
Action/Discussion Item
Information Item
Contact Information:
Audra Ahumada, Director of Alternate Assessment, Assessment Section
Leila Williams, Associate Superintendent Quality Assessment and Adult Education
EXECUTIVE SUMMARY
The NCSC Standard Setting meeting will take place August 10 13 in Indianapolis,
Indiana. Arizona will have 7 educator panelists representing various grades, content
knowledge and districts from our state and a state representative.
The final process will be to present the recommended cut scores to the board for their
approval at the August 24th meeting.
EXECUTIVE SUMMARY
Issue: Presentation and discussion regarding the administration of the Move On When
Reading Program
Action/Discussion Item
Information Item
Contact Information:
Christine Thompson, Executive Director, State Board of Education
EXECUTIVE SUMMARY
HB 2479 (Laws 2015, Chapter 310) included session law that allowed the Department
to use up to $500,000 of the K-3 Reading base support funding on technical assistance
and state level administration of the MOWR program. This legislative action shifted the
administration of the MOWR program from the Board to the Department.
MOWR Policy and Administration
The authority to set policy for the MOWR program remains with the Board pursuant to
A.R.S. 15-701 and A.R.S. 15-211. In June 2012, the Board approved the content of
the literacy plans and determined procedures by which the plans would be submitted,
reviewed and approved, thus allowing distribution of funds to those districts and
charters. These procedures were developed in partnership with the Department.
In 2013 the Board, using the FTE authorized in the budget, hired a Deputy Director and
Director of K-3 Reading. The K-3 Reading Director was responsible for overseeing the
MOWR program. The Director oversaw eight consultants which reviewed literacy plans
for completeness. The majority of time and resources spent administering the MOWR
program have been related to literacy plan review and submittal pursuant to A.R.S 15211. This includes building an online portal for districts and charters to submit their
plans online.
As required Laws 2015, Chapter 310, the Department has submitted an expenditure
plan for the MOWR program to the Joint Legislative Budget Committee. The
Departments plan contemplates that the Board will expend $300,000 for administration
of the program, inconsistent with the Board budget unanimously adopted by the Board
on May 18, 2015. The JLBC will review the Departments spending plan at their June 19
meeting.
Update
The transition of the administration of the MOWR program from the Board to the
Department occurred on July 1, 2015. The Board staff created a transition plan to
minimize disruption to districts and charter schools. In order to review the transition
plan, Board staff has requested contact information for the Departments MOWR
Program Administrator as detailed in the JLBC spending plan. As of the publication of
these materials, Board staff has not been provided any contact information from the
Department. Several emails have been sent to the Department informing them of
previous practices of MOWR administration, as well as district and charter expectations.
Specifically, Board staff requested the Department open the window to the online portal
to allow districts and charters to submit literacy plans and data on August 3, 2015.
Board staff does not have access to the MOWR portal, and has not received a response
from the Department. In previous years, the window has been opened in early August.
Recommendation to the Board
This item is for information only.
EXECUTIVE SUMMARY
Issue:
Action/Discussion Item
Information Item
Contact Information:
Christine M. Thompson, Executive Director, State Board of Education
State of Arizona
Department of Education
Diane M. Douglas
Superintendent of Public Instruction
1535 West Jefferson Street, Phoenix, Arizona 85007 (602) 542-4361 www.azed.gov