Results Matter Training and Certification Requirements

Assessment System Orientation Courses

All teachers, paraprofessionals, and administrators with a Results Matter online system user account must complete the system’s online orientation module(s).

For AEPS-3 users:

• All staff with an AEPS-3 user account must complete an overview training of how to use the AEPS-3. Training options are available at the AEPS-3 Training Page.

For CORAdvantage® users:

• All staff with a CORAdvantage® user account must complete the COR 101 course. This course is good for one clock hour.

For GOLD® users:

Teachers and administrators must successfully complete professional development modules by logging into their GOLD® user accounts. These required courses are free. Search for the following courses in Quorum:

• GOLD® Introduction - 2 hours
• Introduction to SmartTeach™ - 2 hours
• Getting Started with MyTeachingStrategies® Setup (for administrators) - 1 hour

Inter-rater Reliability Certification

All teachers and other staff assigning checkpoint ratings to children who have an IEP (i.e., anyone responsible for finalizing assessment ratings for children) must also complete interrater reliability certification. Interrater reliability (IRR) is the extent to which multiple observers score children the same on a given item. Teacher certification is critical as they are the ones scoring children. Progress and outcomes data gathered through Results Matter are used to inform classroom and program planning. In addition, some of the results are used for accountability reporting.  Thus, fidelity with the nationally tested training curriculum and fidelity with the research-based implementation of the assessment are critical.

CDE does not require paraprofessionals and administrators to complete interrater reliability certification. However, programs may choose to require it for all staff at their own discretion.

The online system orientation courses and IRR certification must be completed before staff begin completing ratings in their first checkpoint.

Program-level administrators must employ strategies to support and monitor staff completion of required trainings. Administrator monitoring reports are typically available in the online assessment systems.

For GOLD® users:

• All teachers and other staff assigning checkpoint ratings (i.e., anyone responsible for finalizing assessment ratings for children) must also complete Interrater Reliability (IRR) Certification (Quorum). Inter-rater reliability certification is free, valid for three years from date of completion, and must be renewed on or before the date of expiration. IRR should be completed on your own without assistance from other staff.
• Teachers often ask, “which Age Group should I choose when starting GOLD® IRR?” CDE recommends choosing the most comprehensive demographic option within your primary age/grade. For preschool teachers, this would be “GOLD® Preschool/PreK/Transitional Kindergarten Interrater Reliability Certification."
• It is recommended that users complete the courses before attempting inter-rater reliability certification.
• The Inter-rater Reliability and Online Professional Development reports (Quorum) can help administrators monitor completion among staff.

For CORAdvantage® users:

• All teachers and other staff determining assessment scores must also complete the CORAdvantage 1.5 Reliability Test. The reliability test is free. It should be completed on your own without assistance from other staff.
• It is recommended that users complete the COR 101 course before attempting the inter-rater reliability test.

For AEPS-3 users:

• AEPS-3 offers an online module that takes approximately 2-4 hours to complete and includes a training presentation, practice items, and certification test. A three-year certification is provided with a score of 80% or higher.

IRR and Colorado’s Early Childhood Professional Credential

Since inter-rater reliability certification (IRR) is a test, not a course per se, it is not considered professional development and is therefore not eligible for CEU or professional development clock hours. However, IRR certification for GOLD® is approved as a “Qualifying Credential, License, or Endorsement” in the Ongoing Professional Development area of Colorado’s Early Childhood Professional Credential.  This means that educators who pass GOLD® inter-rater reliability certification are eligible for two additional points under the Ongoing Professional Development section of the credential scoring worksheet.

Results Matter Assessment Alignment to Standards and Best Practices in Early Childhood

1. The Division of Early Childhood (DEC) Recommended Practices for assessment have several commonalities including “Practitioners use a variety of methods, including observation and interviews, to gather assessment information from multiple sources, including the child’s family and other significant individuals in the child’s life” (A6) and “Practitioners conduct assessments that include all areas of development and behavior to learn about the child’s strengths, needs, preferences, and interests.” (A4)

2. Colorado’s Early Childhood Professional Competencies around child observation and assessment have several commonalities including “Applies appropriate formal and informal child observation and assessment methods, which are embedded in daily curriculum, to gather a well-rounded, accurate, culturally responsive and confidential description of the development of the whole child.” (COA.1.2) and “Uses child observation and assessment strategies on a regular basis to collect culturally and linguistically relevant information about each child. Links information to key instructional/learning goals. Identifies and recognizes how own implicit bias may influence assessment practices and interpretation of data.” (COA 3.2).