Edcheckup Standard Reading Passages
Maze
Rating Summary
Classification Accuracy  

Generalizability  Moderate High  
Reliability  
Validity  
Disaggregated Reliability and Validity Data  
Efficiency  
Administration  Group  
Administration & Scoring Time  20 Minutes  
Scoring Key  Computer Scored  
Benchmarks / Norms  Yes 
Cost  Technology, Human Resources, and Accommodations for Special Needs  Service and Support  Purpose and Other Implementation Information  Usage and Reporting 

Each license (or “set”) allows you to access materials, enter data, and generate reports for up to 35 students. The cost per set is as follows:
This includes all materials and full data/reporting functionality for all subjects, which includes the following: 138 Controlled Reading passages; 23 Beginning Reading passages; 23 Writing probes; and 23 Math probes. 
Computer and Internet access are required for full use of product services. Testers will require less than 1 hour of training. Paraprofessionals can administer the test. 
Edcheckup, LLC Phone: 9522291441 Fieldtested training manuals are included and should provide all implementation information. Ongoing technical support is available. 
Edcheckup Maze consists of equivalent sets of 23 reading passages for each grade level. Each passage is formatted as a maze passage where every seventh word has been deleted and replaced with a multiple choice option consisting of three words from which the correct choice is to be selected by the reader. Three of each set of passages are used for screening to establish students’ current level of proficiency in reading aloud from text and are used to establish cut scores for identifying students who are academically at risk as readers. 
Edcheckup is group administered and requires 15 minutes for administration and 5 additional minutes per student for scoring. Scores available include: raw, standard, developmental benchmarks, and error analysis. 
Classification Accuracy
Classification Accuracy in Predicting Proficiency on the Measures of Academic Progress (MAP)  

Study 1  Total Sample  Grade 2  Grade 3  Grade 4  Grade 5  Grade 6 
False Positive Rate  0.35  0.26  0.43  0.28  0.43  0.41 
False Negative Rate  0.20  0.15  0.21  0.18  0.22  0.21 
Sensitivity  0.80  0.85  0.79  0.82  0.78  0.79 
Specificity  0.65  0.74  0.57  0.72  0.57  0.59 
Positive Predictive Power  0.35  0.44  0.32  0.36  0.32  0.31 
Negative Predictive Power  0.93  0.95  0.91  0.96  0.91  0.92 
Overall Classification Rate  0.68  0.76  0.61  0.74  0.62  0.63 
AUC (ROC)  0.83  0.89  0.80  0.90  0.80  0.81 
Base Rate  0.19  0.19  0.20  0.16  0.21  0.19 
Cut Points:  97.80  6.33  8.60  7.17  12.60  11.60 
At 90% Sensitivity, Specificity equals  0.51  0.65  0.43  0.66  0.46  0.50 
At 80% Sensitivity, Specificity equals  0.65  0.79  0.55  0.75  0.64  0.58 
At 70% Sensitivity, Specificity equals  0.75  0.88  0.69  0.94  0.81  0.70 
Classification Accuracy in Predicting Proficiency on the Measures of Academic Progress (MAP)  

Study 2  Total Sample  Grade 2  Grade 3  Grade 4  Grade 5  Grade 6 
False Positive Rate  0.27  0.39  0.22  0.22  0.25  0.26 
False Negative Rate  0.21  0.18  0.21  0.22  0.25  0.20 
Sensitivity  0.79  0.82  0.79  0.79  0.75  0.80 
Specificity  0.73  0.61  0.78  0.78  0.75  0.74 
Positive Predictive Power  0.47  0.31  0.56  0.56  0.43  0.44 
Negative Predictive Power  0.92  0.94  0.92  0.91  0.92  0.93 
Overall Classification Rate  0.75  0.65  0.79  0.78  0.75  0.75 
AUC (ROC)  0.86  0.86  0.87  0.85  0.85  0.83 
Base Rate  0.23  0.18  0.26  0.26  0.20  0.21 
Cut Points:  97  101  95  96  95  97 
At 90% Sensitivity, Specificity equals  0.60  0.45  0.58  0.62  0.57  0.67 
At 80% Sensitivity, Specificity equals  0.74  0.63  0.76  0.75  0.74  0.74 
At 70% Sensitivity, Specificity equals  0.84  0.93  0.86  0.81  0.79  0.76 
Generalizability
Description of Sample:
Study 1
 Number of States: 1
 Size: 465

Gender:
 51.8% Male
 48.2% Female
 SES: 15.8% Eligible for free or reducedprice lunch

Race/Ethnicity:
 68.4% White, NonHispanic
 13.5% Black, NonHispanic
 11.5% Hispanic
 0.9% American Indian/Alaska Native
 5.6% Asian/Pacific Islander
 Disability classification: 13.8% (includes Federal Setting 1 & 2 LD, EBD, OHD, ASD and Speech students)
 First Language: 85.1% have home language of English. Other languages represented include Spanish (4.5%)
Study 2
 Number of States: 1
 Size: 282

Gender:
 53.4% Male
 46.6% Female
 SES: 15.3% Eligible for free or reducedprice lunch

Race/Ethnicity:
 68.0% White, NonHispanic
 13.2% Black, NonHispanic
 12.8% Hispanic
 1.1% American Indian/Alaska Native
 5.0% Asian/Pacific Islander
 Disability classification: 11.0% (includes Federal Setting 1 & 2 LD, EBD, OHD, ASD and Speech students)
 First Language: 84.0% have home language of English. Other languages represented include Spanish (3.9%)
Cross Validation Study Description of Sample:
Study 1
 Number of States: 1
 Size: 553

Gender:
 53.5% Male
 46.5% Female

Race/Ethnicity:
 86.9% White, NonHispanic
 8.4% Black, NonHispanic
 2.5% Hispanic
 0.4% American Indian/Alaska Native
 1.8% Asian/Pacific Islander
 Disability classification: 12.7% (includes LD, EBD, OHD, ASD and Speech)
 First Language: 94.7% have English as First Language. Other languages include: Spanish (1.3%)
Study 2
 Number of States: 1
 Size: 522

Gender:
 52.9% Male
 47.1% Female

Race/Ethnicity:
 87.4% White, NonHispanic
 7.9% Black, NonHispanic
 2.5% Hispanic
 0.4% American Indian/Alaska Native
 1.8% Asian/Pacific Islander
 Disability classification: 12.1% (includes LD, EBD, OHD, ASD and Speech)
 First Language: 94.8% have English as First Language
Reliability
Type of Reliability  Age or Grade  n (range)  Coefficient  SEM  Information / Subjects  

range  median  
Cronbach’s Alpha 
2  211  0.72660.8106  0.7529  Median = 0.22 
Alpha = 0.9016 Standardized Item Alpha = 0.9063 17.9% Students of Color, 7.6% Students of Poverty, 13.4% Students with Disabilities 
Cronbach’s Alpha 
3  233  0.46610.7269  0.5849  Median = 0.23 
Alpha = 0.8023 Standardized Item Alpha = 0.8136 19.7% Students of Color, 7.5% Students of Poverty, 15.1% Students with Disabilities 
Cronbach’s Alpha 
4  206  0.68720.7653  0.7589  Median = 0.23 
Alpha = 0.8910 Standardized Item Alpha = 0.8938 23.8% Students of Color, 6.0% Students of Poverty, 13.1% Students with Disabilities 
Cronbach’s Alpha 
5  249  0.74090.8600  0.7823  Median = 0.27 
Alpha = 0.9125 Standardized Item Alpha = 0.9206 21.8% Students of Color, 5.6% Students of Poverty, 11.6% Students with Disabilities 
Cronbach’s Alpha 
6  74  0.70980.7541  0.7300  Median = 0.45 
Alpha = 0.8829 Standardized Item Alpha = 0.8909 33.3% Students of Color, 16.7% Students of Poverty, 11.5% Students with Disabilities 
SplitHalf  2  211  0.72660.8106  0.7529  Median = 0.22  Guttman Splithalf = 0.8519, Unequallength SpearmanBrown = 0.9130, 17.9% Students of Color, 7.6% Students of Poverty, 13.4% Students with Disabilities 
SplitHalf  3  233  0.46610.7269  0.5849  Median = 0.23  Guttman Splithalf = 0.7074, Unequallength SpearmanBrown = 0.8054, 19.7% Students of Color, 7.5% Students of Poverty, 15.1% Students with Disabilities 
SplitHalf  4  206  0.68720.7653  0.7589  Median = 0.23  Guttman Splithalf = 0.8164, Unequallength SpearmanBrown = 0.8851, 23.8% Students of Color, 6.0% Students of Poverty, 13.1% Students with Disabilities 
SplitHalf  5  249  0.74090.8600  0.7823  Median = 0.27  Guttman Splithalf = 0.8620, Unequallength SpearmanBrown = 0.9306, 21.8% Students of Color, 5.6% Students of Poverty, 11.6% Students with Disabilities 
SplitHalf  6  74  0.70980.7541  0.7300  Median = 0.45  Guttman Splithalf = 0.8410, Unequallength SpearmanBrown = 0.8925, 33.3% Students of Color, 16.7% Students of Poverty, 11.5% Students with Disabilities 
Alternate Form  2  67  0.6130.756  0.681  School A  
Alternate Form  3  93  0.6490.790  0.737  School A  
Alternate Form  4  69  0.7000.817  0.772  School A  
Alternate Form  5  112  0.7470.851  0.794  School A  
Alternate Form  6  75  0.7100.754  0.731  School A  
Alternate Form  2  142  0.7840.841  0.804  School B  
Alternate Form  3  140  0.4150.704  0.556  School B  
Alternate Form  4  135  0.6940.738  0.721  School B  
Alternate Form  5  137  0.7350.866  0.793  School B 
Validity
Type of Validity  Age or Grade  Test or Criterion  n  Coefficient  Information / Subjects 

Construct  2  Measure of Academic Progress  211  0.628  16.6% Students of Color, 7.1%, Students of Poverty, 13.3% Students with Disabilities 
Construct  3  Measure of Academic Progress  233  0.502  19.5% Students of Color, 7.1%, Students of Poverty, 14.2% Students with Disabilities 
Construct  4  Measure of Academic Progress  204  0.566  22.3% Students of Color, 5.9%, Students of Poverty, 11.9% Students with Disabilities 
Construct  5  Measure of Academic Progress  249  0.591  20.4% Students of Color, 5.4%, Students of Poverty, 11.2% Students with Disabilities 
Construct  6  Measure of Academic Progress  75  0.502  34.7% Students of Color, 17.3%, Students of Poverty, 10.7% Students with Disabilities 
Predictive  2  Measure of Academic Progress  200  0.648  16.4% Students of Color, 5.8%, Students of Poverty, 12.6% Students with Disabilities 
Predictive  3  Measure of Academic Progress  224  0.550  18.7% Students of Color, 5.9%, Students of Poverty, 14.2% Students with Disabilities 
Predictive  4  Measure of Academic Progress  193  0.533  22.1% Students of Color, 5.1%, Students of Poverty, 11.3% Students with Disabilities 
Predictive  5  Measure of Academic Progress  158  0.511  17.2% Students of Color, 3.2%, Students of Poverty, 8.3% Students with Disabilities 
Disaggregated Reliability, Validity, and Classification Data for Diverse Populations
Disaggregated Reliability, Validity, and Classification Data for Diverse Populations
Disaggregated Classification Accuracy
Classification Accuracy in Predicting Proficiency on the Measures of Academic Progress (MAP)  

Study 1  African American  Hispanic American  Poverty 
False Positive Rate  0.368  0.600  0.359 
False Negative Rate  0.200  0.111  0.222 
Sensitivity  0.800  0.889  0.778 
Specificity  0.632  0.400  0.641 
Positive Predictive Power  0.462  0.500  0.600 
Negative Predictive Power  0.889  0.842  0.806 
Overall Classification Rate  0.679  0.597  0.697 
AUC (ROC)  0.842  0.792  0.776 
Base Rate  0.283  0.403  0.409 
Cut Points: CBM Standard Score  95.3  96.0  94.5 
At 90% Sensitivity, Specificity equals  60.5%  44.9%  36.5% 
At 80% Sensitivity, Specificity equals  71.1%  59.4%  53.5% 
At 70% Sensitivity, Specificity equals  80.3%  79.2%  77.7% 
Classification Accuracy in Predicting Proficiency on the Measures of Academic Progress (MAP)  

Study 2  African American  Hispanic American  Poverty 
False Positive Rate  0.194  0.400  0.261 
False Negative Rate  0.00  0.176  0.074 
Sensitivity  1.00  0.824  0.926 
Specificity  0.806  0.600  0.739 
Positive Predictive Power  0.571  0.636  0.806 
Negative Predictive Power  1.00  0.800  0.895 
Overall Classification Rate  0.846  0.703  0.840 
AUC (ROC)  0.940  0.821  0.826 
Base Rate  0.502  0.459  0.540 
Cut Points: CBM Standard Score  88  94  91 
At 90% Sensitivity, Specificity equals  90%  50%  82% 
At 80% Sensitivity, Specificity equals  90%  65%  87% 
At 70% Sensitivity, Specificity equals  91%  65%  92% 
Disaggregated Reliability
Type of Reliability  Grade  n  Coefficient  SEM  Information Subjects  

range  median  
Cronbach’s Alpha 
2  19 
0.9554 0.9658 
0.9633 
African American Students Alpha = 0.9844 Standardized item Alpha = 0.9868 

Cronbach’s Alpha 
3  20 
0.8162 0.8811 
0.8173 
African American Students Alpha = 0.9382 Standardized item Alpha = 0.9396 

Cronbach’s Alpha 
4  25 
0.8720 0.9018 
0.8989 
African American Students Alpha = 0.9543 Standardized item Alpha = 0.9608 

Cronbach’s Alpha 
5  25 
0.9011 0.9289 
0.9241 
African American Students Alpha = 0.9671 Standardized item Alpha = 0.9711 

Splithalf  2  19 
0.9554 0.9658 
0.9633 
Median = 9.50 
African American Students Guttman Splithalf = 0.8853, Unequallength SpearmanBrown = 0.98900. 
Splithalf  3  20 
0.8162 0.8811 
0.8173 
Median = 8.51 
African American Students Guttman Splithalf = 0.8167, Unequallength SpearmanBrown = 0.9224, 
Splithalf  4  25 
0.8720 0.9018 
0.8989 
Median = 7.01 
African American Students Guttman Splithalf = 0.8652, Unequallength SpearmanBrown = 0.9556, 
Splithalf  5  25 
0.9011 0.9289 
0.9241 
Median = 6.40 
African American Students Guttman Splithalf = 0.8675, Unequallength SpearmanBrown = 0.9772, 
Disaggregated Validity
Type of Validity  Grade  Test or Criterion  n  Coefficient  Information/Subjects 

median  
Construct  2  Measure of Academic Progress  18  0.854  African American Students 
Construct  3  Measure of Academic Progress  20  0.774  African American Students 
Construct  4  Measure of Academic Progress  25  0.688  African American Students 
Construct  5  Measure of Academic Progress  25  0.580  African American Students 
Construct  3  Minnesota Comprehensive Assessment  20  0.518  African American Students 
Construct  4  Minnesota Comprehensive Assessment  25  0.637  African American Students 
Construct  5  Minnesota Comprehensive Assessment  25  0.514  African American Students 
Predictive  3  Minnesota Comprehensive Assessment  15  0.634  African American Students 
Predictive  4  Minnesota Comprehensive Assessment  19  0.436  African American Students 
Predictive  5  Minnesota Comprehensive Assessment  26  0.511  African American Students 
Predictive  6  Minnesota Comprehensive Assessment  16  0.437  African American Students 