NCATE Accreditation Home >Exhibit 5: Samples of candidate assessment data disaggregated by distance learning programs

Exhibit 5: Samples of candidate assessment data disaggregated by distance learning programs

Download the Printable Version (PDF)


Data from three programs that involve courses with significant portions online are presented below in Tables 1-3.  These data reflect the overall satisfactory performance of candidates engaged in courses and programs that are 50% or more online.  (The section designations indicate the approximate time online.  Course sections designated D = >50 but < 95% online; courses with  N = >95% Online).  

Data from three different approaches to instruction, (in class face to face, partially online, or all online, shown in Table 4, reveal no statistically significant difference based on an analysis using the ANOVA statistical test .  These are relatively small samples sizes and the data are average percents of various grades in the courses, rather than individual student grades.

There may be some concern with regard to the percentage of withdrawals (W) but since these are very small sample sizes, it is difficult to determine if there is any significance with regard to these data.

Table I. Media Master’s Certification Program - Percentages of Course Grades for 2009-2010

Semester
Program
Course No.
Section
%A
Grade
%B
Grade
%C
Grade
%D
Grade
%F
Grade
% WD
% WD
Fail
Sum 2010 MEDT 6463 01D
93
7
0
0
0
0
0
  MEDT 6464 01D
90
5
0
0
0
0
0
  MEDT 6464 02D
100
0
0
0
0
0
0
  MEDT 6465 01D
100
0
0
0
0
0
0
Spring 2010 MEDT 6468 02D
90
5
0
0
0
0
0
  MEDT 6468 01D
100
0
0
0
0
0
0
  MEDT 6467 02D
87
0
0
0
0
13
0
  MEDT 6467 01D
80
7
7
0
0
7
0
  MEDT 6466 N02
82
18
0
0
0
0
0
  MEDT 6466 N01
60
30
0
0
0
10
0
  MEDT 6465 01D
88
6
0
0
0
6
0
  MEDT 6464 01D
83
8
8
0
0
0
0
  MEDT 6463 02D
82
18
0
0
0
0
0
Fall 2009 MEDT 6468 01D
100
0
0
0
0
0
0
  MEDT 6467 02D
82
6
6
0
0
0
0
  MEDT 6467 01D
96
0
0
0
0
4
0
  MEDT 6466 01D
83
4
0
0
0
13
0
  MEDT 6465 02D
100
0
0
0
0
0
0
  MEDT 6465 01D
100
0
0
0
0
0
0
  MEDT 6464 01D
95
0
0
0
0
5
0
  MEDT 6463 01D
86
5
5
0
0
0
0
  MEDT 6462 N01
90
5
0
0
5
0
0
  MEDT 6461 02D
86
14
0
0
0
0
0
      Ave %
Each
Grade
0
0
0

 

Table2.  ESOL Online Endorsement Program - Percentages of Course Grades for 2009-2010

Semester
Program
Course No.
Section
%A
Grade
%B
Grade
%C
Grade
%D
Grade
%F
Grade
% WD
% WD
Fail
Sum 2010 PTED 7240 N91
96
0
0
0
0
4
0
  PTED 7241 N91
88
8
0
0
0
0
4
  PTED 7242 N91
80
15
0
0
0
5
0
      Ave %
Each
Grade
88
8
0
0
0
3
1

 

Table3.  Reading Online Endorsement Program - Percentages of Course Grades for 2009-2010

Semester
Program
Course No.
Section
%A
Grade
%B
Grade
%C
Grade
%D
Grade
%F
Grade
% WD
% WD
Fail
Sum 2010 READ 7271 91D
88
0
0
0
0
12
0
  READ 7263 91D
83
13
4
0
0
0
0
Spring 2010 READ 7271 01D
100
0
0
0
0
0
0
  READ 7263 01D
92
0
0
0
0
8
0
  READ 7201 91D
69
6
00
0
0
19
0
Fall 2009 READ 7271 01D
100
0
0
0
0
0
0
  READ 7263 01D
82
0
0
0
0
18
0
  READ 7201 52D
100
0
0
0
0
0
0
  READ 7201 51D
100
0
0
0
0
0
0
  READ 7201 01D
88
6
0
0
0
0
6
      Ave %
Each
Grade
0
0

 

Table 4.  Comparison of average numbers of A, B, C, D, F, W, or WF grades in PWLA 1600 taught in a face to face class, partially online, or all online.    (No letter = face to face, D= >50 but <95% online, N= all online)

Semester
Program
Course No.
Section
%A
Grade
%B
Grade
%C
Grade
%D
Grade
%F
Grade
% WD
% WD
Fail
Fall 2009 PWLA 1600 3
45
24
16
2
7
2
4
  PWLA 1600 6
26
28
28
2
9
7
0
  PWLA 1600 8
59
19
6
2
7
7
0
      Ave %
Each
Grade
44
23
17
2
8
6
1
  PWLA 1600 04D
33
31
16
2
15
0
0
  PWLA 1600 07D
16
22
18
11
16
0
0
      Ave %
Each
Grade
25
27
17
7
16
0
0
  PWLA 1600 N01
9
33
22
11
16
9
0
  PWLA 1600 N02
28
30
18
5
8
1
0
  PWLA 1600 N09
27
41
16
5
3
5
3
  PWLA 1600 N10
18
33
23
15
5
8
0
  PWLA 1600 N1H
46
8
23
0
8
1
0
      Ave %
Each
Grade
26
29
20
7
8
10
1

 

The results of an ANOVA statistical test of data related to the PWLA courses (F2F, partially online, and all online show that:

Source of Variation Sum of Squares d.f. Mean Squares F
between 25.37 2 12.69 7.2198E-02
error 1.1772E+04 67 175.7  
total 1.1798E-04 69    

The probability of this result, assuming the null hypothesis, is 0.93

Group A (Face to Face): Number of items= 21
0.00 0.00 2.00 2.00 2.00 2.00 4.00 6.00 7.00 7.00 7.00 7.00 9.00 16.0 19.0 24.0 26.0 28.0 28.0 45.0 59.0
Mean = 14.286
95% confidence interval for Mean: 8.512 thru 20.06
Standard Deviation = 15.8
High = 59.00 Low = 0.000
Median = 7.000
Average Absolute Deviation from Median = 10.9

Group B (>50% but ,95% Online): Number of items= 14
0.00 0.00 0.00 0.00 2.00 11.0 15.0 16.0 16.0 16.0 18.0 22.0 31.0 33.0
Mean = 12.857
95% confidence interval for Mean: 5.786 thru 19.93
Standard Deviation = 11.3
High = 33.00 Low = 0.000
Median = 15.50
Average Absolute Deviation from Median = 8.86

Group C (All Online): Number of items= 35
0.00 0.00 0.00 0.00 0.00 3.00 3.00 5.00 5.00 5.00 5.00 8.00 8.00 8.00 8.00 9.00 9.00 11.0 13.0 15.0 15.0 16.0 16.0 18.0 18.0 22.0 23.0 23.0 27.0 28.0 30.0 33.0 33.0 41.0 46.0
Mean = 14.400
95% confidence interval for Mean: 9.928 thru 18.87
Standard Deviation = 12.3
High = 46.00 Low = 0.000
Median = 11.00
Average Absolute Deviation from Median = 9.74