50 of items represent the topic of negative and interrogative form, and 60 of items represent the topic of regular and irregular verb.
For the spoken test items, Hughes 1989: 110 says that scoring will be valid if clearly recognizable and appropriate descriptions of criterial levels are
written and scorers are trained to use them. The following is the weighting table which includes the criterial levels:
The maximum score for the spoken test is 60, since the portion of spoken test is 60 and the portion of written test is 40. This was because one of the
basic principles in teaching grammar is focusing on the development of procedural knowledge rather than declarative knowledge. It was important that
the students were able to use the knowledge for communication. Therefore, the portion for spoken test was higher than the written test.
1.2. Reliability
The researcher administered a pilot test first to count the reliability coefficient. Then, if the test is reliable, the real test could be given to other group
of students. The calculation on the reliability of the test was taken by using the formula suggested by Lado. The first formula is known as the split half method. It
WEIGHTING TABLE
AREA\ LEVEL I
II III
IV V
Grammar
4 8
12 16
20
Vocabulary
3 6
9 12
15
Comprehension 2
4 6
8 10
Fluency
2 4
6 8
10
Pronunciation 1
2 3
4 5
TOTAL PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI
is used to count the reliability of only half of the test because the test involves two halves of the test. Therefore, to find the reliability of the entire test, the
second formula, the spearman-brown is used. The following are the Pearson r correlation and the Spearman Brown Split-Half formula.
The Pearson r correlation:
The Spearman Brown Split- Half:
=
The result of the computation showed that the reliability coefficient is 0.64. The complete computation presented in the appendix. According to Best
1970:257, if the reliability coefficient 0. 64, it means substantial. Therefore, the test was considered reliable and could be used as the instrument of the research.
The reliability for the spoken test was taken by the method suggested by Hughes. Hughes 1989:110 states that scoring will be reliable if there is more
than one scorer for each perfo rmance. Therefore, in giving the score for the spoken test, the researcher asked the favor of one of the ninth semester students
of English Language Education Study Program of Sanata Dharma University.
1.3 Test Results
The following was the report of the results of the pretest and posttest score of both control group class IAP and the experimental group class IAK.
PRETEST POSTTEST
Student Written
Spoken Total
Written Spoken
Total
1. 8
49 57
27 51
78 2.
11 41
52 22
45 67
3. 13
42 55
18 48
66 4.
8 41
49 30
43 73
5. 12
37 49
26 41
67 6.
7 38
45 29
41 70
7. 14
38 52
24 41
65 8.
8 43
51 28
47 75
9. 6
35 41
27 37
64 10.
10 34
44 25
34 59
11. 20
41 61
23 38
61 12.
10 42
52 21
42 63
13. 12
41 53
13 45
58 14.
13 41
54 14
52 66
15. 19
41 60
21 47
68 16.
8 41
49 27
47 74
17. 8
41 49
27 45
72 18.
24 41
65 34
53 87
19. 13
38 51
27 48
75 20.
12 38
50 23
47 70
21. 17
37 54
14 44
58 22.
12 32
44 29
35 64
23. 12
32 44
16 35
51 24.
8 42
50 25
46 71
25. 8
42 50
16 47
63 26.
17 41
58 36
38 74
27. 8
41 49
16 38
54 28.
8 42
50 26
48 74
29. 8
41 49
27 47
74 30.
8 41
49 27
45 72
Table 10. The Comparison of IAP students’ pretest and posttest score From, the calculation from SPSS 15, we can see the mean score on their
pretest and posttest as follows:
Descriptive Statistics
N Range
Minimum Maximum
Mean Std. Deviation
Variance PRETEST1AP
30 24,00
41,00 65,00
51,1667 5,32453
28,351 POSTTEST1AP
30 36,00
51,00 87,00
67,7667 7,63695
58,323 Valid N listwise
30
Table 12. The mean score of IAP students’ pretest and posttest
From the calculation above, we can conclude that the mean score for the pretest is 51.16. It means that from 100 of the total score, the students’ score in
IAP control group is 51,16 in average. Then, the mean score for the posttest is 67.76. It means that from 100 of the total score, the students’ score in IAP
control group is 67, 76 in average.
PRETEST POSTTEST
Student Written
Spoken Total
Written Spoken
Total
1. 7
33 40
33 53
86 2.
10 32
42 19
50 69
3. 5
36 41
31 56
87 4.
9 45
54 26
49 75
5. 7
36 43
15 43
58 6.
8 41
49 22
56 78
7. 7
37 44
20 46
66 8.
10 43
53 36
51 87
9. 6
39 45
15 45
60 10.
16 39
55 26
47 73
11. 16
30 46
30 30
60 12.
11 44
55 35
56 91
13. 2
47 49
23 49
72 14.
4 43
47 37
49 86
15. 7
35 42
13 41
54 16.
8 32
41 12
42 54
17. 9
37 46
33 49
82 18.
20 36
56 20
49 69
19. 5
41 46
21 43
64 20.
10 39
49 31
42 73
21. 14
37 51
26 45
71 22.
7 37
44 13
40 53
23. 8
35 43
13 37
50 24.
15 41
56 28
45 73
25. 12
41 53
24 47
71 26.
10 33
43 19
41 60
27. 10
38 48
20 44
64 28.
10 48
58 24
56 80
29. 28
32 60
39 56
95 30.
7 35
42 18
38 56
Table 13. The Comparison of IAK students’ pretest and posttest score PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI
From, the calculation from SPSS 15, we can see the mean score on the ir pretest and posttest as follows:
Descriptive Statistics
N Range
Minimum Maximum
Mean Std. Deviation
Variance PRETESTIAK
30 20,00
40,00 60,00
48,0333 5,77440
33,344 POSTTESTIAK
30 45,00
50,00 95,00
70,5667 12,37819
153,220 Valid N listwise
30
Table 14. The mean score of IAK students’ pretest and posttest
From the calculation above, we can conclude that the mean score for the pretest is 48.03. It means that from 100 of the total score, the students’ score in
IAK experimental group is 48.03 in average. Then, the mean score for the posttest is 70,56. It means that from 100 of the total score, the students’ score in
IAK experimental group is 70,56 in average.
2. Students’ Transcript on the Spoken Test
