121 both sides, they are item no 14, 15, 16 and 19. Therefore, the decision of
revisions should be taken after a deep observation on the improvement feedbacks given by the experts. This will be elaborated more in the discussion of the
preliminary product revision.
b. Writing Section 1 Indicator 7: ability to write vocabulary words in the right spelling.
This indicator is manifested into 5 items, no. 23 up to 27. The test items
are formatted in essay -gap filling. Hence, the students get task to fill incomplete
sentences by writing the correct words or vocabularies not by selecting among alternatives. The results collected from the trial test can be observed below:
The data set above shows that most items have been done quite well by the students although one item, namely item no. 26 gets the least, only three items
that get correct responses from the students. Yet, to see how the items perform expected results can be traced through the performance of the trend lines which is
presented below:
Table. 4.8. Students’ response on. Text Production, writing part1, indicator 7, item no 24-28
Indicator Writing , Part 1
Test itemsStudents
1 2
3 4
5 6
7 8
9 10
11 12
Qualification high high
high high middle middle middle middle
low low
low low
No. 24 1
1 1
1 1
1 1
1 1
1 10
No. 25 1
1 1
1 1
1 1
1 1
1 10
No. 26 1
1 1
3 No. 27
1 1
1 1
1 1
1 1
8 No. 28
1 1
1 1
1 1
1 1
1 1
1 11
TEXT PRODUCTION 7. Ability to write vocabulary words in the right spelling
122 It can be observed from the above graphs that the responses of the students
during the trial test are quite good. The trend lines of the five items have performed rising slope which means the items have fulfilled the expected results.
To decide whether revision is needed, the researcher will observe the conformity of the students’ response with the experts’ judgment. The data is presented below:
Figure 4.24. Trend line of students’ response for.Writing Part 1, Item No. 25
Figure 4.23. Trend line of students’ response for.Writing Part 1, Item No. 24
Figure 4.27. Trend line of students’ response for.Reading Part 3, item no. 28
Figure 4.26. Trend line of students’ response for. Reading Part 3, item no. 27
Figure 4.25. Trend line of students’ response for. Reading Part 3,item no. 26
123
Indicators of language competence
7. Ability to
