Decode letters and words match sounds with

111 Indicators of language competence

1. Decode letters and words match sounds with

letters, with phonic blends Test items coverage Students’ response Experts’ judgment No. 1 Successful Need to be revised No. 2 Successful Acceptable From the above table, it can be seen that item no 2 is acceptable from both side and the response of the student respondents has confirmed that this item is better than the previous one. Meanwhile, inconformity happens to item no 1. Although according to the expert respondent the item need to be revised, the response of the student respondents is fine. Therefore, the decision of revising the item will be formulated after observing the improvement feedback given by the expert respondents which will be elaborated in the discussion of the preliminary product revision. 2 Indicator 2: read and understand a growing range of vocabulary: This indicator is manifested into 5 items, no. 3 up to 7. The researcher designs the item format in the form of matching items. It contains two columns of words or phrases. One column contains words or phrases for which the students seek a match. Traditionally, this column is placed on the left and the phrases are referred to as premises. The second column contains words which are available for selection. The items in this column are referred to as responses. The premises are numbered and the responses are framed by squares. The students are required to draw a line from the premises to the matching responses. And below is the result of the trial test: Table. 4.2. Conformity between students’ response and experts’ judgment for manifestation of indicator 1, item 1-2 112 From the above table, it can be observed that the five items mostly have got correct responses from the student respondents. This can be seen from the trend line performances below: Indicator Reading , Part 2 Test items Students 1 2 3 4 5 6 7 8 9 10 11 12 Qualification high high high high Middle Middle Middle Middle Low low low low No. 3 1 1 1 1 1 1 1 1 1 1 1 11 No. 4 1 1 1 1 1 1 1 1 1 1 10 No. 5 1 1 1 1 1 1 1 1 1 1 1 11 No. 6 1 1 1 1 1 1 1 1 1 1 1 11 No. 7 1 1 1 1 1 1 1 1 1 1 1 11 TEXT UNDERSTANDING 2. Ability to read and understand a growing range of vocabulary Table. 4.3. Students’ response on Text Understanding Part 2, indicator 2, item no 3up to 7 Middle e Figure 4.3. Trend line of students’ response for Reading, Part 2, item no. 3 Reading Part 2, Item No. 3 Figure 4.4. Trend line of students’ response for Reading Part 2, item no. 4 Figure 4.5. Trend line of students’ response for Reading Part 2, item no. 5 Figure 4.6. Trend line of students’ response for Reading Part 2, item no. 6 113 It can be seen from the figures that the achievements of item no 3 up to 7 are almost similar. The items of all high and middle students have 4 correct responses, and of the low students got 3 or 2 correct responses. Although the middle and high students’ performance are equal, the trend lines of those items show a rising slope from left low to right high. Therefore items no 3 up to 7 can be concluded fulfilling the expected results. The conformity of the results with the experts’ judgments can be examined below: The feedbacks gathered from the expert judgment show that two respondents agree with the design of all five test items, but other two respondents only agree with one test item, namely item no 3 and suggest for revision for other four test items, namely item no 4, 5, 6, and 7. Therefore, the Indicators of language competence

2. ability to read and understand a growing range