Criterion-Related Evidence of Validity

Table 3.2 The Reliability of the Test COEFFICIENT RELATIONSHIP 0.00 – 0.20 negligible 0.20 – 0.40 low 0.40 – 0.60 moderate 0.60 – 0.80 substantial 0.80 – 1.00 high to very high

E. Data Gathering Technique

The data was collected from the participants’ work through the test of reported speech. The test was given in different time and place to the students of the two classes chosen. The test was conducted in the class during Structure IV lesson. There were some steps done in gathering the data. First, the test papers were distributed to the students. Second, before doing the test, the students were given an explanation to make sure that they understood each part of the test instruction. Third, after finishing the test, the test papers with students’ answers were collected. Last, students’ answers were scored to find out the students’ mastery on reported speech and analysed to identify the types of errors of reported speech. Students’ answers were also used to identify the possible causes of errors by referring to the theory of sources of errors. Since this study focused on the fourth semester students, for those who were not the fourth semester students but taking the class, their works were not scored and not analysed. There were 52 answers collected from the fourth semester students. 38 PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI

F. Data Analysis

There were two steps used to analyse the data from the test as the instrument of this research. Those steps are explained as follows:

1. Checking and Scoring

This step was started by collecting the student’s answers. Then the students’ answers were checked to show the correct and the incorrect answers. Both the correct and the incorrect answers were given different check marks, circle O for the correct answers and cross X for the incorrect answers. It was intended to make easier to classify the answers. After checking, each item of the test was scored. For all items in part A and part B, the scoring used a scale 1-0, one 1 was for the correct answer and zero 0 was for the incorrect answer. Each correct item then was counted to show the students’ scores. The result of scoring system both of each item and of the total score the sum were presented in the table. Then, the students’ scores were counted and presented in the table of the students’ achievement in the test. The presentation of the students’ achievement in the test would answer problem formulation number one.

2. Classifying

This was the last step of data analysis. The students’ errors were classified based on 1 the types of errors proposed by Dulay et al., 2 the grammatical changes of reported speech, and 3 the types of reported speech. Then the students’ errors were counted into percentage form and presented in the tables of errors based on their types. The presentation of the types of errors would answer problem formulation number two. After presenting the types of errors in the table, this step proceeds to analyse the possible causes of errors based on Brown’s theory, which answered problem formulation number three. 39 PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI