Research Method Research Setting

21 semester students’ mastery. Here, each correct number was scored one 1 and each incorrect answer was scored zero 0. To obtain the final score, the total score achieved by the students were multiplied by three, and then the result was deprived by two. Based on the academic regulation of Sanata Dharma University, which was writtern in Peraturan Akademik Universitas Sanata Dharma 2002: 14, the students’ mastery is perceived if the the total score the students achieved reach 56 of the total score. Based on the academic regulation in Sanata Dharma University, the category of scores is as follows: 80 - 100 A very good 70 - 79 B good 56 - 69 C sufficient 50 - 55 D insufficient ≤ 49 E poor Brown 2004 stated that the reliability of the test is defined as the extent to which the test results can be considered consistent or stable p. 20. In this research, the researcher used K-R 20 formula to calculate the reliability of the test because the formula was used to determine the homogeneity which was based on the proportion of correct and incorrect answer which was stated in Ary et al 2002 p.258. The formula would be presented as: �� = � � − 1 � 2 − � � 2 Where �� = the reliability of the whole test 22 � = number of items in the test 2 � = variance of the total score squared standard deviation = proportion of correct responses on a single item = proportion of incorrect responses on the same item In order to know whether the test was reliable or not, the writer used the table of value of reliability coefficient. The classification is presented in Table 3.1. Table 3.1: The Classification of Reliability Coefficient Best, 1981, p. 255 Coefficient r Relationship 0.00 to 0.20 Negligible 0.20 to 0.40 Low 0.40 to 0.60 Moderate 0.60 to 0.80 Substantial 0.80 to 1.00 High to Very High 2. Data Collection The researcher distributed a test to the students to obtain the data. The test was conducted in some classes of the sixth and eighth semester students of English Language Education Study Program of Sanata Dharma University. After designing the test and assuring that it already met the requirements. The researcher administered the test to two classes of sixth semester students. The test is also given to eighth students randomly. Within the population of the whole sixth and eighth semester students, the researcher took fifty four students of sixth