Multiple-Choice Items Essays Validity of the Test

k : The number of questionnaire item : The sum of item variance : Total variance Arikunto 1998:193

3.7.4 Test

I use a pre-test, a post-test, and a formative test in this study. The purpose of giving pre-test is to measure the students’ reading ability before they are taught by using ‘Look Ahead 2’ textbook. The purpose of the post-test is to measure the students’ achievement of teaching and learning. The formative test is given after the teaching and learning process. Department of National Education defines that the purpose of formative is to measure students’ achievement in mastering the material given in a certain period. This type of assessment is called achievement assessment 1994: 3. The formative test consists of 15 multiple-choice items and 10 essays.

3.7.4.1 Multiple-Choice Items

I give 45 multiple-choice items that should be answered by the students. There are 15 multiple-choice items to be answered in the pre-test, 15 items for the formative test and the rest is given in the post-test. Before the test is used as the instrument for collecting the data, I make some preparations: 1 I select six reading passages. 2 I make some questions from the text. The test consists of 50 items. 3 I consult the test to the advisor. 4 After getting some revision, the multiple-choice items are ready to be tried out. The time allotment is 45 minutes. 5 After conducting the try-out test, the answer sheets will be scored. Then, the score of each item will be analyzes to decide which test item can be used as the instrument. The analysis is based on the result to find out validity, reliability, difficulty level and discriminating power for each test item.

3.7.4.2 Essays

The second type I use is essays. I give 30 essays that should be answered by the students. First, I give 10 essays on the pre-test. Then, 10 essays are given in the formative test and 10 essays for the post-test. In preparing the essays, I take the following steps: 1 I select three narrative texts from ‘Look Ahead 2’ textbook. 2 I take the questions that are acquired from the book on each text. 3 I consult the advisor. 4 I select 10 questions that are valid and reliable based on the face validity on the stage 3. 5 After getting some revision, the essays are ready to be used as the test.

3.7.4.3 Validity of the Test

Validity is the important principle of the most complex criterion of an effective test. It shows whether the instrument is valid or not. According to Gronlund 1998: 226 as quoted by Brown 2004: 22 validity is the extent to which inferences made from assessment results are appropriate, meaningful, and useful in terms of the purpose of the assessment. A valid test of reading ability actually measures reading ability. The validity of the instrument is analyzed using The Product Moment Formula: In which: rxy : coefficient of correlation between x and y variable or variable of each item. N : the number of studentssubject participating in the test. ∑X : the sum of score in each item. ∑X 2 : the sum of the square score in each item. ∑Y : the sum of total score from each student. ∑Y 2 : the sum of the square score from each student. ∑XY : the sum of multiple of score from each student with the total score in each item. Arikunto 1998:174 3.7.4.4 Reliability of the Test Brown 2004: 20 argues that a reliable test is consistent and dependable. If you give the same test to the students or matched students on two different occasions, the test should yield similar result. To calculate the reliability of the test, I use this formula: { } { } 2 2 2 2 xy r ΣΥ − ΝΣΥ ΣΧ − ΝΣΧ ΣΥ ΣΧ − ΝΣΧΥ = Where: r 11 : reliability of test k : the number of the items p : proportion the subject answering the item incorrectly q : proportion the subject answering the item correctly S 2 : total variance Arikunto 1998:193

3.7.4.5 Difficulty Level