2. Readability of the Test
To measure internal validity of instrument test of text writing, the writer measured readability of the instrument. Readability tests are indicators that measure how text a
document is to read and understand. For evaluators, readability statistics can be solid predictors of the language difficulty level of particular documents. The essential
information in an evaluation document should be easily understandable.
11
In addition, according to Jornes and Bartllet, the best way to know whether documents are truly
easy to read is by asking for feedback from readers representing the intended audiance.
12
To know readability of the text test instrument, the writer followed Kouame’s research. Participants will be asked to evaluate instructions and the understandability
of each item on a scaleof to 10, where, I describe an item that is easy to read and 10 described an item that is difficult to read.
13
The questions are tested individually. The participants may not have difficulties in understanding because they take the context
of the writing into consideration. After that, the writer measured mean of each item. Based on the finding of Kouame’s research, if the mean of all items of the instrument
11
Julien B. Kouame, Using Readability Tests to Improve the Accuracy of Evaluation Documents Intended for Low-Literate Participants, Journal of Multi, Disciplinary Evaluation Vol. VI NO. 14
August 2010, Michigan: Western Michigan University, 2010, p. 133. Accessed on july 10
th
, 2016, 7:15 pm
12
Jones and Bartllet, Assessing Readability with Grade Level Formula, http:www.readability.com-assesing-readability-with-grade-level-formula. Accessed on October 4
th
, 2014, 21:12 pm
13
Julien B. Kouame, Loc. Cit.
text has mean under 4.46, the instrument is quite readable and understandable by the readers or test takers.
14
3. Reliability
Indeed Arikunto says that: Realibility shows that the instrument can be believed to be used as a tool of data collecting technique when the instrument is good enough.
15
If the data are true based on the facts, how many data will take the result will be same.
Reliability shows the degree of main stays about something. Reliability means the data can be believed so it can be relied on.
To know the reliability of test, the writer uses the following steps: 1. Giving pre-test and post-test items to students out of sample.
2. Collecting the result and analyzing it. 3. Analyzing the difference between the pre-test and post-test result.
To get the reliability of the test, the writer used inter-raters reliability. It was done by three raters who examine the students’ narrative text writing ability test with the
intention of knowing the reliability of the test. The statistical formula for counting the reliability is variant formula as follows:
= 1 − 6 ∑ D
NN − 1
14
Ibid., p.134
15
Suharsimi Arikunto, Op. Cit, p. 60