46
3. The Result and Discussion of Evaluation
In this part, there are four areas of discussion of the reading exercise design. They are the description of the respondents as evaluator, the results of
close-ended, and the result of open-ended evaluation.
a. The Description of the Evaluator
There were four evaluators of reading exercise design. They were from two English teachers of SMP Pangudi Luhur 1 Yogyakarta who taught VII grade
students and two active lectures who taught in English Language Education Study Program ELESP of Sanata Dharma University. The first teacher is female who
had more than 15 years ‟ experience in teaching English and she had Bachelor‟s
degree. Then, the second teacher i s male and he also got Bachelor‟s degree. He
also had 5 years ‟ experience in teaching English. The male teacher followed a
short education of the use of curriculum 2013. Other evaluators were two lecturers who had more than 15 years
‟ experience in teaching English. Both of them are males and t
hey had Doctorals‟ degree. The researcher chose the evaluators‟ group based on the design evaluation‟s need. The design needed to
evaluate from teachers and lecturers who had experiences in teaching English, especially in reading skill and knowledgeable in the use of technology. Here are
the complete data of evaluators design can be seen in Table 12 below.
Table 12. The Description of the Evaluators Participants
Gender Educational
Background Teaching Experience
in year
Female Male S1
S2 S3
5 5-10
10-15 15
Teacher 1 Teacher 2
Lecturer 1 Lecturer 2
47
b. The Result of Close-Ended Evaluation
In evaluating the design, the researcher distributed evaluation sheets as in questionnaire. There were two parts in close-ended session, such as exercise and
Hot-Potatoes parts. The exercise part used to measure the reading exercises look like. There were 10 questions; first, the lesson plan provided time allocation in
each unit. There were 3 evaluators from 4 strongly agreed with the given time allocation in each unit. Thus, the researcher did not need to change the time
allocation. Second, there was an evaluator disagreed with the given reading exercises for the seventh grade students. While 3 of them agreed about the
exercises design. Because of this statement achieved the lowest score than the other statements, the researcher added more varied exercises and texts in each
unit. Third, the exercises in each unit were in accordance with the given indicators in lesson plan. However, the researcher needed to change and add some indicators
because the exercises will be added in each unit. Fourth, this research found that the evaluators chose agree part in the language usage is easy to understand. The
researcher only needed to revise the grammar in the language usage. Fifth, the evaluators agreed that the level of difficulty from simple-to-complex in each unit
is well-arrange. Thus, the researcher did not need to revise the arrangement of the difficulties level. Sixth, the given statementsdirections were not ambiguous and
the three evaluators agreed in this statement. However, the researcher changed and revised some directions in each exercise because an evaluator disagreed about the
given directions are not ambiguous. Seventh, the evaluators agreed that the given questions are easy to understand. Thus, the researcher did not need to change the
48 language usage in the questions provided. Otherwise, the researcher needed to
check the grammar usage and added the questions in each unit because the researcher added more varied exercises in each unit. Eight, the answers provided
in multiple choice tasks are not confusing and in this statement, an evaluator agreed and the others strongly agreed with this statement. Thus, the researcher
kept in consistent this statement in each exercise. Ninth, both questions and answers connected with the given statement. Hence, the researcher kept in
consistent this statement in each exercise. Last, there were not any mistyped in both reading texts and reading exercises provided in each unit. In this statement,
the evaluators agreed. Hence, the researcher needed to improve this part when adding some exercises in each unit. Therefore, the data evaluation result in detail
can be seen in Table 13 below.
Table 13. A Statistic
Description of Evaluators’ Feedback Using Evaluation
No. Statements
Range Disagree
Agree 1
2 3
4 EXERCISE
1. The time allocation is suitable
with the exercise 1
3 2.
The exercise is appropriate for 7
th
grade students 1
3 3.
The exercise can fill the indicators given
3 1
4. The language usage is easy to
understand 1
3 5.
The level of difficulty is suitable for 7
th
grade students and well- arranged
4 6.
The statements are not ambiguous
1 3
7. The questions are easy to
understand 2
2 8.
The answers are not confusing 1
3
49
No. Statements
Range Disagree
Agree 1
2 3
4
9. The given questions and answers
are connected 1
3 10.
There is not any mistyped 1
3
The second part was about the Hot-Potatoes program works in the website. This research found that the evaluators agreed if the program was easy to
administer within the three programs usage, such as JQuiz, JMatch, and JCross. Then, the second statement three evaluators agreed and an evaluator disagreed
about the second statement, because of bad Internet connection which made some pictures disappeared and comments box could not work properly. The evaluators
agreed in the third statement about the use of Hot-Potatoes program in each unit. Then, the fourth statement got three agreed from evaluators and an evaluator who
disagreed in the fourth statement. In the fifth statement, the evaluators agreed and through this research, the researcher did not need to use another weblog because it
is very easy to log in by using Pbworks. Therefore, the data evaluation result in detail can be seen in Table 14 below.
Table 14. A Statistic Description of Evaluators’ Feedback Using Evaluation
No. Statements
Range Disagree
Agree 1
2 3
4 HOT-POTATOES PROGRAM
1. The program is easy to
administer, such as matching tasks, crossword puzzles, and
multiple-choice tasks 1
3
2. There are not any difficulties in
doing the exercises using Hot- 1
1 2
50 Potatoes
3. The exercise in each unit are
using Hot-Potatoes 1
3 4.
The program can work well in the website, namely Pbworks
1 1
2 5.
There are not any difficulties to log in using Pbworks
1 3
c. The Result of Open-Ended Evaluation
T he researcher also received evaluators‟ feedbacks in form of open-ended
questions. The researcher asked about the design looked like, the weaknesses, the strengths, the given topic, and the needs to improve the design. These were the
results of evaluators‟ feedbacks on the reading exercises design as seen in the narrative description below.
1 The Evaluators’ Feedback on How the Design looks like
Through this research, the researcher found that the design was interesting for teen-age students and good as a whole since English is learnt using
technology. It was also useful to improve students‟ interest in learning English.
Probably, the design could prevent stu dents‟ boredom in learning English.
The feedback were positive in this part. Thus, the design was quite good based on the result of evaluation. However, the researcher needed to improve and
revise the design color of weblog so that the students will be more addicted in doing the exercises.
2 The Evaluators’ Feedback on the Weaknesses of the Design
This research found that the design should be more eye-catching, because the design were to plain and less colorful for the layout. Additionally, some
pictures in exercises could not work well. Again, there were some grammatical
Kategori