68
Table 4.11 The Summary of Summative Evaluation in Open-ended Questionnaire
No Items
Participants’ Opinion Lecturer 1
Lecturer 2
1 Comments on the
designed materials 1. Very good
materials, especially strong in
reflection or conclusion phase.
1. Good enough materials for Cave
Tubing guides. 2. The materials are
simple and it provides limited
possible activities. Suggestions on the
designed materials 1. Giving more
opportunity for the guides to express
and explore themselves.
1. The researcher may consult course book
more to enrich the insights.
2. Provide more varied activities.
2 Comments
on the teacher’s guide 1. Understandable
2. Helpful 1. Clear in instruction
The data in Table 4.11 showed that the designed materials were good and suitable for cave tubing guides. However, the researcher had to revise on the task
activities . The task should give more opportunity to explore guides’ competencies
and skills by themselves. The designed materials needed some varied activities. The researcher was suggested to consult course books more to enrich the various
kind of activities. For the teacher’s guide, it was understandable, helpful and clear
in instructions.
5. Main Product Revision
The revision was done to present the final version of the designed materials. The revision was made based on the suggestions from the
experts’ validation on the summative evaluation inn preliminary field testing. The
researcher accepted the suggestions from the experts ’ validation. The researcher
69
would provide more varied activities, would make the tasks to give more opportunity to express and explore guides’ competencies and skills, and would
consult course books to find out various kinds of activities. The researcher found some books to add various activities to the designed
materials. Before revising the designed materials, the materials were about identifying conversation and making conversation with unclear clues about what
learners should do with the conversations. Then, the researcher made more varied activities such as tasks to express ideas and to guess true or false. The researcher
also made clearer clues and examples about what the learners should do with the task.
6. Main Field Testing
This step actually was not the step to design the designed materials. The purpose of main field testing was to obtain data of a formative evaluation in Dick
Carey’s instructional design model 2009: 1 which was used in this study. To gain the data of the formative evaluation, the researcher implemented the designed
materials to the target learners – the tour guides of Kalisuci Gunungkidul. Thus, in this study, the researcher taught the learners using the designed materials and then
conducted the formative evaluation. The formative evaluation was done by distributing evaluative questionnaires to the learners. The researcher used both
closed and open form of questionnaire. The all of the questions asked about the speaking materials to find out whether or not the learners enjoyed learning
speaking through the designed materials and whether or not the designed
70
materials helped them to fulfill their needs. The results of closed form of questionnaire can be seen in Table 4.12.
Table 4.12 The Results Of Formative Evaluation in Close-ended Questionnaire
No Participants’ Opinion
Central Tendency
N Mean
1 The materials are suitable for the needs of cave
tubing guides. 15
4.67 2
The materials motivated me to be active to speak in English.
15 4.27
3 The materials are easy to be practiced in
everyday guiding. 15
3.93 4
The materials are interesting to be practiced. 15
4.00 5
The materials are not boring. 15
4.00 6
The units and the materials are sequenced from the easiest one to the most difficult one .
15 4.47
7 The conversation materials are interesting and
suitable for cave tubing guides. 15
4.13 8
Role-playing brings an effective way to express my speaking skills and competencies.
15 4.00
9 The
tasks instruction
are clear
and understandable.
15 3.87
10 The layout of the designed materials are
interesting. 15
4.00
From the Table 4.12, the mean was at the range of 3.87 to 4.67. Furthermore, the mean in statement number one was 4.67. It was concluded that
the designed materials were suitable for the needs of the tour guides of cave tubing acvtivities because the mean 4.
67 was considered as “agree” in the degree of agreement. The complete results of closed form questionnaires can be seen in
Appendix D. In order to gain the suggestions to make the next revision, the researcher also distributed closed form questionnaires. There were some
suggestions to be considered in revising the final version of the designed
71
materials. The summary of the data in closed form questionnaire can be seen in Table 4.13.
Table 4.13 The Summary Of Formative Evaluation in Open-ended Questionnaire
No Items
Participants’ Opinion
1 The easiest topic and the
reason why the topic is the easiest one than other topics
1. Greeting, leave taking, and introducing self and others, because those topics had
been taught for many times in school so that it can be remembered easily.
2 The most difficult topic and
the reason why the topic is the most difficult one than
other topics 1. Asking for and giving directions because
there are many words to remember. 2. Making a correct composaition of a
sentence. 3
Suggestions for the design materials
1. More repetition on the difficult topics. 2. Teach us again how to make a correct
sentence.
Based on Table 4.13, it could be concluded for the next revision that the researcher might add materials in making correct sentences for speaking class.
Then, for the difficult topic about asking for and giving directions, the researcher might add more hours. Since, this study was only taking six steps of the
educational RD steps, the researcher did not revise the final version of the designed materials. Therefore, the suggestions to revise the materials in formative
evaluation can be used by the next researchers who are interested in developing the speaking materials for cave tubing guides.
B. The Final Presentation of the Designed Materials
This section was to answer the second research problem, namely, what task-based English speaking materials using for the tour guides of Kalisuci
