132
preliminary field testing, main product revision, main field testing, and operational product revision.
1. Preliminary Field Testing
In the preliminary field testing, the assigned evaluators validate the materials as a form of summative evaluation. The evaluation took three ways of
evaluation which were in forms of interview, questionnaires, and field notes in order to get more valid data. As stated in the previous chapter, selecting evaluators
was based on their experiences in dealing with material development. The following table shows the descripton of the evaluators.
Table 4.12. The Description of the Evaluators’ Background
Evaluators Gender
Educational Background
Experience year
Female Male
S1 S2
S3 1
1-5 10
Evaluator 1 √
√ √
Evaluator 2 √
√ √
Evaluator 3 √
√ √
Evaluator 4 √
√ √
The dates of interviewing the evaluators were 1 December 2016 evaluator 1 2, 2 December 2016 evaluator 3, and 5 December 2016 evaluator 4.
Before conducting interview sections, a day before, the evaluators received the designed materials to make them have longer time to evaluate the designed
materials. Filling in the questionnaires and giving their field notes were also done in the same day with the interview sections. The data obtained from those three
ways was represented in the following sections of analysis of the data and overview of the suggestions in preliminary field testing.
133
a. Analysis of the Data
After obtaining the data from the evaluators, the data was then analyzed qualitatively. Moreover, the questionnaire was analyzed descriptively as there
were only four evaluators contributed. The analysis of the data in the preliminary field testing is divided into three parts: 1 interview analysis, 2 questionnaire
analysis, and 3 field notes analysis.
1 Interview Analysis
In giving questions to the evaluators, there are five topics covering layout and design, activities, English skills, language level, and overall appropriateness
of the designed materials. After transcribing and analyzing the interview results using coding techniques, five themes were generated. Those five themes were 1
the materials have excellent layout and design, 2 the activities are challenging, 3 the English skills are well-integrated, 4 the language level is already
appropriate, but need to be adjusted, and 5 the materials are already appropriate to be implemented, but need to be revised.
a Theme 1: The materials have appropriate layout and design.
In evaluating the layout and design of the design materials, all of the evaluators agreed that the designed materials showed appropriate layout and
design. The following part is included in the interview transcript of the first evaluator.
Oh, excellent . There’s nothing to comment on. I Ie 2; page 266
134
Furthermore, the second evaluator gave more detail evaluation related to the layout and design of the designed materials which is represented in the
following interview part. The layout so far so good. I think, my last comment on the layout, e,
I think I didn’t give much critics and also suggestions because it has been already good. And I think, in terms of face validity and also
when I looked at the design, I think, it’s already appropriate and I
can, related to the font of the text, it’s okay, and it’s consistent. And also, it’s not too big and also not to small, and it’s appropriate. And
also, related to the pictures, the pictures are already good. I mean, the resolutions of the pictures are already good. So I can see clearly
the pictures and also what happens in the picture. But, related to the pictures, I think you should, e, give information about the source of
the pictures. Because I think, you do not take the pictures by yourself. I mean, you take the pictures from..you browse it from the
Internet, you download it from the Internet, and then you attach it in your material design. And then I think, to avoid plagiarims, you
should add the references of the source of the pictures. J Ie 2; page 267
In giving positive evaluation toward the design and layout, the second evaluator suggested to add the resource of the pictures used in the materials.
Furthermore, another positive evaluation of the design and layout was delivered also by the third evaluator.
OK. First of all, the layout, I think the layout is very good and interesting enough. And then, the layout also readable for the
students and also for the teachers and also for the others, maybe. And then the materials inside the design is very good. It has
connection with wedding organizer and then it can improve students’ knowledge even the students who do not know English at all, they
can understand the materials well. K Ie 2; page 269
The last claim to judge the appropriateness of the design and layout was also delivered by the forth evaluator. It can be seen from the following interview
part. PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI
