5. Evaluation After the first draft was completed, it was then evaluated by employing
the expert judgment. It aimed to examine whether the first draft of the materials has or has not met the appropriateness from the aspects of content,
language, and visual appearance. For the instrument which was used to evaluate the materials, the researcher provided a questionnaire which was
adapted from BSNP 2011. 6. Revision
After being evaluated, the first draft of the materials was revised based on some feedback, comments, and suggestions which are already given by the
expert. Eventually, the revised materials were the final product of reading learning materials for the Grade XI students of the Patisserie Expertise
Program.
E. Data Collection Techniques and Instruments
In this research, there were two types of data that should be collected. They were data of the students’ target and learning needs and data for the
materials evaluation. Accordingly, the techniques of data collection which was implemented in this research were the needs analysis and the expert judgment.
The data from the needs analysis were used as the bases to develop the first draft of the materials. Then, the expert judgment was conducted after the first draft of
the materials had been completed. To collect the data, the researcher used questionnaires as the instruments.
1. The Needs Analysis Questionnaire As has been mentioned before, the needs analysis questionnaire was
used to gather data about the students’ needs. The questionnaire was in the form of multiple choices. There were close-ended questions and the
combination of close- and open-ended questions. The organization of the needs analysis questionnaire is presented below.
Table 4: The Organization of the Needs Analysis Questionnaire
No. Aspect of
the Question
The Purpose of the Question Number
of Items
References 1.
Students’ personal
identity to find out information about
who the students are Graves
2000: 103
2. Goals
to find out the students’ intention of learning English
and reading skill 1, 2
Graves 2000: 104
Target Needs 3.
Necessities to find out the students’ needs
based on the demands of the target situation
3, 4, 5 Hutchinson
and Waters 1991: 55
4. Lacks
to find out the gap between the students’ current knowledge and
the required level in the target situation
6, 7 Hutchinson
and Waters 1991: 56
5. Wants
to find out what the students expect to be included in the
materials 8, 9
Hutchinson and Waters
1991: 56
Learning Needs 6.
Input to find out the appropriate
written texts as the input for learning materials that the
students want the most 10, 11,
12 Nunan
2004: 47
7. Procedure
to find out what kinds of learning activities the students
like to do 13, 14,
15 Nunan
2004: 52
8. Teacher’s
roles to find out what the teacher is
expected to perform during the teaching and learning process
16 Nunan
2004: 64
9. Learner’s
roles to find out the information
about the learners’ roles during the teaching and learning
process 17
Nunan 2004: 64
10. Setting to find out what kinds of
situations the students like the most in doing the tasks
18, 19 Nunan
2004: 70
2. The Expert Judgment Questionnaire The expert judgment rating questionnaire was used to evaluate the first
draft of the developed materials. The aspects which were considered in the questionnaire were the content, language, and the visual appearance
appropriateness. There were two types of questions in this questionnaire. They were close-ended questions in the form of likert scales with four-point
scale and open- ended questions to accommodate the expert’s suggestions
related to the materials which were evaluated. The following table shows the organization of the expert judgment questionnaire.
Table 5: The Organization of the Expert Judgment Questionnaire
No. Aspect of the Evaluation
Number of Items
References Content
1. Relevancy
1-9 BSNP
2011 2.
Depth 3.
Accuracy 4.
Life skill development
Language 5.
The appropriateness for students’ level of development
10-15 BSNP
2011 6.
Language accuracy 7.
The unity of ideas Presentation
8. Presentation technique
16-26 BSNP
2011 9.
Presentation of the learning activity 10. Completeness of the presentation
Layout 11. Typography
27-35 BSNP
2011 12. Arrangement
13. Illustration
F. Data Analysis Techniques
