Observation Data Gathering Technique

73 alternatives: 1 strongly disapprove, 2 disapprove, 3 undecided, 4 approve, and 5 strongly approve. Furthermore, the following table represents the points of agreement used in the questionnaire. Table 3.4. Points of Agreement Points of Agreement Meaning 1 Not at all important 2 Slightly important 3 Moderately important 4 Very important 5 Extremely important The following table is the table to record the members’ opinion toward the blueprint of the designed materials. The contents in the questionnaire are classified into seven categories as there were seven units provided in the designed materials. The complete table can be seen in the appendix. Table 3.5. The Form of the Blueprint of the Materials Blank Contents Scale 1 2 3 4 5 3 Questionnaire in Preliminary Field Testing The role of the questionnaire in preliminary field testing was to support the interview results and field notes about the materials. The evaluators were asked to fill in the questionnaires to enrich the data which would be used to revise the materials. The questionnaire was adopted from Demir Ertas 2014 due to the complexity of the categories being included in the questionnaire. Moreover, the questionnaire consists of 54 questions covering subject and content, skills, sub- skills, layout and physical make-up, and practical consideration. 54 questions in PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI 74 the questionnaire are results of compilation of either questions or statements from other 23 different checklists of materials evaluation. The questionnaires in this step utilized Likert Scale which contain five points of agreement as suggested by Best Kahn 2006. The following table represents the blank format of the questionnaire. Table 3.6. The Form of the Questionnaire Blank No. Statements Frequency of Points of Agreement 1 2 3 4 5 Furthermore, for the following table represents the points of agreement used in the questionnaires. Table 3.7. Points of Agreement Points of Agreement Meaning 1 Strongly disagree 2 Disagree 3 Undecided 4 Agree 5 Strongly agree

b. Interview Protocol

In interviewing the respondents, interview protocol was utilized to make the interview effective and efficient. The role of interview protocol is also as a tool to produce a structured interview. Cresswell 2003 states that “the interview protocol includes a heading, opening statements, the key research questions, probes to follow the key questions, etc. ” p. 190. Furthermore, the existence of interview protocol in the interview session has some advantages such as addressing a list of questions structurally and systematically and as becoming a