36
product. It is important to choose an expert to validate the product because it is the way to check whether the content and the face validity were appropriate or not for
the students. According to Borg and Gall 1983 there were three characteristic as the product’s evaluator.
a. The evaluator must be master in education.
b. The evaluator must have teaching experience in speaking class.
c. The evaluator must have teaching experiences more than a year.
Since the evaluating results were the tools to revise the product, those characteristics were used to determine the success of the evaluating process.
C. Research Instruments
This research used four instruments such as observation, interview, questionnaire, and document. However, the use of instruments were divided into
two steps as follows.
1. Pre-Design Instruments
In this part, the researcher used observations, interviews, and questionnaires as the instruments. At the first step, observation checklist was
chosen since the researcher was going to observe the teachers and students when they were learning about speaking. The used of observation form could be helpful
in diagnosing the effectiveness of speaking materials that were used by the teacher and the students in the class.
37
The researcher distributed questionnaires to collect background data. There were two types of questionnaires namely the close form and the open form.
The first was close form questionnaires. Closed questions asked the respondent to choose among a possible set of answers. The response represented hisher
viewpoint. The second was open form questionnaire. Open-ended or free-response questions were not followed by any choices and the respondent must answer by
supplying a response, usually by entering a number, a word, or a short text. Then, the researcher held the interviews to the teacher and the students.
The researcher chose the students randomly to set the data validation. Interview was chosen in order to get more and specific data about the kinds of the speaking
materials which was used in the speaking class and whether it was effective or not. The type of questions in the interview was open-ended questions. Therefore,
the respondents could answer the questions freely.
2. Post-Design Instrument
In this stage, the researcher had designed the speaking materials. The researcher consulted it to the evaluators who were classroom teacher and three
lecturers. The evaluators did document analysis of the materials designed. They evaluated and gave some comments to the materials. In addition, the evaluators
also filled the questionnaires provided to gain some opinions, comments, suggestions, and criticisms. The questionnaires were in the form of close ended
and open ended questions. Closed questions asked the respondent to choose among a possible set of point in the agreement scale. Then the open ended
38
questions are used to gain more comments and suggestions deeper from the evaluators.
D. Data Gathering Technique
