30
4. Preliminary Field Testing
It is the step of evaluating the designed materials. It can be done by distributing interview checklist, questionnaire and observation. The data would be collected
and analyzed. The result of evaluation can be useful for revising and improving the designed materials.
5. Main Product Revision
The results of preliminary field testing are used to revise and improve the materials. The revision of the product should be based on the evaluation and
analysis.
B. Research Participant
The respondents of the research are thirty eight students of grade XI in Seminari Pius XII Kisol, Manggarai Timur, Flores, NTT. Besides the students, the
participants of the study are also three English teachers in Seminari Pius XII Kisol and two English lecturers in English Education Study Program in Sanata Dharma
University. The thirty eight students participated in need analysis and evaluation. They
were asked to fulfill the questionnaire related to students’ need analysis in research and information collection step and in material evaluation in preliminary
field testing step. The three English teachers and two lecturers were asked to evaluate the
designed materials. They participated in preliminary field testing. The teachers
31 were asked because they had experiences in teaching English in Seminari Pius XII
Kisol. The two English lecturers were asked as competent and qualified evaluator. They were asked to evaluate and give comment about the materials.
C. Research Instruments
The instruments that were used in the research were questionnaire and interview checklist. The questionnaire and interview checklist were given to the
students in phase of research and information collecting. They just got the questionnaire in phase of preliminary field testing. The teachers and the lecturers
just got questionnaire for evaluation in the phase of preliminary field testing. The questionnaire and interview check list were given to the students to
gain the data about students’ need analysis. The questions for students’ need analysis related to the process of learning and teaching writing in seminary, the
source of materials, and students background knowledge about the genre of writing. The questions for interview related to the genre and topics. The students
also got the questionnaire for evaluation in preliminary field testing. The questions for students’ evaluation related to their opinion about the proposed
materials. The questionnaire and interview checklist were distributed to the students in order to know their needs and to know their comment and evaluation
about the materials. The questionnaires were given to the teachers and lecturers in preliminary
field testing. The questions related to their evaluation about the designed
32 materials. The questions were given to find their opinion on the designed
materials. It also aimed to get their suggestion or recommendation for the improvement of the materials.
All the questions for questionnaire were formulated in the form of Likert Scale close-ended question. The respondents were asked to register on a 5 4 3 2
1 scale to respond to the questionnaires given. The respondent’s answers indicated their attitudes to a certain case the stage of agreement and disagreement or their
frequency of doing things the stage of frequency. For students’ need analysis, the answers to questions related to the stage of frequency. For evaluations, the
answer related to the stage of agreement and disagreement strongly agree = 5; agree = 4; doubt = 3; disagree = 2; strongly disagree = 1.
D. Data Gathering Technique