37
2. Evaluation
In gathering the data for evaluation, the researcher just used post- design questionnaires as research instrument. In the questionnaires for the post
design research, the researcher used the combination of both close ended and open ended questions.
The data for the evaluation were divided into two categories. The first category was about the respondents’ opinions on the designed materials which
were presented statically close ended questions. The second category was the respondents’ comments and suggestions which were explained in
sentences open ended questions.
a. Respondents’ Opinions on the Designed Materials
In the close ended questionnaire, the respondents’ opinions on the designed materials were assessed using five points of agreements.
Table 3.2 Points of Agreement
Point of Agreement
Meaning
1 If the respondents strongly disagree with the statements
2 If the respondents disagree with the statements
3 If the respondents agree with the statements
4 If the respondents strongly agree with the statements
To calculate the data from respondents’ opinions on the designed materials, the researcher used same calculation with pre-designed
PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI
38 questionnaire. The data collected in the post-design questionnaire would be
calculated using percentage as follows.
n_ x 100 ∑n
Notes: n = the total number of the scale chosen by the participants
∑n = the maximum scale of the statement of agreement
Then, the data were presented in the form of a table in which the participants’ opinions, the degree of agreement and the percentage were
included.
Table 3.3 The Descriptive Statistics of Participants’ Opinion
No. The Participants’
Opinion on... Frequency of the
Degree of Agreement
N Percentage
1 2 3 4
Note:
N = Number of participants
Those scores show whether the designed materials are good or acceptable or not. The designed materials are considered good and acceptable
if all the statements in the questionnaires have the percentage more than seventy-five percent. The designed materials are called good but needed
crucial revisions if the percentage shows fifty percent up to seventy-five
PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI
39 percent. The materials designed are called poorly designed if the percentage
is below fifty percent.
b. Respondents’ Comments and Suggestions
In the open ended questionnaire, which is incuded respondents’ comments and suggestions, the respondents had to write down their opinions
and suggestions about the designed materials. The result of the questionnaires was used to revise and improve the designed materials.
To analyze respondents’ comments and suggestions, the researcher listed all respondents’ comments and suggestions which included respondents’
comments on the strengths, the weaknesses, and their suggestions of the designed materials. Based on respondents’ comments and suggestions, the
researcher revised the designed materials in order to make better designed materials.
F. Research Procedure