78
notes were written by the researcher herself as the practitioner of the materials. The field notes also function as concrete suggestions related to what happened in
the classroom as well as the suggestions to the a better version of the designed materials.
d. Test Worksheet
There were two kinds of tests in main field testing. They were pre-test and post-test. Since the course includes the integrated skills, in addition, the tests were
also skill-integrated. The idea of test items in pre-test and post-test that cover four English skills was adapted from Linguapeace Test in English 2002. In
developing the questions, questions in pre-test were different with questions in post-test. The following table contains the blueprint of the pre-test and post-test.
Table 3.9. The Blueprint of Pre-Test and Post-Test Skills
Pre-Test Post-Test
Time Allocation
Listening Part 1: The students write down five vocabulary items
they listen to. 5 items 20’
Part 2: The students fill in the blanks related to the sentences they listen to. 10 items
Part 3: The students listen to a short dialogue. The students will answer two questions based on the short
dialogue they listen to. 2 items
Speaking Part 1: The students pronounce five words. 5 items
30’ Part 2: The students answer three questions about their
own experiences in becoming wedding organizer. 3 items
Part 3: The students describe the wedding brochure with their own words.
Reading Part 1: The students do an exercise about TrueFalse
statements based on the wedding package. 5 items 30’
Part 2: The students answer questions based on a very short passage. 3 items
Writing The students write a short paragraph about particular topic
given. 20’
Total 100’
79
The words used in both pre-test and post-test are all about wedding organization. The difference between content in pre-test and post-test is on the
vocabulary used and level of language utilized. As in post-test the students have already finished the course, it is expected that the students have gained more
vocabulary mastery and enhance their English ability. Therefore, the language level used in post-test will be more proficient than in pre-test.
To validate the questions in the tests, questionnaires were distributed to the respondents. Brown 2004 states:
By far the most complex criterion of an effective test – and arguably
the most important principle – is validity, “the extent to which
inferences made from assessment results are appropriate, meaningful, and useful in terms of the purpose of the assessment p.
22.
In verifying the validation of the pre-test and post-test, the questions proposed by Khalifa 2003, in Weir, 2005 are adopted. However, the
questions provided only represent the existence of face and content validity. Meanwhile, the construct validity can be seen from the blueprint of the pre-
test and post-test.
E. DATA ANALYSIS TECHNIQUE
As both qualitative and quantitate data are gathered in the research, therefore, this research utilized different data analysis technique. In dealing with
qualitative data, the data analysis technique was coding categorization. Whereas, the quantitative data would be analyzed through descriptive statistics and
inferential statistics, particularly paired samples t-test. PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI
80
1. Descriptive Qualitative
This data analysis technique is for the interview results and field notes. After obtaining the data, the researcher took some steps which ere reducing the
data, coding categories, generating themes, and interpreting. As Strauss and Corbin 1998 state that:
Basically, in interpreting the data, the researcher conceptualize and reduce data, elaborate categories, and relate it through a series of
prepositional statements. Conceptualizing, reducing, elaborating, and relating are referred to as coding p. 11.
Furthermore, the typical ways of analyzing the interview data were also proposed by Marshall and Rossman 2006, “the analytic procedures fall into
seven phases: organizing the data, immersion in the data, generating categories and themes, coding the data, offering interpretations, and writing the report for
presenting the study” p. 156. To conclude the ways of interpreting the data, Lichtman 2013 proposes three Cs: coding, categorizing, and concepts p. 251
which can be seen in the following figure.
Figure 3.9. The Three Cs: Coding, Categorizing, and Concepts Lichtman, 2013: 251
In the research, as the qualitative data are gathered through interview and observation, therefore the results of the interview and field notes would be
analyzed. The interview and field notes were transcribed. In the interview results, PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI
81
the role of the blueprint of the interview will make the researcher easier to codes the interview transcripts. Based on the categories of the interview protocol, the
researcher collect any utterances or expressions that represent particular themes. Highlighting particular utterances or expressions in the interview transcripts in
different colors would also become a way to categorize which utterances or expressions to be included in which categories. After the categories were all being
obtained, the researcher came to an interpretation of the results of the interview.
2. Descriptive Statistics
The descriptive statistics was used to analyze the data gathered by using Likert scale and close-ended questionnaire. In analyzing the Likert scale data, the
researcher utilized the central tendency. Brown and Rodgers 2002 state that “central tendency, the trend of a set of numbers that clusters around a particular
value, is a convenient way of summarizing data nominal categories such as Likert scale” p. 74. Therefore, the means of central tendency of every statement were
counted. The following is the appearance of the form of the questionnaire after added the column of the central tendency.
Table 3.10. The Form of the Likert Scale Results Blank
No. Statements
Frequency of Points of Agreement
Central Tendency
1 2
3 4
5 N
Mn
Notes: N
= Number of the respondents Mn
= Mean
Here is the formulation to get mean of the data: PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI
