Written Test Research Instruments

Table 3.3. The translation of noun phrase No Noun Phrase Translation 1 a. Computers komputerseperangkat computer b. data-processing equipment perangkatalat mengolah data 2 a. a balance sheet Neraca b. two sides that must be always be in balance dua sisi yang harus senantiasa seimbang 3 a. business transaction transaksi bisnistransaksi usaha b. economic events that affect the financial position of a business entity kegiatanperistiwa ekonomi yang mempengaruhi posisi keuangan sebuah badan usahabisnis 4 a. the purpose of a balance sheet tujuan dari neraca b. the financial position of business on certain date kondisi keuangan perusahaan pada waktu tertentu 5 a. an audit pemeriksaan keuangan b. the reliability of the accounting report reliabilitas dari laporan akuntansi 6 a. the solution of this problem solusi untuk permasalahan inikasus ini b. a chronological record of all transactions sebuah catatan kronologis dari semua transaksi 7 a. modern accounting akuntansi modern b. a basic component of business management sebuah komponen dasar dalam pengelolaan usaha 8 a. extensive financial information informasi keuangan yang luas b. various levels of government berbagai tingkat Pemerintahan 9 a. the document that report on an individual’s or organization’s business dokumen yang melaporkan perorangan atau sekelompok orang b. financial statement laporan keuangan 10 a. assets aset atau modal atau kekayaan b. economic resources owned by a business that are expected to benefit future operations sumber daya ekonomi yang dimiliki oleh sebuah perusahaan bisnis yang diharapkan mendatangkan keuntungan di masa depan 11 a. the statement of owners’s policy pernyataan dari kebijakan pemilik bisnis b. the changes in the owner’s capital account during the year perubahan dalam rekening modal pemilik selama setahun 12 a. the new employee working in your office pegawai karyawan baru di kantor muAnda b. a reputable accounting academy sebuah akaedemi akuntansi ternamayang memiliki reputasi baik The process of designing written test begins with clarifying the purpose of the written test, identifying the specific information to obtain, planning the sequence of questions, and developing the items based on the purpose and topic Cohen Manion, 2000, p. 246. The writer has to focus on the purpose of the written test, ensure that the data obtained from the instruments could answer the research questions, and formulate simple, clear and brief items. The format of the written test was random both pre-modification and post-modification noun phrase materials. As mentioned earlier, the written test was grouped in two instructions; identifying and rendering the noun phrase. PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI

3.3.2 Interview

The purposes of the interview are to gather information based on the research objectives, test hypothesis or suggest new ones, help to identify and explain the variables and the relationship Ary, Jacob, Sorensen, 2010, p. 30. In this research, the interview was used to gather information about the EFL learners’ opinions, beliefs, and feelings. In addition, interview method was used to engange the respondents to understand their experiences and understand the meaning about their experiences. The interview was designed as unstructured interview. The unstructured interview form was used because the interviewer follow the interviewees’ narration and generates questions spontaneously based on his or her reflection on that narration. Unstructured interview can be very use ful in studies of people’s information seeking and use. It is usually useful for studies attempting to find pattern, generate models, and inform information system design and implementation. Punch 1998 described unstructured interview as a way to understand the complex behavior of people without imposing any a priori categorization, which might limit the field of inquiry. Unstructured interviews as a natural extension of participant observation, because they so often occur as part on going participant obs ervation fieldwork Patton, 2002. The researcher’s control over the conversation is intended to be minimal, but nevertheless the researcher will try to encourage the interviewees to relate experiences and perspective that are relevant to the problems of interest to the researcher Burgess, 1984. This study designed the unstructured interview because it rely entirely on the spontaneous generation of questions in the natural flow of an interaction with the participants. The writer needed to review some theories and define the nature of the data to gather. Next, the writer had to design the interview plan. In the planning process, the writer needed to specify the variables of the research, formulate the great line of questions to gather information about the acquisition of noun phrase, select the respondents, obtain permission from the respondents, and arrange schedule. Then, the writer began to organize the data. This process involved transcribing the interview and coding the data. In transcribing the interview, the writer directly transcribed and selected the important points of the story. The obtained data were then classified, categorized into coding, and ordered to help the analysis process. Finally, the writer could analyze the obtained data. In the process of data analysis, the writer tried to catch and portray the uniqueness of what happened and find the regularities of answers. The result of the data analysis was used to verify the generalization about the population. The individual interview is also conducted in less formal situation. The purposes of conducting less formal interview are to invite the EFL learners to express their ideas and share opinions comfortably as well as maintain social interaction between the interviewer and respondents. The unstructured and less formal interview can invite more responses from the respondents and accommodate all possible and unpredicted answers. As a result, the interview can be matched with the situations and participants. PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI In order to confirm the result of written test, 7 participants were interviewed. The participants selected for the interview were those who had taken the structure class.

3.4 Pilot Study

A pilot study is one of the essential stages in a research study. A pilot study is necessary and useful in providing the groundwork in a research. The purpose of the pilot study is to assess the appropriateness and practicality of the data collecting instruments Ary, Jacob, Razavieh, 2006. It serves to check the clarify of instructions and lay out to eliminate ambiguities or difficulties in the wording of the test items, to gain feedback on the types of question and its format, to check the time taken to complete the tests, to check whether the test are to short or too long, too easy or too difficult, and to try out the codingclassification system for data analysis Cohen, Manion, Morrison, 2000. The pilot study run instrument consisted of three parts. Part one was the cover which displayed the type of the test and provided a space on which the EFL learner’s personal data were written. The second part consisted of introduction, directions on how to answer the questions, examples of the questions and how to answer them, and expression of gratitude for participating in the pilot study. The third part consisted of the questions. Fourteen sentences within two types of noun phrase were tested. The fourteen questions consist of two instructions; identifying and rendering the noun phrase. Totally, there are 24 noun phrases on twelve questions in the pilot study. The pilot study was conducted on 26 April 2016 , involving 10 subjects, the eighth semester of the English Study Program at Sebelas Maret University or called University of Surakarta. It was conducted in class under the supervision of a graduate student of UNS as a tutor. Each participant was given seven sheets of paper containing the test. Before the participants answered the questions, the participants were invited to follow the directions carefully. A tutor read aloud and explained the directions on how to answer the test or questions. If the participant did not understand the directions, they were encouraged to ask. The participants found the instructions clear and helpful. Then, the participants worked on the test. With respect to the direction in working on the test, both the tutor and the participants found the direction clear and the layout of the test acceptable. One necessary improvement they suggested was changing the “dua puluh” kalimat on the instruction became “empat belas” and deduction of maximum duration to do the test. The time taken to complete the test varied from 11 to 52 minutes. The types of items and test format were also appropriate, but the writer omitted 2 questions later for revision because two numbers of pre-modification noun phrase materials number 4 and 9 in the pilot study are redundant. The pilot study was also used to try out the coding and scoring system for data analysis. The scoring and coding of the answers to the test were found appropriate. Information on how PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI the scoring and coding of the answers is presented in detail in the data analysis section later. In establishing the acceptable answers, the supervisor of the writer suggested that the level of difficulties of questions should start from easier to more difficult and from short sentences to more complex sentences on test. This was necessary because it would make the test became structured.

3.5 The Main Study

The procedures in the main study involved research setting and respondents, data collection, and data analysis.

3.5.1 Research Setting and Respondent

The sampling technique was needed to select the samples effectively. Cohen et al 2000, p. 92 assert that “the quality of a piece of research not only stands or falls by the appropriateness of methodology and instrumentation but also by the suitability of the sampling strategy that has been adopted”. As discussed in the research design, the main study involved three different groups that made up big target population. Therefore, population can be considered valid if the sample resembles the target population. If the population is valid, the selected sampling from the population can be used to generalize the result because of its accuracy. Therefore, the sampling should have the capacity and characteristics of the target population because they will represent the population. The population of the current study