AN ANALYSIS OF THE QUALITY OF TEACHER-MADE TEST IN EFL CLASSROOM AT GAMALIEL ELEMENTARY SCHOOL AND ITS WASHBACK IN TEACHING AND LEARNING - UNS Institutional Repository

  AN ANALYSIS OF THE QUALITY OF TEACHER-MADE TEST IN EFL CLASSROOM AT GAMALIEL ELEMENTARY SCHOOL AND ITS WASHBACK IN TEACHING AND LEARNING THESIS

  By: DESRINLEBAGI S891508007

  Written as a Partial Fulfillment of the Requirements for Graduate Education Degree of English Language Teaching

  ENGLISH EDUCATION OF GRADUATE SCHOOL TEACHER TRAINING AND EDUCATION FACULTY SEBELAS MARET UNIVERSITY 2017

  PRONOUNCEMENT This is to certify that I myself write this thesis entitled “An Analysis of the

  Quality of Teacher-Made Test in EFL Classroom at Gamaliel Elementary School and Its Washback in Teaching and Learning”. It is not a product of plagiarism or made by others. Anything related to others’ works is written in quotation, the sources of which are listed on the list of references.

  If then this pronouncement proves false, I am ready to accept any academic punishment including the withdrawl or cancelation of my academic degree.

  Surakarta, April 2017 DesrinLebagi MOTTO “Pura-pura ua puru ndaya I mPue, pura-pura tila kabangke nto’o Nda”

  “It’s only by His grace and only for His glory”

  DEDICATION This thesis is lovely dedicated to my beloved parents (Surya

  Morianto Lebagi and Erma Mustapa) who always pray and support me on and on. I could pass this process because of you. Thank to brother of mine, Juan Pascal Ruutana, my lovelysiblings, my big family, DEAVID, AMAU, D2A, and all of my friends. Last, but not least, thank to Martoria Alfonsus Bintindjaja as supporting partner.

  ABSTRACT DesrinLebagi. S891508007. 2017. An Analysis of the Quality of Teacher-Made Test in EFL Classroom at Gamaliel Elementary School and Its Washback in Teaching and Learning. A Thesis. First Consultant: Dr. Sumardi, M.Hum; Second Consultant: Dr. Sudjoko, M.A. English Education Department, Graduate School, Sebelas Maret University.

  The main objective of this research is to describe: (1) the quality of test items including the difficulty index, the discrimination index, the distractor index, and the reliability of the test; (2) the washback of teacher-made test on teacher’s way of teaching; and (3) the washback of teacher-made test on students’ motivation in learning English.

  This case study was conducted at Gamaliel Elementary school, Palu, Central Sulawesi in Academic Year of 2016-2017. The sampling used in this research was purposive sampling. In collecting the data, the researcher used interview, observation, and document analysis as the techniques of collecting data. The informants were an English teacher and students of Gamaliel Elementary School. The documents were students answer sheets that were analyzed using ITEMAN program. The data were analyzed by using Interactive Model.

  Based on the analysis, it can be concluded that: (1) the teacher-made test administered in final examination overall can be classified as a good test; (2) the teacher-made test administered in final examination brought positive washback on teacher’s way of teaching including what teacher teaches and how teacher teaches; (3) the teacher made-test distributed in final examination brought both positive washback and negative washback on students’ motivation on learning. It influences what students learn and how students learn. Therefore, it is recommended for the English teacher to increase the awareness about the importance of conducting test analysis to know the quality of his made test. The students are suggested not only to study when they have examination, but also study when they do not have any examination. It is recommended for the school to instruct all teachers to analyze the quality of their test and the washback of test itself in their way of teaching. For the other researchers who intend to conduct similar research, the result of this research can be useful as an additional reference. Keywords: Teacher-made Test, Washback, Teaching, Learning

  ACKNOWLEDGEMENT Praise The Lord Jesus Christ for all His abundant blessing, mercies, and guidance, hence the writer can complete the process of writing this thesis. First of all, the researcher would like to express the biggest thanks to LPDP-RI Scholarship. The completion of this thesis is due to valuable support and help from some people as mentioned below:

  1. The Dean of Teacher Training and Education Faculty, Sebelas Maret University, Prof. Dr. Joko Nurkamto, M.Pd 2. The Head of English Department of Graduate Program, Dr. Ngadiso, M.Pd.

  3. Dr. Sumardi, M.Hum, the first consultant for his kindly guidance, support, and academic advice.

  4. Dr. Sujoko, M.A, the second consultant for his support, patience and pray.

  5. Ni Nyoman Suhermi, M.A., M.Pd, the Headmaster of Gamaliel Elementary School, for her lovely support, guidance, advice, and permission in carrying out the research.

  6. Irfan, S.Pd, the English teacher of Gamaliel Elementary School for his kindly cooperation and help in collecting the data.

  7. The fifth grade students of Gamaliel Elementary school.

  8. The writer’s family, all friends and everyone who have given help to the researcher in accomplishing this thesis.

  Surakarta, April 2017 DesrinLebagi

  TABLE OF CONTENT TITTLE .......................................................................................................... i APROVAL ..................................................................................................... ii LEGITIMATION .......................................................................................... iii PRONOUNCEMENT .................................................................................... iv MOTTO ......................................................................................................... v DEDICATION ............................................................................................... vi ABSTRACT ................................................................................................... vii ACKNOWLEDGEMENT ............................................................................. viii TABLE OF CONTENT ................................................................................. ix LIST OF TABLES ......................................................................................... xiii LIST OF FIGURES ....................................................................................... xiv LIST OF APPENDICES ............................................................................... xv

  CHAPTER I: INTRODUCTION A. Background of the Study ........................................................................... 1 B. Problem Statements.................................................................................... 6 C. Objectives of the Study ............................................................................. 7 D. Benefits of the Study ................................................................................ 8 CHAPTER II: LITERATURE REVIEW A. Definition of Test ....................................................................................... 9

  a. Standardized Test ........................................................................... 11

  b. Teacher-made Test ......................................................................... 12

  B. Test Significances for Teaching and Learning ............................................ 13

  b. Positive Washback in Teaching and Learning ................................. 29 E. Test Item Analysis Using ITEMAN ...........................................................

  G. Research Framework .................................................................................. 48

  F. Related Studies .......................................................................................... 41

  d. Distractor Index .............................................................................. 40

  c. Discrimination Index ...................................................................... 39

  b. Difficulty Index .............................................................................. 39

  a. Reliability ..................................................................................... 36

  30

  27

  C. Characteristics of Good Test ...................................................................... 14

  D. Definition of Washback ............................................................................. 21 a. Negative Washback in Teaching and Learning ...............................

  3. Usability ......................................................................................... 20

  2. Reliability ...................................................................................... 19

  d) Face Validity ............................................................................ 18

  c) Construct Validity ..................................................................... 17

  b) Criterion-related Validity .......................................................... 16

  a) Content Validity ....................................................................... 15

  1. Validity .......................................................................................... 14

  CHAPTER III: RESEARCH METHODOLOGY A. Time and Place of the Research ................................................................ 49 B. Research Method ...................................................................................... 50

  C. Sources of the Data ................................................................................... 51

  a. Events ........................................................................................... 52

  b. Informants ...................................................................................... 52

  c. Documents .................................................................................... 52

  D. Techniques of Data Collection .................................................................. 53

  a. Interview ........................................................................................ 53

  b. Observation .................................................................................... 54

  c. Document Analysis ........................................................................ 54

  E. Trustworthiness ........................................................................................ 55

  a. Triangulation .................................................................................. 56

  b. Member Checking .......................................................................... 56

  c. Rich and Thick Description ............................................................ 57

  F. Technique of Data Analysis ...................................................................... 57

  a. Data Reduction ............................................................................... 58

  b. Data Display ................................................................................... 58

  c. Drawing Conclusion and Verification ............................................. 58

  CHAPTER IV: RESEARCH FINDINGS AND DISCUSSION A. Research Findings ...................................................................................... 59

  1. The Quality of the Teacher-made Test ............................................ 59

  a) The Difficulty Index of the Test Items ..................................... 67

  b) The Discrimination Index of the Test Items ............................. 70

  c) The Distractor Index of Test Items .......................................... 72

  d) Reliability of the Test .............................................................. 79

  2. The Washback of Test on Teacher’s Way on Teaching ................... 80

  3. The Washback of Test on Students’ Motivation on Learning ......... 82

  B. Discussion ................................................................................................. 85

  1. The Quality of the Teacher-made Test ............................................ 85

  a) The Difficulty Index of the Test Items ..................................... 86

  b) The Discrimination Index of the Test Items ............................. 88

  c) The Distractor Index of Test Items .......................................... 89

  d) Reliability of the Test .............................................................. 90

  2. The Washback of Test on Teacher’s Way on Teaching ................... 92

  3. The Washback of Test on Students’ Motivation on Learning ......... 95

  CHAPTER V: CONCLUSIONS, IMPLICATIONS AND SUGGESTIONS A. Conclusions ............................................................................................... 99 B. Implications .............................................................................................. 100 C. Suggestions ................................................................................................ 101 REFFERENCES ............................................................................................ 103 APPENDICES ................................................................................................ 109

  LIST OF TABLES

Table 2.1 The Differences between Standardized Test and Teacher-made Test 10Table 3.1 Research Schedule............................................................................ 49Table 3.2 Research Mapping ............................................................................ 55Table 4.1 The Output of ITEMAN Analysis ..................................................... 60Table 4.2 The Difficulty Index of Test Items .................................................... 68

  Table 4.3The Discrimination Index of Test Items ............................................. 71

Table 4.4 The Distractor Index of Test Items ................................................... 73

  

Table 4.7TheTrichotomy Backwash Model ...................................................... 81

  LIST OF FIGURES

Figure 2.1 Input Data in Notepad ..................................................................... 33Figure 2.2 ITEMAN Process ............................................................................ 34Figure 2.3 Result of ITEMAN.......................................................................... 35Figure 2.4 Scale Statistics of ITEMAN Result ................................................. 37Figure 3.1 Interactive Model proposed by Miles and Huberman ....................... 57Figure 4.1 Scale Statistics of ITEMAN Result ................................................. 80

  LIST OF APPENDICES Appendix 1: Interview Transcript with the English Teacher ............................. 109 Appendix 2: Interview Transcript with the Students ......................................... 118 Appendix 3: Observation ................................................................................. 138 Appendix 4: English Test Items of Final Examination ...................................... 149 Appendix 5: Students’ Answer Sheets .............................................................. 156 Appendix 6: List of Pictures ............................................................................. 197 Appendix 7: Letter of Research Permission ...................................................... 198