AN ANALYSIS OF THE TEACHER COMPETENCE ON DEVELOPING RUBRIC TO ASSESS ENGLISH COMPETENCE OF EIGHTH-GRADE STUDENTS IN SMPN 1 SEDATI SIDOARJO (CASE STUDY).

AN ANALYSIS OF THE TEACHER COMPETENCE ON DEVELOPING RUBRIC TO ASSESS ENGLISH COMPETENCE OF EIGHTH-GRADE

STUDENTS IN SMPN 1 SEDATI SIDOARJO

(CASE STUDY)

THESIS

Submitted In Partial Fulfillment of the Requirement for the Degree of Sarjana Pendidikan (S.Pd) in Teaching English

By

Silvy Millata Shallianah

D05212028

ENGLISH TEACHER EDUCATION DEPARTMENT

FACULTY OF TARBIYAH AND TEACHERS TRAINING

SUNAN AMPEL STATE ISLAMIC UNIVERSITY

SURABAYA

STUDENTS IN SMPN 1 SEDATI SIDOARJO

(CASE STUDY)

THESIS

Submitted In Partial Fulfillment of the Requirement for the Degree of Sarjana Pendidikan (S.Pd) in Teaching English

By

Silvy Millata Shallianah

D05212028

ENGLISH TEACHER EDUCATION DEPARTMENT

FACULTY OF TARBIYAH AND TEACHERS TRAINING

SUNAN AMPEL STATE ISLAMIC UNIVERSITY

SURABAYA

ADVISOR APPROVAL SHEET

This thesis by Silvy Millata Shallianah entitled “An Analysis of The Teacher’s Competence On Developing Rubric To Assess Students Competence Rubric of

Eighth-Grade Students In SMPN 1 Sedati Sidoarjo (Case Study) ” has been

approved by the thesis advisor for further approval by the Boards of Examiners.

Surabaya, October 13rd, 2016 Advisor,

Dra. Irma Soraya, M.Pd NIP.196709301993032004

LEMBAR PERNYATAAN PERSETUJUAN PUBLIKASI KARYA ILMIAH UNTUK KEPENTINGAN AKADEMIS

Sebagaisivitasakademika UINSunanAmpel Surabaya, yang bertandatangan di bawahini, saya:

Nama : SILVY MILLATA SHALLIANAH

NIM : D05212028

Fakultas/Jurusan : FTK/PENDIDIKAN GURU BAHASA INGGRIS E-mail address : Cicy.sshallianah20@gmail.com

Demi pengembangan ilmu pengetahuan, menyetujui untuk memberikan kepada Perpustakaan UIN Sunan Ampel Surabaya, Hak Bebas Royalti Non-Eksklusif atas karya ilmiah :

Skripsi Tesis Disertasi Lain-lain (………)

Yang berjudul :

AN ANALYSIS OF THE TEACHER COMPETENCE ON DEVELOPING RUBRIC TO ASSESS ENGLISH COMPETENCE OF EIGHTH-GRADE STUDENTS IN SMPN 1 SEDATI SIDOARJO (CASE STUDY)

Beserta perangkat yang diperlukan (bilaada). Dengan Hak Bebas Royalti Non-Ekslusif ini Perpustakaan UIN Sunan Ampel Surabaya berhak menyimpan, mengalih-media/format-kan, mengelolanya dalam bentuk pangkalan data (database), mendistribusikannya, dan menampilkan/mempublikasikannya di Internet atau media lain secara fulltext _{untuk kepentingan akademis tanpa perlu meminta ijin dari saya} selama tetap mencantumkan nama saya sebagai penulis/pencipta dan atau penerbit yang bersangkutan.

Saya bersedia untuk menanggung secara pribadi, tanpa melibatkan pihak Perpustakaan UIN Sunan Ampel Surabaya, segala bentuk tuntutan hukum yang timbul atas pelanggaran Hak Cipta dalam karya ilmiah saya ini.

Demikian pernyataan ini yang saya buat dengan sebenarnya.

Surabaya, 4 November 201

Penulis

(SILVY MILLATA SHALLIANAH)

KEMENTERIAN AGAMA

UNIVERSITAS ISLAM NEGERI SUNAN AMPEL SURABAYA

Saya yang bertanda tangan dibawah ini:

Nama : SILVY MILLATA SHALLIANAH

NIM : D05212028

Jurusan/Program Studi : PENDIDIKAN BAHASA INGGRIS

Fakultas : TARBIYAH DAN KEGURUAN

Menyatakan dengan sebenarnya bahwa skripsi yang saya buat ini benar-benar merupakan hasil karya saya sendiri bukan merupakan pengambil-alihan tulisan aau pikiran orang lain yang saya akui sebagai hasil tulisan saya atau pikiran saya sendiri.

Apabila kemudian hari terbukti atau dapat dibuktikan bahwa skripsi ini hasil jiplakan, maka saya bersedia menerima sanksi atasa perbuatan tersebut.

Surabaya, 13 Oktober 2016 Yang membuat pernyataan,

Silvy Millata Shallianah D05212028

ABSTRACT

Silvy Millata, S. (2016). “An Analysis of The Teacher Competence On Developing Rubric To Assess English Competence of Eighth-Grade

Students In SMPN 1 Sedati Sidoarjo (Case Study)” A Thesis. English

Teacher Education Department, Faculty of Tarbiyah and Teaching Training, Sunan Ampel State Islamic University, Surabaya. Advisors: Dra. Irma Soraya, M. Pd

Key Words : Teacher Assessment Competence, Teacher’s Rubrics

As one of the education components, teachers have the most important position in determining educational success. However the fact some researches show that both parents and government are still unsatisfied with the teachers’ competence. It

means that teachers’ competency are not significant in progress to build better ways in their teaching. Even the government gives program to increase the income; it does not give any change with the condition. Another program from the government to help the condition is UKG. However the result shows that many teachers still that get low score. Then as one of the important competence in teaching, assessment process also should get special attention. Like designing rubric for assessment, it is one of roles for teachers as the reflection of their competence. In SMPN 1 Sedati, the teacher uses rubric for assessing role play performance accurately and give feedback tranparancy. However to decide and create the appropriate assessment and an effective rubric, teacher should have a good competence in assessment. This paper examines the teacher competence and the teacher’s rubrics in role play assessment. This study measures the teacher competence in assessment based on standard of the teacher competence in educational assessment. And also the analysis of the rubrics emphasizes on the quality of the rubrics based on the metarubric standard. To answer those problems, this study uses descriptive qualitative method for case study. Meanwhile, the sources of the data are the result of interview, observation checklist and metarubric checklist. The result shows that the teacher competence was good. She could do almost all the criteria. However the teacher should still need to improve the strategy in time management and prepare for optional plan. In addition, for the teacher’s rubric based on the metarubric shows that teacher is also good enough but still need improvement for some points like the criteria or dimension, description, scale level and the other components of the rubric like title, aim and scoring procedure.

xi

LIST OF CONTENT

Page

TITLE SHEET... i

ADVISOR APPROVAL SHEET ... ii

APPROVAL SHEET ... iii

MOTTO ... iv

DEDICATION SHEET ... v

ABSTRACT ... vi

ACKNOWLEDGEMENT ... viii

PERNYATAAN KEASLIAN TULISAN ... x

TABLE OF CONTENTS ... xi

LIST OF TABLES ... xiii

LIST OF APPENDICES ... xiv

CHAPTER I: INTRODUCTION A. Research Background ... 1

B. Research Questions ...9

C. Objective of the Study... 9

D. Significance of the Study...10

E. Scope and Limitation of the Study ...10

F. Definition of Key Term...11

CHAPTER II: REVIEW OF RELATED LITERATURE A.Theoretical Framework ...14

1. Profressional Teacher ...14

2. Teachers’ Condition in Indonesia and the Government Solution………...16

3. Differences between Measurement, Assessment, and Evaluation in Education ………..………...17

4. Teacher Competence………...20

5. The Standards For Teacher Competence In Educational Assessment of Students………...23

6. Teacher Competency Test (UKG) ………...30

a. Benefits of UKG ………...31

b. Principle of UKG ………...32

c. Competence Tested in UKG…………...32

7. Rubric………..………..………..…...34

a. Definition of Rubric………...34

b. Steps of Developing Rubric .…...35

c. Types of Rubrics………...38

xii

8. Role Play ...40

a. The Definition of The definition of Role Play...40

b. Benefits of Role Playing...41

c. Examples of Role Play Exercises ……...43

B. Review of Previous Studies ...44

CHAPTER III: RESEARCH METHOD A. Research Design ...49

B.Researcher Presence ………...50

C. Research Location ……….………...51

D.Data and Source of Data ...52

E. Data Collection Technique ...53

F. Research Instrument ...54

G.Data Analysis Technique ...55

H.Research Stages ...56

CHAPTER IV: RESEARCH FINDING AND DISCUSSION A. Research Finding...60

1. Teacher Competence Based On The Standard For Teacher Competence In Educational Assessment of Students..………...60

a. Teacher Competence in Choosing Assessment Methods...61

b. Teacher Competence in Developing Assessment Methods………....64

c. Teacher Competence in Administering, Scoring and Interpreting the Results of Assessment Methods…...69

d. Teacher Competence in Using Assessment Results When Making Decisions about Individual Students and Planning Teaching…...74

2. An Analysis of The Teacher’s Rubrics ...79

a. Teacher developed Rubrics...79

1. Writing Script Rubric ………....…………...82

2. Reading Script Rubric………...84

3. Practice Rubric ……….……...…………...87

B. Discussion ...89

1. The Teacher Competence Based On The Standard For Teacher Competence In Educational Assessment of Students...89

2. An Analysis of The Teacher’s Rubrics……...…...92

CHAPTER V: CONCLUSION AND SUGGESTION A. Conclusion ... 95

B. Suggestion ... 96

REFERENCES APPENDICES

xiii

LIST OF TABLE

Table Page

Table b.1 Basic rubric grid formats ………...36

Table c. 1 Definition of analytic and holistic rubrics ………38

Table c. 2 Definition of general and task- specific rubrics ………...39

Table E.1 Techniques for Collecting Data Based on Research Questions ……..53

Table c. 1 The observation criteria for point one and two………...…..70

Table c. 2 The Research Finding: observation research result 8 grades 4.1 and 4.2 class………..…...…...71

Table d. 1 the observation checklist for point three and four………..…...76

Table d. 2 The Research Finding: observation research result 8 grades 4.1 and 4.2 classes………... 77

Table 1.1 Teacher’s Rubric for Writing skill………...80

Table 1.2 Teacher’s Rubric for Reading skill………...81

Table 1.3 Teacher’s Rubric for Practice skill ………...…………..81

xiv

LIST OF APPENDICES

Appendix 1 (Previous Research)

Appendix 2 (Metarubric Checklist) Appendix 3 (Observation Checklist) Appendix 4 (Interview Guideline) Appendix 5 (Teacher’s Rubric)

Appendix 6 (Metarubric Result)

Appendix 7 (Observation Checklist Result)

Appendix 8 (Interview Result)

Appendix 9 (Students Score)

Appendix 10 (Teacher’s Lesson Plan)

Appendix 11 (Letters)

1 CHAPTER I INTRODUCTION

This chapter provides the background of the study that describe the reasons why the researcher conducts the study. It also contains the problem of the study, objective of the study, and significance of the study. Next, the scope and limitation of the study is presented. Finally, the definition of key term is given to avoid misundersanding of those terms.

A. Background of Study

Education was a strategic way to improve the quality of the human resources, thus serve as one measurement level progress of a nation. Therefore, efforts to improve the quality education continuously should be done in order to achieve the objectives according to the preamble of the 1945 Constitution, namely developing the intellectual life of the nation.1 To build intelligent human beings who were able to compete with developed countries, the nation required professional teachers as educators which were being major determinant of educational success. The awareness of teachers about their responsibility of maintaining the quality of education, encouraged the teachers to always strive improving its quality in order to obtain maximum learning results in school.

In an effort to improve the quality of teachers, Indonesia launched a ground-breaking policy in 2005 through Law No. 14/2005 on teachers and

1

2

lecturers. Accordingly, the government started TCP (Teacher Certification Program) as an ambitious program in 2007 to test, evaluate and certify around 3 million Indonesian teachers.2 By giving this certificates, hopefully teachers would continuously improve their competence.

Unfortunately, many certified teachers did not feel obliged to maintain and improve their competency. Some studies about teachers’ competency including that by the World Bank in 2012 had found that the teachers' certification had no significant impact on their competency. It meant that teachers’ competency were not significant in progress to build better ways in their teaching, even teachers have enough income.

In addition, there was another program from the govenment to measure the teachers’ competence that is called UKG (Teacher Competency Test). The result of UKG test in 2015, General of Teachers and Education Resources Director (GTK) Kemendikbud, Sumarna Surapranata said that the results for pedagogic competence is only 48.94 in average. This was below the minimum competency standards (SKM) of 55. Even for this pedagogical field, there was only one province that was above the national average while reaching SKM, namely Yogyakarta (56.91). In addition he also said that the teachers were lack of teaching strategies, so their teaching competence must be considered.3

2

/Teacher%20certification%20%20Competency%20detraction%20%20%20The%20Jakarta%20P ost.htm accessed on August 2016

3

Kementerian%20Pendidikan%20dan%20Kebudayaan%20%C2%BB%20Republik%20Indonesia. htm Accessed on August 2016

However this test result could not be the only reference for the government and people to judge the teachers who got low score with incompetence, unqualified and unprofessional teachers. Mr. Sumarna stated that there was a teacher who got the average value 85. However , the teacher had shortcomings in several groups of competencies.4 From these data showed that there were many teachers still had low competency based on the standards value. The consequent, it would affect the learning success which was done by the teachers and ultimately it would also affect on the quality of education. So, there should be more considerations to know the teachers competence. Eventhough UKG result test is also important.

Measuring teacher competence had a big reason to create every teacher to be professional teachers. However, to be a professional teacher had been arranged in the policy number 14 in 2005. It was about the job of teachers and lecturers that had more practical responsibility in educating, teaching, guiding, training, assessing and evaluating the students.5 In addition, teacher competency in Indonesia was devided into four competencies. One of the competecy was pedagogy competence. Pedagogy competence was the management ability of participants learners that includes six points abilities. However, some of them were included the important parts in evaluation. Such as understanding the

4

Kementerian%20Pendidikan%20dan%20Kebudayaan%20%C2%BB%20Republik%20Indonesia. htm Accessed on August 2016

5

4

learners, development of curriculum / syllabus, designing learning, evaluation of learning outcomes.6

Then as parts of the teachers’ job in assesing and evaluating the students, these four abilities had role which were important each other, like teacher should understand the students in their capability before deciding the assessment. Then teacher also should be capable in developing curriculum/syllabus which it must be there was assessment part. It was also for designing learning for the students in lesson plan as a teacher plan for every meeting. And the last was evaluation of the learning outcomes to know the students progress during the learning process.

By evaluating teacher competence in student assessment, the teachers associations said that it was an essential part of teaching because good teaching could not exist without good student assessment. 7 Another thing that also important was creating the assessment rubric, it was for scoring the students’ assignment.

However, even a good rubric could be made by the teacher, it was not a guarantee if the teacher could create and practice assessment well and appropriate with the purpose of the teaching learning process. A study conducted by Jenniver and team on students’ assessment revealed that teacher merely copied the questions at the back of textbooks without taking into cognizance the purpose and

6

Winano. Usaha Peningkatan Professionalisme Guru. (Yogyakarta: Kemendiknas) p.6 7

Accessed on 5 April 2016 http://buros.org/standards-teacher-competence-educational-assessment-students

used of the assessment results.8 It was based on the teacher competence which could influence the teaching learning process, the assessment and the scoring process.

Then one of the assignments that must use rubric was when teacher assessed the students’ competence especially in skill competence. However it could be assessed in role play assignment. It was because role play may have a bit complicated criteria for all the skill and to evaluate such as actions, roles, knowledge, understanding, skills, values and attitudes. Furthermore, assessment criteria should be clearly defined, unambiguous, measurable and verifiable.9 The way covered aforesaid criteria; a teacher needed a rubric including task description, scale levels of achievement, dimensions of the skills/ knowledge and description for each level of performance.10 Hence, it was clear that teacher should be transparent informing the criteria because a role play assessment was different from particular indicator.

In the reality, on the field teachers rarely made and used a rubric to score student’s role play activity, a case illustration was found after the researcher did preliminary research to 27 different schools, then the result only 14 schools used rubric (see on appendix 1).11 Ironically, this phenomenon became a common case

8

Jennifer Omo and Team. Standards for teacher competence in educational assessment of students: Nigerian teachers’ ratings of their need. The 36th International Association for Educational Assessment (IAEA). 2010. http://selectscore.com/ accessed on May 2016

9

Ndanduleni Norah Munyai. Effect of Role-Play as A Formative Assessment Technique On Job Performance. (University of South Africa Press. 2011). P. 28

10

Annelle D. Stevens and Antonia Levi. INTRODUCTION TO RUBRICS: An Assessment Tool to Save Grading Time, Convey Effective Feedback, and Promote Student Learning. (Virginia:Stylus Publishing. Sterling, 2005). p. 3

11

6

in education world that not all the teachers used rubric in the school even for the assessment which needs various criteria.

From these explanation and phenomena, the researcher was curious about how deep teacher understand on the way assessing the students which could be

influential for students achievement. The researcher used the standards for teacher competence in educational assessment of students developed by the American Federation of Teachers, National Council on Measurement in Education and National Education Association, had been taken from University of Florida.12 The researcher used that standard because in Indonesia there was no specific standard for educational assessment. And also the researcher described the rubric that was used by the teacher in assessing role play; to what extent the rubric follow the standard of metarubric.13

This research was conducted at one of school in Sidoarjo exactly at SMP N 1 SEDATI for the eighth graders. Taking specifically in this school as locus of this research was considered based on preliminary research in 27 different schools, only 2 two schools that gave role play test for the final exam but only one school held for eight grades.14 Then the researcher chose that school because some reasons: the first, because not all the teachers wanted their capability as a teacher to be evaluated. The second, because another school which used rubrics, it was for the third grade than it held two months ago. The third, another reason

12

Accessed on 5 April 2016 http://buros.org/standards-teacher-competence-educational assessment-students

13

Annelle D. Stevens and Antonia Levi. INTRODUCTION TO RUBRICS: An Assessment Tool to Save Grading Time, Convey Effective Feedback, and Promote Student Learning. (Virginia:Stylus Publishing. Sterling, 2005). p. 93

14

selected this school because the preliminary research showed only this school which used role play assessment for the eighth graders.15 In addition, the researcher looked for the eighth grades not ninth grades because the academic calendar for ninth grades showed national examination schedule.16

There were some different studies on teachers’ competence and scoring rubrics. Two researches focused on the consistency of the rubric criteria and analyze indeterminacy of rubrics.17 The previous study was done by Ana Filipe for her thesis under the title “A Comparative Analysis of Teacher Competence and Its Effect on Pupil Performance in Upper Primary Schools in Mozambique and Other Sacmeq Countries”. This study was to describe and explore the main factors that have an effect on Grade 6 teacher competence and pupil performance in reading and mathematics.18 The differences between these previous studies with the current study are in the previous study used theory of Medley’s Model of Teacher Effectiveness and Cheng and Tsui’s Models of Levels of Teacher Effectiveness.

The next study was done by Tierney & Simon from University of Ottawa in 2004. Investigated rubrics Focus on the consistency of the language that was used across the scale levels to describe performance criteria for learning and

15

Based on the preliminary research on 27 different schools on March-April 2016 16

Based on Academic school calendar for junior high school 2016 17

Robin T. & Marielle S. What’s still wrong with rubrics: Focusing on the consistency of performance criteria across scale levels. University of Ottawa. A peer-reviewed electronic journal. University of Ottawa. 2004. p. 1 and D. Royce Sadler. Indeterminacy in the use of preset criteria for assessment and grading. Assessment and Evaluation in Higher Education journal, 34. Griffith University. 2009.

18

Ana Filipe. A Comparative Analysis of Teacher Competence and Its Effect on Pupil Performance in Upper Primary Schools In Mozambique And Other Sacmeq Countries. (Pretoria: niversity of Pretoria, 2009).p. 47.

8

assessment. That rubric was to assess the mapping skills of elementary students.19 The differences between this previous studies with the current study are the focus of research, the previous study was only the consistency of performance criteria and this current study was for all aspect based on the standard of an effective rubric.The result showed that the verbal qualifiers of the attributes used in rubrics, and their underlying scales, had not been standardized to the degree that they were universally understood, and fuzziness was associated with the interpretations.

Another similar study agreed with assessment rubrics. The study conducted by Khusnaini Mufarrokhah from English Teacher Education Department entitled “A Study on English Teachers’ Assessment Rubric Development in International Class at SMP Muhammadiyah 5 Surabaya” aimed to know the ability of the teachers to develop assessment rubric and the use of the rubric. The result of the study showed that the teachers’ rubric have strong level and only need little revision.20

This research took the new idea of investigating the rubrics for role play as the assessment. It based on the standard of metarubric. Then for teacher competence in this study focuses on an English teacher to measure the teacher competence in assessment for developing rubric of role play. The result was expected to be able to give such information to the teachers related with designing

19

Robin T. & Marielle S. What’s still wrong with rubrics: Focusing on the consistency of performance criteria across scale levels. University of Ottawa. A peer-reviewed electronic journal. University of Ottawa. 2004. p. 1

20

Khusnaini Mufarrokhah, Undergraduate Thesis: A Study On English Teachers’ Assessment Rubric Development In International Class At SMP Muhammadiyah 5 Surabaya (Surabaya: FTK-PBI Universitas Islam Negeri Sunan Ampel Surabaya 2015)

a rubric and how to increase the teachers’ competence in assessment, so that they would make some improvement to design rubric and assessment.

B. Research Questions

Based on the phenomena in background of the study then the researcher was coriuos to search some points in the questions below:

1. How is the teacher competence in assessment at SMP N 1 SEDATI based on the standards for teacher competence in educational assessment of students?

2. How does the teacher’s rubric of students competence follow the metarubric standard as reflection of the teacher’s competence in assessment?

C.

Objective of the Study

From the research that would be done by the writer, there were some objectives of the researcher that would be found in this research, they were:

1. To describe the teacher competence in assessment at SMP N 1 SEDATI based on the standard for teacher competence in educational assessment of students.

2. To describe the teacher’s rubric of students competence as reflection of teacher competence in assessment at SMP N 1 SEDATI based on the metarubric standard.

10

D. Scope and Limitation

This research had two scopes to examine. The first scope was the teacher competence in assessment which would be measured by checking the standards for teacher competence in educational of students developed by the American Federation of Teachers, National Council on Measurement in Education and National Education Association. The researcher used this standard because in Indonesia still there was no specific standard which measured teacher competence in assessment. In addition, it serves seven standards, but the writer will only takes four points in this study based on the topic of this study.21

The second scope was the teacher’s rubric of students competence especially in skill competence. It was assessed in role play assignment the researcher would analyze that based on the standard of metarubric in Stevens and Levi’s book under the title Introduction To Rubrics: An Assessment Tool to Save

Grading Time, Convey Effective Feedback, and Promote Student Learning.22

E. Significance of the Study

This study attempted to give both theoretical and practical contribution. 1. Theoretically, this study is intended to contribute research on the ability to

measure the teacher competence in assessment and provide the advantages of rubric as a problem-solving for both teacher and students in evaluation. 2. Practically, this study is intended to give an insight of how the teachers

was measured the competence in assessment. How teacher was providing

21

Accessed on 5 April 2016 http://buros.org/standards-teacher-competence-educational-assessment-students developed by the American Federation of Teachers, National Council on Measurement in Education and National Education Association.

22

objective, validities, and transparency rule in evaluating that serve in a rubric.

This research could be useful for the teacher as the references to start evaluating the own teacher competence. It was also as the references for both teachers and students to use rubric in the class. However it was a prohibition before building a mistake and subjectivity in grading. For the students this research would be useful to open their mind that there is a way to make them achieve higher score in the class by knowing the rubric of the task because they would know what they should do. Whatever the subject of the study could be writing, speaking and also reading.

The result of this study was also expected to be useful for the future researchers who wanted to inverstigate deeper on teacher competence and rubric in improving the competence for teaching process. Another interesting topic for the future studies may be about the effcet of using rubric on the students’ response and their learning behavior.

F. Definition of Key Terms

1. Teacher competence in assessment was how teacher should be skilled in some aspects like choosing the assessment until using that assessment result when making decision about an individual student, planning teaching, developing curriculum and school improvement.23 Based on the researcher, teacher competence was a competence in

23

Accessed on 5 April 2016 http://buros.org/standards-teacher-competence-educational-assessment-students developed by the American Federation of Teachers, National Council on Measurement in Education and National Education Association.

12

teaching that takes big role in learning process to achieve the aim of the subject. In this study it focused more specifically on educational assessment competence of a teacher to decide or create an assessment then apply it in the classroom.

2. Pedagogical Competence was the management ability of participants’ learners that includes in six abilities.24 Pedagogical competence was teaching competence which should be understood by the teachers to be professional teachers. However there were four of the abilities were the important parts of assessment which became the focus of the researcher in this study.

3. According to Stevens and Levi said that rubric is a scoring tool that lays out the specific expectations for an assignment.25 It means that rubric is an answer table which serves both the teacher and students problem in a way to achieve high score. In this research the researcher focused on teacher’s competence in designing role play rubrics. So, teacher has to be able to connect the indicator together with criteria of a good performance.

4. Role play as an assessment technique equips the learner on how to apply what they have learned appropriate with OBE (Outcome Based Education).26 Role play as one of assessment that can build the students’ motivation to apply the skills in communication using

24

Winano. Usaha Peningkatan Professionalisme Guru. (Yogyakarta: Kemendiknas) p.6 25

Dannelle D. Stevens and Antonia Levi. INTRODUCTION TO RUBRICS... p. 3 26

Ndanduleni Norah Munyai. Effect of Role-Play as A Formative Assessment Technique On Job Performance. University of South Africa. 2011. P. 38 accessed on April 14th 2016 from http://uir.unisa.ac.za/bitstream/handle/10500/6100/thesis_munyai_n.pdf?sequence=1

English. In this case role play is the performance assessment which reflects the real situation problem. This assessment becomes a project for the students in the end of semester that should explore their creativity and the material that they had learnt.

14

CHAPTER II

REVIEW OF RELATED LITERATURE

The literature in this chapter the researcher describes some related theories and literature to the problems of this study in order to give relevant knowledge in the field. This review consists of four subheadings. They are: rubric, summative assessment, role play, and teacher competence.

A. Theoretical Framework 1. Profressional Teacher

Professional is the work or activities performed by a person life and a source of income that requires expertise, skills that meet quality standards or norms and requires specific professional education by Law No. 14 of 2005.1

Winarno quote from the education management journal for Educational Leadership issue of March 1993, about five things that required teachers to be professional.2 They are:

a. Teachers are committed to students and the learning process. It means that the teacher is the highest commitment to the interests of students. b. Teachers have control over the material in depth the subjects taught as

well as how to teach it to students.

c. Teachers are responsible for monitoring student learning outcomes through various evaluation techniques, starting from observation in the behavior of students to test learning outcomes.

1

Undang-Undang Republik Indonesia No. 14 tahun 2005, tentang Guru dan Dosen 2

d. Teachers are able to think systematically about what it does, and learn from his experience. This means that there should always be time for teachers in order to stage a reflection and correction of what have done. To get learning from the experience he must know which right and wrong, and good and bad impact on students' learning process. e. Teachers should be part of a learning society in the teacher’s

environmental profession.

Based on the Law of the Republic of Indonesia No. 14, 2005, stated that the principles of professionalism of the teaching profession is a field special work carried out by3:

a. Having the talents, interests, as calls of the soul and idealism.

b. Having the commitment to improve the quality of education, faith, devotion and moral noble.

c. Having academic qualifications and background of education in accordance with the task field.

d. Having the necessary competence in accordance with the task

e. Having responsibility for the execution as the tasks of professionalism f. Earning determined based on the job performance.

g. Have the opportunity to develop professionalism in continuing with life long learning.

h. Having the guarantee of legal protection in carrying out the task of professionalism

3

16

i. Having a professional organization that has the authority to regulate matters relating to the duties of professional teacher.

2. Teachers’ Condition in Indonesia and the Government Solution Various issues related to conditions of teachers4:

a. The diversity of the ability of teachers in the learning process and mastery of knowledge.

b. The absence of measurement tools to determine the ability of teachers. c. The guidance that does not yet reflect the needs.

d. Welfare is still inadequate for teachers.

If it is not addressed it will be able to have an impact on low quality of education. The low quality of education shall in two points such as: (1) The ability

of students to absorb teachers’ subjects is not optimal, (2) Less incomplete formation to build character which is reflected in the attitudes and life skills possessed students.

Because of the problems above, then the government create Accreditation and Certification Program as an effort to increase the quality of teachers and nationally. In Chapter IV in article 8 by law no. 14, 2005 states that teachers are required have academic qualifications, competence, teaching certificate, physically healthy and spiritual, as well as having the ability to realize the goal of national education. Academic qualifications can be obtained through higher education program degree or diploma program IV5.

4

Winano. Usaha Peningkatan Professionalisme Guru. (Yogyakarta: Kemendiknas) p.4 5

3. Differences between Measurement, Assessment, and Evaluation in Education

In Education specificly for evaluation process there were some steps that should be done to evaluate the students learning and take the students score. In evaluation there was always be part as called measurement and assessment in evaluation.

a. Measurement

Measurement beyond its general definition refers to the set of procedures and the principles for how to use the procedures in educational tests and assessments.6 Some of the basic principles of measurement in educational evaluations would be raw scores, percentile ranks, derived scores, standard scores, etc.

Measurement refers to the process by which the attributes or dimensions of some physical object are determined.7 Measuring such things as attitudes or preferences also applies. However, when people measure generally use some standard instrument to determine how big, tall, heavy, voluminous, hot, cold, fast, or straight something actually is. Standard instruments refer to instruments such as rulers, scales, thermometers, pressure gauges, etc.

People measure to obtain information about what is. Such information may or may not be useful, depending on the accuracy of the instruments we use, and our skill at using them. However to make it accuracy and valid the instrument, usually the researcher will ask some

6

Assessing Learners with Special Needs: 6TH ED. By Terry Overton 7

Bob Kizlik. Measurement, Assessment, and Evaluation in Education. 2012 http://www.adprima.com/measurement.htm accessed on September 2016

18

help from the other people that are skilled for the instrument. To apply a standard scale or measuring device to an object, series of objects, events, or conditions, according to practices after accepting by those who are skilled in the use of the device or scale.

b. Assessment

Test is a method to determine a student's ability to complete certain tasks or demonstrate mastery of a skill or knowledge of content. 8 Some types would be multiple choice tests, or a weekly spelling test. While it is commonly used interchangeably with assessment, or even evaluation, it can be distinguished by the fact that a test is one form of an assessment.

Assessment is the process of gathering information to monitor progress and make educational decisions if necessary.9 As noted in the definition of test, an assessment may include a test, but also includes methods such as observations, interviews, behavior monitoring, etc.

Another definition assessment is a process by which information is obtained relative to some known objective or goal.10 Assessment is a broad term that includes testing. A test is a special form of assessment. Tests are assessments made under contrived circumstances especially so that they may be administered. People test at the end of a lesson or unit. Then assessing progress at the end of a school year through testing, and people assess verbal and quantitative skills through such instruments. In that

8

Assessing Learners with Special Needs: 6TH ED. By Terry Overton 9

Assessing Learners with Special Needs: 6TH ED. By Terry Overton 10

Bob Kizlik. Measurement, Assessment, and Evaluation in Education. 2012 http://www.adprima.com/measurement.htm accessed on September 2016

sense, test or assess to determine whether or not an objective or goal has been obtained.

Assessment of skill attainment is rather straightforward. Skills are readily demonstrable. Assessment of understanding is much more difficult and complex. Skills can be practiced; understandings cannot. People can

assess a person’s knowledge in a variety of ways, but there is always a leap, an inference that people make about what a person does in relation to what it signifies about what he knows. In the section on this site on behavioral verbs, to assess means to stipulate the conditions by which the behavior specified in an objective may be ascertained. Such stipulations are usually in the form of written descriptions.

c. Evaluation

Evaluation is procedures used to determine whether the subject (i.e. student) meets a preset criterion, such as qualifying for special education services.11 This uses assessment (remember that an assessment may be a test) to make a determination of qualification in accordance with a predetermined criteria.

Evaluation is perhaps the most complex and least understood of the terms. Inherent in the idea of evaluation is "value."12 When people evaluate, what people are doing is engaging in some process that is designed to provide information that will help us make a judgment about a given situation. Generally, any evaluation process requires information about the situation in question. A situation is an umbrella term that takes

11

Assessing Learners with Special Needs: 6TH ED. By Terry Overton 12

Bob Kizlik. Measurement, Assessment, and Evaluation in Education. 2012 http://www.adprima.com/measurement.htm accessed on September 2016

20

into account such ideas as objectives, goals, standards, procedures, and so on. When people evaluate are saying that the process will yield information regarding the worthiness, appropriateness, goodness, validity, legality, etc., of something for which a reliable measurement or assessment has been made.

To sum up, people measure distance, people assess learning, and people evaluate results in terms of some set of criteria. These three terms are certainly connected, but it is useful to think of them as separate but connected ideas and processes.

4. Teacher Competence

Competence is defined as the knowledge and skills of basic values which is reflected in the habit of thinking and acting. Competencies owned by each teacher will show the actual quality of teachers13.

According to Crick cited in a book of supporting teacher competence development, a competence is best described as „a complex combination of knowledge, skills, understanding, values, attitudes and desire which lead to effective, embodied human action in the world, in a particular domain’. Competence is therefore distinguished from skill, which is defined as the ability to perform complex acts with ease, precision and adaptability. On the other hand in national educational policies, there is a wide variety of approaches to defining the

competences that teachers are required to be able to deploy, ranging from a „light touch’ to complex description. 14

13

Winano. Usaha Peningkatan Professionalisme Guru. (Yogyakarta: Kemendiknas) p.5 14

Francesca Caena. Supporting Teacher Competence Development: For Better Learning Outcomes. (Europe: European Commission, 2013), p. 9 & 19

Based on definitions from several domains, competence can be defined as the skills, knowledge, attitudes, and motivational variables that form the basis for mastery of specific situations. According to this approach, skills, knowledge, attitudes, and motivational characteristics are not innate, but learnable and thus teachable. The term “professional competence” is the application of the concept to working life, particularly in highly complex and demanding professions, in which mastery of situations is especially dependent on the interplay of knowledge, skills, attitudes, and motivation in classroom.15

Teacher competency standard is a defined size or required in the form of mastery of the knowledge and behavior for teacher in order to make teachers in appropriate functional positions areas of duties, qualifications and level of education. Teacher competency includes four competencies, namely:16

a. Pedagogy competence is the management ability of participants learners that includes:

1) Understanding of the learners

2) Development of curriculum / syllabus 3) Designing learning

4) Implementation of learning that educates and dialogical 5) Evaluation of learning outcomes

6) Development of learners to actualize the student’s potential. b. Personality competence is the ability of personality to be:

1) Steady

15

Mareike Kunter and team. Professional Competence of Teachers: Effects on Instructional Quality and Student Development. Journal of Educational Psychology. Vol. 105, No.3. 2013. p. 807

16

22

2) Stable 3) Adult 4) Wise 5) Tactful 6) Noble

7) Role models for students and the community 8) Evaluating its own performance

9) Develop self-sustainable manner.

c. Professional competence is an mastery ability of the material in broad and deep learning that includes:

1) Understand the concept, structure, and methods of science / technology / art coherent with the teaching materials

2) Understand the teaching materials in the curriculum of the school

3) Understand the relationship between the concept of related subjects

4) Apply the concepts of science in everyday life

5) Able to compete in a global context professionally while keep preserving national values and culture.

d. Social competence is the ability of educators as part of the communities to:

1) Oral and written communication.

2) Use of communications technology and information basis function.

3) Interact effectively with students, fellow educators, educators, parents / guardians of students.

4) Mingle politely with the surrounding community.

Measures to assess the development of teachers' competences are important because they:17

a. Can raise teacher's awareness of the need to develop her or his competences;

b. Can support a transformation in teaching culture and practice; c. Permit the recognition of the (new) competences acquired or

developed;

d. Play a part in the quality assurance and control of training and e. Development, thereby leading to its improvement and helping to

achieve excellence;

f. Can help to develop trust in the teaching workforce; and g. Can facilitate timely intervention to improve teaching.

5. The Standards For Teacher Competence In Educational Assessment of Students

Based on the definition above, it becomes important to find out in this study. Even it is not easy to measure, the researcher will use standard for measuring it. The standard will be based on the standards for teacher competence in educational assessment of students developed by the American Federation of Teachers, National Council on Measurement in Education and National Education Association. It has been taken from University of Florida homepage.

17

The Thematic Working Group „TeacherProfessional Development’. Supporting teacher competence development for better learning outcomes.(European Commission: Education and Training, 2013).p 36

24

There are seven points in this standards, those are: 18

a. Teachers should be skilled in choosing assessment methods appropriate for instructional decisions.

Skills in choosing appropriate, useful, administratively convenient, technically adequate, and fair assessment methods are prerequisite to good use of information to support instructional decisions. Teachers need to be well-acquainted with the kinds of information provided by a broad range of assessment alternatives and their strengths and weaknesses. In particular, they should be familiar with criteria for evaluating and selecting assessment methods in light of instructional plans.

They will understand how valid assessment data can support instructional activities such as providing appropriate feedback to students, diagnosing group and individual learning needs, planning for individualized educational programs, motivating students, and evaluating instructional procedures. They will understand how invalid information can affect instructional decisions about students. They will also be able to use and evaluate assessment options available to them, considering among other things, the cultural, social, economic, and language backgrounds of students. They will be aware that different assessment approaches can be incompatible with certain instructional goals and may impact quite differently on their teaching.

Teachers will know, for each assessment approach they use, its appropriateness for making decisions about their pupils. Moreover,

18

Accessed on 5 April 2016 http://buros.org/standards-teacher-competence-educational-assessment-students

teachers will know of where to find information about and/or reviews of various assessment methods. Assessment options are diverse and include text- and curriculum-embedded questions and tests, standardized criterion-referenced and norm-criterion-referenced tests, oral questioning, spontaneous and structured performance assessments, portfolios, exhibitions, demonstrations, rating scales, writing samples, paper-and-pencil tests, seatwork and homework, peer- and self-assessments, student records, observations, questionnaires, interviews, projects, products, and others' opinions.

b. Teachers should be skilled in developing assessment methods appropriate for instructional decisions.

While teachers often use published or other external assessment tools, the bulk of the assessment information they use for decision-making comes from approaches they create and implement. Indeed, the assessment demands of the classroom go well beyond readily available instruments.

Teachers who meet this standard will have the conceptual and application skills that follow. Teachers will be skilled in planning the collection of information that facilitates the decisions they will make. They will know and follow appropriate principles for developing and using assessment methods in their teaching, avoiding common pitfalls in student assessment. Such techniques may include several of the options listed at the end of the first standard. The teacher will select the techniques which are appropriate to the intent of the teacher's instruction.

26

Teachers meeting this standard will also be skilled in using student data to analyze the quality of each assessment technique they use. Since most teachers do not have access to assessment specialists, they must be prepared to do these analyses themselves.

c. The teacher should be skilled in administering, scoring and interpreting the results of both externally-produced and teacher-produced assessment methods.

It is not enough that teachers are able to select and develop good assessment methods; they must also be able to apply them properly. Teachers should be skilled in administering, scoring, and interpreting results from diverse assessment methods.

Teachers who meet this standard will have the conceptual and application skills that follow. They will be skilled in interpreting informal and formal teacher-produced assessment results, including pupils' performances in class and on homework assignments. Teachers will be able to use guides for scoring essay questions and projects, stencils for scoring response-choice questions, and scales for rating performance assessments. They will be able to use these in ways that produce consistent results.

Teachers will be able to administer standardized achievement tests and be able to interpret the commonly reported scores: percentile ranks, percentile band scores, standard scores, and grade equivalents. They will have a conceptual understanding of the summary indexes commonly

reported with assessment results: measures of central tendency, dispersion, relationships, reliability, and errors of measurement.

Teachers will be able to apply these concepts of score and summary indices in ways that enhance their use of the assessments that they develop. They will be able to analyze assessment results to identify pupils' strengths and errors. If they get inconsistent results, they will seek other explanations for the discrepancy or other data to attempt to resolve the uncertainty before arriving at a decision. They will be able to use assessment methods in ways that encourage students' educational development and that do not inappropriately increase students' anxiety levels.

d. Teachers should be skilled in using assessment results when making decisions about individual students, planning teaching, developing curriculum, and school improvement.

Assessment results are used to make educational decisions at several levels: in the classroom about students, in the community about a school and a school district, and in society, generally, about the purposes and outcomes of the educational enterprise. Teachers play a vital role when participating in decision-making at each of these levels and must be able to use assessment results effectively.

Teachers who meet this standard will have the conceptual and application skills that follow. They will be able to use accumulated assessment information to organize a sound instructional plan for facilitating students' educational development. When using assessment

28

results to plan and/or evaluate instruction and curriculum, teachers will interpret the results correctly and avoid common misinterpretations, such as basing decisions on scores that lack curriculum validity. They will be informed about the results of local, regional, state, and national assessments and about their appropriate use for pupil, classroom, school, district, state, and national educational improvement.

e. Teachers should be skilled in developing valid pupil grading procedures which use pupil assessments.

Teachers who meet this standard will have the conceptual and application skills that follow. They will be able to devise, implement, and explain a procedure for developing grades composed of marks from various assignments, projects, in class activities, quizzes, tests, and/or other assessments that they may use. Teachers will understand and be able to articulate why the grades they assign are rational, justified, and fair, acknowledging that such grades reflect their preferences and judgments. Teachers will be able to recognize and to avoid faulty grading procedures such as using grades as punishment. They will be able to evaluate and to modify their grading procedures in order to improve the validity of the interpretations made from them about students' attainments.

f. Teachers should be skilled in communicating assessment results to students, parents, other lay audiences, and other educators.

Teachers must routinely report assessment results to students and to parents or guardians. In addition, they are frequently asked to report or to discuss assessment results with other educators and with diverse lay

audiences. If the results are not communicated effectively, they may be misused or not used. To communicate effectively with others on matters of student assessment, teachers must be able to use assessment terminology appropriately and must be able to articulate the meaning, limitations, and implications of assessment results. Furthermore, teachers will sometimes be in a position that will require them to defend their own assessment procedures and their interpretations of them. At other times, teachers may need to help the public to interpret assessment results appropriately.

g. Teachers should be skilled in recognizing unethical, illegal, and otherwise inappropriate assessment methods and uses of assessment information.

Fairness, the rights of all concerned, and professional ethical behavior must undergird all student assessment activities, from the initial planning for and gathering of information to the interpretation, use, and communication of the results. Teachers must be well-versed in their own ethical and legal responsibilities in assessment. In addition, they should also attempt to have the inappropriate assessment practices of others discontinued whenever they are encountered. Teachers should also participate with the wider educational community in defining the limits of appropriate professional behavior in assessment.

Teachers who meet this standard will have the conceptual and application skills that follow. They will know those laws and case decisions which affect their classroom, school district, and state assessment practices. Teachers will be aware that various assessment

30

procedures can be misused or overused resulting in harmful consequences such as embarrassing students, violating a student's right to confidentiality, and inappropriately using students' standardized achievement test scores to measure teaching effectiveness.

In this research, the researcher uses only four points of these standards because it based on the focus of the research itself. The researcher takes the data about teacher decision such as in choosing assessment methods appropriate for instructional decisions, in developing assessment methods appropriate for instructional decisions, in administering, scoring and interpreting the results of both externally-produced and teacher-produced assessment methods, in using assessment results when making decisions about individual students, planning teaching, developing curriculum, and school improvement.

6. Teacher Competency Test (UKG)

UKG is a follow-up of the teacher certification program, which at first time before UKG, the teacher certification using the portfolio. UKG implemented especially to monitor the function of the teaching profession.19 It is because every profession demands the ability to make decisions and the right policy. UKG needed to get teachers to work professionally adequate competence-based as mandated by the law on the national education system (National Education) and national education standards (SNP). UKG actually implemented not just test the skills required to be held by teachers, but more than that, it can develop and demonstrate intact competence from a teacher. Intact competence, including

19

Zaenudin Idris. Uji Kompetensi Guru (UKG) dan Penilaian Kinerja Guru (PKG). (Bandung: Universitas Islam Nusantara Bandung, 2014).p. 4

incorporation and application of a skill, attitude and knowledge of each other are interlocked.

a. Benefits of UKG

Theoretically and practically, UKG implementation has a variety of benefits, which can be used as:20

1) Means to map the competencies and performance of teachers. UKG outcome data then will be used to group teachers and will be used as input for follow-up coaching and competence development of teachers;

2) Means Support for grouping teachers; Grouping teachers will be done according to the level the achievement of their respective competence;

3) Means coaching teachers. Coaching teachers are more effective because it is possible to come from The initial accurate data;

4) Support the empowerment of teachers. As well as teacher training, teacher empowerment was possible more effective than accurate data;

5) References in curriculum development. Curriculum development will be clearer and focused because it is based on achievement data;

20

Zaenudin Idris. Uji Kompetensi Guru (UKG) dan Penilaian Kinerja Guru (PKG). (Bandung: Universitas Islam Nusantara Bandung, 2014).p. 6

32

6) Tools to encourage activity and learning outcomes. The focus of improvement for teaching and learning by teachers will be able to based on data obtained;

7) Tool selection acceptance of new teachers. Not only for

teachers who had already served, but also teachers’ candidate

or new teachers should have the same standards. b. Principles of UKG

The principles in implementing UKG from Kemendiknas are:21 1) Comprehensive;

2) Open; 3) Cooperative; 4) Gradual; 5) Advanced.

c. Competence Tested in UKG

Along with the elaboration of the Asian Institute for Teacher Education, the competencies tested on UKG are:22

1) Personal competence.

These competencies include: sympathy, empathy, dignity, responsibility, open and can do self assessment. Teachers’ understanding in acting should according to religious norms, legal, social, and Indonesia national culture, showing a private mature, responsible, high work ethic and can serve as an example;

21

Zaenudin Idris. Uji Kompetensi Guru (UKG) dan Penilaian Kinerja Guru (PKG). (Bandung: Universitas Islam Nusantara Bandung, 2014).p. 7

22

Zaenudin Idris. Uji Kompetensi Guru (UKG) dan Penilaian Kinerja Guru (PKG). (Bandung: Universitas Islam Nusantara Bandung, 2014).p. 8

2) Professional competence.

Professional competence includes the mastery ability of foundation education, teaching materials, management learning, the use of instructional media, understanding both the learners as well as the principles of good educational services;

3) Pedagogy competence

Pedagogic competence or the competence of teachers about science education. Among the tested competency is about ability of teachers to recognize the characteristics of students, master the learning theory and principles of educate learning, curriculum development, instructional educate activities, understand and develop the potential of communications with learners, assessment and evaluation.

4) Social competence

Social competence that must be possessed of teachers in this case, commonly include the ability of teachers in social interaction both with students, peers friends, superiors, and the community. This social competence also included a teacher status as educators in the eyes of the public and social responsibility in the eyes of the community.

The material which is tested on teacher competency test cover 30 percent for pedagogical competence and 70 percent professional competence. Pedagogic competence which is tested for pedagogical concepts is in the fields of study integration of the learning process in the classroom. While professional aspect is a basic competence appropriate field of study that tested the academic qualifications of teachers and teacher's ability to plan and implement the learning process.

34

As an initial breakthrough on the importance of Internet empowerment in education, which should also be controlled by the teacher, in 2012 UKG government held online. This program will be sustainable, so that all aspects can be benefit for teachers, schools and the education ministry.

For teachers, UKG tests online, like it or not 'force' teachers to a maximum effort in order to understand and use the tools of computers and the Internet, besides the ability to master the test material. For schools with this online test, it makes a reason for the school completing computer device with a connection internet, which in fact will positively impact activities learning in schools. For the government, in this case the education ministry will be obtained this data from UKG value fast, analyzed and standardized.

7. Rubric

a. The Definition of Rubric

The word rubric comes from the Latin word for red. The online Merriam‑Webster dictionary lists the first meaning of rubric as “an authoritative

rule” and the fourth meaning as “a guide listing specific criteria for grading or

scoring academic papers, projects, or tests. Another explanation from that book a

rubric is a coherent set of criteria for students’ work that includes descriptions of levels of performance quality on the criteria. 23 According to Stevens and Levi said that a scoring tool that lays out the specific expectations for an assignment.24 From these definitions rubric is a tool that can be used for scoring or grading which describes the levels of performance quality on the list of criteria. The

23

Susan M. Brookhart. How to Create and Use Rubrics for Formative Assessment And Grading.

(USA:ASCD. Alexandria Virginia, 2013), p. 3-4 24

Dannelle D. Stevens and Antonia Levi. INTRODUCTION TO RUBRICS: An Assessment Tool to Save Grading Time, Convey Effective Feedback, and Promote Student Learning. (Virginia:Stylus Publishing. Sterling, 2005), p. 3

genius of rubrics is that they are descriptive and not evaluative. Of course, rubrics can be used to evaluate, but the operating principle is you match the performance to the description rather than “judge” it.25

The main purpose of rubrics is to assess performances. This list is not meant to suggest what students should perform. State standards, curriculum goals, and instructional goals and objectives are the sources for what types of performances the students should be able to do.26 However rubrics divide an assignment into its component parts and provide a detailed description of what constitutes acceptable or unacceptable levels of performance for each of those parts. Rubrics can be used for grading a large variety of assignments and tasks: research papers, book critiques, discussion participation, laboratory reports, portfolios, group work, oral presentations, and more.27

b. Steps of Developing Rubrics

Rubrics are composed of four basic parts in which the professor sets out the parameters of the assignment. The basic format of rubric for simplest form includes a task description (the assignment), a scale of some sort (levels of achievement, possibly in the form of grades), the dimensions of the assignment (a breakdown of the skills/knowledge involved in the assignment), and descriptions of what constitutes each level of performance (specific feedback) all set out on a grid, as shown in table 1.1.28

25

Susan M. Brookhart..How to Create… p. 4 26

Susan M. Brookhart. How to Create… p. 4 27

Dannelle D. Stevens and Antonia Levi. INTRODUCTION TO RUBRICS,… p. 3

28

36

However to make an appropriate rubric for the needs of the students, developing rubric also has an important role. There are some steps in developing a rubric:29

Step1: Considering models of the performance or product. The characteristics of each model should be though carefully. The teachers should choose the best one to be developed based on the learning aims and goals.

Step 2: Constructing the criteria. In constructing the criteria, the teachers should discuss it with the students.

Step 3: Determining the number of levels. Three levels are usually used for younger students. For older ones, the literature recommends to use four or five levels.

Step 4: Developing descriptions of quality for each level of the criteria. To comprehend the description of quality, the teachers should examine provided rubrics so that the suitability of each level can be accomplished. Establishing from the highest and lowest levels, then filling the rest of the levels is the easiest way to develop the description of quality. The use of parallel language, unambiguous

29

Cheryl Erlandson, Rubrics: When? Why? How? Connecting the Pieces. (Saskatchewan Professional Development Unit), p.13

words selection and descriptions also should be considered among the levels to avoid the lowest level sound bad.

Step 5: Using the rubric. To practice using the rubric, the teachers give copies of the rubric to the students.

Step 6: Revising the rubric as needed. In revising the rubric, the teachers can do and discuss together with students. This helps students to recognize the desire of the teachers.

Brophy also gives tips for developing a rubric, they are:30

1) Finding and adapting an existing rubric. Adapting an existing rubric can be a consideration because it is hard and time consuming to get a suitable rubric for every situation and condition.

2) Evaluating the rubric. The rubric should communicate to the outcomes of subject being assessed, be feasible, functional, practical, and manageable. The deletion can be done for unrelated outcomes.

3) Benchmarking - gathering some of student duties that represent each point on the level. It is done to make the rubric more essential.

4) Expecting to revise the rubric. Revising the rubric can be done together with students.

5) Sharing effective rubrics with other teachers. The rubric will be developed better if seen from different perceptions.

The teachers can use the tips above to improve the important value of rubric since the rubric is one of tools to measure the students’ achievement and progress.

30

Timothy S. Brophy, Writing Effective Rubrics (Florida: University of Florida Institutional assessment), p. 3.

38

c. Types of Rubrics

Types of rubrics have four types and it is divided by the advantages and disadvantages. The first is analytic and holistic rubrics, analytic rubrics describe work on each criterion separately. Holistic rubrics describe the work by applying all the criteria at the same time and enabling an overall judgment about the quality of the work.

Table c. 1 Definition of analytic and holistic rubrics

The next types are general and task-specific rubrics. For general rubrics use criteria and descriptions of performance that generalize across (hence the name general rubrics), or can be used with, different tasks. The tasks all have to be instances of the same learning outcome—for example, writing or mathematics. On the other side task-specific rubrics are pretty well described by their name: They are rubrics that are specific to the performance task with which they are used. Task‑specific rubrics contain the answers to a problem, or explain the reasoning students are supposed to use or list facts and concepts students are supposed to mention.

Table c. 2 Definition of general and task- specific rubrics d. Standard of an Effective Rubric by Metarubric

Rubrics are not cast in cement. They are flexible, adaptable grading tools that become better and better the more times we use them. Their strength, reliability, and validity increase as we use rubrics, discover limitations, and make revisions. But to make effective revisions, we first need to evaluate our existing rubrics. A “metarubric” is a rubric used to evaluate rubrics. Some of us use a metarubric to evaluate a new rubric before showing it to our students. Some of us use metarubrics to reevaluate old rubrics after using them to grade a set of assignments, especially if that grading proved unsatisfactory in some way.31

In metarubric there are five parts of the rubric that will be checked by the evaluator. each of the parts has some criteria and sould be chosen by check lish answer yes or no answer.

The five parts are about the important things in rubric:32  The dimensions of rubric,

 The description of rubric

31

Dannelle D. Stevens and Antonia Levi. INTRODUCTION TO RUBRICS… p. 93 32

40

 The scale of rubric  The overall rubric  Fairness and sensibility

If people want to use this to check any rubric so it should be changed depond on the assignment and what the teachers’ need. For example metarubric for role play rubric so the parts in metarubric should be adapted by the role play instruction.

8. Role Play

Role play exercises give students the opportunity to assume the role of a person or act out a given situation. These roles can be performed by individual students, in pairs, or in groups which can play out a more complex scenario. Role plays engage students in real-life situations or scenarios that can be “stressful,

unfamiliar, complex, or controversial” which requires them to examine personal feelings toward others and their circumstances.33

a. The definition of Role Play

Role play is a technique which is virtually one of the ways teachers can give the learners an opportunity to practice improving a range of real-life spoken language in the classroom stated from Chen-jun cited in Aliakbari.34 However role play as one of techniques in performance assessment because role-play is a piece of activity exploited by different approaches to language teaching, as Tateyama points out in Aliakbari journal. It is more cognitive demands on learners’

comprehension and production system are made and learners’ ability to

33

Bonwell, C. C., & Eison, J. A. Active learning: Creating excitement in the classroom.

(Washington, DC: The George Washington University, 1991) From http://www.niu.edu/facdev/_pdf/guide/strategies/role_playing.pdf 34

M. Aliakbari, - B. Jamalvandi. The Impact of „Role Play’ on Fostering EFL Learners’ Speaking Ability; A Task-Based Approach. Journal of Applied Linguistics 14 (1), 2010. p. 20

instantaneously incorporate sociopragmatic and pragmalinguistic knowledge in interaction are examined.35 Another reason that role play is fun and motivating because it gives a chance for the silent students to express themselves which is broadened to other world outside the classroom habit, thus offering a much wider range of language opportunities said Khusnul in her thesis.36

b. Benefits of Role Playing

Role playing can be effectively used in the classroom to:37 1) Motivate and engage students

2) Enhance current teaching strategies

3) Provide real-world scenarios to help students learn

4) Learn skills used in real-world situations (negotiation, debate, teamwork, cooperation, persuasion)

5) Provide opportunities for critical observation of peers

These benefit can be applied in the class depends on the situation an condition of the class.

Guidelines in Developing Role Playing Exercises Using a set of guidelines can be helpful in planning role playing exercise. Harbour and Connick (2005) offer the following:38

35

M. Aliakbari, - B. Jamalvandi. The Impact of „Role Play’ on Fostering EFL… P.20 36

Khusnul K. Role Play Technique To Improve Speaking Skill For First Grade Students At MA Assa’diyah Bangil. (Surabaya:The Sunan Ampel State Islamic University Press. 2015), p. 26 accessed on April 14th 2016 from www.digilib.uinsby.ac.id

37

Bonwell, C. C., & Eison, J. A. Active learning: Creating excitement in the classroom.

(Washington, DC: The George Washington University. 1991). From http://www.niu.edu/facdev/_pdf/guide/strategies/role_playing.pdf 38

Bonwell, C. C., & Eison, J. A. Active learning: Creating excitement in the classroom.... http://www.niu.edu/facdev/_pdf/guide/strategies/role_playing.pdf

96

2. The researcher concluded that the teacher did some steps dealing with the development of the quality rubrics but others still need to improve. Teacher needed improving in discussing the rubric criteria together with the students, developing criteria, description and number for the scale level more detail, trying out using the rubrics, doing self evaluation with metarubric, and revising the rubrics as needed. Other things that also should be considered were giving the title, task description and the procedure of scoring the assessment. It was the way that made the rubric easier to understand. So the researcher could conclude that the quality of the role play rubrics was still not really strong. However with some practices, discussions, and workshops with curriculum experts, the teachers would be able to handle the obstacles.

B. Suggestion

After describing the teacher competence in assessment and analyzing the teacher’s role play rubrics, there were some suggestions that could be used for improvements.

1. For the English teacher

The English teacher could increase the teacher competence especially in assessment competence for the time management in doing assessment for some project. This was to avoid any missing part of the assessment process. However rubric also was important as one of the reflection from the teacher competence. Some aspects here dealing with the steps that could teacher did in developing an effective rubric. They

97

were developing criteria, description and the level of the criteria, trying out using it, doing self evaluation using metarubric and revising.

2. For the readers

For the readers, especially educators, the result of this study could show them some of the best ways in developing effective rubrics. The steps and elements in developing rubrics should be considered carefully by the readers. They should be able to maximize the use of the rubric in their assessment process. Like sharing the rubric for every assignment that needed or showing how some assessment would be scored by the teacher. In addition, the readers or educators could hold training in developing the assessment rubric or could do self evaluation using metarubric so that, more proper rubrics could be obtained.

3. For the next researchers

For the next researcher the result of this study could become an interesting topic to be discussed deeper like about the teacher competence in using media and may be about the students’ respond of the rubric based on their learning behavior or based on their gender or sexuality. So that both the students and the teachers could get more benefit of the use of the rubric and improve their English skills.

REFERENCES

Aliakbari, M. – Jamalvandi, B. The Impact of ‘Role Play’ on Fostering EFL Learners’ Speaking Ability; A Task-Based Approach. Journal of Applied Linguistics 14 (1). 2010.

Arikunto, Suharsimi. Prosedur Penelitian Suatu Pendekatan Praktek, Jakarta: Rineka Cipta. 2002.

As chited in Moleong, Lexy J. Metodologi Penelitian Kualitatif Edisi Revisi. Bandung: Remaja Rosdakarya, 2009.

As cited in Assessment Toolkit, Using Assessment Rubrics. USNW Australia, 2014.

A Vision for 21st Century Assessment." Retrieved from North Carolina Department of Public Instruction. Accessed on January 24th 2016. website: http://www.ncpublicschools.org/accountability/educators/vision/

Brown, H. Douglas. Teaching by principles (second edi). California: Longman. 2000.

Caena, Francesca. Supporting Teacher Competence Development: For Better Learning Outcomes. Europe: European Commission. 2013.

Cohen, A. D.& Macaro, E. (Eds.) Language Learner Strategies: Thirty Years of Research and Practice. New Work: Oxford University Press. 2007. C., Bonwell, C. & Eison, J. A. Active learning: Creating excitement in the

classroom. (Washington, DC: The George Washington University, 1991) From http://www.niu.edu/facdev/_pdf/guide/strategies/role_playing.pdf Erlandson, Cheryl. Rubrics: When? Why? How? Connecting the Pieces.

(Saskatchewan Professional Development Unit).

Filipe, Ana. A Comparative Analysis of Teacher Competence and Its Effect on Pupil Performance in Upper Primary Schools In Mozambique And Other Sacmeq Countries. Pretoria: niversity of Pretoria, 2009.

Garrison, Catherine and Ehringhaus, Michael. Formative and Summative Assessments in the Classroom. 2010. Accessed on March 2016. Adopted

Hussain and team. Educational Assessment Attitudes, Competence, Knowledge, and Practices: An Exploratory Study of Muscat Teachers in the Sultanate of Oman. Journal of Education and Learning; Vol. 1. No. 2. Published by Canadian Center of Science and Education. 2012.

Hakim, Adnan. Contribution of Competence Teacher (Pedagogical, Personality, Professional Competence and Social) On the Performance of Learning. The International Journal of Engineering and Science (IJES). Volume 4 Issue 2 Pages PP.01-12. 2015.

Idris, Zaenudin. Uji Kompetensi Guru (UKG) dan Penilaian Kinerja Guru (PKG). Bandung: Universitas Islam Nusantara Bandung, 2014.

Jonsson, Anders and Svingby, Gunilla. The use of scoring rubrics: Reliability, validityand educational consequences. Educational Research Review 2 (2007) 130–144. (www.elsevier.com) accessed on January 24th 2016. K, Khusnul. Role Play Technique To Improve Speaking Skill For First Grade

Students At MA Assa’diyah Bangil. The Sunan Ampel State Islamic University Press.Surabaya. 2015. Accessed on April 14th 2016 from

www.digilib.uinsby.ac.id

Kizlik, Bob. Measurement, Assessment, and Evaluation in Education. 2012

http://www.adprima.com/measurement.htm accessed on September 2016 Kunter, Mareikeand team. Professional Competence of Teachers: Effects on Instructional Quality and Student Development. Journal of Educational Psychology.Vol. 105, No. 3. 2013.

K., Yin, R. Case study research: Design and methods (3rd ed.). Thousand Oaks, CA: Sage 2003.

Mufarrokhah, K. Undergraduate Thesis: A Study On English Teachers’ Assessment Rubric Development In International Class At SMP Muhammadiyah 5 Surabaya. Surabaya: FTK-PBI Universitas Islam Negeri Sunan Ampel Surabaya 2015.

Munyai, Ndanduleni Norah. Effect of Role-Play as A Formative Assessment Technique On Job Performance. University of South Africa. 2011.

http://uir.unisa.ac.za/bitstream/handle/10500/6100/thesis_munyai_n.pdf?

sequence=1 Accessed on April 14th 2016

Omo, Jennifer and Team. Standards for teacher competence in educational assessment of students: Nigerian teachers’ ratings of their need. The 36th International Association for Educational Assessment (IAEA). 2010.

http://selectscore.com/ accessed on May 2016

Rudner, Lawrence M.andSchafer, William D. What Teachers Need to Know about Assessment. DC: National Education Association of the United States. 2002.

Regier, Natalie. Book Three: Summative Assessment -50 Ways to Gather Evidence ofStudent Learning. 2012. Accessed on April 19th 2016.

https://gssdelementarymath.wikispaces.com/file/view/Book+Three.pdf

Stevens, Annelle D.andLevi, Antonia. INTRODUCTION TO RUBRICS: An Assessment Tool to Save Grading Time, Convey Effective Feedback, and Promote Student Learning. Virginia: Sterling. 2005.

Sadler, D. Royce. Indeterminacy in the use of preset criteria for assessment and grading. Assessment and Evaluation in Higher Education, 34. Griffith University. 2009.

Scott, John. Authentic Assessment Tools. Georgia: The University of Georgia. T, Robin.& S, Marielle. What’s still wrong with rubrics: Focusing on the

consistency ofperformance criteria across scale levels. University of Ottawa. A peer-reviewed electronic journal.University of Ottawa. 2004 Terry, Overton Assessing Learners with Special Needs: 6TH ED.

The Thematic Working Group ‘Teacher Professional Development’. Supporting teacher competence development for better learning outcomes. European Commission: Education and Training, 2013.

National Council on Measurement in Education and National Education Association.Accessed on 5 April 2016 http://buros.org/standards-teacher-competence-educational-assessment-students

Timothy F. Slater. Performance Assessment.Department of Physics Montana State University. Accessed on April 19th 2016.

http://www.flaguide.org/extra/download/cat/perfass/perfass.pdf

Trochim, William.& Donnelly, James P. The Research Methods Knowledge Base.Cengage Learning. 2007.

T, William. & P. D., James. The Research Methods Knowledge Base. Cengage Learning. 2006.

Vagle, Nicole Dimich. Creating Rubrics for Feedback and Assessment Design (Solution Tree Press), 2014.

Wren, Douglas G. Performance Assessment: A KeyComponent of A Balanced Assessment System. Virginia: Report from the Department of Research, Evaluation, and Assessment. Number 2. 2009.

Winano. Usaha Peningkatan Professionalisme Guru. Yogyakarta: Kemendiknas The Preamble of The 1945 Indonesia Constitution

The Jakarta Post Article was taken from

Kementerian%20Pendidikan%20dan%20Kebudayaan%20%C2%BB%20

Republik%20Indonesia.htm Accessed on August 2016

Pedoman Pelaksanaan Uji Kompetensi Guru 2015

Based on the interview of 27 teacher-students and teachers on April- May 2016 Undang-Undang Republik Indonesia No. 14 tahun 2005, tentang Guru dan Dosen The interview for teacher was conducted on Thursday August 28th 2016 at SMPN 1 Sedati Sidoarjo