82
B. Recommendations
In this part, the researcher intends to present the recommendations for English teachers, the National Examination test-designers and researchers who
want to conduct similar research. The recommendations relate to the implementation of the principle of language assessment in composing a language
test. Besides, the recommendations relate to the implementation of research methodology.
1. For English Teachers
This research reveals the results of the analysis of the content validity and the authenticity of English items of National Examination year 2012 for senior
high schools. The researcher suggests English teachers be more aware when designing English tests, particularly national examination. In addition, the
researcher suggest the English teachers beware of employing test texts without putting a little information where the texts are taken from the sources since the
texts would be considered as the unauthentic materials. The research findings can be utilized as a kind of evaluation in order to design similar English tests. In
addition, considering all principle of language assessment is important to design the appropriate English tests.
2. For National Examination Test-designers
The research findings can be used to evaluate sets of National Examination test items year 2012 for senior high schools in case of the test items’ content
validity and authenticity. The research findings imply sets of National Examination test items year 2012 for senior high schools need revision and
83 improvement. The data findings shows that the English test items of National
Examination year 2012 cannot reach the highest degree of content validity and authenticity as well as provide significant considerations for the National
Examination test-designers in designing the English language tests. It is particularly to make the test-designers follow principles of language testing and
design test materials carefully for the National Examinationin the futures. Besides, this research implies that considering all principle of language assessment is
important to design English tests particularly the highest standardized test like National Examination.
3. For Future Researchers
The data of this research are useful for other researchers as the reference. The researcher suggest the other researchers who would like to conduct a research
on the English language tests, especially on National Examinationfor senior high schools, investigate the analysis of authenticity and the instruments used for the
analysis in this research. Moreover, investigating principles of language assessment namely reliability or the remaining facets of validity face validity,
criterion-related evidence, construct validity, and consequential validity is highly recommended.
It is stated from one of the respondents of the data triangulation that the test tasks of the reading test do not maintain face validity since the options of the
answer are not constructed well. In a set of optional answers, there are probably some longer sentences while some others are written in short sentences or in the
precisely short ones. Moreover, the test task number 38 A57 test version has two
84 possible answers namely answers B and D. According to the respondents’
findings on data triangulation, it could be concluded that there are a lot of aspects which are able to be investigated deeper on this study.
REFERENCES
Alderson, J. C., Clapham, C., Wall, D. 1995. Language test construction and evaluation
. Cambridge: Cambridge University Press. American Psychological Association. 1954. Technical recommendations for
psychological tests and diagnostic techniques: Preliminary proposal .
American Psychologist, 7, 461-476. American Psychological Association. 1985. Standards for educational and
psychological testing. Washington, DC: American Psychological
Association. Bachman, L. F. 1990. Fundamental considerations in language testing. Oxford:
Oxford University Press. Bachman, L. F., Palmer, A. S. 1996. Language testing in practice: Designing
and developing useful language tests . Oxford: Oxford University Press.
Berelson, B. 1952. Content analysis in communication research. New York: Free Press. Retrieved on October 15, 2012, from
https:www.ischool.utexas.edu~palmquiscoursescontent.html Brown, H. D. 2004. Language assessment: Principles and classroom
practices .USA: Pearson Education, Inc.
Crocker, L., Algina, J. 1986. Introduction to classical and modern test theory. Belmont, CA: Wadsworth Group.
Day, R. R. 2003. Authenticity in the design and development of materials. In Willy A. Renandya Ed., Methodology and materials design in language
teaching: Current perceptions and practices in their implications pp. 1-
9. Singapore: SEAMEO Regional Language Centre. Fadillah. August, 2011. Asean calls more proactive engagement of business
people. The Jakarta Post. Retrieved September 13, 2013, from http:lgtv.thejakartapost.com
Fraenkel, J. R., Wallen, N. E. 2008. How to design and evaluate research in education
7
th
ed.. Boston: McGraw-Hill Higher Education. Gronlund, N. 1998. Assessment of student achievement 6
th
ed.. Needham Heights, MA: Allyn Bacon.
85
86 Hunt, C. A. n.d. Qualitative and quantitative concepts in proposal writing:
similiarities, differences, and controversy . Retrieved October 15, 2012,
from http:www.und.nodak.eduinstructwstevensPROPOSALCLASSHuntp
aper.htm.
Jandaghi, G., Shateria, F. 2008. Rate of validity, reliability and difficulty indices for teacher-designed exam questions in first year high school.
International Journal of Human Sciences [Online]. 5:2. Retrieved
September 19, 2013 from http:www.insanbilimleri.com McNamara, T. 2000. Language testing. Oxford: Oxford University Press.
McRoy, R., Grotevant, H., Zurcher, L. 1988. Emotional disturbance in adopted adolescents: Origins and development
. New York: Praeger. Miller, J. M. 2003. Test validation: literature review. Retrieved October 15,
from 2012 plaza.ufl.edu...from validity_litreview_072203.pdf Mousavi, S. A. 2002. An encyclopedic dictionary of language testing 3
rd
ed. Taipei: Tung Hua Book Company.
Myers, M.D. 1997. Qualitative research in information systems. MISQ Discovery
. Retrieved October 15, 2012, from http:www.und.nodak.eduinstructwstevensPROPOSALCLASSHuntp
aper.htm. Natural language. 2013. Merriam-Webster.com. Retrieved November 29, 2013,
from http:www.merriam-webster.comdictionarynatural language Nuttal, C. 1996. Teaching reading skills in a foreign language 2
nd
ed. London: Heinemann.
Oxford Advanced Learner’s Dictionary 7
th
ed. 2005. Oxford: Oxford University Press.
Peraturan Menteri Pendidikan Nasional No. 22 tahun 2006 tentang Ujian Nasional.
Peraturan Menteri Pendidikan dan Kebudayaan Republik Indonesia No. 35 Tahun 2012 tentang Penyelenggaraan Ujian Nasional Pendidikan
Kesetaraan Peraturan Menteri No. 59 tahun 2011 tentang Ujian Nasional.
Peraturan Pemerintah No.29 tahun 1990 tentang pendidikan menengah.
87 Richards, J. C. 2001. Curriculum development in language teaching. New York:
Cambridge University Press. Rudner, L., Schafer, W. 2002. What teachers need to know about assessment.
Washington, DC: National Education Association. Retrieved October 17, 2012 from http:echo.edres.org:8080neateachers.pdf
Scarcella, R. C., Oxford, R. L. 1992. The tapestry of language learning: The individual in the communicative classroom
. Boston, Mass.: Heinle Heinle.
Seif, A. A. 2004. Assessment and Evaluation in Education. Tehran: Doran Publication.
Retrieved September
19, 2013
from http:www.insanbilimleri.com
Seti, I. September 7, 2008. Laskar pelangi: The audacity of hope. The Jakarta Post
. Retrieved September 13, 2013, from http:www.thejakartapost.com Shepard, L. A. 1993. Evaluating test validity. In L. Darling-Hammond Ed.,
Review of Research in Education Vol. 19. Washington, D.C.: American
Educational Research Association. Tempo Interactive. June, 2012. National exams warrant re-evaluation. Tempo.
Retrieved on
August 31,
2012, from
http:www.tempo.coreadnews201206...055409165 Anggrita Desyani. September, 2012. Rencana variasi 20 soal ujian nasional
dikritik. Tempo. Retrieved on September 19, 2013, from http:www.tempo.coreadnews20120911079428853Rencana-
Variasi-20-Soal-Ujian-Nasional-Dikritik
Widdowson, H. G. 1976. The authenticity of language data. In John F. Fanselow Ruth H. Crymes Eds., TESOL ’76 pp. 261-270. Washington, D.C.:
TESOL. Williams, E. 1984. Reading in the language classroom. London: Macmillan.
Appendix 1 Transcription of the Listening Section
88
89
TRANSCRIPTION OF THE LISTENING SECTION
Part I
1. Man
: Excuse me. Is there a grocery store around here? Woman : Yeah, there is one near here.
Man : Can you tell me how to get there?
Woman : Sure Go straight down this street for two blocks. Turn left when you get to Maple street. Stay on Maple street for half a block. It’s
on the left-hand side.
Narrator : What is the woman doing?
2. Woman
: Why didn’t you answer my call? Man
: Did you call me? When? Woman
: Around 8 in the evening. Man
: Oh, I was already in bed. I felt very exhausted after working in the garden from morning till afternoon.
Narrator : When did the woman call the man?
3. Dad
: I heard you passed your exam with flying colours. I’m very proud of you
Daughter : Thank you dad I got 10 for Math and Biology. Narrator : What is the topic of the conversation?
4. Woman
: Thank you very much for the beautiful book, Mr. Sugeng. It was very nice of you to remember my birthday.
Man : It was the least I could give you. I hope you like it.
Narrator : What is the dialogue about? Part II
5. Man
: Hi, Debby Thank you for the book you gave me. Woman
: Don’t mention it. Do you like it?
Narrator : What did the man probably answer? A. Thanks Goodness.
B. Yes. I was amazed reading it. C. I like the way you treat me.
D. Sure Absolutely, you are right.
90 6.
Man : I really made a mistake.
Woman : What about?
Man : I have broken your pen.
Woman : That pen? Oh, no
Narrator: What would the man most likely reply? A. I’d love that pen.
B. Thank you. C. I’m proud of you.
D. I’m very sorry.
7. Man
: Do you want me to carry these books to your room? Woman
: No, thanks. Man
: Let me bring your bag, then.
Narrator : What did the woman probably respond? A. My bag is black and big.
B. I will go to the teacher room. C. Thank you very much.
D. It’s a hand-made leather bag.
Part III
8. Woman
: Did you come to our school reunion last night? Man
: No. I had surgery with some fellow doctors in the emergency room. Did you go?
Woman : Yes. I met so many old friends there. Bill is a lawyer. He works for his own law firms. Edward is a Math teacher in Houston. John
is in the Army, and his Brother, Jimmy, is a pilot.
Narrator : Which picture shows the man’s occupation?
9. Man
: Have you cook the rice, honey? Woman : Not yet I think we need a new gas stove. This old one does not
work very well anymore. Man
: Okay, then. Let’s buy one, then.
Narrator : Which picture shows what they want to buy?
10. This animal has a pair of wings. It is active at night and it sleeps during the day. People regard the animal as a manifestation of Dracula. It has broad-
round eyes and sharp fangs. This animal can be found in the cave hanging upside down.
Narrator: Which picture goes to the monologue?
91 11. I love gardening. I have a small garden in my backyard. There are daffodils,
Cambodian flowers, orchids, red roses and white lilies. My oldest daughter, Annisa, is crazy about red roses. She always helps me water the flowers in
the afternoon. I love all my flowers. Narrator: Which flower does Annisa like?
Part IV
This passage below is related to question 12 and 13. CNN A major snowstorm slammed the East Coast and foiled the busy
holiday travel season as airports shut down the runways, rail services was slowed and bus routes were suspended on the last weekend before Christmas.
Three deaths in Virginia were blamed on the storm, state officials said. One person was killed late Friday in a single-car crash. Two other deaths were
reported Saturday as there was more heavy snow than expected.
12. Narrator: What is the monologue about? 13. Narrator: How many causalities were there in the incident?
This passage below is related to question 14 and 15 The anaconda is the largest snake in the world. Also known as the Water Boa,
this giant, meat-eater lives in swampy areas of tropical South America. It spends a lot of time in shallow water, hidden from unsuspecting prey.
Anacondas are related to boa constrictors. They give birth to 20 to 40 baby snakes at one time.
Like all snakes, anacondas are cold-blooded; they have the same temperature as the environment. They continue to grow all their lives, getting bigger and
bigger each year. The longest anaconda ever found was 11.4 m long, there are probably even bigger anacondas that have not been seen. Anacondas are
greenish-brown with a double row of black oval spots on the back and smaller white markings on the sides.
14. Narrator: What is the monologue about? 15. Narrator: How many babies does an anaconda give birth at one time?
92
Appendix 2 The Document of Competence Standard and Basic
Competence Grades X-XII for Senior High Schools
93
Indonesian Version of Competence Standard and Basic Competence for Senior High Schools
1. Grade X, Semester 1 Standar Kompetensi
Kategori