Manajemen | Fakultas Ekonomi Universitas Maritim Raja Ali Haji joeb.83.6.360-368
Journal of Education for Business
ISSN: 0883-2323 (Print) 1940-3356 (Online) Journal homepage: http://www.tandfonline.com/loi/vjeb20
Classroom Contribution: What Do Students
Perceive as Fair Assessment?
Molly B. Pepper & Seemantini Pathak
To cite this article: Molly B. Pepper & Seemantini Pathak (2008) Classroom Contribution: What
Do Students Perceive as Fair Assessment?, Journal of Education for Business, 83:6, 360-368,
DOI: 10.3200/JOEB.83.6.360-368
To link to this article: http://dx.doi.org/10.3200/JOEB.83.6.360-368
Published online: 07 Aug 2010.
Submit your article to this journal
Article views: 74
View related articles
Citing articles: 5 View citing articles
Full Terms & Conditions of access and use can be found at
http://www.tandfonline.com/action/journalInformation?journalCode=vjeb20
Download by: [Universitas Maritim Raja Ali Haji]
Date: 11 January 2016, At: 23:16
Downloaded by [Universitas Maritim Raja Ali Haji] at 23:16 11 January 2016
ClassroomContribution:WhatDoStudents
PerceiveasFairAssessment?
MOLLYB.PEPPER
GONZAGAUNIVERSITY
SPOKANE,WASHINGTON
SEEMANTINIPATHAK
UNIVERSITYOFHOUSTON
HOUSTON,TEXAS
ABSTRACT. Assigningagradetostu-
S
dents’classcontributionmaybe1ofthe
mostcontroversialanddifficultchallenges
thatinstructorsface.Theauthorsexamine
theperceivedfairnessofclasscontribution
gradingmethodsfromtheperspectiveof
theperformanceappraisalliterature.In2
scenariostudiesbasedonactualgrading
techniques,theauthorsexaminedperceptionsoffairassessment.Participantswere
undergraduatestudentsfrom2universities.
Atheoreticalmodelofproceduraljustice
providedthebackground.Resultsindicate
that3objectiveaspectsofgrading—explicitnessofgradingcriteria,frequencyof
feedback,andproactivenessofinstructor
techniques—affectperceivedfairness.
Keywords:classroomcontribution,perceivedfairness,performanceappraisal
Copyright©2008HeldrefPublications
360
JournalofEducationforBusiness
queezed by increased competition
among business schools and the
demandsofstudentsandrecruiters,managementfacultymembersareunderpressuretoexcelintheclassroom(Gerdes,2006;
Lavelle,Gerdes,Jespersen,Gloeckler,&
Symonds,2006;O’Brien&Hart,1999).
Tomeetthechallenge,managementfaculty members are shifting away from a
paradigm of passive learning (Auster &
Wylie, 2006) to one of active learning
(Bonwell & Eison, 1991; Wingfield &
Black,2005).Theoldparadigminvolved
theinstructorastheexpertwhoimparted
knowledge to students through lectures
(Barr & Tagg, 1995, p. 24). The new
paradigm replaces the instructor as an
actor on the stage imparting knowledge
withan“inter-actor”whofacilitatesstudentlearning(Barr&Tagg,p.24).Active
learning—anything that “involves studentsindoingthingsandthinkingabout
what they are doing”—has a powerful
impact on student learning (Bonwell &
Eison,p.2).Thenewparadigmsuggests
that students need to be involved in the
learning process to internalize the information. Of the recommended strategies
for active learning—for example, using
name cards, arranging seats in a circle,
and using breakout groups—class discussions are perhaps the most frequently used (Bonwell & Eison; Dallimore,
Hertenstein,&Platt,2006).
Inthepresentresearch,weexaminedthe
perceived fairness of different methods
of grading this form of active learning. We try to answer the question of
how an instructor can quantify student
involvement through class contribution
in a way that is perceived as fair by
the students. We examined this perceived fairness of contribution grading
fromtheperspectiveoftheperformance
appraisal literature, which has already
examined perceived fairness of evaluationinorganizations.
ChristophandNystrand(2001)defined
classroom discussion as free exchange
among students or among at least three
studentsandtheinstructor.Thesediscussion formats help students to develop
appreciation for different perspectives
(Brookfield & Preskill, 1999), criticalthinkingskills(Delaney,1991),problemsolvingskills(Gilmore&Schall,1996),
interpersonal skills (Smith, 1994), and
self-awareness (Brookfield & Preskill).
Well-done class discussions increase
student achievement (Nystrand &
Gamoran,1991)andstudentmotivation
(Wade,1994).
Reid and Johnson (1999) found that
bothstudentsandinstructorsconsidered
class interaction an important part of
goodteaching,althoughinstructorsrated
itmorehighlythandidstudents.Instructorswantstudentstoparticipatesothat
thestudentscanlearnfromoneanother
(Maznevski, 1996). Auster and Wylie
(2006)recommendedusingclassdiscussions to leverage students’ experiences
Downloaded by [Universitas Maritim Raja Ali Haji] at 23:16 11 January 2016
andinputstoexpandsourcesoflearning
in the classroom and increase the relevanceofcoursematerials.Theimportance of verbal communication skills
duringjobinterviewsalsosuggeststhat
learning to speak extemporaneously
about a topic is an important goal for
college students (Sautter, Gagnon, &
Mohr,2007).
Widespreaduseofclassdiscussionhas
ledtoincreasedattentiontoevaluatingstudentcontributionstolearning(Dallimore
et al., 2006). Class contribution grades
havebecomeanexpectedpartofcollege
syllabi (e.g., Bean & Peterson, 1998;
Gilson, 1994). These grades are often
referredtoasclassparticipationgrades.
However,inthepresentstudy,wereferto
thegradesasclasscontributiongrades.
In defining class contribution, Gioia
(1987) distinguished between participationandcontribution.Participation“connotes involvement, sharing and simply
takingpart”(Gioia,p.16).Contribution,
ontheotherhand,“connotessocial,but
alsointellectualinvolvementandsharing
of knowledge and knowledge construction”(Gioia,p.16).
Assigning a grade to class contribution may be one of the most controversial and difficult challenges that
instructorsface.Tiberius(1990)argued
that grading contribution makes studentsfeelcoercedintospeakinginstead
of speaking because they have somethingtosay.Thisleadstoconfusionfor
the students who come to expect good
grades based on the quantity of comments made; often they are surprised
when graded instead on the quality (or
lackthereof)oftheircomments(Desiraju&Gopinath,2001).
Gilson(1994)suggestedthatgrading
class contribution increases racial and
gender discrimination, ignores cultural
diversity,anddemotivatesstudentsfrom
learning. Further, class contribution
scores are considered among the most
subjectiveofclassroomgrades(Melvin,
2000).BeanandPeterson(1998)found
that most instructors determine contributiongradesimpressionistically,using
class contribution largely as a “fudge
factor” when figuring final grades (p.
33).Lowman(1995)contendedthatitis
“almostimpossible”foraninstructorto
assignagradetoclasscontributionina
fairandobjectivemanner(p.177).Davis
(1993) recommended basing grades
strictly on academic performance and
eliminatingotherconsiderationssuchas
effort, attendance, punctuality, attitude,
personality traits, or student interest in
thecoursematerial.
Other researchers have argued that
participation plays an important role
in learning and deserves evaluation
(Bean & Peterson, 1998; Dallimore et
al., 2006; Gioia, 1987; Melvin, 2000;
Smith, 1994). Bean and Peterson suggested that grading class contribution
can send positive signals to students
aboutwhataninstructorvalues,suchas
criticalthinking,activelearning,listening and speaking skills, and the ability to join a discipline’s conversation.
When students know their contribution
isbeinggraded,theyadjusttheirstudy
habits to be better prepared for discussion(Bean&Peterson).
JusticeandPerformance
Appraisal
Regardless of how important graded
classcontributionmightappeartostudent
learning,thefairnessofthegradingprocedureisparamountforitseffectiveness.
PriceandMueller(1986)initiallydefined
fairness in appraisal as “the degree to
whichrewardsandpunishmentsarerelatedtoperformanceinputs”(p.122).This
definition seems to refer to distributive
justice, the fairness of the decision outcomes (Deutsch, 1985). Early research
on the outcomes of distributive justice
perceptionswasinconsistent(e.g.,Landy,
Barnes,&Murphy,1978;Landy,BarnesFarrell&Cleveland,1980).Morerecent
research has showed that employees
were more concerned with procedural
justice—theperceivedaccuracyandfairness of the procedures used to generate
outcomes—than with distributive justice
(Dipboye&dePontbriand,1981;Greenberg,1987;Lind&Tyler,1988).
Whatdofindingsondistributiveand
procedural justice indicate for grading
classcontribution?Thefindingssuggest
thatastudentismorelikelytoperceive
a grade as fair if the student believes
thatfairprocedureswereusedtoreach
thatgraderegardlessofthevalueofthat
grade.Landyetal.(1978)foundprocess
variables to be important in employee
perceptionsofthefairnessandaccuracy
of performance appraisal. Specifically,
they found that frequency of feedback,
knowledge of performance, agreement
onjobduties,andproactivenessinhelpingtheemployeeovercomeweaknesses
wererelatedtotheemployee’sperceived
fairnessandaccuracyofappraisals.
Gilliland(1993)developedatheoretical model of procedural justice based
on organizational justice research. His
model included 10 procedural rules of
which satisfaction or violation—the
modelposited—affectedoverallevaluationofproceduraljustice.Althoughthe
model was designed to measure fairness in selection procedures, the presentresearchextendedittoperformance
appraisal (i.e., class contribution grading). Performance appraisal and selection involve many of the same procedures, primarily in rating individuals.
Previous researchers (e.g., Forgas &
George,2001;Latham,Wexley,&Pursell,1975)haveexaminedperformance
appraisalandselectiontogether.
Gilliland(1993)groupedthe10rules
inhismodelintothreebroadcategories:
formalcharacteristics,explanation,and
interpersonaltreatment.Formalcharacteristicsincludejobrelatedness,chance
toperform,reconsiderationopportunity,
and consistency. Explanation includes
feedback, justification for a decision,
and openness. Interpersonal treatment
includestreatment,two-waycommunication,andproprietyofquestions.Bauer
etal.(2001)developedacomprehensive
measureofGilliland’sproceduraljustice
rules, the Selection Procedural Justice
Scale(SPJS).Theirresultssuggestthat
there are 11 procedural justice factors
with a two-factor, higher-order factor
modelconsistingofstructureandsocial
factors. The structure factor reflects
Gilliland’s formal characteristics, and
thesocialfactorreflectsexplanationand
interpersonal characteristics. Although
alltherulesinthestructurefactorrelate
toclasscontributiongrading,thisarticle
focuses on 5 because researchers are
likelytofindthemincoursesyllabiand
canmeasurethemmoreobjectivelythan
theycanthosenotincoursesyllabi.
InformationKnown
The first relevant rule of Gilliland’s
(1993)modelreferstoinformationand
July/August2008
361
Downloaded by [Universitas Maritim Raja Ali Haji] at 23:16 11 January 2016
explanation about the process that the
leader gives to the participant before
testing. English (1991) listed “agreementamongallcriticalpartiesonwhat
istobeperformed”(p.58)asacritical
component of a performance appraisal
system.Inthecontextofemployeeevaluation,theformalevaluationshouldnot
containanysurprisesfortheemployee,
because it is just a specific point in
an ongoing process. In the context of
classcontributiongrading,information
known refers to how well the syllabus
spellsoutthecriteriaforclasscontributiongrading.
JobRelatedness
The second relevant rule refers to
the extent to which a test appears to
measure content relevant to the situation. Gilliland (1993) based this rule
on the findings of several studies that
indicate that perceptions of fairness in
evaluationprocessesdependonwhethertheyarebasedonrelevantandaccurateinformation(e.g.,Leventhal,1980;
Sheppard & Lewicki, 1987). Court
cases on performance appraisal have
demonstrated that managers cannot
baseappraisalsongutfeelings(Eldred
v. Consolidated Freightways, 1995)
butcanusesubjectivecriteria,suchas
interpersonalskillsandteamleadership
(Amirmokri v. Baltimore Gas & ElectricCo.,1995).Inthecontextofclass
contribution grading, job relatedness
refers to how much class contribution
gradesappeartoreflectstudentcontributionstolearning.
Feedback
The third relevant rule refers to the
provision of timely and informative
feedback. DeNisi and Kluger (2000)
suggested that repeated feedback gives
employees needed information on how
their performance is improving over
time. Folger, Konovsky, and Cropanzano (1992) suggested that providing
feedback on a regularly recurring and
timely basis is vital to performance
appraisal fairness. For students, feedback is a primary motivator. Without
feedback,studentsdonotknowhowfar
they have traveled toward their goals
and may withdraw their energy from
learning(Tiberius,1990).
362
JournalofEducationforBusiness
ReconsiderationOpportunity
The fourth relevant rule refers to
whether the applicant has the opportunity to challenge the decision-making
process and review the outcome. Folger et al. (1992) suggested that allowing employees to hear the appraiser’s
description of their performance and
then respond with their own commentary is an essential part of receiving
a fair hearing. In the context of class
contribution grading, reconsideration
opportunity refers to whether the student is given the opportunity to challengeacontributiongrade.
ChancetoPerform
The fifth relevant rule refers to
whether the participant gets the opportunitytoexpressknowledge,skills,and
abilities prior to a decision. Gilliland
(1993)basedthisruleonseveralstudies
(e.g., Dipboye & de Pontbriand, 1981;
Greenberg, 1986; Thibaut & Walker,
1975) that showed that procedures are
perceived as more fair if the recipients
of the decision get the opportunity to
expressthemselvesbeforethedecisions
are made. In the context of class contribution grading, chance to perform
refers to the opportunities for students
to contribute to class discussion, providedbytheinstructor.
Hypotheses
We developed hypotheses regarding
therelationshipbetweentheaforementioned procedural justice rules and the
objectivecharacteristicsofclasscontributiongrading.Todeterminetheobjectivecharacteristicsofclasscontribution
grading, we compiled syllabi from all
management classes at a Southwestern
university and examined and content
coded the class contribution portions.
Fromthecontentcodingemergedthree
independent variables: (a) explicitness
of class contribution grading criteria,
(b) frequency of feedback on contribution grades, and (c) proactiveness of
instructorinencouragingcontribution.
Perceptions of information known
and job relatedness should be related
to the explicitness of the criteria for
gradingclasscontribution.Explicitcriteria are clearly stated and leave noth-
ing implied. Spelling out requirements
ahead of time should reduce students’
uncertainty and beliefs that they did
poorlybecausetheydidnotknowwhat
toexpect.Wheninstructorsmakeitclear
whatactionswillconstituteacontributiontoclassroomlearning,studentswill
beabletomakethelinkbetweenthem
andtheobjectivesoftheclass.
Hypothesis 1 (H1): Explicitness of class
contributiongradingcriteriawillbepositivelyrelatedtoperceivedfairness.
Perceptions of feedback and reconsiderationopportunityshouldberelated
tohowoftentheinstructorinformsstudentsoftheirclasscontributiongrades.
Feedback is defined as a process in
which the factors that produce a result
are themselves modified, corrected, or
strengthened by that result (Neufeldt,
1997). More frequent feedback should
keep students from being surprised at
theendofthesemesterbyapoorgrade.
More frequent feedback should also
givestudentstheopportunitytoredress
their performance either by changing
theirbehaviororaskingtheinstructorto
reconsidertheirgrade.
Hypothesis2(H2):Frequencyoffeedback
onclasscontributiongradeswillbepositivelyrelatedtoperceivedfairness.
Perceptions of chance to perform
should be related to the proactiveness
of the instructor in encouraging class
contribution. The tactics used by the
instructor to encourage class contribution define proactiveness. More proactiveinstructorsprovideopportunitiesfor
discussionthroughsuchmechanismsas
coldcallingtodrawquietstudentsinto
discussionorsuggestingtopicsfordiscussioninadvancesothatstudentscan
prepare(Bean&Peterson,1998).Other
proactive methods include using class
exercises and breaking into small discussiongroups(Bean&Peterson).
Hypothesis 3 (H3): Proactive instruction
techniques will be positively related to
perceivedfairness.
METHOD
StudyDesign
We conducted two studies to examine how students perceive the fairness
of various types of class contribution
grading. To test the hypotheses, a scenarioandsurveydesignwasused.Independent variables were manipulated in
scenarios,anddependentvariableswere
measuredinasurvey.Thefirststudyhad
abetween-subjectsdesigninwhichstudentsreadonegradingscenarioreflecting a fairness condition and rated its
proceduraljustice.Thesecondstudyhad
a within-subject design in which students read grading scenarios reflecting
all fairness conditions and rated each
oneseparatelyonproceduraljustice.
Downloaded by [Universitas Maritim Raja Ali Haji] at 23:16 11 January 2016
StimulusMaterialDevelopment
To create scenarios to represent the
rangeofactualclasscontributiongrading methods, we content coded class
contribution portions of syllabi from
allmanagementclassesataSouthwesternuniversityandwrotedescriptionsof
classroom contribution grading proceduresthatcapturedhighandlowcondi-
tionsofeachindependentvariable.Severalsubjectmatterexpertsthenreadthe
conditions to ensure face validity. The
finalconditionsarelistedinTable1.
Wethencombinedthesixconditions
(explicitness: high and low; frequency
of feedback: high and low; and proactivenessofinstructor:highandlow)in
a 2 × 2 × 2 fully crossed experimental
design.Eachofthescenarioswasintroducedbythesentence“Pleasereadthe
below synopsis of a class contribution
gradingtechniquefromaclasssyllabus
andanswerthesubsequentquestionsas
if you were taking a class with such a
gradingtechnique.”
Tomeasureproceduraljusticeofeach
scenario, we adopted items from the
SPJS (Bauer et al., 2001). The SPJS
found two higher order factors—structure and social factors—among Gilliland’s (1993) procedural justice rules.
Becausewepredictedthatthemanipulations in this study would influence
perceptions through the structure of
class contribution grading techniques,
onlystructuralfactoritemswereused.
Thefiveproceduraljusticerulesthat
fall under the structure factor are jobrelatedness,informationknown,chance
toperform,reconsiderationopportunity,
andfeedback.Theitemswererewritten
toreflecttheproceduraljusticeofclass
contribution grading instead of selection procedures. Bauer et al. (2001)
wrotetheitemstemssothattheirscale
could be translated into other research
areas. The revised items are listed in
Table 2. We used a pilot study to test
the new wording of the SPJS on scale
reliability.Anexploratoryfactoranalysis (EFA) of the results of the pilot
study revealed minor problems with
the new wording of questions in the
SPJS.We examined questions that did
notloadwellontheirfactorsandmade
slightmodifications.Inthemainstudy,
the revised SPJS and its subscales all
TABLE1.DescriptionofHighandLowConditionsforEachIndependentVariable
Variable
Description
Explicitness
Low
Thisclassisdesignedtobehighlyparticipatory.Therefore,youwillbegradedonyouroverallparticipationand
attendance.
High
Thisclassisdesignedtobehighlyparticipatory.Therefore,youwillbegradedonyourclassparticipation.While
thisisasubjectivemeasure,yourinstructorwilltrytostandardizeitasmuchaspossiblebytrackingyourattendanceandproductiveparticipationinclassdiscussionsandactivities.Severalofthein-classactivitieswillinvolve
smallgroupdiscussions.Thisparticipationgradewillconsistofthefollowingcomponents:qualityofproductive
commentsmadeinclass(qualitynotquantity);comingtoclassontimeandnotleavingearly;workingproductivelyduringin-classexercises.
Feedback
Low
Attheendofthesemester,youwillreceiveyoursemestergradeforclassparticipation.Participationgradesfor
thesemesterwillbepostedduringthefinalweekofclasses.
High
Youwillreceivefeedbackonyourparticipationgradeeachweekthroughthefollowingmethod.Attheendof
eachclassperiod,theinstructorwillaskyoutopassyournamecardsback.Butbeforeyoupassthemin,turn
themoverandgradeyourowncontributiontotheclassonthefollowingscale:0(didn’tshowuporcameto
classanddidnotpayattention[readnewspaper,tookanap,etc.]);1(cametoclass,actedinterested);2(cameto
class,madesomecontributions);3(cametoclass,madeseveralcontributionsandatleastoneinsightfulone);4
(madeanumberofinsightfulcomments).Theinstructorwilllooktheseoveraftereachclassandiftheinstructor’sassessmentofyourcontributionisdifferentthanyours,yournamecardwillbereturnedtoyounextclass
periodwithashortnoteregardingwhy.Ifyourassessmentandtheinstructor’sarethesame,youwillreceive
yournamecardbackatthenextclassperiodwithoutanycommentsonit.
Proactiveness
Low
Youareencouragedtospeakupduringclassdiscussionsandparticipateinclassexercises.
High
Youareencouragedtospeakupduringclassdiscussionsandparticipateinclassexercises.Theinstructorwill
trytoincreaseyourparticipationinclassby:1.holdingopen,freeclassdiscussion;2.suggestinginadvance,
topicsfordiscussion;3.callingonpeoplewhodonothavetheirhandsup;4.usingclassexercisesthatyoucan
beinvolvedin;5.workinginateamtocompleteaclassproject;6.holdingtwo-persondiscussionexercises;7.
encouragingcontributionsthataresuccinctandhaveahighimpactontheclassdiscussion.
July/August2008
363
TABLE2.RewrittenItemsFromtheSelectionProceduralJusticeScale(S.W.Gilliland,1993)
Downloaded by [Universitas Maritim Raja Ali Haji] at 23:16 11 January 2016
Proceduraljusticerule
Items
Jobrelatedness
Agoodgradeontheclassparticipationgradingscaleinthisclassmeansastudentenhancedthelearningof
theclass.
Apersonwhoscoredwellonclassparticipationinthisclassisaknowledgeablestudent.
Studentswhogethighparticipationgradesunderthissystemwouldbeknowledgeableandwell-prepared
forclass.
Chancetoperform
Themethodofgradingclassparticipationinthisclassgiveseveryonetheopportunitytoshowwhattheycan
reallydo.
Themethodofgradingclassparticipationinthisclassallowsmetoshowwhatmyskillsare.
IamabletoshowwhatIcandothroughthisclass’methodofgradingclassparticipation.
Feedback
ThemethodofgradingclassparticipationinthisclassgivesmeaclearideaofwhenIwillgetmy
participationgraderesults.
Thismethodofgradingclassparticipationgivesstudentsplentyoffeedbackonhowtheyaredoing.
Inthisclass,Iamsatisfiedwiththeamountoftimeittakestogetfeedbackonmyclassparticipationresults.
Informationknown
Inthisclass,Iunderstandwhatisrequiredtogetagoodgradeinclassparticipation.
Fromthisdescription,Iunderstandtherequirementsofclassparticipation.
Iknowwhattoexpectregardingthecomponentsofclassparticipationgradinginthisclass.
Reconsideration
Themethodofgradingclassparticipationinthisclassprovidesstudentswiththeopportunitytocontesttheir
participationgradesbeforetheendofthesemester.
Themethodofgradingclassparticipationinthisclassgivesstudentsthechancetodiscussparticipation
gradeswithsomeone.
Themethodofgradingclassparticipationinthisclassallowsstudentstohavetheirgradesreviewedif
theywant.
reachedacceptablelevelsofCronbach’s
alpha(.70orgreater).
RESULTS
Study1
WedesignedStudy1asa2×2×2
fully crossed between-subjects experiment.Theparticipantswere385undergraduatestudents(207men,158women,
20 individuals of unspecified gender)
at a Southwestern university. Students
were randomly given one of the eight
possible scenarios and answered the
SPJSquestionsduringclassinbusiness
classeswhoseinstructorshadagreedto
cooperate with the study.A researcher
presentedthesurvey,stressingthatstudentsshouldconsiderthestudyseparate
from how contribution was graded in
thatparticularclass.Also,theresearcher encouraged students to answer the
surveyfollowingthescenariosforaltruistic reasons, suggesting that completing it would help improve education
at the university. This approach was
purposeful to avoid appealing only to
students who were disgruntled about
theirgrades.
We tested hypotheses by using analysis of variance (ANOVA). Table 3
364
JournalofEducationforBusiness
shows correlations, means, and standarddeviationsamongtheindependent
and dependent variables. The hypotheses were submitted to a 2 (frequency
of feedback: high, low) × 2 (proactiveness: high, low) × 2 (explicitness:
high,low)independentgroupsfactorial
ANOVA. All three independent variablesproducedsignificantmaineffects.
Forexplicitness,F(1,377)=24.62,p
ISSN: 0883-2323 (Print) 1940-3356 (Online) Journal homepage: http://www.tandfonline.com/loi/vjeb20
Classroom Contribution: What Do Students
Perceive as Fair Assessment?
Molly B. Pepper & Seemantini Pathak
To cite this article: Molly B. Pepper & Seemantini Pathak (2008) Classroom Contribution: What
Do Students Perceive as Fair Assessment?, Journal of Education for Business, 83:6, 360-368,
DOI: 10.3200/JOEB.83.6.360-368
To link to this article: http://dx.doi.org/10.3200/JOEB.83.6.360-368
Published online: 07 Aug 2010.
Submit your article to this journal
Article views: 74
View related articles
Citing articles: 5 View citing articles
Full Terms & Conditions of access and use can be found at
http://www.tandfonline.com/action/journalInformation?journalCode=vjeb20
Download by: [Universitas Maritim Raja Ali Haji]
Date: 11 January 2016, At: 23:16
Downloaded by [Universitas Maritim Raja Ali Haji] at 23:16 11 January 2016
ClassroomContribution:WhatDoStudents
PerceiveasFairAssessment?
MOLLYB.PEPPER
GONZAGAUNIVERSITY
SPOKANE,WASHINGTON
SEEMANTINIPATHAK
UNIVERSITYOFHOUSTON
HOUSTON,TEXAS
ABSTRACT. Assigningagradetostu-
S
dents’classcontributionmaybe1ofthe
mostcontroversialanddifficultchallenges
thatinstructorsface.Theauthorsexamine
theperceivedfairnessofclasscontribution
gradingmethodsfromtheperspectiveof
theperformanceappraisalliterature.In2
scenariostudiesbasedonactualgrading
techniques,theauthorsexaminedperceptionsoffairassessment.Participantswere
undergraduatestudentsfrom2universities.
Atheoreticalmodelofproceduraljustice
providedthebackground.Resultsindicate
that3objectiveaspectsofgrading—explicitnessofgradingcriteria,frequencyof
feedback,andproactivenessofinstructor
techniques—affectperceivedfairness.
Keywords:classroomcontribution,perceivedfairness,performanceappraisal
Copyright©2008HeldrefPublications
360
JournalofEducationforBusiness
queezed by increased competition
among business schools and the
demandsofstudentsandrecruiters,managementfacultymembersareunderpressuretoexcelintheclassroom(Gerdes,2006;
Lavelle,Gerdes,Jespersen,Gloeckler,&
Symonds,2006;O’Brien&Hart,1999).
Tomeetthechallenge,managementfaculty members are shifting away from a
paradigm of passive learning (Auster &
Wylie, 2006) to one of active learning
(Bonwell & Eison, 1991; Wingfield &
Black,2005).Theoldparadigminvolved
theinstructorastheexpertwhoimparted
knowledge to students through lectures
(Barr & Tagg, 1995, p. 24). The new
paradigm replaces the instructor as an
actor on the stage imparting knowledge
withan“inter-actor”whofacilitatesstudentlearning(Barr&Tagg,p.24).Active
learning—anything that “involves studentsindoingthingsandthinkingabout
what they are doing”—has a powerful
impact on student learning (Bonwell &
Eison,p.2).Thenewparadigmsuggests
that students need to be involved in the
learning process to internalize the information. Of the recommended strategies
for active learning—for example, using
name cards, arranging seats in a circle,
and using breakout groups—class discussions are perhaps the most frequently used (Bonwell & Eison; Dallimore,
Hertenstein,&Platt,2006).
Inthepresentresearch,weexaminedthe
perceived fairness of different methods
of grading this form of active learning. We try to answer the question of
how an instructor can quantify student
involvement through class contribution
in a way that is perceived as fair by
the students. We examined this perceived fairness of contribution grading
fromtheperspectiveoftheperformance
appraisal literature, which has already
examined perceived fairness of evaluationinorganizations.
ChristophandNystrand(2001)defined
classroom discussion as free exchange
among students or among at least three
studentsandtheinstructor.Thesediscussion formats help students to develop
appreciation for different perspectives
(Brookfield & Preskill, 1999), criticalthinkingskills(Delaney,1991),problemsolvingskills(Gilmore&Schall,1996),
interpersonal skills (Smith, 1994), and
self-awareness (Brookfield & Preskill).
Well-done class discussions increase
student achievement (Nystrand &
Gamoran,1991)andstudentmotivation
(Wade,1994).
Reid and Johnson (1999) found that
bothstudentsandinstructorsconsidered
class interaction an important part of
goodteaching,althoughinstructorsrated
itmorehighlythandidstudents.Instructorswantstudentstoparticipatesothat
thestudentscanlearnfromoneanother
(Maznevski, 1996). Auster and Wylie
(2006)recommendedusingclassdiscussions to leverage students’ experiences
Downloaded by [Universitas Maritim Raja Ali Haji] at 23:16 11 January 2016
andinputstoexpandsourcesoflearning
in the classroom and increase the relevanceofcoursematerials.Theimportance of verbal communication skills
duringjobinterviewsalsosuggeststhat
learning to speak extemporaneously
about a topic is an important goal for
college students (Sautter, Gagnon, &
Mohr,2007).
Widespreaduseofclassdiscussionhas
ledtoincreasedattentiontoevaluatingstudentcontributionstolearning(Dallimore
et al., 2006). Class contribution grades
havebecomeanexpectedpartofcollege
syllabi (e.g., Bean & Peterson, 1998;
Gilson, 1994). These grades are often
referredtoasclassparticipationgrades.
However,inthepresentstudy,wereferto
thegradesasclasscontributiongrades.
In defining class contribution, Gioia
(1987) distinguished between participationandcontribution.Participation“connotes involvement, sharing and simply
takingpart”(Gioia,p.16).Contribution,
ontheotherhand,“connotessocial,but
alsointellectualinvolvementandsharing
of knowledge and knowledge construction”(Gioia,p.16).
Assigning a grade to class contribution may be one of the most controversial and difficult challenges that
instructorsface.Tiberius(1990)argued
that grading contribution makes studentsfeelcoercedintospeakinginstead
of speaking because they have somethingtosay.Thisleadstoconfusionfor
the students who come to expect good
grades based on the quantity of comments made; often they are surprised
when graded instead on the quality (or
lackthereof)oftheircomments(Desiraju&Gopinath,2001).
Gilson(1994)suggestedthatgrading
class contribution increases racial and
gender discrimination, ignores cultural
diversity,anddemotivatesstudentsfrom
learning. Further, class contribution
scores are considered among the most
subjectiveofclassroomgrades(Melvin,
2000).BeanandPeterson(1998)found
that most instructors determine contributiongradesimpressionistically,using
class contribution largely as a “fudge
factor” when figuring final grades (p.
33).Lowman(1995)contendedthatitis
“almostimpossible”foraninstructorto
assignagradetoclasscontributionina
fairandobjectivemanner(p.177).Davis
(1993) recommended basing grades
strictly on academic performance and
eliminatingotherconsiderationssuchas
effort, attendance, punctuality, attitude,
personality traits, or student interest in
thecoursematerial.
Other researchers have argued that
participation plays an important role
in learning and deserves evaluation
(Bean & Peterson, 1998; Dallimore et
al., 2006; Gioia, 1987; Melvin, 2000;
Smith, 1994). Bean and Peterson suggested that grading class contribution
can send positive signals to students
aboutwhataninstructorvalues,suchas
criticalthinking,activelearning,listening and speaking skills, and the ability to join a discipline’s conversation.
When students know their contribution
isbeinggraded,theyadjusttheirstudy
habits to be better prepared for discussion(Bean&Peterson).
JusticeandPerformance
Appraisal
Regardless of how important graded
classcontributionmightappeartostudent
learning,thefairnessofthegradingprocedureisparamountforitseffectiveness.
PriceandMueller(1986)initiallydefined
fairness in appraisal as “the degree to
whichrewardsandpunishmentsarerelatedtoperformanceinputs”(p.122).This
definition seems to refer to distributive
justice, the fairness of the decision outcomes (Deutsch, 1985). Early research
on the outcomes of distributive justice
perceptionswasinconsistent(e.g.,Landy,
Barnes,&Murphy,1978;Landy,BarnesFarrell&Cleveland,1980).Morerecent
research has showed that employees
were more concerned with procedural
justice—theperceivedaccuracyandfairness of the procedures used to generate
outcomes—than with distributive justice
(Dipboye&dePontbriand,1981;Greenberg,1987;Lind&Tyler,1988).
Whatdofindingsondistributiveand
procedural justice indicate for grading
classcontribution?Thefindingssuggest
thatastudentismorelikelytoperceive
a grade as fair if the student believes
thatfairprocedureswereusedtoreach
thatgraderegardlessofthevalueofthat
grade.Landyetal.(1978)foundprocess
variables to be important in employee
perceptionsofthefairnessandaccuracy
of performance appraisal. Specifically,
they found that frequency of feedback,
knowledge of performance, agreement
onjobduties,andproactivenessinhelpingtheemployeeovercomeweaknesses
wererelatedtotheemployee’sperceived
fairnessandaccuracyofappraisals.
Gilliland(1993)developedatheoretical model of procedural justice based
on organizational justice research. His
model included 10 procedural rules of
which satisfaction or violation—the
modelposited—affectedoverallevaluationofproceduraljustice.Althoughthe
model was designed to measure fairness in selection procedures, the presentresearchextendedittoperformance
appraisal (i.e., class contribution grading). Performance appraisal and selection involve many of the same procedures, primarily in rating individuals.
Previous researchers (e.g., Forgas &
George,2001;Latham,Wexley,&Pursell,1975)haveexaminedperformance
appraisalandselectiontogether.
Gilliland(1993)groupedthe10rules
inhismodelintothreebroadcategories:
formalcharacteristics,explanation,and
interpersonaltreatment.Formalcharacteristicsincludejobrelatedness,chance
toperform,reconsiderationopportunity,
and consistency. Explanation includes
feedback, justification for a decision,
and openness. Interpersonal treatment
includestreatment,two-waycommunication,andproprietyofquestions.Bauer
etal.(2001)developedacomprehensive
measureofGilliland’sproceduraljustice
rules, the Selection Procedural Justice
Scale(SPJS).Theirresultssuggestthat
there are 11 procedural justice factors
with a two-factor, higher-order factor
modelconsistingofstructureandsocial
factors. The structure factor reflects
Gilliland’s formal characteristics, and
thesocialfactorreflectsexplanationand
interpersonal characteristics. Although
alltherulesinthestructurefactorrelate
toclasscontributiongrading,thisarticle
focuses on 5 because researchers are
likelytofindthemincoursesyllabiand
canmeasurethemmoreobjectivelythan
theycanthosenotincoursesyllabi.
InformationKnown
The first relevant rule of Gilliland’s
(1993)modelreferstoinformationand
July/August2008
361
Downloaded by [Universitas Maritim Raja Ali Haji] at 23:16 11 January 2016
explanation about the process that the
leader gives to the participant before
testing. English (1991) listed “agreementamongallcriticalpartiesonwhat
istobeperformed”(p.58)asacritical
component of a performance appraisal
system.Inthecontextofemployeeevaluation,theformalevaluationshouldnot
containanysurprisesfortheemployee,
because it is just a specific point in
an ongoing process. In the context of
classcontributiongrading,information
known refers to how well the syllabus
spellsoutthecriteriaforclasscontributiongrading.
JobRelatedness
The second relevant rule refers to
the extent to which a test appears to
measure content relevant to the situation. Gilliland (1993) based this rule
on the findings of several studies that
indicate that perceptions of fairness in
evaluationprocessesdependonwhethertheyarebasedonrelevantandaccurateinformation(e.g.,Leventhal,1980;
Sheppard & Lewicki, 1987). Court
cases on performance appraisal have
demonstrated that managers cannot
baseappraisalsongutfeelings(Eldred
v. Consolidated Freightways, 1995)
butcanusesubjectivecriteria,suchas
interpersonalskillsandteamleadership
(Amirmokri v. Baltimore Gas & ElectricCo.,1995).Inthecontextofclass
contribution grading, job relatedness
refers to how much class contribution
gradesappeartoreflectstudentcontributionstolearning.
Feedback
The third relevant rule refers to the
provision of timely and informative
feedback. DeNisi and Kluger (2000)
suggested that repeated feedback gives
employees needed information on how
their performance is improving over
time. Folger, Konovsky, and Cropanzano (1992) suggested that providing
feedback on a regularly recurring and
timely basis is vital to performance
appraisal fairness. For students, feedback is a primary motivator. Without
feedback,studentsdonotknowhowfar
they have traveled toward their goals
and may withdraw their energy from
learning(Tiberius,1990).
362
JournalofEducationforBusiness
ReconsiderationOpportunity
The fourth relevant rule refers to
whether the applicant has the opportunity to challenge the decision-making
process and review the outcome. Folger et al. (1992) suggested that allowing employees to hear the appraiser’s
description of their performance and
then respond with their own commentary is an essential part of receiving
a fair hearing. In the context of class
contribution grading, reconsideration
opportunity refers to whether the student is given the opportunity to challengeacontributiongrade.
ChancetoPerform
The fifth relevant rule refers to
whether the participant gets the opportunitytoexpressknowledge,skills,and
abilities prior to a decision. Gilliland
(1993)basedthisruleonseveralstudies
(e.g., Dipboye & de Pontbriand, 1981;
Greenberg, 1986; Thibaut & Walker,
1975) that showed that procedures are
perceived as more fair if the recipients
of the decision get the opportunity to
expressthemselvesbeforethedecisions
are made. In the context of class contribution grading, chance to perform
refers to the opportunities for students
to contribute to class discussion, providedbytheinstructor.
Hypotheses
We developed hypotheses regarding
therelationshipbetweentheaforementioned procedural justice rules and the
objectivecharacteristicsofclasscontributiongrading.Todeterminetheobjectivecharacteristicsofclasscontribution
grading, we compiled syllabi from all
management classes at a Southwestern
university and examined and content
coded the class contribution portions.
Fromthecontentcodingemergedthree
independent variables: (a) explicitness
of class contribution grading criteria,
(b) frequency of feedback on contribution grades, and (c) proactiveness of
instructorinencouragingcontribution.
Perceptions of information known
and job relatedness should be related
to the explicitness of the criteria for
gradingclasscontribution.Explicitcriteria are clearly stated and leave noth-
ing implied. Spelling out requirements
ahead of time should reduce students’
uncertainty and beliefs that they did
poorlybecausetheydidnotknowwhat
toexpect.Wheninstructorsmakeitclear
whatactionswillconstituteacontributiontoclassroomlearning,studentswill
beabletomakethelinkbetweenthem
andtheobjectivesoftheclass.
Hypothesis 1 (H1): Explicitness of class
contributiongradingcriteriawillbepositivelyrelatedtoperceivedfairness.
Perceptions of feedback and reconsiderationopportunityshouldberelated
tohowoftentheinstructorinformsstudentsoftheirclasscontributiongrades.
Feedback is defined as a process in
which the factors that produce a result
are themselves modified, corrected, or
strengthened by that result (Neufeldt,
1997). More frequent feedback should
keep students from being surprised at
theendofthesemesterbyapoorgrade.
More frequent feedback should also
givestudentstheopportunitytoredress
their performance either by changing
theirbehaviororaskingtheinstructorto
reconsidertheirgrade.
Hypothesis2(H2):Frequencyoffeedback
onclasscontributiongradeswillbepositivelyrelatedtoperceivedfairness.
Perceptions of chance to perform
should be related to the proactiveness
of the instructor in encouraging class
contribution. The tactics used by the
instructor to encourage class contribution define proactiveness. More proactiveinstructorsprovideopportunitiesfor
discussionthroughsuchmechanismsas
coldcallingtodrawquietstudentsinto
discussionorsuggestingtopicsfordiscussioninadvancesothatstudentscan
prepare(Bean&Peterson,1998).Other
proactive methods include using class
exercises and breaking into small discussiongroups(Bean&Peterson).
Hypothesis 3 (H3): Proactive instruction
techniques will be positively related to
perceivedfairness.
METHOD
StudyDesign
We conducted two studies to examine how students perceive the fairness
of various types of class contribution
grading. To test the hypotheses, a scenarioandsurveydesignwasused.Independent variables were manipulated in
scenarios,anddependentvariableswere
measuredinasurvey.Thefirststudyhad
abetween-subjectsdesigninwhichstudentsreadonegradingscenarioreflecting a fairness condition and rated its
proceduraljustice.Thesecondstudyhad
a within-subject design in which students read grading scenarios reflecting
all fairness conditions and rated each
oneseparatelyonproceduraljustice.
Downloaded by [Universitas Maritim Raja Ali Haji] at 23:16 11 January 2016
StimulusMaterialDevelopment
To create scenarios to represent the
rangeofactualclasscontributiongrading methods, we content coded class
contribution portions of syllabi from
allmanagementclassesataSouthwesternuniversityandwrotedescriptionsof
classroom contribution grading proceduresthatcapturedhighandlowcondi-
tionsofeachindependentvariable.Severalsubjectmatterexpertsthenreadthe
conditions to ensure face validity. The
finalconditionsarelistedinTable1.
Wethencombinedthesixconditions
(explicitness: high and low; frequency
of feedback: high and low; and proactivenessofinstructor:highandlow)in
a 2 × 2 × 2 fully crossed experimental
design.Eachofthescenarioswasintroducedbythesentence“Pleasereadthe
below synopsis of a class contribution
gradingtechniquefromaclasssyllabus
andanswerthesubsequentquestionsas
if you were taking a class with such a
gradingtechnique.”
Tomeasureproceduraljusticeofeach
scenario, we adopted items from the
SPJS (Bauer et al., 2001). The SPJS
found two higher order factors—structure and social factors—among Gilliland’s (1993) procedural justice rules.
Becausewepredictedthatthemanipulations in this study would influence
perceptions through the structure of
class contribution grading techniques,
onlystructuralfactoritemswereused.
Thefiveproceduraljusticerulesthat
fall under the structure factor are jobrelatedness,informationknown,chance
toperform,reconsiderationopportunity,
andfeedback.Theitemswererewritten
toreflecttheproceduraljusticeofclass
contribution grading instead of selection procedures. Bauer et al. (2001)
wrotetheitemstemssothattheirscale
could be translated into other research
areas. The revised items are listed in
Table 2. We used a pilot study to test
the new wording of the SPJS on scale
reliability.Anexploratoryfactoranalysis (EFA) of the results of the pilot
study revealed minor problems with
the new wording of questions in the
SPJS.We examined questions that did
notloadwellontheirfactorsandmade
slightmodifications.Inthemainstudy,
the revised SPJS and its subscales all
TABLE1.DescriptionofHighandLowConditionsforEachIndependentVariable
Variable
Description
Explicitness
Low
Thisclassisdesignedtobehighlyparticipatory.Therefore,youwillbegradedonyouroverallparticipationand
attendance.
High
Thisclassisdesignedtobehighlyparticipatory.Therefore,youwillbegradedonyourclassparticipation.While
thisisasubjectivemeasure,yourinstructorwilltrytostandardizeitasmuchaspossiblebytrackingyourattendanceandproductiveparticipationinclassdiscussionsandactivities.Severalofthein-classactivitieswillinvolve
smallgroupdiscussions.Thisparticipationgradewillconsistofthefollowingcomponents:qualityofproductive
commentsmadeinclass(qualitynotquantity);comingtoclassontimeandnotleavingearly;workingproductivelyduringin-classexercises.
Feedback
Low
Attheendofthesemester,youwillreceiveyoursemestergradeforclassparticipation.Participationgradesfor
thesemesterwillbepostedduringthefinalweekofclasses.
High
Youwillreceivefeedbackonyourparticipationgradeeachweekthroughthefollowingmethod.Attheendof
eachclassperiod,theinstructorwillaskyoutopassyournamecardsback.Butbeforeyoupassthemin,turn
themoverandgradeyourowncontributiontotheclassonthefollowingscale:0(didn’tshowuporcameto
classanddidnotpayattention[readnewspaper,tookanap,etc.]);1(cametoclass,actedinterested);2(cameto
class,madesomecontributions);3(cametoclass,madeseveralcontributionsandatleastoneinsightfulone);4
(madeanumberofinsightfulcomments).Theinstructorwilllooktheseoveraftereachclassandiftheinstructor’sassessmentofyourcontributionisdifferentthanyours,yournamecardwillbereturnedtoyounextclass
periodwithashortnoteregardingwhy.Ifyourassessmentandtheinstructor’sarethesame,youwillreceive
yournamecardbackatthenextclassperiodwithoutanycommentsonit.
Proactiveness
Low
Youareencouragedtospeakupduringclassdiscussionsandparticipateinclassexercises.
High
Youareencouragedtospeakupduringclassdiscussionsandparticipateinclassexercises.Theinstructorwill
trytoincreaseyourparticipationinclassby:1.holdingopen,freeclassdiscussion;2.suggestinginadvance,
topicsfordiscussion;3.callingonpeoplewhodonothavetheirhandsup;4.usingclassexercisesthatyoucan
beinvolvedin;5.workinginateamtocompleteaclassproject;6.holdingtwo-persondiscussionexercises;7.
encouragingcontributionsthataresuccinctandhaveahighimpactontheclassdiscussion.
July/August2008
363
TABLE2.RewrittenItemsFromtheSelectionProceduralJusticeScale(S.W.Gilliland,1993)
Downloaded by [Universitas Maritim Raja Ali Haji] at 23:16 11 January 2016
Proceduraljusticerule
Items
Jobrelatedness
Agoodgradeontheclassparticipationgradingscaleinthisclassmeansastudentenhancedthelearningof
theclass.
Apersonwhoscoredwellonclassparticipationinthisclassisaknowledgeablestudent.
Studentswhogethighparticipationgradesunderthissystemwouldbeknowledgeableandwell-prepared
forclass.
Chancetoperform
Themethodofgradingclassparticipationinthisclassgiveseveryonetheopportunitytoshowwhattheycan
reallydo.
Themethodofgradingclassparticipationinthisclassallowsmetoshowwhatmyskillsare.
IamabletoshowwhatIcandothroughthisclass’methodofgradingclassparticipation.
Feedback
ThemethodofgradingclassparticipationinthisclassgivesmeaclearideaofwhenIwillgetmy
participationgraderesults.
Thismethodofgradingclassparticipationgivesstudentsplentyoffeedbackonhowtheyaredoing.
Inthisclass,Iamsatisfiedwiththeamountoftimeittakestogetfeedbackonmyclassparticipationresults.
Informationknown
Inthisclass,Iunderstandwhatisrequiredtogetagoodgradeinclassparticipation.
Fromthisdescription,Iunderstandtherequirementsofclassparticipation.
Iknowwhattoexpectregardingthecomponentsofclassparticipationgradinginthisclass.
Reconsideration
Themethodofgradingclassparticipationinthisclassprovidesstudentswiththeopportunitytocontesttheir
participationgradesbeforetheendofthesemester.
Themethodofgradingclassparticipationinthisclassgivesstudentsthechancetodiscussparticipation
gradeswithsomeone.
Themethodofgradingclassparticipationinthisclassallowsstudentstohavetheirgradesreviewedif
theywant.
reachedacceptablelevelsofCronbach’s
alpha(.70orgreater).
RESULTS
Study1
WedesignedStudy1asa2×2×2
fully crossed between-subjects experiment.Theparticipantswere385undergraduatestudents(207men,158women,
20 individuals of unspecified gender)
at a Southwestern university. Students
were randomly given one of the eight
possible scenarios and answered the
SPJSquestionsduringclassinbusiness
classeswhoseinstructorshadagreedto
cooperate with the study.A researcher
presentedthesurvey,stressingthatstudentsshouldconsiderthestudyseparate
from how contribution was graded in
thatparticularclass.Also,theresearcher encouraged students to answer the
surveyfollowingthescenariosforaltruistic reasons, suggesting that completing it would help improve education
at the university. This approach was
purposeful to avoid appealing only to
students who were disgruntled about
theirgrades.
We tested hypotheses by using analysis of variance (ANOVA). Table 3
364
JournalofEducationforBusiness
shows correlations, means, and standarddeviationsamongtheindependent
and dependent variables. The hypotheses were submitted to a 2 (frequency
of feedback: high, low) × 2 (proactiveness: high, low) × 2 (explicitness:
high,low)independentgroupsfactorial
ANOVA. All three independent variablesproducedsignificantmaineffects.
Forexplicitness,F(1,377)=24.62,p