Manajemen | Fakultas Ekonomi Universitas Maritim Raja Ali Haji joeb.83.1.37-44

Journal of Education for Business

ISSN: 0883-2323 (Print) 1940-3356 (Online) Journal homepage: http://www.tandfonline.com/loi/vjeb20

Building Skills in Thinking: Toward a Pedagogy in
Metathinking
Victoria Crittenden & Arch G. Woodside
To cite this article: Victoria Crittenden & Arch G. Woodside (2007) Building Skills in Thinking:
Toward a Pedagogy in Metathinking, Journal of Education for Business, 83:1, 37-44, DOI:
10.3200/JOEB.83.1.37-44
To link to this article: http://dx.doi.org/10.3200/JOEB.83.1.37-44

Published online: 07 Aug 2010.

Submit your article to this journal

Article views: 35

View related articles

Citing articles: 1 View citing articles


Full Terms & Conditions of access and use can be found at
http://www.tandfonline.com/action/journalInformation?journalCode=vjeb20
Download by: [Universitas Maritim Raja Ali Haji]

Date: 11 January 2016, At: 23:01

Downloaded by [Universitas Maritim Raja Ali Haji] at 23:01 11 January 2016

Building฀Skills฀in฀Thinking:฀Toward฀a฀
Pedagogy฀in฀Metathinking
VICTORIA฀CRITTENDEN฀
ARCH฀G.฀WOODSIDE฀
BOSTON฀COLLEGE฀฀
CHESTNUT฀HILL,฀MASSACHUSETTS

ABSTRACT.฀Most฀managers฀do฀not฀
receive฀formal฀training฀in฀metathinking—
that฀is,฀they฀are฀not฀trained฀formally฀in฀
thinking฀about฀thinking฀or฀in฀thinking฀about฀

deciding.฀In฀this฀article,฀the฀authors฀review฀
the฀lack฀of฀educational฀focus฀on฀metathinking฀and฀suggest฀several฀tools฀for฀improving฀
the฀decision-making฀process฀and฀for฀skill฀
building฀in฀metathinking.฀The฀tools฀include฀
two฀experiential฀exercises฀that฀facilitate฀
learning฀in฀metathinking.
Keywords:฀decision฀analysis,฀learning฀
theory,฀metathinking,฀pedagogy฀

Copyright฀©฀2007฀Heldref฀Publications



T

he฀ way฀ chief฀ executive฀ officers฀
(CEOs)฀ draw฀ conclusions฀ and฀
make฀decisions฀can฀have฀disastrous฀consequences.฀ For฀ example,฀ government฀
CEOs฀ George฀W.฀ Bush฀ (United฀ States),฀
Tony฀ Blair฀ (United฀ Kingdom),฀ John฀฀

Howard฀(Australia),฀and฀additional฀coalition฀ country฀ CEOs฀ concluded฀ in฀ early฀
2003฀ that฀ Iraqi฀ leaders฀ had฀ weapons฀
of฀ mass฀ destruction฀ and฀ were฀ refusing฀
to฀ disarm฀ these฀ weapons.฀ Thus,฀ these฀
government฀CEOs฀made฀the฀decision฀to฀
declare฀war฀on฀Iraq.฀In฀mid-2004฀(more฀
than฀a฀year฀after฀the฀war฀was฀declared฀as฀
officially฀won),฀the฀CEOs฀had฀found฀no฀
weapons฀ of฀ mass฀ destruction,฀ close-tofull-blown฀ civil฀ war฀ was฀ raging฀ in฀ Iraq,฀
and฀world฀terrorism฀had฀increased.฀Amid฀
all฀ of฀ this,฀ the฀ U.S.฀ CEO฀ reported฀ that฀
there฀were฀weapons฀of฀mass฀destruction.
At฀ a฀ more฀ mundane฀ level,฀ consider฀
why฀highly฀successful฀firms฀such฀as฀Polaroid฀ and฀ Lucent฀ became฀ failures.฀ The฀
cover฀story฀of฀the฀May฀27,฀2002฀issue฀of฀
Fortune฀magazine฀described฀10฀big฀mistakes฀ as฀ the฀ primary฀ reasons฀ why฀ companies฀fail,฀with฀a฀critical฀mistake฀being฀
that฀ people฀ presume฀ that฀ the฀ future฀ will฀
be฀good฀on฀the฀basis฀of฀historical฀successes฀ rather฀ than฀ planning฀ for฀ unexpected฀
changes฀(Charan,฀Useem,฀&฀Harrington,฀
2002).฀Weick฀and฀Sutcliffe฀(2001)฀made฀

the฀same฀observation฀in฀their฀aptly฀titled฀
monograph,฀Managing฀the฀Unexpected.฀
These฀ examples฀ point฀ out฀ the฀ obvious:฀that฀CEOs,฀middle฀level฀managers,฀

and฀the฀rest฀of฀us฀are฀prone฀to฀drawing฀
inaccurate฀conclusions฀and฀making฀bad฀
decisions.฀ It฀ is฀ unfortunate฀ that฀ such฀
thinking฀ (a)฀ occurs฀ frequently,฀ (b)฀ can฀
be฀ very฀ expensive,฀ (c)฀ often฀ wrecks฀
local฀economies,฀and฀(d)฀can฀cause฀massive฀ layoffs,฀ terror,฀ or฀ even฀ death฀ (for฀
reviews฀on฀this฀point,฀see฀Baron,฀2000;฀
Bazerman,฀1998;฀Gilovich,฀1991).฀Rather฀ than฀ shaking฀ our฀ heads฀ or฀ pointing฀
fingers฀at฀someone฀else’s฀bad฀decisions,฀
people฀should฀identify฀tools฀to฀improve฀
the฀ accuracy฀ and฀ quality฀ of฀ decisions฀
(cf.฀Martz฀&฀Shepherd,฀2003).฀In฀other฀
words,฀ what฀ tools฀ will฀ help฀ decision฀
makers฀become฀more฀cognizant฀of฀their฀
decision฀processes฀and฀outcomes?฀With฀
the฀ high฀ frequency฀ and฀ seriousness฀ of฀

bad฀decision฀making,฀the฀creation,฀testing,฀ and฀ teaching฀ of฀ tools฀ to฀ improve฀
thinking฀ (i.e.,฀ increasing฀ sensemaking฀
quality฀ in฀ becoming฀ aware,฀ acquiring฀
knowledge,฀interpreting฀data฀and฀information,฀drawing฀conclusions,฀deciding,฀
and฀ evaluating)฀ are฀ important฀ in฀ the฀
business฀school฀classroom฀(cf.฀Shadish,฀
Cook,฀&฀Levitton,฀1991;฀Weick,฀1995).฀
March฀and฀Olsen฀(1976)฀observed,฀
“Individuals฀ and฀ organizations฀ make฀
sense฀ of฀ their฀ experiences฀ and฀ modify฀ behavior฀ in฀ terms฀ of฀ their฀ interpretations”฀ (p.฀ 56).฀ Weick฀ (1995)฀
referred฀ to฀ this฀ as฀ sensemaking,฀ and฀
he฀ described฀ sensemaking฀ as฀ “how฀
people฀generate฀that฀which฀they฀interpret”฀(p.฀13).฀
September/October฀2007฀

37

Downloaded by [Universitas Maritim Raja Ali Haji] at 23:01 11 January 2016

Parry฀ (2003)฀ suggested฀ that฀ sensemaking฀is฀a฀process฀in฀which฀individuals฀and฀groups฀in฀organizations฀organize฀

their฀ experiences฀ about฀ reality.฀ As฀ an฀
example,฀consider฀the฀question,฀“What’s฀
really฀happening?”฀This฀question฀generally฀contains฀four฀subissues:
1.฀What฀ actions฀ being฀ done฀ now฀ help฀
improve฀the฀organization’s฀performance?
2.฀What฀ actions฀ are฀ wasted฀ motions฀
(i.e.,฀what฀actions฀are฀we฀taking฀that฀do฀
not฀contribute฀but฀do฀waste฀our฀time)?
3.฀What฀ actions฀ harm฀ the฀ organization’s฀ performance฀ (i.e.,฀ what฀ actions฀
are฀ counterproductive฀ in฀ the฀ organization’s฀achievement฀of฀what฀really฀needs฀
to฀be฀accomplished)?
4.฀What฀actions฀are฀we฀not฀doing฀now฀
but฀should฀we฀be฀doing฀to฀improve฀the฀
organization’s฀performance?
However,฀a฀fifth฀subissue฀that฀tends฀
to฀ be฀ overlooked฀ in฀ this฀ process฀ is฀
more฀ important.฀ How฀ does฀ one฀ go฀
about฀the฀process฀of฀finding฀out฀what฀
is฀really฀happening?฀An฀implicit฀mental฀ model฀ that฀ decision฀ makers฀ often฀
use฀is฀one฀in฀which฀the฀person฀believes฀

that฀what฀comes฀to฀mind฀first฀is฀accurate฀(Senge,฀1990).
It฀seems฀that฀the฀process฀of฀interpretation฀
is฀ so฀ reflexive฀ and฀ immediate฀ that฀ we฀
often฀ overlook฀ it.฀ This,฀ combined฀ with฀
the฀ widespread฀ assumption฀ that฀ there฀ is฀
but฀one฀objective฀reality,฀is฀what฀may฀lead฀
people฀ to฀ overlook฀ the฀ possibility฀ that฀
others฀ may฀ be฀ responding฀ to฀ a฀ very฀ different฀ situation.฀ (Gilovich,฀ 1991,฀ p.฀ 117;฀
cf.฀Surowiecki,฀2004)฀

This฀fifth฀subissue฀requires฀individuals฀to฀engage฀in฀metathinking.฀Leff฀and฀
Nevin฀(1990)฀described฀metathinking฀as฀
thinking฀and฀creating฀strategies฀to฀assist฀
one’s฀thinking.฀
In฀ this฀ article,฀ we฀ advocate฀ that฀ faculty,฀students,฀and฀executives฀adopt฀the฀
view฀ that฀ all฀ decision฀ makers฀ need฀ to฀
learn฀ and฀ practice฀ metathinking฀ skills.฀
Although฀ social฀ psychologists฀ spend฀
considerable฀ time฀ and฀ energy฀ studying฀thinking฀processes,฀business฀school฀
academicians฀have฀not฀done฀a฀thorough฀

job฀of฀translating฀the฀research฀into฀classroom฀ experiences฀ that฀ engage฀ students฀
in฀understanding฀the฀link฀between฀metathinking฀and฀business฀success.฀
In฀ the฀ next฀ section,฀ we฀ review฀ several฀key฀studies฀on฀and฀tools฀for฀meta38฀

Journal฀of฀Education฀for฀Business

thinking฀in฀relation฀to฀decision฀quality.฀
Then,฀ we฀ suggest฀ a฀ simple฀ classroom฀
example฀ that฀ engages฀ students฀ in฀ the฀
thinking-about-thinking฀topic.฀We฀provide฀two฀rigorous฀experiential฀exercise฀
examples฀ that฀ are฀ applicable฀ in฀ the฀
business฀school฀classroom.฀In฀the฀next฀
section,฀ we฀ discuss฀ classroom฀ use฀ of฀
the฀ exercises฀ and฀ offer฀ a฀ brief฀ list฀ of฀
recommended฀ readings.฀ We฀ conclude฀
with฀a฀look฀at฀the฀differences฀between฀
scientific฀and฀executive฀thinking.
Improving฀the฀Quality฀of฀
Decisions
Traditionally,฀ educators฀ have฀ not฀

included฀ formal฀ training฀ in฀ metathinking฀ in฀ the฀ core฀ (or฀ even฀ elective)฀ business฀ education฀ curriculum.฀ Few฀ academic฀ programs,฀ including฀ those฀ in฀
executive฀education,฀include฀courses฀in฀
thinking฀ about฀ thinking฀ or฀ in฀ thinking฀
about฀ deciding.฀ Therefore,฀ few฀ business฀students฀participate฀in฀courses฀that฀
focus฀on฀acquiring฀prescriptive฀tools฀for฀
improving฀ the฀ quality฀ of฀ thinking฀ and฀
deciding฀(e.g.,฀Sterman,฀2001).฀
Two฀ reasons฀ may฀ be฀ responsible฀ for฀
this฀lack฀of฀educational฀focus฀and฀training.฀First,฀overconfidence฀bias฀is฀widespread:฀ Most฀ executives฀ tend฀ to฀ rely฀
too฀often฀on฀their฀unconsciously฀driven฀
automatic฀ thoughts฀ (Bargh,฀ Gollwitzer,฀
Lee-Chai,฀ Barndollar,฀ &฀ Troetschel,฀
2001;฀ Wegner,฀ 2002).฀ There฀ is฀ a฀ natural฀ tendency฀ to฀ assume฀ that฀ intuitive฀
beliefs฀are฀accurate฀and฀that฀relying฀on฀
external฀ heuristics฀ (e.g.,฀ written฀ checklists,฀explicit฀protocols)฀is฀unnecessary.฀
People’s฀ initial฀ response฀ is฀ often฀ one฀
of฀disbelief฀and฀resentment,฀even฀when฀
presented฀ with฀ hard฀ evidence฀ that฀ formal฀external฀searching฀of฀relevant฀information฀ sources฀ and฀ the฀ use฀ of฀ explicit฀
decision฀ rules฀ result฀ in฀ more฀ accurate฀
decisions฀ than฀ does฀ intuitive฀ judgment฀

alone.฀Such฀resentment฀is฀attributable฀to฀
an฀implicit฀loss฀of฀authority฀to฀evaluate฀
and฀decide฀(e.g.,฀Gaither,฀2002).฀Second,฀
research฀in฀the฀area,฀as฀a฀scientific฀field฀
of฀ study,฀ is฀ relatively฀ new.฀ Researchers฀ recognized฀ metathinking—unlike฀
related฀ fields฀ of฀ study฀ (e.g.,฀ biology,฀
sociology,฀ psychology)—as฀ a฀ field฀ of฀
formal฀research฀only฀recently฀(e.g.,฀see฀
the฀ landmark฀ works฀ by฀ Baron,฀ 2000;฀
Shadish฀et฀al.,฀1991;฀Weick,฀1995).฀

Tools฀for฀Improving฀Thinking฀
Quality
Regarding฀ the฀ quality฀ of฀ decisions,฀
Gilovich฀(1991)฀stated,
A฀fundamental฀difficulty฀with฀effective฀
policy฀ evaluation฀ is฀ that฀ we฀ rarely฀ get฀
to฀ observe฀ what฀ would฀ have฀ happened฀
if฀ the฀ policy฀ had฀ not฀ been฀ put฀ into฀
effect.฀ Policies฀ are฀ not฀ implemented฀ as฀

controlled฀ experiments,฀ but฀ as฀ concerted฀ actions.฀ Not฀ knowing฀ what฀ would฀
have฀happened฀under฀a฀different฀policy฀
makes฀ it฀ enormously฀ difficult฀ to฀ distinguish฀ positive฀ or฀ negative฀ outcomes฀
from฀good฀or฀bad฀strategies.฀If฀the฀base฀
rate฀ of฀ success฀ is฀ high,฀ even฀ a฀ dubious฀
strategy฀can฀be฀seen฀as฀wise;฀if฀the฀base฀
rate฀is฀low,฀even฀the฀wisest฀strategy฀can฀
seem฀foolish.฀(pp.฀41–42)฀

Several฀useful฀tools฀are฀now฀available฀
for฀improving฀sensemaking฀capabilities฀
(e.g.,฀ Baron,฀ 2000;฀ Gigerenzer,฀ 2000;฀
Green,฀ 2002;฀ Green฀ &฀ Armstrong,฀
2004).฀These฀ tools฀ include฀ (a)฀ estimating฀what฀would฀happen฀if฀a฀policy฀had฀
not฀been฀put฀into฀effect฀(e.g.,฀Campbell,฀
1969)฀ and฀ (b)฀ software฀ programs฀ that฀
help฀ structure฀ problems฀ and฀ test฀ the฀
impact฀of฀alternative฀problem฀structures฀
(e.g.,฀Clemen฀&฀Reilly,฀2001).
Training฀ in฀ metathinking฀ may฀ help฀
overcome฀ fundamental฀ attribution฀ error.฀
Fundamental฀ attribution฀ error฀ is฀ the฀
tendency฀ of฀ a฀ person฀ to฀ blame฀ other฀
people฀or฀environmental฀forces฀for฀a฀bad฀
decision฀rather฀than฀recognizing฀that฀the฀
process฀that฀the฀person฀applied฀to฀reach฀a฀
decision฀ reflects฀ shallow฀ systems฀ thinking฀ (Plous,฀ 1993).฀ “When฀ we฀ attribute฀
behavior฀ to฀ people฀ rather฀ than฀ system฀
structure,฀ the฀ focus฀ of฀ management฀
becomes฀ scapegoating฀ rather฀ than฀ the฀
design฀ of฀ organizations฀ [and฀ problemsolving฀ procedures]฀ in฀ which฀ ordinary฀
people฀can฀achieve฀extraordinary฀results”฀
(Sterman,฀2001,฀p.฀17).
The฀ introduction฀ and฀ application฀ of฀
various฀metathinking฀tools฀into฀the฀traditional฀ school฀ of฀ management฀ classroom฀ may฀ be฀ difficult฀ for฀ educators฀ to฀
implement,฀particularly฀given฀the฀functional฀ nature฀ of฀ most฀ business฀ school฀
curricula.฀ However,฀ there฀ is฀ one฀ metathinking฀process,฀experiential฀exercises,฀
that฀ fits฀ clearly฀ within฀ the฀ school฀ of฀
thought฀ referred฀ to฀ as฀ constructivism฀
(Garman,฀1997;฀Martz,฀Neil,฀&฀Biscaccianti,฀ 2003).฀ Constructivism฀ theories฀
suggest฀that฀active฀participation฀is฀bene-

ficial฀in฀the฀learning฀process.฀In฀an฀experiential฀exercise,฀learners฀can฀construct฀
a฀ world฀ by฀ combining฀ past฀ information฀with฀future-oriented฀dispositions฀to฀
actively฀ engage฀ in฀ the฀ learning฀ process฀
(cf.฀Kolb,฀1984).฀

Downloaded by [Universitas Maritim Raja Ali Haji] at 23:01 11 January 2016

Classroom-Oriented,฀Experiential฀
Exercises฀in฀Metathinking
Thinking฀ about฀ how฀ one฀ thinks฀ is฀
not฀ an฀ easy฀ topic฀ of฀ discussion฀ among฀
students,฀regardless฀of฀whether฀they฀are฀
undergraduates,฀ graduates,฀ or฀ executives.฀By฀nature,฀the฀topic฀of฀“thinking”฀
is฀ vague฀ and฀ hard฀ to฀ grasp.฀ Davenport฀
(2004)฀suggested฀a฀basic,฀yet฀provoking,฀
exercise฀for฀engaging฀people฀in฀thinking฀
about฀how฀they฀think:
2฀+฀2฀=฀_____

How฀do฀you฀arrive฀at฀the฀answer?
A.฀Purely฀from฀memory
B.฀Analysis฀of฀the฀numbers
C.฀Counting
D.฀฀A฀visual฀process
A฀ natural฀ response฀ is,฀ “Well,฀ I฀ just฀
know฀ that!”฀ This฀ drives฀ home฀ the฀ primary฀ question,฀ “How฀ do฀ you฀ know฀
that?”฀Although฀simplistic,฀this฀exercise฀
engages฀participants฀easily฀and฀actively฀
in฀a฀discussion฀about฀how฀business฀people฀ address฀ problems.฀ In฀ this฀ scenario,฀
participants฀ may฀ recall฀ kindergarten฀
classes฀ with฀ four฀ of฀ the฀ same฀ items฀ on฀
the฀ board,฀ envision฀ flash฀ cards,฀ recall฀
counting฀ on฀ fingers,฀ or฀ recall฀ problem฀
recitation.฀ Regardless฀ of฀ the฀ solution฀
method,฀the฀exercise฀forces฀participants฀
to฀ become฀ aware฀ of฀ their฀ individual฀
thinking฀ processes.฀ This฀ awareness฀ is฀
the฀first฀step฀in฀metacognition.฀
This฀ simple฀ exercise฀ and฀ subsequent฀ discussion฀ engage฀ students฀ in฀
the฀ metathinking฀ process.฀This฀ may฀ be฀
the฀ first฀ time฀ they—as฀ business฀ school฀
students—have฀ talked฀ about฀ thinking,฀
although฀some฀of฀their฀syllabi฀(particularly฀ those฀ in฀ case-based฀ courses)฀ may฀
have฀referred฀to฀critical฀thinking฀skills.฀
Yet,฀ becoming฀ aware฀ of฀ one’s฀ individual฀ knowledge,฀ assumptions,฀ skills,฀
and฀ intellectual฀ resources฀ is฀ a฀ critical฀
success฀ factor฀ in฀ business฀ (Davenport,฀
2004).฀
After฀students฀have฀become฀engaged฀
in฀ thinking฀ about฀ thinking,฀ profes฀

sors฀ can฀ implement฀ the฀ following฀ two฀
experiential฀ exercises฀ and฀ the฀ following฀ decision-tree฀ analytical฀ tool฀ in฀ the฀
classroom.฀ They฀ are฀ good฀ exercises฀ in฀
management฀ classrooms฀ and฀ training฀
programs฀ that฀ involve฀ an฀ overt฀ effort฀
to฀ improve฀ metathinking฀ processes.฀
Although฀ in฀ the฀ classroom฀ the฀ discussion฀ and฀ analysis฀ can฀ become฀ confusing,฀the฀decision-tree฀framework฀allows฀
the฀professor฀to฀present฀the฀process฀in฀a฀
straightforward฀ manner.฀ Thus,฀ we฀ recommend฀ that฀ the฀ decision-tree฀ be฀ used฀
as฀ a฀ visual฀ for฀ framing฀ the฀ discussion.฀
However,฀it฀is฀interesting฀to฀allow฀classroom฀participants฀to฀wander฀through฀the฀
process฀ before฀ providing฀ a฀ process฀ for฀
structuring฀their฀thinking.
Example฀1:฀The฀Taxicab฀Accident฀฀
A฀cab฀was฀involved฀in฀a฀hit-and-run฀accident฀ at฀ night.฀ Two฀ cab฀ companies,฀ the฀
Green฀ and฀ the฀ Blue,฀ operate฀ in฀ the฀ city.฀
You฀ are฀ given฀ the฀ following฀ data:฀ (a)฀
85%฀of฀the฀cabs฀in฀the฀city฀are฀Green฀and฀
15%฀ are฀ Blue฀ and฀ (b)฀ a฀ witness฀ identified฀the฀cab฀as฀Blue.฀The฀court฀tested฀the฀
reliability฀ of฀ the฀ witness฀ under฀ the฀ same฀
circumstances฀ that฀ existed฀ on฀ the฀ night฀
of฀ the฀ accident฀ and฀ concluded฀ that฀ the฀
witness฀ correctly฀ identified฀ each฀ one฀ of฀
the฀two฀colors฀80%฀of฀the฀time฀and฀failed฀
20%฀of฀the฀time.
What฀ is฀ the฀ probability฀ that฀ the฀ cab฀
involved฀ in฀ the฀ accident฀ was฀ Blue฀ rather฀
than฀ Green?฀ Please฀ write฀ your฀ answer฀
here:฀฀_____%

Most฀ participants฀ say฀ that฀ the฀ probability฀is฀over฀50%฀that฀the฀cab฀involved฀
in฀ the฀ accident฀ was฀ blue,฀ and฀ many฀
say฀ that฀ it฀ is฀ 80%฀ (Tverksy฀ &฀ Kahneman,฀ 1982).฀The฀ later฀ decision฀ focuses฀
mainly฀ on฀ the฀ conditional฀ probability฀
that฀ the฀ witness฀ accurately฀ predicts฀ a฀
cab’s฀ color,฀ when฀ the฀ color฀ is฀ known,฀
and฀ignores฀the฀base฀rate฀marginal฀probability฀of฀cabs฀being฀blue฀versus฀green.฀
From฀ a฀ Bayesian฀ analysis฀ perspective,฀
the฀ correct฀ answer฀ is฀ 41%.฀ Structuring฀
the฀problem฀in฀a฀decision฀tree฀is฀helpful฀
in฀solving฀the฀problem฀(see฀Figure฀1).
Additional฀defensible฀solutions฀to฀the฀
cab฀ problem฀ are฀ found฀ in฀ the฀ literature฀(e.g.,฀Birnbaum,฀1983;฀Levi,฀1983).฀
For฀ example,฀ according฀ to฀ Gigerenzer฀
(2000),
If฀Neyman-Pearson฀theory฀is฀applied฀to฀the฀
cab฀problem,฀solutions฀range฀between฀0.28฀
and฀0.82,฀depending฀on฀the฀psychological฀

theory฀about฀the฀witness’s฀criterion฀shift—
the฀ shift฀ from฀ witness฀ testimony฀ at฀ the฀
time฀ of฀ the฀ accident฀ to฀ witness฀ testimony฀
at฀the฀time฀of฀the฀court’s฀test.฀(p.฀16)฀฀

Thus,฀educators฀can฀go฀beyond฀Tversky฀ and฀ Kahneman’s฀ (1974)฀ view฀ of฀
one฀ correct฀ answer฀ that฀ Bayes’฀ statistics฀supplied฀and฀go฀beyond฀considering฀
the฀ deviation฀ between฀ the฀ participant’s฀
answer฀ and฀ the฀ so-called฀ normative฀
answer฀ as฀ a฀ bias฀ of฀ reasoning.฀ Gigerenzer฀ (2000,฀ p.฀ 17)฀ quotes฀ Neyman฀
and฀ Pearson฀ (1928)฀ on฀ this฀ point:฀ “In฀
many฀ cases฀ there฀ is฀ probably฀ no฀ single฀ best฀ solution”฀ (p.฀ 176).฀ Because฀
of฀ the฀ nuances฀ (contingencies)฀ in฀ how฀
the฀ problem฀ is฀ framed,฀ it฀ is฀ important฀
for฀ professors฀ to฀ advocate฀ a฀ particular฀
theoretical฀ model฀ to฀ follow฀ in฀ deciding฀ on฀ a฀ final฀ answer฀ to฀ the฀ problem฀
(cf.฀Koehler,฀1993;฀Woodside฀&฀Singer,฀
1994)฀ rather฀ than฀ advocating฀ exactly฀
one฀ correct฀ solution.฀ It฀ is฀ unfortunate฀
that,฀ except฀ in฀ a฀ statistics฀ classroom,฀
extending฀ the฀ discussion฀ beyond฀ that฀
offered฀by฀Tversky฀and฀Kahneman฀may฀
confuse฀ students,฀ causing฀ them฀ to฀ lose฀
sight฀ of฀ the฀ primary฀ motivation฀ for฀ the฀
exercise:฀ to฀ think฀ about฀ their฀ thinking.฀
In฀ many฀ classrooms,฀ keeping฀ the฀ decision฀ tree฀ and฀ subsequent฀ discussion฀ as฀
a฀ Bayesian฀ analysis฀ may฀ be฀ the฀ best฀
approach฀for฀teaching฀and฀learning.
Example฀2:฀Pricing฀a฀New฀Product฀
(Adapted฀From฀Woodside,฀1999)฀
Using฀Bayesian฀analysis฀and฀the฀decision฀tree฀as฀an฀analytical฀tool,฀the฀taxicab฀example฀further฀engages฀students฀in฀
the฀metathinking฀process.฀The฀simplicity฀of฀the฀example฀eases฀students฀into฀the฀
analytical฀process฀while฀providing฀them฀
with฀a฀tool฀for฀thinking฀about฀thinking.฀
However,฀ many฀ business฀ school฀ situations฀ are฀ not฀ as฀ straightforward฀ as฀ the฀
taxicab฀ example.฀ There฀ are฀ generally฀
various฀ viewpoints฀ and฀ functional฀ perspectives฀ in฀ business฀ decision฀ making,฀
and฀all฀opinions฀must฀be฀included฀in฀the฀
decision-making฀process.฀The฀following฀
example,฀the฀pricing฀of฀a฀new฀product,฀
presents฀ a฀ common฀ business฀ scenario฀
and฀ allows฀ students฀ to฀ dig฀ deeper฀ into฀
the฀ use฀ of฀ a฀ metathinking฀ tool฀ in฀ the฀
decision฀process:
Plaswire฀is฀a฀new฀fencing฀wire฀made฀from฀
polyethylene฀ terephthalate.฀ Plaswire฀ is฀

September/October฀2007฀

39

Base฀rate:
Marginal
Probabilities

Joint฀
Probabilities

Conditional
Probabilities

.80

Green

.68

Blue

.17

Green

.20

Downloaded by [Universitas Maritim Raja Ali Haji] at 23:01 11 January 2016

.85

Decision:
Color฀of฀cab

.20

.15

Green

.03

Blue

Blue

.12

.80

FIGURE฀1.฀Decision฀tree฀for฀taxicab฀color฀problem.฀The฀participant฀will฀say฀“blue”฀29%฀of฀the฀time฀(.17฀+฀.12฀=฀.29);฀the฀
participant฀will฀be฀accurate฀41%฀of฀the฀time฀when฀saying฀“blue”฀(.12/.29฀=฀.41).฀Thus,฀when฀the฀participant฀says฀“blue,”฀
the฀chances฀are฀still฀greater฀than฀50:50฀that฀the฀cab฀was฀green.
designed฀as฀a฀replacement฀for฀galvanized฀
steel฀ wire฀ in฀ permanent฀ fencing฀ construction.฀The฀president฀of฀Kiwi฀Fencing฀
requests฀ that฀ the฀ assistant฀ sales฀ manager฀
implement฀a฀pricing฀strategy฀for฀Plaswire฀
that฀will฀help฀it฀achieve฀national฀distribution.฀ The฀ president฀ believes฀ that฀ pricing฀
Plaswire฀ substantially฀ lower฀ (30%฀ less)฀
than฀ the฀ competing฀ steel฀ wire฀ price฀ will฀
help฀ gain฀ distributor฀ acceptance฀ of฀ the฀
product,฀ as฀ some฀ farmers฀ and฀ livestock฀
station฀ managers฀ may฀ be฀ price฀ sensitive.฀
The฀president฀feels฀certain฀that฀steel฀wire฀
competitors฀will฀not฀respond฀by฀lowering฀
prices฀ in฀ response฀ to฀ a฀ low฀ introductory฀
price฀because฀the฀cost฀of฀galvanized฀steel฀
raw฀ material฀ is฀ 300%฀ ฀ higher฀ than฀ the฀
plastic฀ raw฀ materials฀ used฀ for฀ manufacturing฀Plaswire.฀
After฀ reviewing฀ industrial฀ distributor฀
price฀ lists฀ for฀ agricultural฀ products,฀ the฀
assistant฀ sales฀ manager฀ knows฀ that฀ competitors฀ tend฀ to฀ respond฀ to฀ such฀ a฀ competitive฀ threat฀ with฀ price฀ reductions฀ that฀
match฀or฀exceed฀the฀new฀product’s฀price.฀
When฀ manufacturers฀ introduced฀ new฀
products฀at฀retail฀prices฀well฀below฀competing฀ products,฀ competitors฀ responded฀
with฀similar฀price฀reductions฀three฀out฀of฀

40฀

Journal฀of฀Education฀for฀Business

four฀times.฀The฀final฀result฀was฀failure฀or฀
very฀low฀market฀share฀for฀new฀products฀in฀
92฀of฀the฀96฀cases฀that฀the฀assistant฀sales฀
manager฀had฀reviewed.฀
However,฀ the฀ assistant฀ sales฀ manager฀
also฀knew฀that฀the฀president฀often฀predicted฀
competitive฀reaction฀correctly.฀The฀president฀
had฀been฀correct฀in฀his฀predictions฀in฀two฀of฀
the฀three฀recent฀cases฀concerning฀competitors’฀ responses฀ to฀ new฀ product฀ prices.฀The฀
assistant฀sales฀manager฀favors฀pricing฀Plaswire฀to฀match฀the฀current฀price฀of฀competing฀
steel฀ wire฀ products.฀ This฀ pricing฀ decision฀
would฀result฀in฀a฀quick฀payback฀period฀and฀
substantial฀ profit,฀ with฀ the฀ competitor฀ less฀
likely฀to฀react฀with฀a฀parity฀pricing฀strategy.
The฀ marketing฀ manager฀ recommends฀
pricing฀ Plaswire฀ 10%฀ above฀ the฀ current฀
price฀ of฀ steel฀ wire.฀ She฀ feels฀ that฀ few฀
agricultural฀ customers฀ will฀ buy฀ the฀ new฀
permanent฀ boundary฀ wire฀ because฀ of฀ its฀
low฀ price฀ and฀ that฀ the฀ competitor฀ will฀
lower฀its฀price฀to฀match฀or฀beat฀Plaswire’s฀
price.฀The฀marketing฀manager฀notes฀that,฀
in฀ most฀ cases฀ of฀ new-product฀ introductions฀with฀prices฀higher฀than฀competitors’฀
prices฀ on฀ existing฀ products,฀ only฀ one฀ in฀
10฀ competitors฀ reacted฀ by฀ lowering฀ the฀
price฀on฀an฀existing฀product.฀In฀addition,฀

the฀new฀products฀were฀still฀available฀even฀
when฀ introduced฀ at฀ prices฀ higher฀ than฀
competitors’฀prices.
What฀ decision฀ do฀ you฀ recommend?฀
What฀is฀the฀likelihood฀of฀success฀of฀your฀
strategy฀(i.e.,฀the฀new฀product฀is฀still฀being฀
marketed฀ 5฀ years฀ after฀ market฀ introduction,฀and฀it฀is฀profitable)?฀Please฀provide฀
your฀answers฀here.฀
Your฀recommendation,฀circle฀one:
(a)฀ Price฀ Plaswire฀ 30%฀ below฀ that฀ of฀
steel฀wire.
(b)฀ Price฀ Plaswire฀ equal฀ to฀ the฀ current฀
price฀of฀steel฀wire.
(c)฀Price฀Plaswire฀10%฀above฀steel฀wire.
The฀likelihood฀of฀success฀of฀your฀strategy฀
is฀(circle฀one):
(a)฀15%฀฀
(b)฀25%
(c)฀45%
(d)฀75%
(e)฀100%

Solving฀ the฀ Plaswire฀ pricing฀ problem฀ requires฀ probabilities฀ for฀ alternatives฀ that฀ are฀ not฀ in฀ the฀ problem฀
description.฀Using฀all฀reasonable฀esti-

Downloaded by [Universitas Maritim Raja Ali Haji] at 23:01 11 January 2016

mates฀leads฀to฀the฀same฀recommendation:฀ A฀ price฀ that฀ is฀ higher฀ than฀ that฀
of฀ steel฀ wire฀ results฀ in฀ the฀ highest฀
likelihood฀ of฀ success.฀ Figure฀ 2฀ and฀
Figure฀ 3฀ include฀ the฀ probabilities฀ in฀
the฀ problem฀ description฀ and฀ one฀ set฀
of฀ reasonable฀ probabilities฀ for฀ the฀
other฀ alternatives.฀ Most฀ students฀ and฀
executives฀advocate฀adopting฀the฀president’s฀recommendation฀to฀price฀lower฀
than฀ the฀ competing฀ steel฀ wire.฀ They฀
do฀ so฀ without฀ considering฀ the฀ base฀
rate฀ probability฀ (0.75)฀ that฀ competitors฀usually฀react฀when฀a฀new฀product฀
is฀introduced฀at฀a฀price฀lower฀than฀that฀
of฀their฀product.฀
As฀ with฀ the฀ taxicab฀ example,฀ we฀
recommend฀ that฀ the฀ professor฀ use฀ the฀
decision฀trees฀as฀visuals฀in฀helping฀students฀organize฀their฀thinking.฀In฀reality,฀
the฀ probability฀ estimation฀ process฀ is฀
not฀complicated,฀although฀it฀appears฀to฀
be฀ so฀ when฀ thinking฀ is฀ not฀ organized.฀
Learning฀to฀organize฀one’s฀thoughts฀is฀
critical฀ to฀ the฀ success฀ of฀ teaching฀ and฀
learning฀metathinking.

Classroom฀Use
Professors฀have฀used฀these฀exercises฀
successfully฀ in฀ various฀ business฀ classrooms฀ and฀ seminars฀ at฀ several฀ universities฀ around฀ the฀ world.฀ Starting฀ the฀
discussion฀ with฀ the฀ simple฀ arithmetic฀
problem฀ engages฀ participants฀ in฀ the฀
topic฀ of฀ metathinking.฀ Following฀ the฀
arithmetic฀ problem฀ with฀ the฀ taxicab฀
example฀ helps฀ participants฀ progress฀
into฀ the฀ probabilistic฀ components฀ of฀
decision฀making.฀The฀more฀complicated฀ Plaswire฀ example฀ focuses฀ attention฀
on฀ the฀ use฀ of฀ probabilities฀ in฀ decision฀
making฀and฀provides฀participants฀with฀
much฀more฀information฀with฀which฀to฀
make฀a฀decision.฀
People’s฀ minds฀ tend฀ to฀ limit฀ cognitive฀ effort฀ (Payne,฀ Bettman,฀ &฀
Johnson,฀ 1993)฀ and฀ prefer฀ to฀ apply฀
intuitive฀ problem-solving฀ routines฀
even฀when฀given฀strong฀evidence฀that฀
these฀ routines฀ are฀ not฀ very฀ accurate.฀
For฀ example,฀ in฀ an฀ executive฀ MBA฀
program฀at฀Tulane฀University฀(WoodBase฀
rates

.10
Steel฀wire
responds

.10

.99

Kiwi฀high฀price
p฀=฀1.10

.65
.90

.50
Decision

Steel฀wire
does฀not฀respond

.75

Steel฀wire
responds

Kiwi฀low฀price
p฀=฀.70
.25

Steel฀wire
does฀not฀respond

.001

Failure฀=฀.00

.000

Success฀=฀1.00

.585

Failure฀=฀.00

Payoff฀from
expected
likelihood
of฀success

.000฀฀฀฀฀Total฀=฀.586
.015

Failure฀=฀.00

.000

.70

Success฀=฀1.00

.350

.30

Failure฀=฀.00

.97

Steel฀wire
does฀not฀respond

Success฀=฀1.00

.03 Success฀=฀1.00
Steel฀wire
responds

Kiwi฀parity฀price
p฀=฀1.00
.50

.35

side,฀ 1997),฀ the฀ instructors฀ tested฀ the฀
Plaswire฀ pricing฀ case฀ experimentally฀
among฀24฀two-person฀groups฀of฀executives.฀The฀professors฀instructed฀12฀of฀
the฀groups฀in฀the฀use฀of฀decision฀trees฀
for฀ framing฀ problems฀ and฀ computing฀
expected฀ values฀ of฀ alternative฀ solutions.฀The฀other฀12฀groups฀received฀no฀
such฀ instruction.฀ Of฀ the฀ 12฀ untrained฀
groups,฀8฀recommended฀the฀low-price฀
solution,฀ and฀ none฀ recommended฀ the฀
high-price฀solution.฀Of฀the฀12฀trained฀
groups,฀ 7฀ decided฀ on฀ the฀ high-price฀
solution,฀and฀only฀2฀selected฀the฀lowprice฀solution.฀
Although฀the฀prescriptive฀solution฀to฀
each฀of฀the฀examples฀is฀informative฀and฀
a฀ necessary฀ component฀ of฀ the฀ classroom฀ experience,฀ the฀ major฀ objective฀
of฀ the฀ exercises฀ is฀ to฀ engage฀ students฀
in฀the฀art฀and฀science฀of฀understanding฀
one’s฀ metacognitive฀ abilities.฀ Accordingly,฀the฀professor฀should฀debrief฀participants฀after฀the฀use฀of฀each฀example.฀
The฀ following฀ questions฀ would฀ facilitate฀the฀debriefing:

.000฀฀฀฀฀Total฀=฀.365

.04

Success฀=฀1.00

.030

.96

Failure฀=฀.00

.000

.75

Success฀=฀1.00

.25

Failure฀=฀.00

.1875
.000฀฀฀฀฀Total฀=฀.2175

FIGURE฀2.฀Decision฀tree฀of฀Kiwi฀Fencing฀price฀alternatives.฀For฀payoff,฀survival฀after฀a฀few฀years฀is฀judged฀a฀success฀
and฀assigned฀a฀value฀of฀1;฀death฀is฀judged฀as฀failure฀and฀assigned฀a฀value฀of฀0.



September/October฀2007฀

41

CEO฀“certainty”฀
transformed฀into
.99฀probability฀that
competitor฀will฀not
respond

CEO฀accurate?

Prior฀probability

Yes
.66
Predicts฀competitor
responds

.75

Yes

1.฀=฀.0050

.25

No

2.฀=฀.0016

Yes
.34

No

.01
CEO
predicts?

Yes

.99

Downloaded by [Universitas Maritim Raja Ali Haji] at 23:01 11 January 2016

Revised฀probability

.66
Predicts฀competitor
does฀not฀respond
.34

No

.75

3.฀=฀.0026

.25

No

4.฀=฀.0008

.75

Yes

5.฀=฀.4752

.25

No

6.฀=฀.1584

.75

Yes

.25

No

7.฀=฀.2524
8.฀=฀.0841

FIGURE฀3.฀CEO฀predictions,฀accuracy,฀and฀outcomes.฀Posterior฀probability฀competitor฀responds฀=฀.0050฀+฀.0026฀+฀.4752฀
+฀ .2524฀ =฀ .74.฀ ฀ Posterior฀ probability฀ competitor฀ does฀ not฀ respond฀ =฀ .0016฀ +฀ .0008฀ +฀ .1584฀ +฀ .0841฀ =฀ .26.฀ Conclusion:฀
Because฀the฀CEO฀is฀not฀highly฀accurate฀and฀the฀prior฀probability฀is฀very฀high฀that฀the฀competitor฀will฀respond฀(.75),฀the฀
posterior฀likelihood฀of฀the฀competitor฀responding฀is฀close฀to฀the฀same฀as฀the฀prior฀probability.

1.฀What฀ were฀ your฀ thoughts฀ when฀
reading฀the฀example?
2.฀How฀did฀you฀organize฀and฀use฀the฀
information฀provided฀in฀the฀example?
3.฀What฀ (if฀ any)฀ personal฀ knowledge฀
did฀you฀use฀in฀arriving฀at฀an฀answer?
Once฀ participants฀ dissect฀ their฀ own฀
thought฀ processes,฀ they฀ grow฀ more฀
aware฀of฀their฀own฀knowledge,฀assumptions,฀ skills,฀ and฀ intellectual฀ resources฀
and฀ become฀ cognizant฀ of฀ the฀ way฀ they฀
use฀ these฀ resources฀ in฀ decision฀ making฀ about฀ marketing.฀ Through฀ close฀
attention฀ to฀ one’s฀ thought฀ processes,฀
participants฀take฀the฀first฀step฀in฀acquiring,฀ learning,฀ and฀ practicing฀ skills฀ in฀
metathinking.
The฀ literature฀ on฀ metathinking฀ is฀
robust฀ and฀ useful฀ in฀ providing฀ tools฀
that฀ help฀ reduce฀ problem฀ ambiguity฀
and฀evaluate฀actions฀and฀outcomes.฀We฀
recommend฀ the฀ following฀ reference฀
and฀ reading฀ materials:฀ Baron฀ (2000),฀
Gigerenzer฀and฀Selten฀(2002),฀Gilovich฀
(1991),฀ Weick฀ (1995),฀ Weick฀ and฀ Sutcliffe฀(2001),฀and฀Woodside฀(2003).
42฀

Journal฀of฀Education฀for฀Business

Summary
Executive฀ thinking฀ differs฀ from฀ scientific฀ thinking฀ in฀ at฀ least฀ three฀ fundamental฀ ways฀ (cf.฀ Kozak,฀ 1996).฀ First,฀
scientists฀ (e.g.,฀ academic฀ researchers)฀
get฀ to฀ choose฀ their฀ problem.฀ In฀ organizations,฀ circumstances฀ often฀ thrust฀ the฀
problems฀ (and฀ symptoms฀ of฀ problems)฀
on฀ the฀ executive฀ (e.g.,฀ see฀ Mintzberg,฀
1978).฀ Second,฀ scientists฀ focus฀ on฀ a฀
limited฀ number฀ of฀ problems฀ at฀ a฀ time.฀
However,฀ a฀ vast฀ number฀ of฀ potential฀
problems฀and฀a฀myriad฀of฀possible฀presentation฀ problem฀ frames฀ (see฀ Wilson,฀
McMurrian,฀ &฀ Woodside,฀ 2001)฀ confront฀ executives.฀ Third,฀ scientists฀ have฀
the฀relative฀luxury฀of฀time฀to฀explore฀the฀
problem฀at฀hand.฀Executives,฀especially฀
CEOs,฀do฀not.฀
Unfortunately,฀ a฀ person’s฀ natural฀
tendency฀in฀decision฀making฀includes฀
(a)฀ drawing฀ conclusions฀ on฀ the฀ basis฀
of฀very฀limited฀information,฀(b)฀being฀
overconfident฀ in฀ the฀ possibility฀ that฀
one’s฀initial฀conclusions฀are฀accurate,฀
(c)฀not฀looking฀for฀disconfirming฀evi-

dence,฀ (d)฀ discounting฀ disconfirming฀
evidence฀ if฀ it฀ does฀ appear,฀ (e)฀ being฀
hostile฀ to฀ the฀ belief฀ that฀ using฀ decision฀ tools฀ such฀ as฀ computer฀ software฀
programs฀ (see฀ Gaither,฀ 2002)฀ results฀
in฀ more฀ accurate฀ problem฀ framing฀
than฀ does฀ trusting฀ one’s฀ own฀ judgment,฀ (f)฀ not฀ thinking฀ outside฀ the฀
box฀ and฀ considering฀ all฀ theoretically฀
possible—even฀ if฀ seemingly฀ implausible—combinations฀ of฀ events฀ and฀
their฀ outcomes,฀ and฀ (g)฀ implementing฀ a฀ decision฀ on฀ the฀ basis฀ of฀ limited฀
consultation฀ with฀ knowledgeable฀ colleagues฀or฀experts.
Research฀ findings฀ support฀ the฀ conclusion฀ that฀ a฀ person’s฀ designing฀ and฀
applying฀ decision฀ tools฀ and฀ simple฀
heuristics฀ lead฀ to฀ more฀ accurate฀ decisions฀ than฀ does฀ decision฀ making฀ by฀
intuitive฀thinking฀alone฀(Gaither,฀2002;฀
Gigerenzer฀&฀Selten,฀2002;฀Gigerenzer,฀
Todd,฀&฀ABC฀Research฀Group,฀1999).฀
Using฀ experiential฀ exercises฀ such฀ as฀
those฀described฀in฀this฀article฀can฀help฀
people฀ build฀ skills฀ that฀ improve฀ their฀
decision฀making.฀

NOTES
Dr.฀ Victoria฀ Crittenden’s฀ research฀ interests฀
are฀formulation฀and฀implementation฀of฀marketing฀
strategies,฀especially฀as฀related฀to฀cross-functional฀
decision฀ making.฀ She฀ is฀ widely฀ recognized฀ as฀ a฀
case฀researcher,฀case฀writer,฀and฀case฀teacher.฀
Dr.฀ Arch฀ G.฀ Woodside’s฀ research฀ interests฀ are฀
decision฀making,฀marketing฀strategies,฀and฀tourism.
Correspondence฀ concerning฀ this฀ article฀ should฀
be฀addressed฀to฀Dr.฀Victoria฀Crittenden,฀Chairperson฀of฀MBA฀Core฀Faculty,฀Boston฀College,฀Fulton฀
450,฀ 140฀ Commonwealth฀Avenue,฀ Chestnut฀ Hill,฀
MA฀02467.
E–mail:฀crittend@bc.edu

Downloaded by [Universitas Maritim Raja Ali Haji] at 23:01 11 January 2016

REFERENCES
Bargh,฀ J.฀ A.,฀ Gollwitzer,฀ P.฀ M.,฀ Lee-Chai,฀ A.,฀
Barndollar,฀ K.,฀ &฀ Troetschel,฀ R.฀ (2001).฀ The฀
automated฀ will:฀ Nonconscious฀ activation฀ and฀
pursuit฀of฀behavioral฀goals,฀Journal฀of฀Personality฀and฀Social฀Psychology,฀71,฀230–244.
Baron,฀ J.฀ (2000).฀ Thinking฀ and฀ deciding฀ (3rd฀
ed.).฀ Cambridge,฀ England:฀ Cambridge฀ University฀Press.
Bazerman,฀ M.฀ H.฀ (1998).฀ Judgment฀ in฀ managerial฀ decision฀ making฀ (4th฀ ed.).฀ New฀ York:฀
Doubleday.
Birnbaum,฀ M.฀ H.฀ (1983).฀ Base฀ rates฀ in฀ Bayesian฀
inference:฀Signal฀detection฀analysis฀of฀cab฀problem.฀American฀Journal฀of฀Psychology,฀96,฀85–94.
Campbell,฀D.฀T.฀(1969).฀Reforms฀as฀experiments.฀
American฀Psychologist,฀24,฀409–429.
Charan,฀ R.,฀ Useem,฀ J.,฀ &฀ Harrington,฀ A.฀ (2002,฀
May฀ 27).฀ Why฀ companies฀ fail.฀ Fortune,฀ 145,฀
50–64.
Clemen,฀R.฀T.,฀&฀Reilly,฀T.฀(2001).฀Making฀hard฀
decisions฀ with฀ decision฀ tools.฀ Pacific฀ Grove,฀
CA:฀Duxbury.
Davenport,฀ D.฀ B.฀ (2004).฀ Mega฀ success฀ requires฀
meta฀ thinking.฀ Retrieved฀August฀ 12,฀ 2007,฀ from฀
http://www.davenportfolio.com/ar-mega_success.
php
Gaither,฀C.฀(2002).฀What฀your฀doctor฀doesn’t฀know฀
could฀ kill฀ you.฀ [Electronic฀ version].฀ Boston฀
Globe.฀Retrieved฀August฀12,฀2007,฀from฀http://
www.boston.com/news/globe/reprints/071402_
whenyourdoc/
Garman,฀ N.฀ B.฀ (1997).฀ Introduction฀ to฀ active฀
learning.฀A฀2-day฀workshop฀conducted฀at฀University฀of฀Pittsburgh,฀Pittsburgh,฀PA.฀



Gigerenzer,฀ G.฀ (2000).฀ Adaptive฀ thinking.฀ New฀
York:฀Oxford฀University฀Press.
Gigerenzer,฀ G.,฀ &฀ Selten,฀ R.฀ (2002).฀ Bounded฀
rationality:฀ The฀ adaptive฀ toolbox.฀ Cambridge,฀
MA:฀MIT฀Press.
Gigerenzer,฀ G.,฀ Todd,฀ P.฀ M.,฀ &฀ ABC฀ Research฀
Group.฀ (1999).฀ Simple฀ heuristics฀ that฀ make฀
us฀ smart.฀ Oxford,฀ England:฀ Oxford฀ University฀
Press.
Gilovich,฀T.฀(1991).฀How฀we฀know฀what฀isn’t฀so.฀
New฀York:฀Free฀Press.
Green,฀ K.฀ (2002).฀ Forecasting฀ decisions฀ in฀ conflict฀ situations:฀A฀ comparison฀ of฀ game฀ theory,฀
role-playing,฀ and฀ unaided฀ judgment.฀ International฀Journal฀of฀Forecasting,฀18,฀321–344.
Green,฀ K.฀ C.,฀ &฀Armstrong,฀ J.฀ S.฀ (2004).฀ Structured฀ analogies฀ for฀ forecasting.฀ (Working฀
Paper).฀Wellington,฀New฀Zealand:฀Victoria฀University฀of฀Wellington.฀
Koehler,฀J.฀J.฀(1993).฀The฀base฀rate฀fallacy฀myth.฀
Psycoloquy,฀4,฀10.
Kolb,฀ D.฀ (1984).฀ Experiential฀ learning:฀ Experience฀ as฀ the฀ source฀ of฀ learning฀ and฀ development.฀Englewood฀Cliffs,฀NJ:฀Prentice฀Hall.
Kozak,฀A.฀(1996).฀Local฀clinicians฀need฀knowledge฀
tools.฀American฀Psychologist,฀51,฀1335–1336.
Leff,฀H.฀L.,฀&฀Nevin,฀A.฀(1990).฀Dissolving฀barriers฀ to฀ teaching฀ creative฀ thinking฀ (and฀ metathinking).฀Teacher฀Education฀and฀Special฀Education,฀13,฀36–39.
Levi,฀I.฀(1983).฀Who฀commits฀the฀base฀rate฀fallacy?฀
Behavioral฀and฀Brain฀Sciences,฀6,฀502–506.
March,฀ J.,฀ &฀ Olsen,฀ J.฀ (1976).฀ Ambiguity฀ and฀
choice฀in฀organizations.฀Oslo,฀Norway:฀Scandinavian฀University฀Press.
Martz,฀B.,฀Neil,฀T.฀C.,฀&฀Biscaccianti,฀A.฀(2003).฀
TradeSmith:฀ An฀ exercise฀ to฀ demonstrate฀ the฀
illusion฀ of฀ control฀ in฀ decision฀ making.฀ Decision฀Sciences฀Journal฀of฀Innovative฀Education,฀
1,฀273–288.
Martz,฀B.,฀&฀Shepherd,฀M.฀M.฀(2003).฀Testing฀for฀
the฀transfer฀of฀tacit฀knowledge:฀Making฀a฀case฀
for฀implicit฀learning.฀Decision฀Sciences฀Journal฀
of฀Innovative฀Education,฀1,฀41–56.
Mintzberg,฀H.฀(1978).฀Patterns฀in฀strategy฀formation.฀Management฀Science,฀24,฀934–948.
Neyman,฀ J.,฀ &฀ Pearson,฀ E.฀ S.฀ (1928).฀ On฀ the฀
use฀ and฀ interpretation฀ of฀ certain฀ test฀ criteria฀
for฀ purposes฀ of฀ statistical฀ inference:฀ Part฀ 1.฀
Biometrika,฀20A,฀175–240.฀
Parry,฀J.฀(2003).฀Making฀sense฀of฀executive฀sensemaking:฀ A฀ phenomenological฀ case฀ study฀

with฀ methodological฀ criticism.฀ Journal฀ of฀
Health฀ Organisation฀ and฀ Management,฀ 17,฀
240–263.
Payne,฀ J.฀ W.,฀ Bettman,฀ J.฀ R.,฀ &฀ Johnson,฀ E.฀ J.฀
(1993).฀ The฀ adaptive฀ decision฀ maker.฀ Cambridge,฀England:฀Cambridge฀University฀Press.
Plous,฀S.฀(1993).฀The฀psychology฀of฀judgment฀and฀
decision-making.฀New฀York:฀McGraw-Hill.
Senge,฀ P.฀ (1990).฀ The฀ fifth฀ discipline.฀ New฀York:฀
Doubleday.
Shadish,฀W.฀ R.,฀ Jr.,฀ ฀ Cook,฀T.฀ D.,฀ &฀ Levitton,฀ L.฀
C.฀(1991).฀Foundations฀of฀program฀evaluation.฀
Thousand฀Oaks,฀CA:฀Sage.
Sterman,฀J.฀D.฀(2001).฀Systems฀dynamics฀modeling:฀ Tools฀ for฀ learning฀ in฀ a฀ complex฀ world.฀
California฀Management฀Review,฀43,฀8–25.
Surowiecki,฀ J.฀ (2004).฀ The฀ wisdom฀ of฀ crowds.฀
New฀York:฀Doubleday.
Tversky,฀A.,฀ &฀ Kahneman,฀ D.฀ (1974,฀ September฀
27).฀ Judgment฀ under฀ uncertainty:฀ Heuristics฀
and฀biases.฀Science,฀185,฀1124–1131.฀
Tversky,฀ A.,฀ &฀ Kahneman,฀ D.฀ (1982).฀ Evidential฀ impact฀ of฀ base฀ rates.฀ In฀ D.฀ Kahneman,฀ P.฀
Slovic,฀ &฀ A.฀ Tversky฀ (Eds.),฀ Judgment฀ under฀
uncertainty:฀ Heuristics฀ and฀ biases฀ (pp.฀ 153–
160).฀Cambridge,฀England:฀Cambridge฀University฀Press.
Wegner,฀ D.฀ M.฀ (2002).฀ The฀ illusion฀ of฀ conscious฀
will.฀Cambridge,฀MA:฀MIT฀Press.
Weick,฀ K.฀ E.฀ (1995).฀ Sensemaking฀ in฀ organizations.฀Thousand฀Oaks,฀CA:฀Sage.
Weick,฀K.฀E.,฀&฀Sutcliffe,฀K.฀M.฀(2001).฀Managing฀the฀unexpected.฀New฀York:฀Jossey-Bass.
Wilson,฀E.฀J.,฀McMurrian,฀R.฀C.,฀&฀Woodside,฀A.฀
G.฀(2001).฀How฀buyers฀frame฀problems:฀Revisited.฀Psychology฀and฀Marketing,฀18,฀617–655.
Woodside,฀ A.฀ G.฀ (1997).฀ Applying฀ alternative฀
rational฀theories฀to฀the฀cab฀problem.฀(Working฀
paper).฀ New฀ Orleans,฀ LA:฀ Freeman฀ School฀ of฀
Business,฀Tulane฀University.฀
Woodside,฀ A.฀ G.฀ (1999).฀ Evaluating฀ alternative฀
pricing฀ strategies฀ for฀ market฀ introduction฀ of฀
new฀ industrial฀ technologies฀ [Monograph].฀
Advances฀in฀Business฀Marketing฀and฀Purchasing,฀8,฀181–186.฀
Woodside,฀A.฀ G.฀ (Ed.).฀ (2003).฀ Evaluating฀ marketing฀ actions฀ and฀ outcomes:฀ Advances฀ in฀
business฀ marketing฀ &฀ purchasing฀ (Vol.฀ 12).฀
Amsterdam:฀JAI฀Press.
Woodside,฀A.฀ G.,฀ &฀ Singer,฀A.฀ E.฀ (1994).฀ Social฀
interaction฀effects฀in฀the฀framing฀of฀buying฀decisions.฀Psychology฀&฀Marketing,฀11,฀27–34.

September/October฀2007฀

43

����฀���฀������

Downloaded by [Universitas Maritim Raja Ali Haji] at 23:01 11 January 2016

In Arts Education Policy Review (AEPR), teachers, teacher educators, administrators, policymakers,
researchers, and others involved in arts education discuss difficult, often controversial policy issues
regarding K–12 education in the arts throughout the nation and the rest of the world. Focusing on
education in music, visual arts, theater, dance, and creative writing, the journal encourages varied
views and emphasizes analytical exploration. AEPR’s purpose is to present and explore many points
of view; it contains articles for and against different ideas, policies, and proposals for arts education.
Its overall purpose is to help readers think for themselves, rather than to tell them how they should
think.
Contributors should make sure that any submission is a policy article, complete with policy
recommendations about arts education from prekindergarten through twelfth grade. Articles about
college education should focus on teacher preparation for these grades or teacher retention in arts
education. AEPR intends to bring fresh analytical vigor to perennial and new policy issues in arts
education. AEPR presents analyses and recommendations focused on policy. The goal of any article
should not be description or celebration (although reports of successful programs could be part of
a policy article).
Any article focused on a program (or programs) should address why something works or does not
work, how it works, how it could work better, and most important, what various policymakers (from
teachers to legislators) can do about it. Many articles are rejected because they lack this element.
These orientations can be applied to many issues—from the structure and results of psychometric
research to the values climate that would support the arts as an educational basic. They can deal
with the relationships of teacher preparation to cultural development, the problems of curriculum
building, the particular challenges of teaching specific art forms, and the impact of political,
economic, cultural, artistic, and other climates on decision making for arts instruction.
AEPR does not promote individuals, institutions, methods, or products. It does not aim to repeat
commonplace ideas. Editors want articles that show originality, probe deeply, and take discussion
beyond common wisdom and familiar rhetoric. Articles that merely restate the importance of arts
education, call attention to the existence of issues long since addressed, or repeat standard
solutions cannot be considered.
Authors must prepare their manuscripts according to the The Chicago Manual of Style, 15th edition,
for all matters of style. All manuscripts require an abstract, preferably no longer than 120 words,
and 3–5 keywords to be used for indexing purposes. Keywords should capture the precise content of
the manuscript and should be found in the abstract. Authors