H1S5 AUN-QA asesmen Outcome - SH, SB
AUN-QA in a nut shell
Satria Bijaksana & Suprijadi Harijono
AUN QA Assessors
Institut Teknologi Bandung
(2)
What’s in Your Training Package
• Participant
’
s handout
• Guide to AUN-QA Assessment at Programme
Level, Version 3
• Guidelines for AUN Quality Assessment and
Assessors, Version 2
• Appendices (resources, samples and templates)
• Soft copy of the appendices
(3)
Workshop Outline
Day 1
Topic
1.00pm – 2.30pm
• Introduction to AUN-QA Framework
• PDCA Approach to Self-assessment at programme
level
2.30pm – 3.30pm
• AUN-QA Criteria at Programme Level (Criterion
1-3)
3.30pm - 5.00pm
• Exercise on Expected Learning Outcomes and
Curriculum Mapping
Day 2
Topic
1.00 pm - 2.30pm
• AUN-QA Criteria at Programme Level (Criterion
4-11)
2.30pm – 3.30pm
• AUN-QA Assessment Processes
3.30pm – 4.15pm
• Discussion
(4)
Introduction
• Quality Assurance in Higher Education
• Overview of AUN-QA Framework
(5)
What is Quality?
QA in Higher Education
Quality
University
Students/
Graduates
Govt.
Bodies
Employers
Faculty
Members
(6)
Quality in Higher Education
Excellence:
The view of academia
Fitness for purpose: The view of external
assessors aiming for improvement Threshold:
The view of accreditors The view of studentsValue added:
Value for money: The view taxpayers and
governments Client
satisfaction: The view of students
and employers
(7)
Quality in Higher Education
Quality in higher education is a multi-dimensional
concept, which should embrace all its functions, and
activities: teaching and academic programmes, research
and scholarship, staffing, students, buildings, facilities,
equipment, services to the community and the academic
environment. Internal self-evaluation and external review,
conducted openly by independent specialists, if possible
with international expertise, are vital for enhancing quality.
Source: The World Declaration on Higher Education for the Twenty First Century: Vision and Action (October 1998), Article 11, Quality Evaluation.
(8)
What is Quality Assurance (QA)?
Quality assurance can be described as the systematic,
structured and continuous attention to quality in terms of
maintaining and improving quality.
Source: The Regional Report of Asia and the Pacific (UNESCO, 2003b)
Quality assurance in higher education can be defined as
systematic management and assessment procedures to
monitor performance of higher education institutions.
(9)
AUN-QA Framework
(10)
AUN-QA Framework
Strategic
QA
(Institutional)
Systemic QA
(Internal QA System)
Functional QA
(Education, Research and
Service)
Institutional QA
Assessment
commencing
Jan 2017
Programme QA
Assessment since
2007
(11)
AUN-QA at Institutional Level
(2
nd
Version)
AUN-QA Framework
(12)
PDCA Principle
• Implement
QA
plan/system
• Implement
QA
plan/system
• Monitor and
evaluate QA
plan/system
• Monitor and
evaluate QA
plan/system
• Establish
QA
plan/system
• Establish
QA
plan/system
• Improve QA
plan/system
• Improve QA
plan/system
Act
Plan
Do
Check
(13)
AUN-QA at Programme Level
Version 0
Version 1
2007 – 2010
18 Criteria
Version 2
2011 – 2016
15 Criteria
Version 3
2016/17
onwards
11 Criteria
(14)
AUN-QA at Programme Level
1st Version 2nd Version 3rd Version1. Goals and Objectives;
Expected Learning Outcomes 1. Expected Learning Outcomes 1. Expected Learning Outcomes
2. Programme Specification 2. Programme Specification 2. Programme Specification 3. Programme Content 3. Programme Structure and
Content 3. Programme Structure and Content 4. Programme Organisation
5. Didactic Concept and
Teaching/Learning Strategy 4. Teaching and Learning Strategy 4. Teaching and Learning Approach 6. Student Assessment 5. Student Assessment 5. Student Assessment 7. Staff Quality 6. Academic Staff Quality 6. Academic Staff Quality 8. Quality of Support Staff 7. Support Staff Quality 7. Support Staff Quality 9. Student Quality 8. Student Quality 8. Student Quality and
Support 10. Student Advice and Support 9. Student Advice and Support
11. Facilities and Infrastructure 10. Facilities and Infrastructure 9. Facilities and Infrastructure 12. Quality Assurance of
Teaching/Learning Process 11. Quality Assurance of Teaching and Learning Process 10. Quality Enhancement 13. Student Evaluation
14. Curriculum Design
15. Staff Development Activities 12. Staff Development Activities 6. Academic Staff Quality 7. Support Staff Quality 16. Feedback Stakeholders 13. Stakeholders Feedback 10. Quality Enhancement
17. Output 14. Output 11. Output
(15)
AUN-QA at Programme Level
(3
rd
Version)
Stakeholders’ Needs
Quality Assurance and (Inter)national benchmarking
Programme Specification
Programme Structure &
Content AssessmentStudent
Academic Staff
Quality Support Staff Quality Student Quality & Support InfrastructureFacilities &
Quality Enhancement Output Expected Learning Outcomes A c h i e v e m e n t s Teaching & Learning
Approach
(16)
Criterion
Sub-criterion
Checklist
1. Expected Learning Outcomes
4
3
2. Programme Specification
2
3
3. Programme Structure and Content
6
3
4. Teaching and Learning Approach
6
3
5. Student Assessment
8
5
6. Academic Staff Quality
10
7
7. Support Staff Quality
5
5
8. Student Quality and Support
5
5
9. Facilities and Infrastructure
7
5
10. Quality Enhancement
6
6
11. Output
3
5
AUN-QA at Programme Level
(3
rd
Version)
(17)
• Towards a principles-based
framework
• Reduced overlapping and ambiguity
• From 15 to 11 AUN-QA criteria
• 3
rd
version is effective from January
2017.
Guide to AUN-QA Assessment at
Programme Level (3
rd
Version)
(18)
Guide to AUN-QA Assessment at
(19)
Guide to AUN-QA Assessment at
Programme Level (3
rd
Version)
Adapted from source: “Principles-based accreditation: the way forward?” by Lindsay H Heywood
Characteristics
Principles-Based
Rules-Based
View of Quality System Integrated & Systemic
Standalone & Ad-hoc
Focus
Improvement
Compliance
Feedback
Formative
Summative
Improvement Objective Continuous & Contextualisation Static & Standardisation
Reference
Framework & Non-Prescriptive
Standards &
Prescriptive
Assessors
Skilled Peers
Technical Experts
Assessment Climate
Mutual Respect & Trust
Fearful and Suspicious
Motivation for
Assessment
Intrinsic
Extrinsic
Methodology
Assessment or Evaluation
Audit
(20)
Guide to AUN-QA Assessment at
(21)
The process by which a third party evaluates the quality of an education
institution or programme in order to formally recognise it as having met
certain pre
‐
determined minimal criteria or standards.
The process of the systematic gathering, quantifying, and using of
information in view of judging the QA effectiveness of an education institution
or programme.
The process of reviewing an institution or a programme that is primarily
focused on its accountability, and determining if the stated requirements are
met.
The general process of a systematic and critical analysis leading to
judgments and recommendations of an education institution or programme.
Accreditation, Assessment, Audit and
Evaluation
Accreditation (for the purpose of recognition)
Assessment (for the purpose of improving the effectiveness of
QA system)
Audit (for the purpose of compliance)
Evaluation (for the purpose of improvement)
(22)
Accreditation, Assessment, Audit and
Evaluation
AUN-QA Assessment (for the purpose of
improving the effectiveness of QA system)
• Non-prescriptive
• Recommend areas for improvement rather
than mandating solutions
• Contextualised rather than standardised
QA practices
(23)
AUN-QA Competency Model
(24)
Rationale for QA
• Quality graduates
• Labour market expectations
• Internationalisation of profession and globalisation
• Consumer protection
• From elite university to Institute of mass higher education
• Pressure to meet society
’
s needs
• Increasing importance of quality in higher education
• Student exchange and international cooperation
(25)
AUN-QA Assessment Results (by Ratings)
Rationale for AUN-QA
(26)
PDCA Approach to
Self-assessment at Programme Level
Plan
• Communicate intent
• Organise team • Develop plan
• Understand AUN-QA criteria & process
Do
• Self-assessment •Collect data & evidences
• Close gaps • Write SAR • Review SAR
Check
• Verify SAR • Gather feedback
Act
• Improve QA • Finalise SAR • Communicate SAR • Get ready
(27)
Communicate Intent
• Engage stakeholders
• Objective and scope
• Plan
• Stakeholders roles and involvement
• Set expectations and climate
• Start of change management
(28)
Organise Team
• Structure and Roles
System criteria
Related criteria
Random criteria
• Size
Main and sub-groups
• Ownership
• Subject matter experts including English language
proficiency
• Capability and availability
(29)
Leader
Requirements
(Criterion 1 to 5)
(Criterion 6 to 9)
Input
Quality
Enhancement
(Criterion 10)
Output
(Criterion 11)
Facilitator
Structure and Roles
System Criteria
(30)
Leader
Programme
(Criterion 1, 2, 3,
10)
Teaching & Learning
and Student
Assessment
(Criterion 4, 5, 10)
Resources
(Criterion 6, 7, 8, 9,
10)
Output
(Criterion 10, 11)
Facilitator
Structure and Roles
(31)
Leader
Criterion 1, 2, 3
Criterion 4, 5
Criterion 6, 7, 8
Criterion 9, 10 ,
11
Facilitator
Structure and Roles
Random Criteria
(32)
Key Roles & Responsibilities (example)
Leader Responsibilities
Dean • Link between faculty, QA Office and university administration Head of Academic
Affair of the Faculty • Link between department, Dean and QA office• Link between faculty and data center
Head of Department • Provide leadership
• Link between Dean, Academic Affair and Team Head of Team • Lead team
• Develop plan
• Assign and review task
• Divide team structure and roles
• Link between members with data center • Collate and edit SAR
(33)
Define Key Roles & Responsibilities (example)
Key Role ResponsibilitiesFacilitator (QA Office) • Provide leadership
• Guide internal assessors • Guide SAR team
• Train internal assessors • Train SAR team
• Encourage and motivate SAR team • Review SAR
• Link between faculty and university Facilitator (Faculty) • Guide SAR team
• Encourage and motivate SAR team • Review SAR
Member (Department) • Gather and organize information • Write SAR
Structure and Roles
(34)
Develop Plan
Activity/Month 1 2 3 4 5 6 7 8 9 1
0 11 12 Deadline Assigned to Status
P L A N Communicate Intent Organise Team Develop Plan
Understand AUN QA criteria and process
D
O Self-assessment
Collect data & evidences Close gaps Write SAR Review SAR Verify SAR Gather Feedback A C T Improve QA Finalise SAR Communicate SAR C H E C K
(35)
Understand AUN QA Criteria and
Process
• Obtain copy of the AUN-QA manual
• Educate stakeholders
• Organise training for relevant stakeholders
• Seek clarifications with internal and external
experts
(36)
Stakeholders’ Needs
Quality Assurance and (Inter)national benchmarking
Programme Specification
Programme Structure &
Content AssessmentStudent
Academic Staff
Quality Support Staff Quality Student Quality & Support InfrastructureFacilities &
Quality Enhancement Output Expected Learning Outcomes A c h i e v e m e n t s Teaching & Learning
Approach
AUN-QA at Programme Level
(3
rd
Version)
(37)
YOU MUST BE CLEAR
ABOUT WHERE YOU WANT
TO GO! ---
FITNESS OF PURPOSE
(38)
Stakeholders’ Needs
Quality Assurance and (Inter)national benchmarking
Programme Specification
Programme Structure &
Content AssessmentStudent
Academic Staff
Quality Support Staff Quality Student Quality & Support InfrastructureFacilities &
Quality Enhancement Output Expected Learning Outcomes A c h i e v e m e n t s Teaching & Learning
Approach
AUN-QA at Programme Level
(3
rd
Version)
(39)
AUN-QA at Programme Level
QA at Programme Level
The 11 Criteria
It all starts from the very beginning :
If you do not know where you are going, then
every road you take will lead you there.
(40)
(41)
QA at Programme Level
EVERYTHING IS ALIGNED
TO WHERE YOU WANT TO
(42)
Stakeholders’ Needs
Quality Assurance and (Inter)national benchmarking
Programme Specification
Programme Structure &
Content AssessmentStudent
Academic Staff
Quality Support Staff Quality Student Quality & Support InfrastructureFacilities &
Quality Enhancement Output Expected Learning Outcomes A c h i e v e m e n t s Teaching & Learning
Approach
AUN-QA at Programme Level
(3
rd
Version)
(43)
1 Expected Learning Outcomes 1 2 3 4 5 6 7 1.1 The expected learning outcomes have been clearly
formulated and aligned with the vision and mission of the university [1,2]
1.2 The expected learning outcomes cover both subject specific and generic (i.e. transferable) learning outcomes [3]
1.3 The expected learning outcomes clearly reflect the requirements of the stakeholders [4]
Overall opinion
1. The formulation of the expected learning outcomes takes into account and reflects the vision and mission of the
institution. The vision and mission are explicit and known to staff and students.
2. The programme shows the expected learning outcomes of the graduate. Each course and lesson should clearly
be designed to achieve its expected learning outcomes which should be aligned to the programme expected learning outcomes.
3. The programme is designed to cover both subject specific outcomes that relate to the knowledge and skills of the
subject discipline; and generic (sometimes called transferable skills) outcomes that relate to any and all disciplines e.g. written, oral, problem-solving, information technology, teambuilding skills, etc.
4. The programme has clearly formulated the expected learning outcomes which reflect the relevant demands and
needs of the stakeholders.
1. Expected Learning Outcomes
To meet
Requirements
Content
To write
Checklist
Context
QA at Programme Level
Diagnostic Questions
What is the purpose of the study programme? What are the expected learning outcomes?
How are the expected learning outcomes formulated?
Do the learning outcomes reflect the vision and mission of the university, faculty or department?
(44)
1. Expected Learning Outcomes
1. The formulation of the expected learning outcomes takes into account and reflects the vision and mission of the institution. The vision and mission are explicit and known to staff and students.
2. The programme shows the expected learning outcomes of the graduate. Each course and lesson should clearly be designed to achieve its expected learning outcomes which should be aligned to the programme expected learning outcomes.
3. The programme is designed to cover both subject specific outcomes that relate to the knowledge and skills of the subject discipline; and generic (sometimes called transferable skills) outcomes that relate to any and all disciplines e.g. written and oral communication, problem-solving, information technology, teambuilding skills, etc.
4. The programme has clearly formulated the expected learning outcomes which reflect the relevant demands and needs of the stakeholders.
1 Expected Learning Outcomes 1 2 3 4 5 6 7
1.1 The expected learning outcomes have been clearly formulated and aligned with the vision and mission of the university [1,2]
1.2 The expected learning outcomes cover both subject specific and generic (i.e. transferable) learning outcomes [3]
1.3 The expected learning outcomes clearly reflect the requirements of the stakeholders [4]
(45)
Outcome-based Education (OBE)
OBE can be defined as “defining, organising,
focusing, and directing all aspects of a curriculum
on the things we want all learners to demonstrate
successfully when they complete the programme”
The High Success Network (1992)
(46)
Source: Dr. Andres Winston C. Oreta, Professor in Civil Engineering, De La Salle University-Manila at http://digitalstructures.blogspot.sg/2012/01/outcomes-based-education-as-i-see-it.html
(47)
Outcome-based Education (OBE)
Key concepts and Principles of OBE
• Focus on learning outcomes
• Backwards curriculum design
• Create learning opportunities
• Constructive alignment (assessment –
learning activities – learning outcomes)
(48)
Learning Outcomes
Aim
Learning Outcome
(49)
Goals, Aims and Objectives?
• Typically teacher-centric
“The aim of the programme is to provide a broad
training on the different aspects of setting-up a
family-owned business in Cambodia”.
• May have aims and objectives that are not
referring to students
“The degree programme is designed to be the
benchmark programme in the country, at par with
the best programmes in the World”
(50)
Goals, Aims and Objectives?
• May refer to non-observable, non-measurable
effects on students
“The objective of the course is to instill pride and
love for country among students”
• May refer to skills and traits that are difficult to
assess
“The module is designed to prepare students for
the 21
st
century world”.
(51)
The shift to (Expected) Learning
Outcomes …..
meant to ensure that aims, goals, and
objectives are translated into
observable
and
measurable
results that
can be demonstrated
and
assessed
.
(52)
“To introduce outcomes-based education to
participants”.
“Participants would understand the impacts of
outcomes-based education on curriculum design and
revision”.
At the end of the course, students will be able to apply
knowledge of mathematics and science to solve
real-world engineering problems systematically”.
(53)
Aim
is a broad general statement of the teaching
Intention. It is written from the teacher’s point of view
to indicate the general content and direction of
learning.
QA at Programme Level
(54)
Objective
(or goal) is a specific statement of
teaching intention. It indicates one of the specific
areas that the teacher intends to cover in a block of
learning.
(55)
Learning Outcomes :
working definition
Learning Outcomes
are
carefully written
statements of what a learner is expected to be
able to demonstrate after completion of a
learning activity”
… after completion of a session, a course, a module,
or an entire programme of study
.
(56)
Example : By the end of the course, the student will
be able to
o
solve
(verb)
o
non-linear equations with at least 3 unknowns
(object/noun)
o
to systematically solve real-world engineering problems
(context)
Learning Outcomes
begin with an active verb,
the object of the verb (a noun), followed by a
phrase that gives the context.
(57)
Aim/Goal:
to introduce students to modes of satiric writing in
the eighteenth century.
Objectives:
to familiarize students with a number of
substantive eighteenth century texts. Students will be trained
in the close reading of language and its relation to literary form.
Learning Outcome:
By the end of the course, the student is
able
to analyze the relationship between the language of satire
to the literary form
by the close examination of a selected
number of eighteenth-century texts in a written essay.
Learning Outcomes :
example
(58)
Aim/Goal:
to explain the biochemical basis of drug design
and development.
Objective:
to demonstrate to students the application of
molecular graphics to drug design.
Learning Outcome:
By the end of the course, the student
is able
to apply molecular graphics tools in the design of
drugs
to illustrate general and specific cases via
computer-based presentations.
(59)
Writing learning outcomes
examples, examples, examples ….
(60)
Rewrite :
(61)
The student understands proper
dental hygiene
The student is able to :
o
identify the active ingredient in toothpaste
o
explain why teeth should be cleaned at
least twice per day
o
describe how poor dental hygiene can
lead to poor overall health
(62)
The student understands why there are seasons.
(63)
The student understands why there are seasons.
Student is able to :
explain the relationship between the tilt of the
Earth and its distance to the sun on the changing
of the seasons.
(64)
Students will be familiar with the major theories of
the discipline
(65)
Students will be familiar with withdrawal, smoothing,
forcing, compromising, and problem solving in
conflict-resolution
Students will be familiar with the major theories of
the discipline
(66)
Students will be familiar with withdrawal, smoothing,
forcing, compromising, and problem solving in
conflict-resolution
(67)
Students would be able to :
o
summarize the five major approaches to conflict resolution:
withdrawal, smoothing, forcing, compromising, and problem
solving
o
defend a chosen conflict-resolution approach appropriate
for a given situation
Students will be familiar with withdrawal, smoothing, forcing,
compromising, and problem solving in conflict-resolution
(68)
Tips on writing learning outcomes
(form)
• Begin each learning outcome with an action verb,
followed by the object of the verb, followed by a
phrase that gives the context.
• Use only one verb per learning outcome.
• Avoid vague terms like
know
,
understand
,
learn
,
be
familiar with
,
be exposed to
,
be acquainted with
, and
be aware of.
• Avoid complicated sentences. If necessary use more
than one sentence to ensure clarity.
(69)
Tips on writing learning outcomes
(substance)
• Ensure that the learning outcomes of the module
relate to the overall outcomes of the programme.
• The learning outcomes must be observable and
measurable.
• Ensure that the learning outcomes can be assessed.
• When writing learning outcomes, bear in mind the
timescale within which the outcomes are to be
achieved.
(70)
Levels of Learning Outcomes
• Programme-level learning outcomes that relate
to the entire programme – and are therefore
phrased in more general terms
• Course-level or module-level learning outcomes
are specific to a given course/subject or module
and can be more detailed.
(71)
Levels of Learning Outcomes
not all programme-level outcomes need to be
reflected in the learning outcomes of each course.
But,
set of all course level and co-curricular outcomes
should cover all programme-level learning
outcomes
(72)
Categories of Learning Outcomes
• Subject specific outcomes relate to the subject
discipline and the knowledge/skills particular to it
• Generic outcomes (sometimes called
(73)
Generic
Learning Outcomes
communication skills, problem-solving skills, IT
skills, lifelong learning skills, team-work skills,
leadership, entrepreneurial skills …
need not always be “delivered” in
the classrooms and laboratories …
(74)
Learning Outcomes
Benjamin Bloom (1913 – 1999)
University of Chicago
Bloom’s Taxonomy of Educational
Objectives -
3 Domains of Learning
•
Cognitive
•
Affective
(75)
Learning Outcomes
(76)
(77)
Bloom’s Taxonomy
(Original vs Revised)
Old
New
Read
Appendix 1a
and highlight the key
changes between the original and revised
Bloom’s Taxonomy
QA at Programme Level
(78)
Revised Bloom’s Taxonomy
“Learning is not attained by chance.
It must be sought for with ardor and attended
to with diligence.”
(79)
Revised Bloom’s Taxonomy
QA at Programme Level
o
Terminology Changes
o
Structural Changes
(80)
(81)
Original Taxonomy
QA at Programme Level
1.0 Knowledge
1.10 Knowledge of specifics
1.11 Knowledge of terminology 1.12 Knowledge of specific facts
1.20 Knowledge of ways and means of dealing with specifics 1.21 Knowledge of conventions
1.22 Knowledge of trends and sequences
1.23 Knowledge of classifications and categories 1.24 Knowledge of criteria
1.25 Knowledge of methodology
1.30 Knowledge of universals and abstractions in a field 1.31 Knowledge of principles and generalizations 1.32 Knowledge of theories and structures
2.0 Comprehension
2.1 Translation 2.2 Interpretation 2.3 Extrapolation
3.0 Application 4.0 Analysis
4.1 Analysis of elements 4.2 Analysis of relationships
4.3 Analysis of organizational principles
5.0 Synthesis
5.1 Production of a unique communication 5.2 Production of a plan, or proposed set of
operations
5.3 Derivation of a set of abstract relations
6.0 Evaluation
6.1 Evaluation in terms of internal evidence 6.2 Judgments in terms of external criteria
(82)
(83)
Bloom’s Taxonomy (Revised)
(84)
(85)
Original Taxonomy
QA at Programme Level
1.0 Knowledge
1.10 Knowledge of specifics
1.11 Knowledge of terminology 1.12 Knowledge of specific facts
1.20 Knowledge of ways and means of dealing with specifics 1.21 Knowledge of conventions
1.22 Knowledge of trends and sequences
1.23 Knowledge of classifications and categories 1.24 Knowledge of criteria
1.25 Knowledge of methodology
1.30 Knowledge of universals and abstractions in a field 1.31 Knowledge of principles and generalizations 1.32 Knowledge of theories and structures
2.0 Comprehension
2.1 Translation 2.2 Interpretation 2.3 Extrapolation
3.0 Application 4.0 Analysis
4.1 Analysis of elements 4.2 Analysis of relationships
4.3 Analysis of organizational principles
5.0 Synthesis
5.1 Production of a unique communication 5.2 Production of a plan, or proposed set of
operations
5.3 Derivation of a set of abstract relations
6.0 Evaluation
6.1 Evaluation in terms of internal evidence 6.2 Judgments in terms of external criteria
(86)
(87)
Bloom’s Taxonomy (Revised)
(88)
(89)
Original to Revised Bloom’s Taxonomy
QA at Programme Level
1. 0 K no w le dg e 1. 10 K no w le dg e of sp eci fics 1. 11 Kn ow le dg e of te rmi no lo gy 1. 12 Kn ow le dg e of sp eci fic fa ct s 1. 20 K no w le dg e of w ay s an d m ea ns of d ea lin g w ith sp eci fics 1. 21 Kn ow le dg e of co nv en tio ns 1. 22 Kn ow le dg e of tre nd s an d se qu en ce s 1. 23 Kn ow le dg e of cl assi fica tio ns an d ca te go rie s 1. 24 Kn ow le dg e of cri te ria 1. 25 Kn ow le dg e of m et ho do lo gy 1. 30 Kn ow le dg e of u ni ve rsa ls an d ab st ra ct io ns in a fi el d 1. 31 Kn ow le dg e of p rin ci pl es a nd g en era liz at io ns 1. 32 Kn ow le dg e of th eo rie s an d st ru ct ure s 2.0 Comprehension
2.1 Translation 2.2 Interpretation 2.3 Extrapolation
3.0 Application 4.0 Analysis
4.1 Analysis of elements 4.2 Analysis of relationships 4.3 Analysis of organizational
principles
5.0 Synthesis
5.1 Production of a unique communication 5.2 Production of a plan, or proposed set of
operations
5.3 Derivation of a set of abstract relations
6.0 Evaluation
6.1 Evaluation in terms of internal evidence 6.2 Judgments in terms of external criteria
Kn
ow
le
dg
e
D
ime
nsi
on
Cognitive Process Dimension
(90)
Structural Changes
(91)
Changes in Emphasis
“more authentic tool for curriculum planning, instructional
delivery, and assessment”
(92)
Expected Learning
Outcomes
: at the heart of all
the 10 other Quality Assurance
Criteria
(93)
Second BIG word …
(94)
EVERYTHING IS ALIGNED
TO WHERE YOU WANT TO
(95)
QA at Programme Level
1.
Are your curricula benchmarked against curricula of
the best universities in the world?
2.
What does it mean to be “world class research
university” in terms of curriculum, instruction,
research and service?
3.
Are you preparing your students for the world, for
ASEAN, for your country, for the specific region
within the country?
4.
Will you reserve slots exclusively for foreigners?
5.
What makes an ideal teacher/professor in your
university?
6.
Are your students and faculty members engaged in
research for research’ sake?
(96)
If you do not know to which port you are sailing,
then there is no such thing as a favorable wind …
(97)
Aligning Stakeholders’ Needs to
Learning Outcomes
(98)
LOs
University
MOE
Industry
ABET
ETC.
1
F
F
M
F
?
2
F
M
F
3
F
F
F
F
4
F
F
F
F
5
F
P
F
6
F
P
7
F
F
F
8
F
F
F
F
?
F – Fully fulfilled
M – Moderately fulfilled
P – Partially fulfilled
(99)
Aligning Programme Learning Outcomes to
Graduate Profile
Graduate Profile/Competences
LO1 LO2 LO3 LO4 LO5 LO6 LO71. A strong fundamental chemical
engineering knowledge and the ability
to apply and integrate knowledge to
identify, formulate and solve problems
of chemical engineering fields
X
X
X
2. The professional skills necessary to be
effective and succeed in the modern
workforce including work well in
multi-disciplinary teams, the ability to design
and solve problems, and the ability to
communicate effectively, and to uphold
standards of ethics and professionalism
X
X
X
X
X
3. The ability to engage in life-long
learning by acquiring new skills and to
remain relevant in today’s fast changing
environment
X
X
Source: Chemical Engineering, Universitas Indonesia
(100)
Note: The figures in the ELO column relate to: 1 Not directly related to ELO
2 Quite related to ELO 3 Related to ELO
4 Closely related to ELO 5 Specifically related to ELO
(1)
Curriculum Mapping
Curriculum mapping is a planning tool that can be used at any stage in the curriculum development cycle.
It provides a curriculum map which is a graphical description or a synopsis of curriculum
components that can be used to align courses and lead to the achievement of the programme learning outcomes.
(2)
Curriculum Mapping
(3)
(4)
Curriculum Mapping
Source: Chemical Engineering, Universitas Indonesia
(5)
Exercises:
• Look again at the PLOs of your program
• Produce program structure and curriculum
map of your program
(6)