9th February, 2005
NCEA Standards Based Assessments Fundamentally Flawed for Scholarship
"The recent public assurance employers were given by the NZ Qualifications Authority that the NCEA is always consistent
between schools and over time is again blown apart," said Alasdair Thompson, Chief Executive of the Employers & Manufacturers Association.
"The scholarship exam results debacle is not just the consequence of throwing out scaling results this year. NCEA'S
Standards Based Assessment is a fundamentally flawed measurement of achievement in academic subjects. Its flawed also
because it is not possible to smooth aberration in a Standards Based Assessment System.
"Standards Based Assessments are appropriately used where the standard to be achieved can be clearly defined, such as in
typing, bricklaying, music and sports. They are good for measuring a person's ability in clearly defined, narrow areas,
such as multiplication tables.
"But, in NCEA, the knowledge required for academic subjects is complex and multi-dimensional and it is incredibly
difficult to set standards for them. Hence the so-called standards are vague, fuzzy, ambiguous statements capable of
many interpretations. They are not pre-tested for difficulty and they are not consistent from year to year.
"Knowledge-based subjects like English, Science, History, Geography and Economics simply do not lend themselves to this
approach.
"Employers have expressed concerns and raised questions as have school principals and experts in measuring external
results, but the Minister of Education and NZQA have been dismissing them.
"Maybe now, with this latest fiasco, the Minister of Education will listen and direct that the review of NCEA to be
undertaken will look at its processes and results, and be reviewed by independent educational measurement experts to
identify areas for improvement.
"Steadfastly defending the current standards based system by dismissing its critics as elitist and out of step with the
PC concept that people's performance should not be ranked and the extent of their failures ever acknowledged, nor even
reported, isn't in the best interests of lifting educational achievement in New Zealand, said Mr Thompson.
Additional points -
Objective assessment - not subjective assessment
Unit standards/achievement standards are appropriate where the evidence is clear and consistency between the assessors
can be achieved with little or no debate.
Subjective assessments vary between individuals, overtime, in different locations, etc. Unless moderation techniques
can, and are, used successfully
Variations between assessors produce distortions. Unfairness, unevenness and inconsistency enter the assessment process.
Unless eliminated or 'moderated', these inadequacies guarantee that the system will lose credibility and be rejected by
the stakeholders.
This has happened to NCEA.
Suppressing criticism, stamping feet or bluster will not hold back the tide of rejection.
Review, identify inadequacies, apply remedials and redesign the process to achieve consistency, fairness, acceptance of
the assessment process.
ENDS