INDEPENDENT NEWS

Census 2018 independent review – Expert Reaction

Published: Tue 13 Aug 2019 05:38 PM
Chief Statistician Liz MacPherson resigned this morning, saying she took full responsibility for the "shortfalls identified in the report".
The independent review concluded that Census 2018 was adequately funded, but problems arose with IT systems and staff displacement following the November 2016 Kaikōura earthquake.
The official results were initially slated to be released in August 2018, but they will now be released in September 2019.
The SMC gathered expert comments on the review.
Professor Richard Arnold, Victoria University of Wellington, comments:
"Statistics New Zealand has just received its independent review of the Census 2018.
"The census was a 'digital-first' collection, in which 70% of respondents completed an online census form. The goal of this new version of the census was to save money for the government, in what is an extremely costly five yearly exercise to count the New Zealand population. It was also hoped that the online census would reverse the (slow) decline in response rates.
"However, the census had a catastrophically low response rate. Instead of a undercount of 2-3% (the trend of recent censuses), the undercount was 9% for partial completion of the census, and 14% for full completion.
"Statistics NZ has tried to repair the data set – by imputing data from administrative and other data sources. They have used other data sources, including the 2013 Census, to estimate the properties of the people who did not respond to the census, and claim that in doing so they have reduced the undercount to only 1.4%.
"For key outcomes – the drawing of the electoral boundaries and DHB funding – the Census has met its requirements. However, they admit that for a host of other variables, such as iwi affiliation, the results will be insufficiently accurate.
"This has also led to a delay of more than a year in the release of the first census results: they were planned to be released in August 2018, and they will now finally be released on 23 September 2019.
"What went wrong?
"The review found that 'many aspects of the census went well', and that:
• The goal of the digital-first census was laudable
• The approach that Stats NZ took to it was sound
• The resources Stats NZ had were sufficient.
"But:
• There was lack of 'overall governance and strategic leadership';
• There was an over-optimistic attitude that didn’t recognise the complexity of the task;
• There was with an overemphasis on the online dimension of the census, and insufficient attention paid to the respondents who would find the online census difficult to complete;
• Testing was insufficient;
• Some poor decisions were made;
• The field force was too small for the task that it faced;
• Decisions were made late, and in particular remedial actions were made too late to fix the response rate when it was clear it was too low.
"Key among the decisions that put the response rate at risk were the decisions not to leave a paper form and not to make personal contact with households that had individuals who had not responded and who needed an access code to begin the census.
"What seems clear is that the lack of personal contact with a census field operative, which was the backbone of the previous census model, was a barrier to participation for too many people. Moreover a decision was made not to follow up partially responding households, where only some of the residents had completed their personal forms.
"The review also found accounts of long waiting times for helpline calls, and insufficient staff for community liaison, especially for Māori people.
"From the outside, it looks as if the appropriate technical and statistical expertise was lacking at the highest levels of decision making. The Review concludes that Statistics NZ should continue to follow this model for the next census in 2023, but that there are a number of serious lessons it needs to learn from this experience."
No conflict of interest.
Science Media Centre
Our aim is to promote accurate, evidence-based reporting on science and technology by helping the media work more closely with the scientific community.
The Science Media Centre is New Zealand's only trusted, independent source of information for the media on all issues related to science. Thousands of news stories providing context from and quoting New Zealand researchers have been published as a direct result of our work.
Contact Science Media Centre
Website:
Mobile:
Twitter:
YouTube:
Phone:
Facebook:
Email:
Postal Address:
PO Box 598, Wellington 6140

Next in New Zealand politics

Police Commissioner announces independent review
By: New Zealand Police
PM's Post-Cab: Now We Are Two
By: The Scoop Team
Revamp of guidelines for meth sentencing welcomed
By: NZ Bar Association
Armed police patrols will cause American-style shootings
By: People Against Prisons Aotearoa
Amnesty Int calls on Gov not to rush Terrorism Bill
By: Amnesty International
Funding to support Christchurch Call – Expert Reaction
By: Science Media Centre
Gordon Campbell on a new book on the leaky homes scandal
By: Gordon Campbell
Zhang v R - New Sentencing Guidlelines
By: NZ Court of Appeal
Meth Dealers to be rewarded
By: Sensible Sentencing Trust
Police trial new response to high risk events
By: New Zealand Government
Police to pilot Armed Response Teams
By: New Zealand Police
The Nation: Simon Shepherd Interviews Golriz Ghahraman
By: The Nation
Keeping NZ safer with better counter-terrorism laws
By: New Zealand Government
Govt must sit down with National over Terrorism Suppression
By: New Zealand National Party
National will support terrorism legislation
By: New Zealand National Party
View as: DESKTOP | MOBILEWe're in BETA! Send Feedback © Scoop Media