NZPF Conference 2021

It was such a privilege to simply be at the New Zealand Principals’ Federation Conference in Rotorua at the start of last week, in the presence of so many dedicated primary and intermediate principals from around the whole country, let alone be invited to speak. The atmosphere was positive, energetic and energising. It really is no wonder these outstanding people were all selected to become school leaders!

Somehow, despite trying to remain discreet during the pōwhiri, I ended up on stage, sitting next to the Associate Minister of Education, Jan Tinetti. I was truly humbled by her special mention of me in her speech.

There were some brilliant speakers at the conference, and not only did I get to shake Sir Ian Taylor’s hand, I had a one-on-one with him at Rotorua Airport before we both flew home.

As for my own session, here is a bespoke slide to tie in with the conference theme “Power, Passion, Pace”, signifying the need to renew, refresh and move ahead after a fragmented year in 2020.

I asked my audience to engage with the sobering data presented, and to be inspired by the students at a decile 1 school whose lives changed forever when their teacher showed them how to line up the columns. This is not just about getting better results in our local and international tests – this is about equity in our education system, and ultimately, equity in our society.

The feedback has been overwhelmingly positive, with many special messages like this one:

“Your talk was the highlight of the NZPF Conference for me, as far as what can be done to change practice in my team to improve outcomes for students. What you said made sense and the changes that need to be made are not major. Thank you for enlightening us. I hope the government take notice and promote your ideas!”

Special thanks must go to NZPF President Perry Rush, for leading the charge this year to do something about New Zealand’s maths education. The hundreds of principals who jumped onto this website as soon as he sent them a link are a testament to his tremendous leadership. Let’s see what these amazing school leaders can do on the ground. Wishing them all Power, Passion and Pace!

Dr Audrey M Tan
9 August 2021

Restoring confidence in mathematics education in New Zealand

In my previous post, I provided an overview of the past 20 years of mathematics education and declining student achievement in mathematics. With the announcement of a refresh of the New Zealand Curriculum (NZC), this seems like a good time to discuss the first steps towards restoring confidence in mathematics education in Aotearoa New Zealand.

Explicitly value the culture of mathematics and mathematicians

Earlier this year, I attended a Ministry of Education (MoE)-facilitated hui for Mathematics and Statistics. It was explained that the Ministry desires a bicultural curriculum that explicitly values all cultures, and that we need to shift to a decolonised, anti-racist curriculum.

Immediately, we are faced with a paradox. The word bicultural suggests that we should explicitly value only two cultures, or at least value two cultures more highly than other cultures. Does that not sound a little bit racist?

I do not wish to discuss racism here. In the context of mathematics, I don’t have to. When writing a good maths curriculum, it is the culture of mathematics and mathematicians that needs to be explicitly valued. Studying the common language of mathematics is naturally inclusive and promotes equity in the system. The beauty of mathematics is revealed to people when they realise, not only can they apply mathematics within their own cultural context, it is the same mathematics that can be applied in other cultural contexts. Mathematics is a unifying approach that fosters understanding between communities.

The social landscape of Aoteroa New Zealand is changing rapidly. Of course, local schools and kura must respond to the cultural needs of its learners and whānau, but continually writing new maths problems is exhausting for teachers and hardly a sustainable approach. It’s not mathematical thinking, either. Teachers should contribute the rich materials they write to a central bank of resources, for the benefit of other teachers and their students. As the database grows, we will spot and appreciate patterns, the same mathematics being applied in different contexts and cultures. This must surely be the ultimate in cultural sustainability.

Celebrate column addition (and other column-based methods)

“Education in New Zealand is a student-centred pathway providing continuous progression and choice.” – Ministry of Education website

It’s hard to imagine any education system in the past that wasn’t centred around students. I cannot think of anything more student-centred than giving children the wisdom of our experience and empowering them with the best mathematical tools available, so that they can make continuous progress with their maths and have a full choice of subject options at secondary school and beyond.

Our decimal number system is a place-value system that was designed to be used in columns. The decision to actively discourage our youngest children from lining up the columns not only disrespects one of the earliest key breakthroughs in mathematics, it disadvantages the children who need it the most. I don’t have to explain the benefits of column addition to any parent or caregiver who has seen their child struggle with the cognitive load of a mental strategy.

If this idea still rankles anyone in the education sphere, please read this discussion and note England’s progress since they brought back column addition eight years ago. Or, more locally, look at the progress achieved in a Decile 1 class of Year 7/8 students who caught up on three years of knowledge in five months.

Respect the cognitive science of learning and support children to learn their times tables

Despite this being an achievement objective in the NZC, it does not seem to be happening.

I do not support rote learning times tables if rote means “mindless recall without understanding the concept of multiplication”. But the messaging is that children should be using “number properties” to work out multiplication facts before committing them to memory. This is a false prerequisite.

This topic was discussed years ago, but more recently, I have come across some alarming research, detailing observations of the concept of multiplication being introduced in New Zealand classrooms. It was mathematically unsound, and the poor children were so confused, they ended up regressing. We’ve got serious problems.

Cognitive neuroscience informs us that fluency with basic facts really does matter. See discussion here.

More whole-class, explicit teaching

We already know a lot about what makes great teaching, including Rosenshine’s Principles of Instruction. We don’t need to reinvent teaching, just like we don’t need students to reinvent mathematics.

New Zealand’s own John Hattie has synthesised the results of tens of thousands of studies to measure the effectiveness of different teaching practices. The average effect size is 0.4, meaning that teachers should be aiming higher than that.

Direct instruction (0.60) and explicit teaching (0.57) are more effective than inquiry-based learning (0.4) and discovery-based teaching (0.21).

Scaffolding (0.82), deliberate practice (0.79) and linking new learning to prior knowledge (0.93) all have very high effect sizes.

Within-class ability grouping has a very low effect size (0.18). There has been plenty of discussion about “labelling” children, but there are far more pragmatic reasons for abandoning it. Preparing multiple lessons creates more work for the teacher and significantly reduces the contact time that any one student has with their teacher, resulting in low engagement levels and poor learning.

When done well, whole-class teaching means that students remain engaged for longer and everyone moves forward together, generating effective classroom discussion (0.82). This does not necessarily exclude group work, but the objectives of social, co-operative learning are quite different and should not replace whole-class teaching and individual practice for the core learning of mathematics.

The OECD’s PISA study in 2012 found that student-oriented learning was negatively related to mathematics performance in every education system – that evidence is very hard to ignore. If it doesn’t work for 15-year-olds, for whom it might be plausible because they should have the knowledge and maturity by then to be more self-directed in their learning, then it’s not going to work for younger children.

The same research found that teacher-directed instruction was positively related to mathematics performance, but high levels did become negatively related.

Thus, we have a strong case for mostly whole-class explicit teaching, with student-oriented approaches on the fringe. Perhaps the progressive educationists who support constructivism (the theory of learning in which children construct their own knowledge through their own experiences) forgot that the school day hasn’t gotten any longer. If students are to keep up with the rate of learning required to meet curriculum expectations, we simply cannot wait for them to discover maths by themselves, or risk them giving up when it starts to feels too hard.

There may be no silver bullet to fix New Zealand’s big maths problem, but bringing back column addition is probably as close as we will get. Let our young children line up the columns again and see their confidence restored, and likewise their teachers’ too. Then we can look forward to building a rich and flexible maths curriculum that will meet the needs of all learners.

Dr Audrey M. Tan
May 2021

20 years wasted – enough is enough

In December 2020, RNZ reported that New Zealand’s Year 9 students recorded the worst-ever results in maths and science.  Four years earlier, they reported that the same generation of students, New Zealand’s Year 5 students, were the worst at maths in the English-speaking world.

We have far too many students struggling with basic numeracy tasks. Looking at the TIMSS 2019 results for Year 5 students,

NB: In 2019, TIMSS conducted their survey on paper in some countries (including New Zealand and Australia), and electronically in other countries (including England and Singapore).  Relative placings and international averages are for the paper survey only.  Combined relative placings on the questions above differ by no more than one place.  Combined international averages on the questions above differ by no more than four percentage points.

In case you hadn’t noticed, that last question was multiple choice. New Zealand’s success rate is exactly the same as in 2015, and worse than what we would expect from random guessing (25%).  An earlier cycle of TIMSS suggests a constructed response success rate would have been much lower.  

This is not exactly news. Looking at the TIMSS 2015 results for Year 5 students,

In TIMSS 2011, New Zealand’s Year 5 students finished last-equal among peers in participating developed countries:

If you think it doesn’t matter that children can’t perform these basic numeracy tasks (e.g. “they don’t need to calculate any more because we have calculators” or “it’s more important to develop their reasoning and problem solving skills”), then think again.  When examining the performance of all countries participating in TIMSS 2019, there is a strong positive correlation between performance in the Number content domain and performance in the other two content domains, Measurement and Geometry, and Data. Similarly, there is a strong positive correlation between performance in the Knowledge cognitive domain and performance in the other cognitive domains, Applying and Reasoning. In other words, strong numerical proficiency paves the way for success in all aspects of Mathematics and Statistics, and you can’t solve higher-order problems or perform complex reasoning unless you have a good bed of knowledge to begin with.

What on earth has gone wrong?  

Twenty years ago, a radical new approach to teaching mathematics in New Zealand, known as the Numeracy Development Projects or just the Numeracy Project, was rolled out across the nation before there was any robust proof of its effectiveness.  In fact, the decade-long roll-out was the research experiment. 

The goal was to raise student achievement by strengthening the capability of teachers through professional development.  The philosophy was to prioritise conceptual understanding over procedural knowledge and skills (frequently called “rules”, with a negative inference). Despite acknowledging the interdependence of “knowledge” and “strategy”, the teaching of knowledge was relegated to a mere “ten-minute whole class warm-up at the beginning of lessons“. Written methods such as column addition and subtraction, divisively labelled as “algorithms”, were not to be taught to students, if at all, until students had jumped through a series of hoops for five or six years, calculating in their heads using increasingly complex mental strategies.  The easiest methods for adding and subtracting numbers literally became the last lessons on addition and subtraction.

The Numeracy Project researchers created their own stages of progression called the Number Framework, and so the research conveniently showed that students were, um, progressing.  

Or were they? In 2005, the National Education Monitoring Project reported that students were “improving in tasks that require quantitative reasoning skills, but declining in basic mathematics facts and solving simple number problems.”

In 2009, “there was no meaningful change in number task performance between 2005 and 2009, for either year 4 or year 8 students.  The most notable change in performance was a decline for year 8 students on multiplication problems, where changes in computation strategy were clearly evident.”

The long-term trend from 1997 to 2009 was “a small net improvement in mathematics performance at year 4 level (held back from a larger improvement by the decline between 2001 and 2005 in basic fact knowledge), and essentially no net change in mathematics performance at year 8 level.”

It was clear the researchers needed to do something to address the deficiencies shown up by NEMP.  They did do something.  They shut down NEMP.

And, presumably, knowing their jobs and their Numeracy Project facilitators’ jobs were on the line, they secured their future by having the Number Framework embedded into the revised New Zealand Curriculum and writing the Mathematics National Standards to align with their aspirations, just as the experiment was coming to an end.

In 2010, the awful truth could not be hidden any longer.  The final, longitudinal Numeracy Project study concluded that “the absolute levels on the Framework attained by students were in many cases well short of the numeracy expectations for students at particular year levels stated in the New Zealand Curriculum and in the Mathematics [National] Standards.”

An estimated $100M (based on $70M spent in the first seven years) of taxpayers’ money had been spent on a revolutionary approach to teaching maths, and it didn’t work.  The experiment had failed.

But it was too late and presumably too embarrassing for the Ministry of Education to pull the plug, and much easier to go along with the idea that it was a “temporary situation while teachers are continuing to upskill themselves”.  Apparently, “many teachers stuck very closely to the printed NDP resources (the “pink” books)”, which “could reflect the low levels of confidence that many teachers still have [despite two years of professional development]…In retrospect, it may be that teachers needed to receive support by facilitators for considerably longer…”.

It’s remarkable how the teachers could be criticised for doing exactly as they were told. Did the Ministry ever wonder whether the pink books were the problem? And what does “considerably longer” than two years of professional development look like? It suggests that not even our student teachers would be adequately prepared to teach mathematics by the time they complete a three year Bachelor of Teaching degree.

In New Zealand, a distinction is made between mathematical (content) knowledge and pedagogical (content) knowledge (i.e. how to teach maths). The parallels with the Numeracy Project are uncanny: initial teacher education (ITE) focusses almost entirely on pedagogical knowledge, with little regard for mathematical knowledge. A 2012 survey of first-year student teachers showed that “students enter ITE with minimal levels of mathematical content knowledge…It is questionable whether their performance can be brought to an acceptable level.  Currently students are not assessed before graduation to ensure they meet numeracy competency requirements.”

If publishing the results of this survey was intended to raise the flag on the universities’ inadequate preparation of their student teachers, it fell on deaf ears. To this day, still only one university in New Zealand bothers to assess the numeracy of all their student teachers before graduation.

What can be made of such a muted response by the universities? There is little incentive to improve the training of pre-service teachers if there is an opportunity to sell Ministry-funded professional development to in-service teachers. In the decade following the Numeracy Project, primary school teachers in New Zealand engaged in higher levels of mathematics professional development than the international average. Yet, the “temporary situation” of 2010 has not improved. Page 53 of this report provides insight into what some Ministry-funded professional development programmes look like.

If, on the other hand, publishing the results of this survey was intended to provide a reason for the failure of the Numeracy Project, the researchers had left it too late. They weren’t assessing students taught in the days of old; they were assessing the earliest victims of their own experiment. These kids were now feeding back into the system as teachers.

Enough is enough. The results speak for themselves. Our primary school teachers are not at fault for a flawed curriculum based on an academic theory of learning. Our children deserve a quality mathematics education; right now, some of them are not even getting a basic one.

What should happen next? That will be addressed in my next post.

Dr Audrey Tan, Mathmo Consulting
April 2021

Covid-19 self-isolation policy must extend to children

It is ironic that, on the very day the Minister of Education reassured parents and whānau that school was a safe place for their children to be, a student in Dunedin tested positive for Covid-19 and the student’s school has been closed for 48 hours.

Today, all known cases of Covid-19 in New Zealand are either from overseas travel or through family/whānau transmission. If the Government is serious about avoiding school closures, then the response is obvious: any child living with someone required to self-isolate must also self-isolate, or at least stay away from school, regardless of whether symptoms are showing. Ideally, any adult or child living closely with someone required to self-isolate should also be required to self-isolate, regardless of whether symptoms are showing, but let’s focus on children for now and how our schools can remain safe during this crisis.

We have an overseas traveller who tested positive and the traveller’s child also tested positive for Covid-19. At best, an entire school community has been inconvenienced for 48 hours, with a smaller number of individuals being tested and required to self-isolate for 14 days. At worst, we have community transmission.

Since the weekend, overseas travellers are required to self-isolate but not necessarily their children. Self-isolating all children living with an overseas traveller is not much more of an inconvenience to that family since there should now be at least one adult at home. At best, one family is inconvenienced for 14 days and nobody gets sick. At worst, at least one person in that family gets sick, but there has been no community transmission.

While the Minister considers his next steps, schools may choose to be front-footed and adopt a cautious approach, asking students who are living with a family member who is self-isolating to stay away from school for the same period. Families and whānau with a member who is self-isolating may also simply choose to adopt this policy.

Many people are calling for all schools should be closed now. It may well come to that, but the impact on the nation would be huge. For now, I would like the Minister to be right when he says that school is a safe place for our children to be. That’s why the self-isolation policy must change, and he has only a small window of time in which to act.

Dr Audrey Tan, Mathmo Consulting
18 March 2020

Thank you to the teachers in Christchurch who kept our children safe

Source: www.storemypic.com
It’s been a difficult week in Christchurch, under the world’s gaze for all the wrong reasons. The focus is, of course, on a small community so viciously and atrociously attacked, but with all schools placed in lockdown on that fateful Friday afternoon, most families in Christchurch were affected. This was an assault on all of us living here.

There were many heroes last Friday – naturally, our emergency first responders come to mind – but from the perspective of an educator and a parent, the teachers who guarded our children and kept them safe for at least three and a half hours are my heroes too. Many of these teachers are themselves parents. A good number of them would have been separated from their own children, wondering how much longer the ordeal would last, but were required to focus on looking after the children in their immediate care. It’s time like this we should all pause for thought and appreciate the huge responsibility that comes with being a teacher.

So, from the bottom of my heart, I want to say a big thank you to all of the teachers in Christchurch who kept our children safe last Friday; the same teachers who returned to work this week to provide stability for our children, even though they themselves are probably feeling rather fragile. I hope you are all doing okay.

Dr Audrey Tan, Mathmo Consulting
22 March 2019

researchED Auckland 2018

researchED2018

Isn’t it crazy that, in 2018, we’re still “working out what works” in Education?

In fact, some of us do already have a pretty good idea of what works, but getting the right people to listen is a different problem altogether.

And so, a group of like-minded individuals (and maybe a couple of sceptics) gave up their Saturday on Queen’s Birthday weekend to attend New Zealand’s very first researchED conference in Auckland. researchED is a growing movement based in the UK but spreading internationally, “a grass-roots, teacher-led project that aims to make teachers research-literate and pseudo-science proof” (and by golly does this country need proofing). Founder Tom Bennett quickly realised that his own teacher training was based more on edu-myths and dogma (e.g. learning styles) than any scientific, evidence-based research.  He’s not the only one.  Daisy Christodoulou’s book, Seven Myths About Education, is the coffee that any waking 21st century learning fanatic should smell.  Briar Lipson at the New Zealand Initiative hasn’t spent very long in this country, but has already sized up our education system very well and should be commended for bringing researchED to New Zealand.

Every talk raised serious questions about how we teach in New Zealand, and everyone was there in the belief that we can, and should, be doing better.  Not surprisingly, the academics are calling for the Ministry of Education to change their ways and look for evidence before adopting fads as policies, while the pragmatic principals and teachers cannot afford to wait and are simply getting on with things.

The common factor of the day was subject knowledge and the importance of committing knowledge to long-term memory.  The 21st century learning ethos suggests that we should leapfrog, or at least skim over, these foundational skills in a bid to produce generic critical thinkers and problem solvers, but surely common sense tells us we cannot reasonably expect students to think critically or solve problems unless they actually have some knowledge to work with.

I have no desire to repeat what has been said so well by others, so instead I will direct readers to a newly created blog by Derek Hopper, a music teacher at Tauraroa Area School who has read up on what works and is spreading the word.  He and his colleagues are seeing significant improvements in student behaviour and achievement. Happy students, happy teachers.  Having already spoken to a maths teacher at Tauraroa who is offering guidance to their primary teachers, I believe this school may well provide the model for other schools to follow.

Some other reflections of the day:

Tom Bennett, founder of researchED: Teachers might think that indulging in (catering for individual) learning styles is a harmless bit of fun, but there is no time to waste when teaching children from disadvantaged backgrounds.  Every minute counts.

Katharine Birbalsingh, keynote speaker and founder/Headmistress of the evidence-informed Michaela Community School in London: Her teachers do not play “Guess what’s in my head?”, i.e. they don’t question their students before the relevant knowledge has been taught, so that every student, regardless of their background, has an equal chance of answering the teachers’ questions correctly.  A subtle but powerful way to address social inequity and level the playing field.

Dr. Michael Johnston, Victoria University: When new skills are learned and practised sufficiently, they become automatic and free up the working memory to concentrate on higher-order thinking.  With particular reference to mathematics pedagogy, the current NCEA internal assessment system provides little incentive for students to practise skills and procedures to the point of automaticity, and if they haven’t reached that point, then they will struggle with the cognitive demands of solving the contextualised problems presented in assessment.

Prof. Elizabeth Rata, Auckland University: Already widely known for her views on the lack of academic knowledge in the curriculum.  When she used the definition of the apostrophe as an example of understanding the epistemic structure of academic knowledge, I genuinely thought she was going to ask the audience if they had spotted the misplaced apostrophe in the previous slide.  She didn’t.  I suddenly felt alone.

Dr. Graham McPhail, Auckland University: There is little evidence that deep learning occurs through subject integration.  Wineburg and Grossman (2000) warned that ‘often the choice to implement a new curriculum is based on symbolic factors, such as a desire to be seen as progressive and in the forefront of reform’.

Louise Zame, primary school teacher:  When listening to a teacher speak so eloquently about the professional challenges of implementing Inquiry Learning…to a bunch of 5-7 year olds…you realise just how much the Ministry of Education has lost the plot.  As part of her Master’s research, Louise asks the pertinent question: what content knowledge do young students (aged 5-7 years) gain through inquiry learning?

Dr. Shaun Hawthorne, Cognition Education Ltd: Prof. John Hattie has recently updated his list of influences on student achievement, and top of the list is now “collective teacher efficacy” with a whopping effect size of 1.57.  For those who don’t know about Hattie’s effect size measure, almost everything on the list has a positive effect, so teachers and schools should not be too complacent. They should be looking to maximise their impact, and punching above the average effect size of 0.40.

To finish:

  • I was probably the only person excited to spend a bit of time in the Vaughan Jones Room during the lunch break.
  • Great care must be exercised when evaluating “evidence-based research”.  There is a lot of rubbish out there.  For example, the Numeracy Development Projects “research” showed that if you teach children strategies then children will learn strategies.  Big deal.
  • The panel discussion at the end left me in no doubt of the monumental challenge we face trying to fix New Zealand’s education system. To quote John Morris, “Currently education policy is being determined by political imperatives. It should not be. All policy initiatives, and in education there are so many of them, should be evidence-based.”
  • Tom Haig from the NZPPTA was naturally highly sensitive to the political undertones of the day and felt the debate was too one-sided.  Perhaps that’s because there is little to debate when we rely on evidence.  If the focus on credible and reliable evidence can take the politics out of Education, then bring it on I say, for I can think of no group of stakeholders less politically-minded than our precious children.

Dr Audrey Tan, Mathmo Consulting
8 June 2018

NCEA – where less is more

Our “revolutionary” National Certificate(s) of Educational Achievement (NCEA) secondary school qualification, built on ideals of inclusion and equity, has failed to deliver on many fronts.

The New Zealand Initiative has highlighted some serious problems with the NCEA system. Briar Lipson’s well researched report, Spoiled by Choice: How NCEA Hampers Education and What It Needs To Succeed, exposed the harsh reality behind the dramatic growth in numbers of students achieving NCEA Level 2 each year. NCEA performance may be “improving”, but the international survey PISA shows that our 15-year-olds’ capabilities in maths, science and reading are declining.

Spoiled_by_choice_Fig1

Moreover, despite there being a minimum requirement for literacy and numeracy credits, a Tertiary Education Commission (TEC) study in 2014 found that reasonably large proportions of students with NCEA Level 1 (approximately half) or NCEA Level 2 (four out of 10) were not functionally literate, and similar proportions were not functionally numerate.

TEC_Literacy_Fig1
TEC_Numeracy_Fig2

So what can we actually ascertain about a student with an NCEA qualification?

Very little, according to the Initiative’s second report, Score! Transforming NCEA Data. It brought to attention the huge variation in grade distribution across subject sub-fields. It is comparatively easier to gain an Excellence grade in Languages and Performing Arts than it is in Mathematics and Statistics. And not surprisingly, they found that more students pass internal assessments than external assessments.

Score_Fig4
Score_Fig2

In an attempt to redress these imbalances, the economists at the Initiative came up with a Weighted Relative Performance Index (WRPI) that endeavours to make “sense” of a student’s NCEA credits and provide a fairer comparison of performance between students. 1

It was a laudable attempt. However, one blatant inequity in the NCEA system that was not addressed by the WRPI, and has yet to be discussed widely, is the absence of a sensible time restriction applied to individual external assessments.

Allow me to explain. In Mathematics, students at any of the three NCEA Levels may be entered for a three-hour external examination comprising up to three achievement standards. Each achievement standard is a self-contained assessment/paper, sealed up in its own plastic wrapping. (Biodegradable, I hope.)

It would seem reasonable that each of the three papers should be completed in approximately one hour. 2 Therefore, it would seem reasonable that if a school decides to enter a student for fewer than three achievement standards, then the duration of the exam should be reduced, i.e. one hour for one paper, two hours for two papers. But no, not with NCEA! Schools may enter students for one or two papers, and students still get three hours to complete them!

This obviously puts students entered for three papers at a disadvantage. Are these students supposed to console themselves that they are receiving a better education, even if their peers come out with higher grades because they had more time?

Schools can, and do, game the system by entering their students for fewer than three papers. But students can also game the system by electing to not attempt all of the papers for which they are entered. If they leave the plastic wrapping intact, they will receive a Standard Not Attempted/Assessed (SNA), and apparently this is better than a Not Achieved (N).

Really?? According to this memo, it’s better for schools because School Result Summaries will include N’s but not SNA’s. Also, SNA allows for the possibility that “a student ran out of time so an N would not be a fair result”. In other words, it’s better to fail to try than to try and fail.

For those chasing an Endorsement, it is actually in their best interests to attempt fewer papers and go for higher grades. For example, for a student chasing an Excellence endorsement, two Excellence grades would be preferable to three Merit grades.

Our national secondary school examination system actually rewards students for doing less work.

The acknowledgement of effort is lacking even within an individual paper. In a traditional marking scheme, every correct answer would contribute to the final mark, but NCEA is a standards-based assessment system with “top down” marking. 3 Therefore, confident students can take a gamble and jump straight to the harder parts of a question. It’s a risky strategy, but if it pays off, they may achieve Excellence having answered roughly a third of the paper. This flies in the face of the instruction printed on the cover page: “You should attempt ALL the questions in this booklet.” If you do well, then some of what you do could turn out to be a waste of time.

NCEA is a system that does little to incentivise students to put in maximum effort or to persevere if the results are likely to be sub-optimal. Until these problems are addressed, mediocrity will prevail. We welcome the Ministry of Education’s review of NCEA this year, and hope to be part of that discussion.

Dr Audrey Tan, Mathmo Consulting
21 March 2018

1   Ironically, NZQA in their utopian socialist bubble didn’t want us to compare students, but it’s happening anyway. Students compare themselves, universities have already come up with their own weighted metrics, and employers are learning that “E” grades on a Record of Achievement are actually higher than “A” grades.

2   Prior to 2013, each paper used to start with the recommendation “You are advised to spend 60 minutes answering the questions in this booklet.”, but not any more.

3   Anecdotally, not all markers appear to follow this methodology. Perhaps they too feel that any positive efforts should be acknowledged, even if ultimately ignored in the final score.

Maths I Can Do – a maths version of Shape of You by Ed Sheeran

It turns out Ed Sheeran’s number knowledge is not so bad, but subtraction is his weak spot.

Last month, I delivered a talk to members of the New Zealand Educational Institute (NZEI Te Riu Roa) in Christchurch. The talk was oversubscribed, limited by the size of the venue.

I explained why the current primary maths curriculum is failing our children and the cognitive science behind it. I demonstrated how to develop algebraic thinking (another big failure of the Numeracy Project) to support computational thinking (in the context of the new Digital Technologies curriculum).

I also responded to teachers’ feedback on the areas their students find particularly difficult. It wasn’t a great surprise to see that subtraction was a common problem.

It turns out Ed Sheeran’s number knowledge is not so bad, but subtraction is his weak spot too.

Ed’s maths quiz and fondness of mathematical symbols inspired me to write a maths-themed version of his Platinum hit “Shape of You”, the deeper meaning of the lyrics revealed in my talk.

“Maths I Can Do” is for New Zealand teachers and their students to sing in their classrooms, but classrooms in other countries may enjoy it too. It is for non-profit educational purposes only. Please do not use it commercially.

Please share as widely as possible to raise awareness of New Zealand’s big maths problem.

Dr Audrey Tan, Mathmo Consulting
2 September 2017

What are National Standards worth when our 10-year-olds are the worst in the world at multiplication?

Teachers and parents would naturally think that if a child is at or above the National Standard in Mathematics, then that child must be doing okay.

Results from the international Trends in Mathematics and Science Survey (TIMSS) tell us something quite different.

At the end of 2014, a representative sample of 6,321 New Zealand Year 5 students with an average age of 10.0 years were surveyed. Out of 49 countries, New Zealand placed 34th, behind all other participating predominantly English-speaking countries. Radio New Zealand put it a little more bluntly.

To be fair, some of the questions were considered too advanced for a New Zealand Year 5 student. However, when restricted to the questions deemed appropriate against the New Zealand Year 5 National Standards, the average student answered fewer than half of those questions correctly.

And yet, the National Standards data for 2014 tells us that 73.2% of New Zealand Year 5 students were at or above the National Standard. If we match this up with the TIMSS international benchmarks, it suggests that some of these students who were at or above the National Standard would probably have been classified as Low achievers in TIMSS.

A student meeting the Low international benchmark “has some basic mathematical knowledge. They can add and subtract whole numbers, have some understanding of multiplication by one-digit numbers, and can solve simple word problems. They have some knowledge of simple fractions, geometric shapes, and measurement. Students can read and complete simple bar graphs and tables.”

This is well below the standard we should expect for a 10-year-old. Now, spare a thought for the students who were classified as Below Low…

16% of our 10-year-old TIMSS participants were Below Low. These students completed fewer than half of the Low benchmark tasks correctly. This is a significant proportion compared to other countries, e.g. England (4%), the United States (5%), Australia (9%). In the top performing countries, less than 1% of their 10-year-olds are Below Low.

More concerning are the statistically significant increases in the large proportions of Māori (26%) and Pasifika (31%) students who were Below Low. If we are going to address the inequality in this country, providing these students with a maths education leading to greater opportunities would be a very good place to start.

I analysed the performance of our TIMSS 10-year-olds, question by question. They were mostly on the wrong side of average, but the stand-out questions were the basic arithmetic questions:

To add to the humiliation of coming last, 27 x 43 was a multiple choice question with four options. New Zealand’s result is worse than what we would expect from random guessing (25%). The previous cycle of TIMSS suggests a constructed response success rate would have been lower.

Our current maths curriculum has made our children so bad at basic arithmetic that they’d be better off guessing. Is this a standard to be proud of?

One might claim that it doesn’t matter – maths is not about the numbers, after all. TIMSS dispels that myth. There was a very strong positive correlation between country performance in Number versus both Geometric Shapes and Measures, and Data Display. There was also a very strong positive correlation between country performance in Knowledge versus both Applying and Reasoning. Suffice to say, number knowledge is a very strong predictor of success in all areas of mathematics.

Taxpayers should consider how much money has been spent on primary maths education since 2000 and question a further $126m being spent over four years on more of the same, without addressing the obvious weak spot in the curriculum. I spoke to Radio NZ about it.

The cost of rolling out the Numeracy Project amounted to around $70m in the first seven years. That’s about $85m in today’s money. The goal of the Numeracy Project “was to improve student performance in mathematics through improving the professional capability of teachers”. It failed.

In 2015, the Minister of Education at the time said that around $70m a year was available for professional development, and that was before she promised further money for maths professional development in response to the New Zealand Initiative’s Unaccountable report.

TIMSS informs us that New Zealand has higher proportions of teachers who participate in maths professional development compared to most other countries. Despite all this professional development, student performance has not improved since 2002, so why should we believe that further money spent on teacher training will make any difference?

To put these astonishing sums of money into perspective, the Government will spend just $40m on rolling out the brand new Digital Technologies curriculum, including $24m on teacher training. This is an area in which teachers will have very little experience, especially programming.

There is a much cheaper and effective form of professional development. Roll out my recent presentation to members of the New Zealand Educational Institute (NZEI Te Riu Roa) nationwide, and then see the maths that our kids can do.

Dr Audrey Tan, Mathmo Consulting
2 September 2017

TIMSS resources:
TIMSS 2015: New Zealand Year 5 Maths results, Ministry of Education
What we know about maths achievement: New Zealand Year 5 and Year 9 results from TIMSS 2014/15, Ministry of Education
TIMSS 2015 International Database