Tuesday, 12 June 2018

Arm yourself!

A headteacher recently told me she'd been informed by her LA advisor that "only 'good' schools can experiment and do what they like when it comes to assessment". This lie has been trotted out so many times now that it has become embedded in the collective consciousness and headteachers have come to accept it. Perhaps even believe it. But surely what's right for 'good' schools is right for all schools? It's an incredible irony that some schools are essentially being told that until they are 'good', they are going to have to persevere with ineffective practices. It's the ultimate education Catch 22: you can't start to improve things until you've improved.

And yet it is precisely these schools that have the most to gain from overhauling their approaches to assessment; by reducing tracking and marking and written feedback, not increasing it. Unfortunately schools are often being told the opposite: ramp it up, measure more and more often, track everything that moves.

With apparently little choice, headteachers wearily resign themselves to the drudgery, and often, quite understandably, rail against anyone that suggests a different path. I've been told numerous times "it's all very well for you, but you try being in this position". They are under intense scrutiny by people who think the way to improve outcomes is not to improve the curriculum, and teaching and learning, but to collect more data and increase workload. Clearly many of the processes put in place in the name of school improvement are having the opposite effect. 

Schools need to be brave. They need to be willing to make necessary changes but they also need reassurances that changes are justified, supported, and will not backfire when an inspector calls. To that end, I've compiled a list of key statements that schools can use to support (and defend) their position as they seek to build a more meaningful, and less onerous, approach to assessment. And there is plenty out there to arm themselves with.

  • We do not expect to see 6 week tracking of pupil progress and vast elaborate spreadsheets. What I want school leaders to discuss with our inspectors is what they expect pupils to know by certain points in their life, and how they know they know it. And crucially, what the school does when it finds out they don’t! These conversations are much more constructive than inventing byzantine number systems which, let’s be honest, can often be meaningless.
  • Nor do I believe there is merit in trying to look at every individual sub-group of pupils at the school level. It is very important that we monitor the progress of under-performing pupil groups. But often this is best done at a national level, or possibly even a MAT or local authority level, where meaningful trends may be identifiable, rather than at school level where apparent differences are often likely to be statistical noise.
  • Ofsted does not expect performance and pupil-tracking information to be presented in a particular format. Such information should be provided to inspectors in the format that the school would ordinarily use to monitor the progress of pupils in that school.
  • Inspectors will use lesson observations, pupils’ work, discussions with teachers and pupils and school records to judge the effectiveness of assessment and whether it is having an impact on pupils’ learning. They don’t need to see vast amounts of data, spreadsheets, charts or graphs. Nor are the looking for any specific frequency or type or volume of marking or feedback.
  • I want teachers to spend their working hours doing what’s right for children and reduce the amount of time spent on unnecessary tasks. Damian Hinds, Secretary of State for Education 
  • If the impact on pupil progress doesn’t match the hours spent then stop it! Amanda Spielman, HM Chief Inspector, Ofsted 
  • The origins of the audit culture are complex but we do know there’s no proven link between some time consuming tasks around planning, marking and data drops, and improved outcomes for pupils. Professor Becky Allen, UCL
  • No inspector should be asking for these things, and nobody else should be telling you that this is what inspectors will be looking for. Sean Harford, National Director of Education, Ofsted
  • I want you to know you do have the backing to stop doing the things that aren’t helping chidren to do better. Damian Hinds, Secretary of State for Education 
  • Ofsted does not expect any prediction by schools of a progress score, as they are aware that this information will not be possible to produce due to the way progress measures at both KS2 and KS4 are calculated. Inspectors should understand from all training and recent updates that there is no national expectation of any particular amount of progress from any starting point.
  • ‘Expected progress’ was a DfE accountability measure until 2015. Inspectors must not use this term when referring to progress for 2016 or current pupils. 
  • There is no point in collecting ‘data’ that provides no information about genuine learning
  • Recording summative data more frequently than three times a year is not likely to provide useful information
  • Tracking software, which has been used widely as a tool for measuring progress with levels, cannot, and should not, be adapted to assess understanding of a curriculum that recognises depth and breadth of understanding as of equal value to linear progression
  • It is very important that these systems do not reinvent levels
  • Ensure that the primary purpose of assessment is not distorted by using it for multiple purposes
  • Sometimes progress is simply about consolidation (Ed: how do you measure consolidation? You can't. And if we persist with coverage-based progress measures (i.e. levels) then we are relying on measures that are out of kilter with the principles of this curriculum and  potentially risking pupils learning by prioritising pace at the expense of depth.)
  • Be streamlined: eliminate duplication – ‘collect once, use many times’ 
  • Be ruthless: only collect what is needed to support outcomes for children. The amount of data collected should be proportionate to its usefulness. Always ask why the data is needed. 
  • Be prepared to stop activity: do not assume that collection or analysis must continue just because it always has 
  • Be aware of workload issues: consider not just how long it will take, but whether that time could be better spent on other tasks
  • A purportedly robust and numerical measure of pupil progress that can be tracked and used to draw a wide range of conclusions about pupil and teacher performance, and school policy, when in fact information collected in such a way is flawed. This approach is unclear on purpose, and demands burdensome processes.
  • The recent removal of ‘levels’ should be a positive step in terms of data management; schools should not feel any pressure to create elaborate tracking systems.
  • Focusing on key performance indicators reduces the burden of assessing every lesson objective. This also provides the basis of next steps: are pupils secure and can pupils move on, or do they need additional teaching?
  • I also believe that a focus on curriculum will help to tackle excessive and unsustainable workload. For me, a curricular focus moves inspection more towards being a conversation about what actually happens in the day-to-day life of schools. As opposed to school leaders feeling that they must justify their actions with endless progress and performance metrics. To that end, inspecting the curriculum will help to undo the ‘Pixlification’ of education in recent years, and make irrelevant the dreaded Mocksted consultants. Those who are bold and ambitious for their pupils will be rewarded as a result.
  • Inspectors are reminded that Ofsted has no expectation about how primary schools should be carrying out assessment or recording of pupils’ achievements in any subjects, including foundation subjects. Use of the word ‘tracking’ in inspection reports is problematic as it can suggest that some form of numerical data is required, when there is no such requirement, even in English and mathematics. Schools will not be marked down because they are not ‘tracking’ science and foundation subjects in the same ways they may be doing so in English and mathematics. This clarification will be added to our ‘Clarification for schools’ section of the ‘School inspection handbook’, effective from September 2018.

I will keep adding to this list as and when I find useful statements. Please let me know if you have any to add. Thanks. 

5 comments:

  1. Excellent! This all makes perfect sense if you really understand teaching, learning and assessment. Sadly, a lot of people involved in education do not understand. Keep up the good work.

    ReplyDelete
  2. Thanks. I’ll keep banging at the door.

    ReplyDelete
  3. As a Governor, this is brilliant - thanks - a great starting point for data monitoring/challenge.

    ReplyDelete
  4. This comment has been removed by the author.

    ReplyDelete