Image

…accountability

Much has been said about accountability measures and systems in education over the past year or so. This is a good thing as the debate is much needed due to the flaws in the system as it currently stands. Accountability systems are crucial for ensuring that the quality of our education system improves and accountability measures are a significant lever in educational reform.

I am not offering an all-encompassing solution to the issues, but offer a suggestion to one key issue, that of clearly demonstrating the effectiveness of a school or schools for all children within a given cohort. This is set in the context of some of the blogs that I have read that have helped to shape my thinking. My thoughts will appear obvious to many, and it may well be that similar ideas have already been shared by others; apologies if this is the case.

Others have written extensively about the challenges of accountability measures:

Chris Husbands (@Director_IOE) responded to press reports that an average points score measure would replace the existing 5 A*-C GCSEs including English and maths measure. Of particular value here was the discussion of the difficulty of using the C/D borderline within accountability measures because of its ‘cliff edge’ nature. The result is that the achievements of a significant proportion of students within a cohort go unreported.

Tom Sherrington (@headguruteacher) wrote as comprehensively as ever about the wider issues surrounding accountability – performance measures, inspection, evaluation. He suggested sound ideas for resolving the challenges based on the triangulation of information: about the quality of teaching and learning; contextualised attainment and progress measures; school evaluation and its impact.

Ros McMullen (@RosMcM) contributed an account of the interplay between accountability, school improvement and system improvement during four identifiable stages of school improvement. There was a hint, at a system level, of the dangers of a zero sum game, in which the success of one school is to the detriment of others.

Yesterday I was struck by a blog written by Loic Menzies (@LKMco) about two problems associated with accountability measures – using average progress measures and thresholds. Average progress measures can result in the excellent progress of some students masking the poor progress of others, and a ‘percentage making expected progress’ measure is of value here. But the problem of using attainment measures within an accountability system, and the associated dangers of cliff edge threshold measures, remains. As with progress measures, some students may benefit to the detriment of others.

Of course threshold measures do have a place in accountability systems, as argued by Simon Burgess at The CMPO, who suggested recently that a threshold can be useful in setting a minimum standard of achievement to which all should aspire.

But perhaps it is possible to combine the concepts of progress and attainment in a way that provides insight into a school’s performance for parents, educationalists and those in political power?

I tend towards the use graphs to display information when comparisons are needed and propose a plot of a cohort’s actual attainment in attainment bands (eg 5 C+ grades, 5 B+ grades and so on), compared to the cohort’s expected performance in comparison to national levels according to prior attainment. This generates a clear view of achievement across a range of attainment levels, removing a single cliff edge but demonstrating a school’s effectiveness at each equally important attainment level.

The fictitious Red School is used to illustrate the point.

Red

Attainment. The attainment measure chosen to illustrate the concept is 5 GCSE grades at a particular level as that is currently the dominant measure in performance tables. This could be changed to any grading system, using any number of qualifications, with or without any particular combination of subjects (for example the inclusion of English and maths). It could also be applied to an average point score system, for example ‘> 100 points’, ‘> 200 points’ and so on.

% of cohort achieving within each grade band represents the percentage of a cohort achieving the particular requirements of each grade band. In this case 60% of the cohort attained at least 5 grade A*s, 98% attained at least 5 grade Gs.

Expected for cohort is an indicator of what the cohort should have attained based on their prior attainment compared to the attainment of students with the same prior attainment nationally.

The Red School is successful. All students achieve at a higher level than expected based upon their prior attainment. Students in this cohort have demonstrated particularly high achievement, as a greater proportion of students have achieved higher grades than expected based on prior attainment.

The Purple School has a mixed profile. Those students who were expected to achieve at a higher level – at least 5 grade Bs, As or A*s – have done so; they have made good progress. Students who, based on prior attainment, would be expected to achieve up to 5 C grades have fared less well; their progress has not been as good. This provides quick access to a good deal of information about a school for parents, school leaders and those ensuring the quality of provision.

Purple

The differing nature of cohorts can be identified by the expected attainment indicators. The Blue School below has a cohort of very high prior attainment – all are expected to achieve 5 grade Cs and 95% are expected to achieve 5 A*s. Achievement of this cohort is high and exceeds expectations in comparison to national levels.

Blue

With this method it is hard to differentiate between schools with very, very high levels of achievement. One solution would be to present additional information and plot the proportion of students achieving more than 8 or 10 of each grade, as seen below. It is now possible to see a marked difference between achievement of 5 and 8 grades in a particular band.

Blue 8

Problems with the attainment and achievement of students at a school would be easily identified, such as seen at the Orange School below. There is a significant problem with the outcomes of students expected to achieve at least 5 grade Cs.

Orange

I think there are some clear benefits to this model as a small part of a wider accountability system. There are also problems, as nothing is ever without fault.

Benefits:

  • There is no cliff edge because of the inclusion of outcomes at a range of attainment levels.
  • Progress is included due to the comparison of actual and expected progress.
  • This methodology could be applied to any number of performance indicators to demonstrate the wider successes of a school.
  • Student groupings beyond prior attainment could be explored to make use of the wealth of information available at a national level.

Problems:

  • The progress of individual students could still be masked within the cohort.
  • The issue of determining expected attainment based on prior attainment is unresolved. It could be based upon the average progress made by students nationally according to prior attainment.
  • This method does not seek to address how start or end attainment should be measured, but merely indicates relative progress from point one to another.
  • Some will argue that the expected attainment measure will be seen by some as a limit to aspiration and once achieved, the need to strive beyond disappears. This is is where the wider accountability systems come into play to prevent stagnation.

Transparent and understandable accountability measures are required to support and challenge schools. This is one idea. Neither list above is exhaustive and I’m interested in hearing the thoughts of others about this proposal at this early stage.

Advertisements

…policy… a #blogsync post: What would do most to improve the status of the teaching profession?

I need to start by thanking Laura McInerney (@miss_mcinerney) for reigniting some thoughts in my mind about the importance of policy, and particularly educational policy, to the status of the profession. Laura’s #blogsync post (http://lauramcinerney.com/2013/05/27/blogsync-how-would-i-improve-the-status-of-the-teaching-profession/) addresses the question “What would do most to improve the status of the teaching profession?” by focusing on the need for teachers to develop through ongoing learning. One sentence in particular caught my eye and made me think:

“Teachers didn’t ‘just’ teach, they were also involved in a ‘profession’ that develops, and teaches each other, and influences policy.”

The notion that the profession should influence policy is spot on.

Many of us use our Twitter profiles to give a brief insight into our interests with the aim of encouraging, and I suspect discouraging, followers with similar interests. I have been claiming for some time, via my Twitter profile, that I am interested in educational policy. This is true, I am. But I can’t help thinking that it is easy to display a nominal interest in something without ever having to be proactive and get things done.

I am not writing here to launch my election manifesto, thereby pre-empting the major political parties, with the aim of being able to claim a landslide poll victory in a yet to be announced general election. That would be foolish. Nor am I intending positioning myself in order that I can influence education policy at a national level. (Perhaps in time…) No, I have been prompted to think about how we should all be engaged in the influence of educational policy, in all its  forms and levels, to ensure that we are a learning and shaping profession. It is the word influence that is important here – those who wish to determine policies at a national level are democratically elected.

A policy is not a document, written at a time of enthusiasm, then shared and printed to gather dust or support a wonky table, but a coherent collection of ideas and principles intended to shape and develop the work of individuals and groups. When thought of in this way it is evident that good teachers understand the concept of policies. Good teachers gather ideas and principles. Good teachers shape and develop those ideas and principles. Good teachers share their vision with others. It’s what happens in successful classrooms every day. Those skills are transferable and applicable to ideas outside the classroom in order that they have influence inside the classroom.

These skills are evident in so many ways:

  • Individual teachers asking for ideas, thoughts and constructive criticism – in the car park or staffroom, in departmental meetings, at TeachMeets – all valuable sources of enthusiasm and advice that are accessible to all.
  • Groups of teachers sharing ideas within a subject specialism to develop policies for their schools and classrooms. Discussions using the #asechat, #engukchat and #engchat hashtags are just the tip of the iceberg.
  • Teachers sharing and challenging ideas on more general forums such as #SLTchat and #edukchat.
  • Formally constituted groups of educationalists engaged in work to influence the future of the profession, such as Redesigning Schooling and Vision 2040 led by SSAT (http://www.redesigningschooling.org.uk/).
  • The curriculum and accountability work of the Headteachers’ Roundtable (http://headteachersroundtable.wordpress.com/).

Each of these examples provides opportunities to influence policy, where policy is considered to be a collection of ideas and principles that shape and develop practice. The level of influence of each of these examples is open to debate, but no one would deny the importance of a teacher’s influence on individual children. The skills developed when formulating policy at a classroom level – gathering ideas, shaping and developing, sharing the vision – can be successfully employed at departmental, whole school, regional and national level.

The status of the profession will benefit from teachers using their skills to influence policy makers. The views needn’t be – in fact, shouldn’t be – uniform, the methods of sharing ideas should continue to be broad and the reach of influence will always be varied, but the belief of the profession as a whole that we each have a part to play in that influence is crucial.

Perhaps I will write that manifesto after all…

Other contributions to the #blogsync topic “What would do most to improve the status of the teaching profession?” can be found at http://blogsync.edutronic.net/ .