Thoughts from the Bryanston Education Summit

I attended the 2nd Bryanston Education Summit during the week just past, on 6th June.   I had gone to in the inaugural event last year and I must admit to having found both years to be interesting and useful.   The weather both years has been glorious which also helps to add to the event and the beautiful surroundings of the school.   Here’s hoping Bryanston keep it up, and run another event next year.

During the day I attended a number of different presentations on different topics so I thought I would share some of my thoughts from these sessions.

The first presentation of the day was from Daisy Christodoulou who was discussing assessment.    She drew a really useful analogy in comparing preparing students for their exams with preparing to run a marathon.    It isn’t something where you can jump straight into a marathon distance on day 1 of training.  You need to slowly build up your preparations, focusing on developing certain skills and approaches.   You need to have a plan and then work to this plan, although amending it as needed as you progress, should injury arise or due to weather conditions, etc.    I found myself wondering about how often we actually spend with our students in discussing this plan, the proposed goal of the subject or year and how we will all, teachers, students, support staff and others, work towards those goals.

Daisy also spent some time discussing summative versus formative assessment suggesting that the use of grades should be kept to a minimum of only once or twice per year.   My first reaction to this was concern as it seemed to disregard the potential benefits of spaced retrieval testing which ultimately would result in a score representing the number of correct answers.   Following further thought my conclusion was that spaced retrieval is very focussed on knowledge plus just indicates where an answer is right or wrong as opposed to grading which is more a judgement of students ability.   As such it may be possible to reduce overall summative assessment grading while still making regular use of testing of student knowledge.   I think this also highlights the fact that assessment and testing are actually different things even although they are often generally used as two interchangeable terms referring to the same thing.

Mary Myatt was the second presenter who discussed how we might make learning high challenge but low threat.    As she discussed Sudoku I couldn’t help but draw parallels with computer gaming.  In both case we engage, of our own free will, in a form of testing.   In both cases the key is the low threat nature of the testing.    For me the question is therefore how do we make classroom learning and assessment low threat.    Mary suggested a path towards this in discussing with students our expectations such as setting reading outside their current ability level, which is therefore challenging, but telling them this and then promising to work through it with them in future lessons.   I think this links to building an appropriate classroom culture and climate such that students feel able to share the difficulties they face and work through them with the class.  It is very much about developing an open culture and positive or warm climate in which mistakes and difficulties are not seen as something to be feared or embarrassed by, but to be embraced, shared and worked through together.   Another thing I took away from Marys session was a list of books to read;  My bookshelf will be added to with some of her recommended books shortly.

The third of the sessions which I found most useful was the session by Andy Buck.    He discussed leadership drawing a number of concepts from the book Thinking Fast and Slow by Daniel Kahneman, a book which is one of my favourites.     I particularly enjoyed the practical demonstrations where he evidenced how we all show bias in our decision making.  This is a fact of being human and the way the brain works, we bring to decision making processes assumptions and viewpoints based on previous experiences, upbringing, etc.   He also, linked to this, demonstrated anchoring, managing to influence a whole room of educational professionals to get a question in relation to the number of Year 11 students in the UK wrong.   Statistics suggest that a percentage of the audience should have got this question correct based on a normal distribution of responses however using anchoring Andy influenced the audience away from the correct answer.   I have since used a very similar approach in a lesson with Lower 6 students to show how easily I can influence their answer and to suggest that Google, Amazon, Facebook, etc. with their huge amounts of data on individuals may therefore be able to influence individuals to a far greater extent.

There was also a presentation on VR in education which has opened my mind up a little to the possible applications of VR.   This might therefore be something we experiment with at school in the year ahead.

Microsoft’s Ian Fordham presented on the various things Microsoft are currently working on.   I continue to find the areas Microsoft are looking at such as using AI to help individuals with accessibility and in addressing SEN to be very interesting indeed.   I also was very interested by his mention of PowerBI as I see significant opportunities in using PowerBI within schools to build dashboards of data which are easy to interrogate and explore.    This removes the need for complex spreadsheets of data allowing teachers and school leaders to do more with the data available however with less effort or time required.    I believe this hits two key needs in relation to the data use in schools, being the need to do more with the vast amounts of data held with schools however the need to do it in a more efficient way such that teachers workload in relation to data can be reduced.

I also say a presentation by Crispin Weston on data use in school.    His suggestion that we need to use technology more to allow us to more easily analyse and use data is one I very much agree with.   This partly got me thinking about the Insights functionality in PowerBI as a possible way to make progress in this area.   He also talked about causation and correlation suggesting his belief that there is a link between the two and that the traditional call that “correlation is not causation” is in fact incorrect.   At first I was sceptical as to this however the key here lies in the type of data.    Where the data is simple and results in a simple linear trend line the resulting reliability of an argument that correlation equal causation is likely to be very low.   The world is seldom simple enough to present us with linear trends.    If, however the data over a period of time varies significantly and randomly and the second data element follows this however the reliability that correlation equals causation is likely to be significantly higher.     I think the main message I took away from Crispins session was to take data and findings with a pinch of salt and to ensure that context is taken into account.  If it looks simple and clear then there is something which hasn’t been considered.

Overall the day was a very useful one and the above is a summary of just some of the things I took away.   I must admit to taking 5 or 6 pages of tightly written notes, hastily scribbled on an iPad during the course of the day.

I hope that Bryanston decide to repeat the conference next year and is the quality of presenters and their sessions continues, that it becomes a reliable yearly event.   Here’s hoping the trend of good weather also continues should they decide to run the summit again next year.

 

 

 

Some thoughts on Data

A recent article in the Telegraph (read it here) got me thinking once more about data.   This also got me thinking about the book “Thinking, Fast and Slow” by Daniel Kahneman which I have only recently finished reading.  The book highlighted a number of issues which I feel have implications for education and need to be considered by school leaders.

Firstly the small numbers effect:  The Bill and Melinda gates foundation commissioned a study to examine schools in search of the most effective schools.    It found, unsurprisingly that small size, in terms of student numbers, schools achieved the best results, over larger schools.   Contradictory it also found that small schools also achieved the worst results.   The reason for this as explained by Kahneman is that where a data set contains only a small number of items the potential for variability is high.   As such, due to a variety of random variables and possibly a little helping of luck, some small schools do particularly well, out achieving big schools.    Other small schools are not so lucky and the variables don’t fall so well, resulting in the worst results.

To clarify this consider throwing three darts at a dart board aiming for the centre.   This represents the results of a school with a small number of students with higher scores being nearer centre and a lower score being those darts ending further from the centre.   In the case of student results an average result would then be calculated for the school and the same can be done looking at the position of the darts.   Assuming you are not a professional darts player you may do well or you may not do so well due to a variety of random variables.     Given the limited number of darts the potential for variability is high hence a high average or low average is very possible.   Next consider if you were to continue and throw sixty darts at the dart board, taking the average across all the dart throws.    Given the number of darts the average will regress towards your mean darts throwing ability.    The increased number of data items means that variability is reduced as each significant good or poor throw is averaged out among the other throws.

Within schools a great deal of value is being attached to statistical analysis of school data including standardised testing however care must be taken.   As I have suggested above a statistical analysis showing school A is better than school B could easily be the result of random factors such as school size, school resourcing and funding, etc as much as it may be related to better quality teaching and learning, and improved student outcomes.

Another issue if how we respond to the results.  Kahneman suggests that commonly we look for causal factors.   As such we seek to associate the data with a cause which in schools could be a number of different things however our tendency is to focus on that which comes easily to mind.   As such poorer (and better, although not as often,) results are associated most often attributed to teachers and the quality of their teaching as this is what is most frequently on the mind of school leaders.    We arrive at this conclusion often without considering other possible conclusions such as the variable difficulty of the assessments, assessment implementation, the specific cohort concerned, the sample size as discussed earlier and a multitude of other potential factors.   We also, due to arriving so quickly at a causal factor which clearly must be to blame and therefore needs to be rectified, fail to consider the statistical validity of our data.   We fail to consider the margins for error which may exist in our data including what we may consider acceptable margins for error.   We also fail to consider a number of other factors which influence our interpretation of the data including the tendency to focus more on addressing the results which are perceived to be negative.   This constant focus on the negative can result in a blame culture developing which can result in increasing negative results and increasing levels of blame.   Maybe an alternative approach which may work would be to focus more on the marginally positive results and how they were achieved and how they could be built upon.

The key issue in my belief is that we need to take care with data and the conclusions we infer from it.   We cannot abandon the use of data as how else would we measure how we are doing, however equally we cannot take it as fully factual.   The world is a complex place filled with variables, randomness and luck, and we need to examine school data bearing this fact in mind.   We also need to bear in mind that data is a tool to help us deliver the best learning opportunities for students;  data is not an end in itself!

 

Seeking continual improvement

I am very committed to the process of continual improvement.   We live in an ever changing world with new opportunities, new people and new technologies constantly presenting themselves to us.    As such what may be considered “good enough” today is unlikely to be equally good in the new context in a years time, or possibly a months time, or maybe even tomorrow.    Due to this it is important to continually strive to improve.

The step I am currently undertaking as part of my bid to continually improve is to seek some anonymous feedback from colleagues with regards leadership where I myself am one of the leaders to which those invited will provide feedback.

Sticking your head above the parapet so to speak is never easy and never without some worry or concern with regards the feedback you may receive.

From a research perspective the responses received will be based on the interpretation of the questions being asked and then the perception of the individuals providing the feedback.    Their perception may be coloured by recent events, which due to ease of recall will appear more important than more frequently occurring events which may have resulted in an inverse response.    An individuals state of mind and emotional state on the day they provide their feedback may have an impact on the feedback they provide.    Where a person is having a good day and therefore feeling positive, they are more likely to respond in a positive fashion however where they are having a bad day, where the world is against them the opposite is also true.    If they have recently received bad news the response is also likely to be less positive.

From a statistical point of view I know there are various ways I can interpret the data with each approach potentially resulting in different findings.    A simple look at the highest and lowest average scores may seem to suggest the strengths and areas for development however a look at standard deviations may indicate a high average resulting from some widely fluctuating scores.    This initially apparent strength may therefore turn out to be either inconclusive or even an area for development.

Given all these variables it may be easier to decide to avoid asking the questions.   My choice however is to ask the questions as I would prefer to have data which may upset me rather than having no data at all.   At least if I have upsetting data I have a position to work from and to improve from as opposed to existing in blissful ignorance and therefore having no clue that things need improving.   I also have a baseline to work from in terms of checking if any actions taken have made any difference.

I await the results of the feedback with an element of trepidation and an element of anticipation.

 

 

 

To trust or not to trust

Have been reading and have finished Stephen Coveys Speed of Trust recently.   I have found the book to be very interesting and very much in line with my thinking with regards having a growth mindset and focussing on solutions rather than problems plus on the need to acknowledge the humanistic side of education rather than focussing purely on data such as standardised tests.  It is my belief in the need to trust people and act with trust as a default condition as opposed to assuming distrust and acting accordingly.     The Speed of Trust focuses on this although it also goes on to discuss “Smart Trust” such that we take care on exercising trust where previous events or the situation dictate it.     The book discusses a predisposition towards either trust or distrust, which I think is the key feature of the book.  It suggests the need to encourage a predisposition towards trust.   I have found myself having to defend this position during the last six months having been told that I shouldn’t be open with how I feel to my team and colleagues.   Leaders apparently need to be totally positive even when the situation, either professionally or personally is not, or at least this is what I was told.    For me I believe, and according act, in a way as to display trust in my colleagues and staff and as such I communicate how I feel to them.   I am, after all, a human, a person like everyone else and therefore I have good days and not so good days.   This is not to say that I necessarily have negative days, more a case that I have days when I find positivity and the act of working with a growth mindset more difficult than normal.   During a period of time recently my wife had damaged ligaments in her knee which limited her ability to move, leading to time off work and myself having to take on more duties around the house and with our family as a whole.   As such my ability to remain positive while at work was more difficult than normal and in phone calls or in discussions my tone of voice and body language may have conveyed this.    I was open with people as to the prevailing situation yet I was told that my openness with my emotional status and feelings was a negative thing and something unwanted in senior managers.

Now let us consider the alternative here;   A leader consistently comes across as positive both in terms of beliefs and emotion despite the prevailing situation.    I have worked with people like this and over time you start of lose your trust in them as they repeatedly underplay the humanistic side of life and also the challenges which particular jobs, tasks or activities may present.    They also tend to underplay or fail to acknowledge the culture and climate within the organisation, department or team.   Imagine the boss who you have plainly made aware of personal or professional difficulties who makes light of it rather than engaging you as a person, looking to provide support and arrive at a solution.   “Its going to be fine, just keep at it and focus on solutions”.    I think the reason this constant positivity is stated as positive lies in the hope that positivity will rub off on those you lead and work with however this underplays trust.   Constant positivity both in belief and in emotion suggests a constant level of effort however this is not the case.    Some professional situations require more effort or, as in my situation where my wife was injured, some personal situations result in the need for more effort professionally in order to maintain the normal level of positivity.     As such a consistent “things will get better” approach to positivity may not always work as it fails to recognise the personal effort, commitment or resilience required.     If a leader fails to recognise and acknowledge how a static level of positivity may require varying levels of effort, commitment and resilience then trust may be lost as they more and more appear to be disconnected with a team members reality (Note: I am considering reality as subjective with the only reality which exists to a colleague or team member being their own reality).

Covey puts so much stake in the importance of trust and I cannot help but agree.   Education is more and more focussing on data and standardised testing while ignoring the softer data of what school leaders see and hear on a daily basis.     Trust may steadily be in process of being eroded and teachers more and more see themselves being judged based on data which very often lacks any context.  This is especially evident in terms of a focus on achievement.   Here in the UAE not all students will do Kindergarten so would it be fair to compare two teachers where one has a class of students who did not do kindergarten against a teacher of a class which did, where the later teacher benefits from a class who have two additional years of schooling despite being the same age as the students in the former class;   I would suggest not.

Data is going to continue to be an integral part of education systems as is accountability.   I believe we need to also make some room for trust.    We need to develop the predisposition towards trust as suggested by Covey.   Professional development for example should not be focussed on the needs of the weakest staff at the expense of those who have highly developed skills.    Education often talks of distributed leadership and of empowerment however both of these concepts cannot operate without a level of trust.

I write this in following one of Coveys initial points in his book which is to trust yourself and in writing this I am trusting that my beliefs and ideas are worthy of sharing and consideration.   I trust that you will feel free to share your thoughts whether they be in agreement or disagreement.

Leadership Discussions

The other day I was lucky enough to have time to sit and discuss the important issues of school improvement with Vice Principals of a number of schools.

A number of issues were discussed however 3 key points came out of the discussions:

  • School Culture and Climate
  • School Communication Systems
  • Vision

Now the issues are written down in the order them arose in the discussion so no priority should be read into the order above.   Let’s take each of the issues in turn:

School Culture and Climate

We discussed the need to improve the quality of teaching and learning and how those teachers currently delivering high quality learning experiences could be utilised to encourage this however this doesn’t happen unless a culture exists where staff feel safe in sharing ideas and where ideas are openly discussed and questioned.     Ideas and thoughts regarding how to improve a school often already exist within the school itself although unless a safe, sharing culture exists, these often go without being verbalized.

In addition to this a sharing, safe culture, encourages and supports staff in peer observation, collaboration and team working.    It also serves to support distributed leadership, where teachers are encouraged to take on leadership roles.

School Communication Systems

Now we are not just talking about a weekly briefing here; we are considering the communication system of the school in its most holistic terms.   How do staff and students within the school find out what is going on in the school, its priorities, its mission and its progress towards realising this mission?    Equally how does the school find out about how students and staff feel about the school, its systems and, in general terms, how things are going?     Consideration needs to be given to processes and systems but also to more humanistic issues like how do managers find out about their staff as people with lives outside school.    Communication is about ensuring that the right messages are heard and that all staff feel as if they too are heard, and that their contributions are valued.

Vision

How is the schools vision arrived at and who is involved in this process?    How do we turn the written vision into an espoused vision acted and believed by all staff within the school, independent of role or position?   Some discussion was had regarding whether or not all school vision statements were essentially the same, however I do not believe that this is the case as even although the words used may be similar and the general aim may be education, what this actually means within a given staff body in a specific school in a specific area, at a specific time may differ significantly.

Now overall the discussions were very interesting and identified three important strategic areas in need of consideration however one very important question remained:

How do we go about building on these 3 areas within your school?