John Jerrim.

Today, with my colleagues Becky Allen and Sam Sims, I have published a major new analysis of teacher mental health and wellbeing in England. Funded by the Nuffield Foundation, it is the culmination of two years of work and is, we believe, the most comprehensive analysis on this issue to date.

In this blogpost, we’ll take you through a whistle-stop tour of some of our results.

1. Teachers in England are more likely to perceive their job as causing them stress – and having a negative impact upon their mental health – than teachers in other countries

In spring 2018, teachers in more than 40 countries were asked whether they felt their job caused them stress and had a negative impact upon their mental health.

As the chart below illustrates, teachers in England were very clear in their views. Lower-secondary teachers in (more…)

John Jerrim.

How much can we trust government reporting of key statistics? Not just the headline findings, but the basic details underpinning them? Those things that it’s important for consumers of data to know if they want to form their own independent judgement about the strength of the evidence available?

In my new paper released today, and forthcoming in the Review of Education, I report what I consider to be a worrying lack of transparency surrounding some aspects of the reporting of the PISA 2018 data for the UK.

This blog is the first in a series posted today looking into some of the (more…)

John Jerrim.

In my new paper released today, and forthcoming in the Review of Education, I report what I consider to be a worrying lack of transparency surrounding some aspects of the reporting of the PISA 2018 data for the UK.

This blog is the second in a series published today looking into some of the issues. Here I focus upon the non-response bias analysis conducted in England and Northern Ireland – but that didn’t get reported. (more…)

John Jerrim.

The second blog in this series discussed how a non-response bias analysis had to be undertaken for England’s and Northern Ireland’s PISA 2018 data.

The interpretation of the aforementioned bias analyses (by the OECD and the Department for Education) was that the PISA samples for these countries were ‘representative’ and ‘not biased’.

But is this really the case?

This blog presents evidence (more…)

Paul Morris.

A recent IOE Blog asks whether England should continue its involvement with the triennial PISA tests and concludes that we should, as it provides a wealth of unexplored data for analysis.

The question is timely as the outcomes of the 2018 PISA exercise have just been released. They show once again that England’s scores are fairly stable and around the average – although the they do show improved scores in Reading and Maths and a decline in Science and Life Satisfaction.

The important question in deciding whether to continue with PISA is: what have been the major benefits over the last 19 years?

John Jerrim.

PISA has now been running since 2000, with England participating in every cycle. Yet involvement does not come cheap. It costs more than £2m every three years for England, Wales and Northern Ireland to take part. Not to mention the burden it places upon nearly 500 schools.

It therefore seems important that we consider whether all this time and effort is worthwhile. Is England really getting enough out of its continued participation in the PISA study?

This blogpost focuses on four key reasons why England has participated in the PISA study, and the value that they bring.

John Jerrim.

If anyone has ever read one of the international PISA reports or seen Andreas Schleicher present they will know that the OECD is rather fond of cross-national scatterplots. These illustrate the relationship between two variables measured at the country level.

Take, for instance, the chart below. This has been taken from one of Mr Schleicher’s blogposts, and illustrates the relationship between a country’s test scores and its rate of economic growth. It has been interpreted by the OECD as showing “that the quality of schooling in a country is a powerful predictor of the wealth that countries will produce in the long run”.

Source: Research by Hanushek and Woessmann, via the OECD Education and Skills Today blog

Sounds convincing, right?

The trouble is, correlation does not equal causation. And, despite the OECD’s obsession with such cross-country relationships, they can often deceive.

(more…)

John Jerrim.

Every time PISA results are released, concerns are raised about the methodology that underpins the work.

One area that has come in for repeated criticism is how the test scores of students are actually produced, as in this article, which asked whether PISA was “fundamentally flawed”.

Such concerns were exacerbated by a seminal paper by Svend Kreiner and Karl Bang Christensen who claimed that their results indicated that using PISA to compare countries was “meaningless”.

John Jerrim.

When the reform to GCSEs was initially announced, under the watch of Michael Gove in 2014, the intention was to link performance on the new GCSE exams to the PISA test.

Now, as far as I am aware, this link between PISA and national examination standards has not been established. Instead we have the comparable outcomes policy [PDF] and the national reference test to ensure standards are comparable over time.

Yet the interesting question remains – how do the ‘currency’ of GCSE grades and PISA test scores translate?

John Jerrim.

There have been lots of concerns raised recently about social media use among young people. This includes links found between time spent on social media and declines in mental health. Similarly, some are now likening constant internet use to an addiction, with teenagers suffering withdrawal symptoms if their smartphone is taken away.

But how frequently do young people in England access social media? Are they any more or less ‘addicted’ to the internet than young people in other countries? And does this supposed addiction to the internet really do their mental health any harm?

Evidence from the latest PISA data available may well hold some clues.