19 November 2019

By John Jerrim

When the PISA results are released every three years it is now little surprise when a set of east Asian nations (e.g. Singapore, Taiwan, Japan, South Korea) dominate the top spots in the rankings.

These nations typically substantially outperform most English-speaking western nations, with one important exception – Canada.

This is illustrated by the table below, which shows the top 20 countries in terms of average scores in reading, science and mathematics.

(more…)

12 November 2019

By John Jerrim

If anyone has ever read one of the international PISA reports or seen Andreas Schleicher present they will know that the OECD is rather fond of cross-national scatterplots. These illustrate the relationship between two variables measured at the country level.

Take, for instance, the chart below. This has been taken from one of Mr Schleicher’s blogposts, and illustrates the relationship between a country’s test scores and its rate of economic growth. It has been interpreted by the OECD as showing “that the quality of schooling in a country is a powerful predictor of the wealth that countries will produce in the long run”.

Source: Research by Hanushek and Woessmann, via the OECD Education and Skills Today blog

Sounds convincing, right?

The trouble is, correlation does not equal causation. And, despite the OECD’s obsession with such cross-country relationships, they can often deceive.

(more…)

5 November 2019

By John Jerrim

Every time PISA results are released, concerns are raised about the methodology that underpins the work.

One area that has come in for repeated criticism is how the test scores of students are actually produced, as in this article, which asked whether PISA was “fundamentally flawed”.

Such concerns were exacerbated by a seminal paper by Svend Kreiner and Karl Bang Christensen who claimed that their results indicated that using PISA to compare countries was “meaningless”.

(more…)

29 October 2019

By John Jerrim

When the reform to GCSEs was initially announced, under the watch of Michael Gove in 2014, the intention was to link performance on the new GCSE exams to the PISA test.

Now, as far as I am aware, this link between PISA and national examination standards has not been established. Instead we have the comparable outcomes policy [PDF] and the national reference test to ensure standards are comparable over time.

Yet the interesting question remains – how do the ‘currency’ of GCSE grades and PISA test scores translate?

(more…)

22 October 2019

By John Jerrim

It is widely considered important that children read regularly. A wide range of previous research has linked reading during childhood to improved language skills and higher levels of academic achievement more generally.

But does it matter what children choose to read? Does flicking through a magazine or reading a newspaper have the same benefits for young people as becoming engrossed in a novel? A lot less evidence currently exists on this.

In a research paper published earlier this year, my co-author Gemma Moss and I decided to explore this topic in detail.

(more…)

15 October 2019

By John Jerrim

In England we are fortunate to have a lot of data available about school pupils and how they are achieving academically at school.

Organisations such as FFT aim to make this data available and easily digestible to schools through services such as Aspire so that it can be used to inform the decisions of teachers and school leaders.

But how does the way schools in England make use of data compare to schools in other countries?

(more…)

8 October 2019

By John Jerrim

Since 2009, parts of China have been participated in the OECD’s triennial PISA testing.

In 2009 and 2012, Shanghai topped the international rankings and by quite some distance, with 15-year-olds in this Chinese city estimated to be up to two and a half years ahead of their counterparts in England.

Yet China’s participation in PISA also led to controversy. (more…)

1 October 2019

By John Jerrim

The PISA study is usually used to measure educational achievement across countries.

However, as well as taking a two hour test covering reading, science and mathematics, young people are also asked to complete a background questionnaire.

This covers a wide range of topics, such as self-confidence, life satisfaction, expectations for the future and out-of-school activities. There is hence a whole host of things – outside of educational achievement – that PISA allows us to compare across the world. 

(more…)

24 September 2019

By John Jerrim

In education systems across the world, children are separated into different groups based upon their academic achievement. This is done in different ways.

Countries such as Germany, the Netherlands and Northern Ireland ‘track’ pupils of high and low achievement into different schools (as do parts of England – Kent, for instance – that have retained grammar schools).

Others rely more heavily upon within-school ability grouping of pupils, whether this be setting/streaming, or sitting higher/lower achieving children together within the same class.

A whole host of research has compared countries in how much they segregate higher and lower achieving pupils into different schools. But there has been little work on the extent that different countries group high and low achievers together when they go to the same school.

(more…)

17 September 2019

By John Jerrim

There have been lots of concerns raised recently about social media use among young people. This includes links found between time spent on social media and declines in mental health. Similarly, some are now likening constant internet use to an addiction, with teenagers suffering withdrawal symptoms if their smartphone is taken away.

But how frequently do young people in England access social media? Are they any more or less ‘addicted’ to the internet than young people in other countries? And does this supposed addiction to the internet really do their mental health any harm?

Evidence from the latest PISA data available may well hold some clues.

(more…)