Ben Goldacre’s Bad Evidence should be Good News for liberals

by Stephen Tall on January 3, 2013

If you’ve any interest at all in evidence-based public policy, then do listen to Ben Goldacre’s Bad Evidence, available for the next 6 days on BBC iPlayer here. It’s a fascinating exploration of the issues around using randomised control trials (RCTs) to work out whether the policies we hope will work actually do work in reality.

The medical profession uses RCTs all the time: there is little controversy which surrounds it because it’s become accepted practice, a necessary way of gathering the information clinicians need to ensure their prescriptions are doing us good (and, more importantly, not doing us harm). Yet suggest the use of RCTs in social policy and people come over all queasy. Ironically, if it’s not a matter of life or death then ‘experimentation’ becomes, apparently, a matter of life or death.

Governments have been notoriously bad in the past at actively using robust evidence to inform policy, still less to recognise the need for additional evidence, or proper evaluation of existing policies. Most politicians either don’t understand RCTs, or if they do are too nervous or impatient (or both) to find out if their policies are delivering the promised goods.

Take the Educational Maintenance Allowance: originally the EMA was trialled in a couple of areas (a decade ago), but before even its first pilot evaluation had reported Gordon Brown decided to roll it out nationwide, thus making the original pilots useless. Later evaluation by the IFS suggested the EMA carried a significant ‘dead-weight cost’ (ie, paying young adults to attend school/college who would have attended anyway), but that it was probably justified based on long-term benefits anyway. But by that time, of course, there was no control group to compare the results against. And in the end of course it was ditched by the Coalition anyway in favour of a more targeted (ie, cheaper) bursary scheme.

Liberals should welcome RCTs. Not only because they help promote the kind of rational-sceptical approach to policy-making that’s our natural bent anyway; but also because they encourage devolved, local experimentation, and the piloting of new ideas. Critics call it a ‘postcode lottery’. In reality it’s a way of testing ideas in a smaller setting, checking their impact, adapting based on experience, and allowing for local adaptation. As I wrote a couple of months ago:

Evidence-based policy is not about experts telling professionals, whether in teaching or anything else, what they must do. It is about arming them with the knowledge they need to be evidence-literate. And that evidence-literacy is crucial in working out what will work best in a particular context — because evidence can only tell us that something has worked there, not that it will work here.

Evidence is not a replacement for democratic accountability — unless your concept of democracy is implementing policy and ignoring its impact. It is about giving decision-makers — whether they’re professionals or politicians — the information they need to make informed choices, and how best to put their values into action.

Declaration of interest: one of those interviewed by Ben Goldacre is Kevan Collins, chief executive of the Education Endowment Foundation where I work. Oh, and as Ben remarked on Twitter during the broadcast:

30 comments

New from me > Ben Goldacre's Bad Evidence should be Good News for liberals http://t.co/JiyKEPPX

by Stephen Tall on January 3, 2013 at 2:42 pm. Reply #

New from me > Ben Goldacre's Bad Evidence should be Good News for liberals http://t.co/JiyKEPPX

by Graham Bates on January 3, 2013 at 3:37 pm. Reply #

@stephentall Tall I think you should follow my friend @kirstyevidence and her excellent blog. Also Kirsty – read http://t.co/CvhFAljH pls

by Louise Shaw on January 3, 2013 at 3:52 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence should be Good News for liberals http://t.co/o8IytCD0

by Louise Shaw on January 3, 2013 at 3:53 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence, Good News http://t.co/hyxbrnHJ

by ben goldacre on January 3, 2013 at 3:58 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence, Good News http://t.co/hyxbrnHJ

by The illuminati on January 3, 2013 at 3:59 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence, Good News http://t.co/hyxbrnHJ

by Freedom Programme on January 3, 2013 at 3:59 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence, Good News http://t.co/hyxbrnHJ

by NPC on January 3, 2013 at 4:02 pm. Reply #

New from me > Ben Goldacre's Bad Evidence should be Good News for liberals http://t.co/JiyKEPPX

by Duncan Stott on January 3, 2013 at 4:03 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence should be Good News for liberals http://t.co/o8IytCD0

by Merton Lib Dems on January 3, 2013 at 4:08 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence, Good News http://t.co/hyxbrnHJ

by Paul on January 3, 2013 at 4:09 pm. Reply #

New from me > Ben Goldacre's Bad Evidence should be Good News for liberals http://t.co/JiyKEPPX

by Gavin Williams on January 3, 2013 at 4:09 pm. Reply #

New from me > Ben Goldacre's Bad Evidence should be Good News for liberals http://t.co/JiyKEPPX

by Aldes on January 3, 2013 at 4:51 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence, Good News http://t.co/hyxbrnHJ

by George Preston on January 3, 2013 at 5:13 pm. Reply #

New from me > Ben Goldacre's Bad Evidence should be Good News for liberals http://t.co/JiyKEPPX

by meg thomas on January 3, 2013 at 5:14 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence, Good News http://t.co/hyxbrnHJ

by pharmagossip on January 3, 2013 at 5:34 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence, Good News http://t.co/hyxbrnHJ

by Victoria Silver on January 3, 2013 at 5:50 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence, Good News http://t.co/hyxbrnHJ

by Alonso CarrascoLabra on January 3, 2013 at 5:51 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence, Good News http://t.co/hyxbrnHJ

by Alison Hill on January 3, 2013 at 5:54 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence, Good News http://t.co/hyxbrnHJ

by janet ewan on January 3, 2013 at 5:58 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence, Good News http://t.co/hyxbrnHJ

by KenClemens on January 3, 2013 at 6:00 pm. Reply #

Ben Goldacre's Bad Evidence should be Good News for liberals http://t.co/m2K49no9

by BexhillBattleLibDems on January 3, 2013 at 6:38 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence, Good News http://t.co/hyxbrnHJ

by Kathi Apostolidis on January 3, 2013 at 10:13 pm. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence, Good News http://t.co/hyxbrnHJ

by Chris Warden on January 3, 2013 at 11:51 pm. Reply #

Ben Goldacre’s Bad Evidence should be Good News for liberals http://t.co/eDJwhTNK

by Henry Strick v. L. on January 4, 2013 at 4:42 am. Reply #

RT @stephentall: Ben Goldacre's Bad Evidence, Good News http://t.co/hyxbrnHJ

by Ali Ahmed on January 4, 2013 at 5:46 pm. Reply #

It’s also radio 4′s documentary of the week on podcast. This means it is downloadable to keep forever. Also it causes strange things to happen in my brain when I notice you posting about the very podcast I’m listening to while I’m listening to it…

by Jennie on January 4, 2013 at 7:53 pm. Reply #

Thanks, Jennie, for letting me know about the podcast (and apologies for head-messing).

by Stephen Tall on January 4, 2013 at 7:58 pm. Reply #

No worries. I’m terribly addicted to podcasts – makes my 3 hours per day on the bus not just bearable but interesting (as does being able to read/comment on blog posts while commuting ;))

by Jennie on January 4, 2013 at 8:04 pm. Reply #

[...] access to data and evidence informing the actions of government and other organisations. As I argued here, this stress on evidence-based policy (using controlled trials where possible) should be good news [...]

by Liberal Hero of the Week #29: Ben Goldacre and +AllTrials.net « CentreForum Blog on January 25, 2013 at 1:59 pm. Reply #

Leave your comment

Required.

Required. Not published.

If you have one.



You might also likeclose
Plugin from the creators of Brindes :: More at Plulz Wordpress Plugins