This is a follow-up to an old post on reduced fire risk under the Australian Home Insulation Program (HIP). Blathering critics of that program have suggested that, in addition to “causing more fires” it also “killed Aussie workers” because under the HIP it is known that 4 installation workers died, two of heat exhaustion and two of electrocution. This has led to (mainly political) claims that the HIP was badly implemented and dangerous. I say “political” claims because no one making these claims has bothered to find out whether people died installing home insulation before the program was introduced, or how many people died. People often die in workplace accidents; the question is whether suddenly increasing the rate of home insulation led to an increase in bad workplace practices that might have led to reduced safety and higher death rates. This question is best answered using statistical methods. We can’t do this properly because no one making the claims has presented any data about deaths before the scheme[1]. But we can use the estimates of risk exposure in my previous post, along with the known death rate under HIP, to make some plausible estimates of what data would be required in order to claim that the HIP led to an increase in deaths. As we’ll see, with “only” 4 deaths under HIP, it’s highly unlikely that one can make a strong claim that the HIP led to an obvious increase in risk.
Methods
Using the most basic assumptions about risk from my last post[2], I calculated the death rate per 1000 installations under the HIP program. Under the assumption that deaths are a rare event and poisson distributed, and assuming the best possible situation in the pre-HIP program of 0 deaths, I calculated a confidence interval for the 0 death case using a simple online calculator. I then estimated how many years of risk exposure would be required for the upper bound of this confidence interval to fall below the point estimate of the death rate under HIP. This indicates 95% confidence that the death rates in the pre-HIP era were lower than under HIP.
Results
There were 1,100,000 home insulation installations in 200 days under HIP, giving a death rate of 4/1,100,000=0.36 per 100,000 installations.
There were 70,000 home insulation installations per year pre-HIP, giving a death rate of 0 per 100,000 installations. The upper bound of the 95% confidence interval for 0 deaths under the poisson distribution is 3.7, which calculates to 3.7/70,000=5.3 per 100,000 installations, much higher than the HIP rate. For this confidence interval to fall below the point estimate of the death rate under HIP, we need to observe 0 deaths for 5.3/0.36=14.7 years.
This result arises because the rate of death under HIP is very small. Under a poisson distribution with 0.36 deaths per 100,000 installations, the probability of 0 deaths in 70,000 observations can be calculated as 78% [3]. So under the null hypothesis that the HIP death rate is the same as the pre-HIP rate, you need to go back well past 1 year before you can find a significantly elevated risk of death with any degree of confidence.
Conclusion
In order for critics of the HIP to claim that it led to an increase in death rates, they need to claim that there were no deaths in the home insulation installation business for more than 14 years preceding the implementation of the HIP. This is a pretty tall claim to make in an industry which is known to have had dodgy installations prior to HIP. The CSIRO’s report on the HIP makes this latter fact patently obvious in its risk profiling section, and although it’s possible that there was never a home insulation death in Australian history, I find the possibility quite remote.
Of course this whole issue is a complete furphy, since HIP is a federal program and workplace safety is a state issue. If critics of the HIP want to argue that federal laws can affect workplace safety, then they need to recognize that for the 10 years preceding the HIP, federal workplace safety laws were set by the current critics of HIP, and any risk accruing to workers under HIP has to at least partly be blamed on the previous 10 years of Federal laws. But the likelihood is that there was no increase in workplace deaths, and just as in the case of fires, if the data were available we would probably find a reduction. Criticisms of HIP on this basis essentially use publicity over 4 tragic deaths for purely political aims, with no interest in either workplace safety or greenhouse gas abatement on the part of the critics.
—
fn1: I wonder why? Could it be because they don’t really care to?
fn2: I did a lot of work to establish different risk exposure profiles in that last post, but in the preceding time period no one who is critical of the HIP program’s “dangers” has bothered to advance the state of knowledge one whit. So I’m feeling a lot less charitable a second time around, and can’t be bothered with further shenanigans in the interests of conservative analysis. If some conservative hack has an interest, they’re welcome to find proof of the data they need to make their case. They won’t.
fn3: I did this calculation very quickly in excel and could be wrong, so don’t quote me
May 24, 2011 at 11:43 am
This is a well done, well researched post but I would disaggree with some of the assumptions here. The fact is some installers did die from lack of training and a number of houses did catch fire, which was traced directly to insulation.
May 24, 2011 at 12:48 pm
Undoubtedly deaths and fires can be traced to insulation. But there is no industrial process that is risk free. The issue is whether the program was mishandled in such a way as to increase death rates. The likelihood is quite the opposite, especially with regard to fires.
May 26, 2011 at 6:24 pm
Could you run this analysis on the number of deaths from people trafficking into Australia?
May 27, 2011 at 11:11 am
There’s no need to, because any statistician with a brain can eyeball the data and say “wow! Deaths have increased enormously!” And it’s not people trafficking, it’s people smuggling.
There is actually a case to be made that we don’t know the risk pool for analyzing deaths in the people smuggling industry. i.e. we know that there are X,000 asylum seekers in Malaysia/Indonesia but we don’t know how many are trying to come here at any time, and we don’t know how many boats / smugglers are available to make it happen. So in the strict analytical sense it’s possible that the deaths just reflect rapid fluctuations in the risk pool, probably due to the availability of smugglers. But that analytical problem actually reflects the debate in Australia. Noone disputes that deaths go up and down[1]; the debate is about whether the risk pool changes because of government policy or people smuggling availability.
This is actually a really good example of just how politicized and shit the debate about the HIP program is. When Liberal critics of ALP asylum policy want to talk about the increase in deaths, they’re very very happy to trot out historical data and compare the most recent data to it – “there were no deaths in the last 5 years of the pacific solution” type arguments. Yet with deaths under HIP, they very carefully avoid ever talking about deaths before the HIP program – they talk as if there were none, but they’ve never actually showed any evidence of this. It’s as if they realize that 4 deaths isn’t very many, and if they bother to look at the pre-HIP data[2] they will find a death somewhere in the last few years, and their argument will collapse. This is why I say that this is politicization of those 4 deaths. On the other hand, it’s perfectly reasonable for a critic of ALP asylum policy – even a racist critic – to point out that an increase in deaths is very bad, and ask whether the deaths are related to the policy. This is only “politicization of deaths” if the tone is very nasty or the data is being horribly manipulated.
On the topic of those boat deaths, I have a theory. I have noticed that ships seem to sink a lot more often these days than they used to. We know that under the Pacific solution some ships were turned back and a few sank, but it seems they all do these days. Why could this be? It appears that there’s been a change in the stock of boats being used. The Australian government has been running a policy for many years of sinking the fishing boats of illegal Indonesian fisherman caught in Australian waters, and I’m wondering – do the people smugglers historically buy, steal, cajole or rent fishing boats from these fishermen in the storm season, when the fishers aren’t fishing? This would explain the deterioration in the stock of smugglers’ boats, if the fishermen have been losing ships for 15 years, and so increasingly are loaning out only their dodgiest boats to the smugglers. Alternatively, it could be that the “people smugglers” are just fishermen making money during a non-fishing season. But their boats are actually only designed for short voyages, or they don’t use their best stock for such dangerous journeys. Who knows? But it seems like the rate of sinkings relative to landings has really gone up, and although it is possible that we just missed it in the past (because boats were turned back and then their fate was ignored), it’s also possible that something has changed in the smuggling business. My guess is that it’s become less profitable.
—
fn1: actually I think if you divide the analysis periods into pre-2007 and post-2007, and then carefully calibrate your pre-2007 risk period to include SIEV X and the children overboard affair, you might be able to make an argument that they’re approximately equal. But this would be unwise, because you’d be trying to compare the effects of a policy in 2008 with a policy in – what – 2001? And because it concerns international phenomena (e.g. a couple of wars) you just can’t say that the time periods are good for comparison. So it’s better to restrict the analysis to the few years before 2007 and the few years after, in which case it’s obvious that deaths have increased recently.
fn2: which I’m willing to bet you can get from the ABS if you try
July 5, 2013 at 6:41 am
I see this issue has been revived with the coroner’s report and very political comments from one lot of parents… in the course of the revived ‘debate’ the whole HIP scheme is being described over the ABC as ‘botched’. As a pensioner recipient of HIP insulation, THIS IS JUST SO FALSE. Over a million homes were insulated effectively; blame a few dodgy ‘small business people’ for the very sad deaths. The government should very carefully of course defend their scheme and deny the description of it as ‘botched’; this will otherwise become another opportunity for the LNP, politically.
July 5, 2013 at 7:39 am
In case anyone wants reference material later:
http://www.theage.com.au/federal-politics/political-news/rudd-apologises-for-insulation-program-deaths-20130704-2peal.html
This Age article notes:
1. Prime Minster Rudd apologising for the program.
2. The coroner criticising the program, including the quote: “It is reasonable to conclude the dangers should have been foreseen and mitigated before three people died in Queensland and another in New South Wales.”
Apparently the coroner doesn’t regard deaths as something that can be approached from a purely mathematical background.
Faustus – Can you see any details on Grateful pensioner? (The broken link in their name has me confused) Are they a previous poster here, or have they Googled for articles like this to post government supportive comments?
July 5, 2013 at 10:45 am
Thanks for commenting, Grateful Pensioner. I agree with you that the HIP program was not “botched,” though I can’t say whether it was the most effective use of the government’s money.
Paul, I don’t think that the PM apologising is necessarily a sign that the program was bad: there are lots of colonial apologists who think he shouldn’t have apologised for the Stolen Generations because they disagree with his interpretation of how well that program worked. We should assess it on its merits.
It’s also the responsibility of the coroner to see deaths in all their sad reality, not as mathematical detail; the responsibility of abstracting from the sad particulars to the numerical facts rests with statisticians. The coroner is no doubt right that things could have been done to stop those deaths, which is why I hope you will join with me in pushing for more unionization of casual contracting, better oversight of casual contractor’s workplace safety management, and stricter rules about government use of contractors. I know how much you approve of government oversight of private contracting, especially where even a very small number of lives could be saved in a very large industrial program. But let’s not assume that just because government oversight was insufficient, the program was therefore “botched.”
Regarding the possibility that Grateful Pensioner is actually an ALP hack – as you know I don’t play silly buggers with people’s identities, but even if I were willing to, I have no knowledge of how to find out whether a commenter is actually a hack. And if they are, I guess I should be proud that this humble (ha!) blog has finally attracted the attention of the big wigs. Hi Kev! I should expect a frothing-at-the-mouth liberal rebuttal any moment now…
July 5, 2013 at 8:11 pm
On Grateful Pensioner, my query was purely if they had posted here before or if they were here just for this post. I recall and support the Faustus privacy policy.
One day you’re going to need to accept that your penchant for accepting spam on Margaret Thatcher posts is totally pushing you up the google rankings. With that said, if the spam on that post goes, I go too. 🙂
July 5, 2013 at 10:23 pm
That page does not go!
The coronial findings regarding the HIP program are here. They make interesting reading. I think it’s safe to say that it’s possible to see many areas where changes could have been made or things improved, but that there are a lot of issues being balanced and it’s obvious that there is no single solution to the workplace safety problem that the HIP entailed – at least not given the scale of the program if it was going to continue using private contractors.
July 6, 2013 at 7:34 pm
You now seriously think that private contractors is the reason it can’t be safe rather than simply the size of the program?
I can easily prove that the Australian government provides a manifestly unsafe work environment. For example: http://www.smh.com.au/national/sex-injury-compo-case-goes-to-the-high-court-20130510-2jdcc.html
When will the Australian government accept that the only way to stop the bloodshed is to outsource the management of sex based activities in work environments to properly qualified, and attractive in high heels and lingerie, professionals!