SURELY SOME MISTAKE?
EPISTEMICS RHETORIC REALPOLITIK

Sunday 17 July 2011

CANNABIS CANCER CURE? - More on scientific evidence

As promised, here is a detailed look at some prominent and relatively recent studies. I've restricted myself to two such studies, both of which have Murray's fingerprints on them. I haven't gone further because this kind of analysis is relatively time-consuming and I want to lay the issue to rest as quickly as is possible consistently with answering Hitchens's challenge to explain my views on harm.

While I've tried to avoid selecting straw men for this analysis, I haven't been terribly rigorous in my selection criteria - the selection is in any case limited by the need to choose studies which are freely available to, thus checkable by, the public. To address this potential source of actual or perceived bias, I will make this commitment: should Hitchens care to propose, in comments to this post, any other paper which he considers invulnerable to my objections, or should any author of a paper on the topic propose theirs, I will respond with a post dedicated to analysing that paper.

The two papers represent the two specific sources of error which I discern in this area of research: first, the existence of a common predisposition, in the sense outlined previously, that influences both cannabis use and the emergence of schizophrenia; and second, the confusion of transient cannabis-related phenomena with evidence of schizophrenia.

Before proceeding, I'll mention two other matters.

First, a merely illustrative example of the context in which this research is proceeding. A review paper published in the Lancet, Moore et al., Cannabis use and risk of psychotic or affective mental health outcomes: a systematic review, states that

There is now sufficient evidence to warn young people that using cannabis could increase their risk of developing a psychotic illness later in life.

This is of some interest for two reasons: first, the statement is couched in terms which suggest that a long-sought objective of gaining 'sufficient evidence' has been reached. Second and perhaps more importantly, the standard of evidence reached is low. The best that can be said is that it is sufficient to warn young people that using cannabis could increase their risk. If doctors are to warn of everything that 'could increase risk', they are going to be spending a lot of time issuing warnings.

Cannabis and cancer

Second, in my previous post I did my best to answer Hitchens by honestly laying out the strongest case against cannabis that I consider justified. I said I've already mentioned that smoking cannabis carries a risk of cancer. It hardly need be added that I would assume it imposes the other major risks associated with smoking. In any case, in Europe cannabis is most commonly smoked mixed with tobacco

These remarks were cursory, since my primary concern was not with any cancer risk (as indicated by the quote I supplied from Hitchens: As for the risk of cancer, while it undoubtedly exists, it is not my principal concern).

Since reading my previous post, Hitchens has shown some early signs of shifting his emphasis - as is his unquestioned prerogative - from mental health to smoking-related dangers. In a recent comment he states: As for cannabis being a poison, it is plainly injurious to its users in many ways, especially when smoked ( as Mr Wilkinson concedes in his latest posting).

So to nip this in, so to speak, the bud, I'll slightly expand and clarify my remarks on cancer and cannabis. Any smoking almost certainly imposes - causes - an increased risk of cancer. Many things contain carcinogens (I seem to remember reading that bracken is among them). Smoke and other products of burning organic matter are among these: smoked meats and burned toast are believed to increase cancer risk, for example. So the likelihood is that cannabis smoke does the same. However, Cancer Research UK make it clear that the specific risks of cannabis smoke are not understood and are probably lower than those of tobacco.
Ben Goldacre, in his Bad Science column, points out that science correspondents - and indeed general reporters - seem to have averted their magpie eyes from a particularly bold and sensational claim for the low incidence of harm from cannabis smoking. I would approach this claim with caution, which is why I opted not to mention it in my previous post. But the report is out there, and while I'm going beyond a quick statement of my own best guess, I should mention it:

For textbook bad science we’d also want to see the media distorting research: overstating the stuff it likes, and ignoring stuff it doesn’t, especially negative findings. We used to read a lot about cannabis and lung cancer in the papers. The largest ever study of whether cannabis causes lung cancer reported its findings recently, to total UK media silence. Lifelong cannabis users, who had smoked more than 22,000 joints, showed no greater risk of cancer than people who had never smoked cannabis.

While no journalist has written a single word on that study, the Times did manage to make a front page story headed "Cocaine floods the playground: use of the addictive drug by children doubles in a year," out of their misinterpretation of a government report that showed nothing of the sort.


All this is of course about smoking. Cannabis, unlike tobacco (which, for example, causes mouth cancer when chewed) does not appear to be carcinogenic when it is not burned.

The tobacco-based component of the cancer risk associated with smoking is of course avoidable. If, as appears likely, the risks from cannabis smoking are in fact less than those of tobacco, this should be made public, and conditional advice offered: if you are going to take cannabis, don't smoke it; if you do choose to smoke it, don't add tobacco. Of course this presupposes well-informed and honest advice uncorrupted by the noble aim of churning out one-sided propaganda and squeamishly avoiding anything that might be seen as 'encouraging' or 'promoting' cannabis use.

Note also that if cannabis were legalised, vaporiser technology would no doubt be improved. Furthermore, in the longer term, other smokeless delivery mechanisms for THC might well be developed.

Oh yes - one more thing. The cancer research site (final paragraph) also mentions the sensational news that the active constituents of cannabis have been found to kill cancer cells. Unlike most initial findings about possible cancer cures and antagonists, this does not seem to have been widely reported in the press. The bad news is that smoking draw is not thought to increase house prices, though since I've mentioned the possibility, it would be irresponsible not to speculate.

Back to the analysis of Reefer Madness studies:

Common predisposition

The past few decades' hunt for a causal relationship leading from cannabis use to schizophrenia was prompted by some findings from a cohort study of Swedish conscripts. This, in the classic pattern, was an exciting result which has been followed by a 'decline effect'. I will focus on a follow-up study which purports to address the obvious issues with the initial finding.

Zammit et al., 'Self reported cannabis use as a risk factor for schizophrenia in Swedish conscripts of 1969: historical cohort study'

This paper seems to avoid the problem of transient cannabis-related effects:

It is unlikely that cases diagnosed as schizophrenia in this cohort were either toxic psychoses induced by cannabis (or amphetamine) or acute, transient drug induced psychoses, given the restrictive tradition in Sweden regarding the diagnosis of schizophrenia.17 Satisfactory validity of schizophrenia diagnoses in a small sample from this cohort has been observed,8 and ICD-8 diagnoses from the register have shown high specificity with criteria for schizophrenia as defined in DSM-III (Diagnostic and Statistical Manual of Mental Disorders, third edition).

However, I shall argue that the paper not only suffers from a failure adequately to control for 'common predisposition', but exhibits positive signs of being compromised by that failure. Along the way, I'll point out some other problems which I consider typical of this research programme, and which in some cases tend to indicate the influence of a certain degree of confirmation bias.

These findings, say the authors, are in keeping with accumulating evidence that cannabis has detrimental effects on mental health in some people

The use of the expression 'In keeping with' may be somewhat revealing. It suggests that conforming to that conclusion is seen as tending to validate the findings presented - the analysis has succeeded! This is related to the phenomenon of publication bias discussed before - in the 'honeymoon' period, the only interesting finding is one that appears to support the promising new hypothesis. Given that an ongoing longitudinal study permits re-analyses of what is for the most part the same previously analysed data, one must hope that no prejudice has been allowed to influence the choice of refinements to the analysis.

So, what did this study (one of many derived from the same data set), find? Let's look first at the summary (which is all that most people who cite the paper will probably read):

Results: Cannabis was associated with an increased risk of developing schizophrenia in a dose dependent fashion both for subjects who had ever used cannabis (adjusted odds ratio for linear trend of increasing frequency 1.2, 95% confidence interval 1.1 to 1.4, P<0.001), and for subjects who had used only cannabis and no other drugs (adjusted odds ratio for linear trend 1.3, 1.1 to 1.5, P<0.015). The adjusted odds ratio for using cannabis >50 times was 6.7 (2.1 to 21.7) in the cannabis only group. Similar results were obtained when analysis was restricted to subjects developing schizophrenia after five years after conscription, to exclude prodromal cases.

These result mentions dose dependence: this is regarded as a key concept in assessing causality (though not by any means either necessary or sufficient to establish it) in contexts such as this. The 'adjusted odds ratio for linear dependence' is meant to be a summary measure of the differences in odds between members of any one usage category and those of the one immediately above it.

The higher figure for this linear relationship between 'dose' and frequency of schizophrenia - 1.3 - comes from the subset of data that relates to those who had not reported taking common illegal drugs other than cannabis. The idea of separating out this data is not made entirely explicit - but would seem to be aimed at eliminating any confounding by use of other drugs such as methamphetamine. If that is the case, then such a decision ought to be committed to before running analysis. Instead, the approach seems to have been: analyse both sets of data , take a sneaky peek, and only then decide which one to draw attention to. Such an approach would utterly undermine the evidential validity of any findings. The figure of 6.7 has been cherry-picked on this basis, the corresponding figure for all drugs (3.1) not being reported.

Anyway, let's take a look at the figures from which this linear relationship is derived, using odds ratios for each usage category as adjusted for some potentially confounding factors.

Cannabis only

 Cannabis use  odds ratio
 None          1.0
 Once            -[*]
 2-4 times:    1.9
 5-10 times    1.7
 11-50 times   0.8
 >50 times      6.7

[*no instances of schizophrenia - dividing by zero means the sums won't work, but intuitively the probability would, if anything, come out as zero]


I don't think anyone is going to suggest that this is a series from which one would expect to derive a finding of a positive linear relationship indicating dose-dependence. The central portion of the series suggests a flat or gently declining relationship, assuming - charitably - that the '11-50' figure is a fluke, as the confidence interval (0.1 - 6.9, reflecting the fact that the result derives from a single instance of schizophrenia) might suggest. However, the cardinal rule of statistical evidence - as opposed to exploratory analysis, which should be clearly labelled as such - is that you don't second-guess the results of the predetermined analysis, so if the authors have followed this basic methodological precept, one must accept this result as one finds it, simply noting that the 95% confidence interval covers the range from 1.0 to 1.5.

(As with most of these studies, I wouldn't have started from here. Distinguishing between 'once, '2-4 times' and '5-10 times' seems to impose at least one more distinction than any real differences could justify.)

The one figure which (or rather the data underlying which) is clearly responsible for the finding of a positive linear relationship is the last one - 6.7. Indeed, as we've seen, this figure is reported on its own, so impressive is it. Since the authors of the paper seem happy to give this figure special attention rather than sticking to (what one hopes was) the predetermined plan of calculating a linear relationship, I'll feel free to take an exploratory rather than evidentiary approach.

As we've seen, this is more than twice the corresponding figure for those who had taken other 'street' drugs. But the point of excluding poly-drug-users was to remove a source of confounding - that is, use of other drugs is expected to be associated with increased statistical risk:

The association between cannabis and schizophrenia persisted even after adjusting for use of alcohol, cigarettes, and other drugs, all of which are likely to be indicative of risk taking behaviour. This implies that a shared risk factor (be it biological, genetic, or through personality traits) for developing schizophrenia and for using psychoactive substances does not adequately explain the association observed.

Yet the finding is that risk - for the heaviest use category - is much lower in the 'any drugs' group.

What could account for this? It seems vanishingly unlikely that taking other drugs would directly halve the risk. So, clinging as we must to the idea that the figures are meaningful at all, we can only conclude that there is something else about those who take only cannabis that increases their risk level. It's not - so far as the data can tell us - that they take more cannabis.

The authors do not mention this point, despite drawing special attention to the result - a result which as we've seen, Murray subsequently touted in the press. Why not? Surely some comment is called for in the course of this - exploratory and speculative - discussion of a single figure.

One important possibility is that the behaviour pattern of using cannabis relatively heavily without trying any other drugs is associated with personality traits or other psychological factors which are precursor or prodromal forerunners of schizophrenia, or otherwise associated with it. In other words the data suggests that the common predisposition hypothesis would be worth investigating.

The authors recognise that common predisposition is an important possibility which needs to be addressed. They do not join me in speculating that this specific pattern of use might be especially relevant, nor that further investigation would be in order - common predisposition, for a true believer like Murray, is a possibility to be eliminated, not entertained.

So in an attempt to eliminate common predisposition as a factor, the authors re-run the analysis deleting all those subjects diagnosed with schizophrenia within five years of the initial survey in which drug use was assessed.

But this branch of the analysis did not exclude subjects who had used drugs other than cannabis. One wonders why this should be, since the point of that exclusion was supposed to be to control for the confounding effects of such poly-drug use. The appearance is of sleight of hand. Open the left hand - nothing in here. A bit of fumbling behind the back, and - nothing in the right hand either!

But perhaps the authors forgot to try this analysis on 'cannabis only' data. I must point out for the benefit of suspicious observers that there is no evidence to suggest that they did try it, but gave in to the ever-present temptation to discard inconvenient - too low, or implausibly high - results as 'anomalous' or 'implausible'. I would caution against even suggesting that this may have happened, since not only would that invalidate these results, but it would tend to cast a long shadow of impropriety over all the authors' work in this area.

In any case, the authors say Similar results were obtained when analysis was restricted to subjects developing schizophrenia after five years after conscription, to exclude prodromal cases ('prodromal cases' here corresponding to what I refer to as common predisposition).

So how similar were those results? Here are the results in which the dependent variable (schizophrenia diagnosis) is not stratified according to time of diagnosis (remember, this is data that includes those who had taken other drugs):

Diagnosis at any time:

Cannabis use    odds ratio
Once            0.6
2-4 times       0.9
5-10 times      1.4
11-50 times     2.2
>50 times       3.1

 Linear trend for frequency of use: 1.2

And here are the results from which subjects diagnosed within five years are excluded

Diagnosis after 5 years:

Cannabis use    odds ratio
Once            0.8
2-4 times       0.9
5-10 times      1
11-50 times     2.1
>50 times       2.5

Linear trend for frequency of use: 1.2

This time, a sanity check by inspection of the adjusted figures appears to confirm - rather than flatly contradict - the proposed linear relationship, at least. Notice though that according to these odds ratios, taking cannabis up to four times actually appears to be associated with a reduction in chances of being diagnosed with schizophrenia. But of course no-one is going to suggest that a low level of cannabis use might protect one from schizophrenia!

But note too that notwithstanding the authors' description of the findings as 'similar', the odds ratio is lower in the second data set. Where has that effect size gone? Well, obviously it's lurking in the data that was excluded. Although they choose not to draw too much attention to it in their executive summary, the authors also ran the analysis for data that excludes those diagnosed after five years. That is, they looked directly at those cases diagnosed within five years, in which - and this is the whole point of this part of the analysis - common disposition is considered to be a potential factor. Let's have a look at that data.

Diagnosis within 5 years:

Cannabis use  odds ratio
Once          -
2-4 times     1
5-10 times    2.6
11-50 times   2.8
>50 times     4.7

Linear trend for frequency of use: 1.3 

We can see that the effect sizes are indeed substantially higher than the data for diagnosis at any time. This is a group which the authors themselves chose to sequester as potentially subject to confounding or reverse causation arising from a 'common predisposition' effect. They give the clear impression that this stratification of the data has no significant effect (comparable results were 'similar' despite it). And yet this is not the case. There appears to be a substantial difference here, which confirms that the main analysis and thus the results reported, does not adequately control for common predisposition.

The authors of course must have noticed this, and without directly acknowledging that an explanation for the result is required, they quietly provide one anyway: [UPDATE 19 JUL 2011 10:38: this is inaccurate - they do provide a different explanation, though it has its own problems. A section will be inserted here shortly, explaining the slightly intricate complications involved. The substance of the following criticism still applies.]

[UPDATE 22 JUL 2011:

At least it seems to confirm this, if we accept that the whole point of this analysis is to check that common predisposition has been eliminated as a factor. If this is a test which can eliminate but not establish the presence of this source of error, it seems a handy kind of test.

Certainly the authors explain this finding away:

The association between use of cannabis and schizophrenia was stronger in subjects who were first admitted within five years of conscription. One explanation is that subjects with a prodrome of schizophrenia at conscription may have increased their cannabis use, perhaps as a means of self medication. But all subjects were screened at conscription, and we adjusted for other psychiatric problems recorded at that time. The relation with cannabis use was also observed in the later onset group, admitted more than five years after conscription. It seems more likely that the reduced association in the group with later onset is due to misclassification, as the number of people who discontinued cannabis use accumulated over time.

The authors mention common predisposition as just 'one explanation' despite the fact that testing for that phenomenon was the whole point of the exercise. They then provide reasons for disregarding the possibility: but if those reasons were good enough, there would have been no point in performing the exercise of stratifying by time of diagnosis. The actual explanation offered for the difference in the figures would actually be quite a convincing one - except that no attempt is made to quantify the effect (discontinuation of cannabis use) suggested, so it is impossible to determine how large the difference would have to be before the authors would accept that their data had failed the test - a test they specifically introduce - for robustness to the hypothesis of common predisposition.

These observations expose the analysis as dodging one of the main issues which need to be addressed, and which it purports to address, and thus to have greater validity than past studies. The explanation offered for this failure is not substantiated, and consists of the hypothesis that since initial data gathering, there will be a tendency for cannabis use to drop off over time. In the absence of any evidence to support the applicability and extent of such an effect, though, the explanation is of doubtful import.

The authors also discuss the major problem of inadequate data in more general terms. One might well have concluded at the design phase that the data has simply not captured sufficient information for further attempts at extracting a conclusion to be worthwhile. The authors instead state rather baldly that the poor quality of the data is not likely to be a problem:
]

We are limited in that we have only data regarding use of cannabis before conscription. But if the pattern of increased initiation and reduced cessation of drug use seen in the schizophrenia group persisted after the time of conscription, this would result in us underestimating the effect size of cannabis.

And again:

Fewer subjects in this cohort claimed to have used cannabis and other illicit drugs compared with similar cohorts that used anonymous questionnaires. The effect of under-reporting would again result in an underestimate of the true effect size.

Does this amount to anything more than special pleading? Are the authors just saying that since this data is not much good, the inconvenient result is not to be trusted, while other results are sound? Certainly the fact that the problem is explained away so cursorily (in fact, not only explained away but even described as tending to strengthen the findings!) leaves something to be desired.

What is the schizophrenia group, in which it is suggested the pattern of increased initiation and reduced cessation of drug use...[might persist]...after the time of conscription? The authors seem, despite themselves, to be saying that those who will turn out to be diagnosed with schizophrenia are more likely to start and less likely to stop using cannabis - that is, that the schizophrenia outcome determines the degree of cannabis use. This is how one would frame it if one were to presuppose reverse (schizophrenia -> cannabis) causation, or more generally the common disposition thesis. These people are going to get schizophrenia, therefore they are more likely to use cannabis.

That is the only justification for supposing that unmeasured cannabis use would be found to be greater among the 'schizophrenia group' than among the rest of the sample. Without that assumption - an assumption directly at odds with the authors' claim to have eliminated this source of error - there is no justification for supposing that the unknown data would strengthen the findings.


Transient effects of cannabis

Murray also had a hand in in one rehashing of the data from the Dunedin multidisciplinary health and development study conducted in New Zealand: Arseneault et al., 'Cannabis use in adolescence and risk for adult psychosis: longitudinal prospective study'

The study attempted to control for the common predisposition effect by the inadequate method of examining self-reported 'psychotic symptoms' at age 11. I won't go into this further.

The more interesting aspect of the study is in the measurement of outcomes other than clear diagnoses of schizophrenia. The paper states:

Logistic regression analyses showed that people who used cannabis by age 15 were four times as likely to have a diagnosis of schizophreniform disorder at age 26 than controls. After psychotic symptoms at age 11 were controlled for, the risk for adult schizophreniform disorder remained higher among those who used cannabis at age 15; however, this risk was reduced by 31% and was no longer significant.

'Schizophreniform disorder', as I understand it, differs from schizophrenia in that it is diagnosed on the basis of a single month's symptoms, and is less serious in terms of functional impairment. It is often an interim diagnosis in reponse to early stages of schizophrenia, but one third of those diagnosed with schizophreniform disorder do not develop schizophrenia. This is an instance of the slippage in severity of measured outcomes which I mentioned in the previous post, and which would tend to, in a memorable phrase, 'hide the decline' in effect sizes. Still, this is a relatively unimportant point.

Rather, the key issue here is that After psychotic symptoms at age 11 were controlled for... - that is, once the statistical analysis was completed - ...this risk was reduced by 31% and was no longer significant.

Statistical significance is, as the name suggests, the sine qua non of statistical inference - and again, this is only based on a crude and inadequate control of 'psychotic symptoms' at age 11.

Having failed to find an increase in risk of schizophreniform disorder, the authors turn to other symptoms:

Multiple linear regression analyses showed that cannabis users by age 15 and by age 18 had more schizophrenia symptoms than controls at age 26 (table). These results remained significant after psychotic symptoms at age 11 were controlled for. The effect was stronger with earlier use.

Looking at the table of results, it uis clear that just as in the case of the Zimmer study examined above, two different sets of factors were adjusted for: here, other drug use, and self-reported psychotic symptoms at age 11. And just as in that study there seems a curious coyness about adjusting for both factors together. But the key point here is that these statistics were based on a study which assessed psychiatric symptoms at age 26 with a standardised interview schedule to obtain DSM-IV (diagnostic and statistical manual of mental disorders, 4th edition) diagnoses

This sounds impressive, but in fact what it means is that the data was gathered by lay interviewers using a standardised diagnostic checklist. Such a checklist aims to gather sufficient information for a statistical algorithm to generate diagnoses, without the need for the opinion of a medic. In order to do this, many minor and peripheral 'symptoms' are included. This is useful if these symptoms are properly weighted and then tested against a threshold to determine the presence or absence of a certain condition (one may certainly question the validity of this approach to diagnosis, but that is not my point here). It is not however very useful when the individual symptoms are counted outside the diagnostic framework, and used to determine degrees of schizophrenia-likeness. That project is deeply questionable - it is not too much of a simplification to say that we are dealing with diagnosing people as being 'a little bit schizophrenic'.

The specific problem with this approach is that many of the minor 'symptoms' or indicators are likely to be slightly better represented among those who are under the influence of cannabis, or have been so recently, or are such heavy users that their daily functioning has become impaired in ways that have no connection to schizophrenia. This was not controlled for in this study, and given that we are talking about very small numbers and marginal statistical trends, seems highly likely to have provided false positive findings of schizophrenia-likeness.

This concludes my remarks on scientific evidence of cannabis-related harm, for this round of debate anyway. In the following paper, I will address moral and policy arguments, including Hitchens's own non-scientific theories about certain social harms which he attributes to cannabis.

21 comments:

  1. If legalisation could, in some possible world, be shown definitively to reduce cannabis consumption would Peter Hitchens be in favour of it. If not, what would be the basis of his objection to legalisation. Also, would Tim Wilkinson regard a decline in cannabis reduction, either by prohibition or legalisation as a desirable social goal.

    ReplyDelete
  2. Regarding your analysis of the Zammit paper:

    "The idea of separating out this data is not made entirely explicit - but would seem to be aimed at eliminating any confounding by use of other drugs such as methamphetamine."
    But that is exactly the reason. This is made clear by the paper's introduction. The point of isolating the "cannabis-only" group is to answer the many, many objections made by other researchers after the publication of the original paper in 1987. This is not cherry-picking - it's a response to criticisms made long before this paper was written, criticisms that have led other researchers to call the Andreasson results "unconvincing" and "inconclusive".

    "The one figure which (or rather the data underlying which) is clearly responsible for the finding of a positive linear relationship is the last one - 6.7."
    I do not know why the authors have attempted to find a linear relationship, but I can tell you that 6.7 is the figure of greatest interest. It refers to people who have used cannabis on more than 50 occasions... not per month, or per year, but across their lifetimes. Any regular user will easily reach this figure. If you smoke one spliff per week, you get there in under a year.

    "Yet the finding is that risk - for the heaviest use category - is much lower in the 'any drugs' group."
    I can't find this 'any drugs' data. Which table are you referring to? Perhaps you mean Table 2 - users of cannabis including users of other drugs, developing schizophrenia any time after conscription.

    If so, remember that these are confidence intervals, not exact values. The interval for "heavy use" in Table 2 is 1.7 to 5.5. The corresponding interval in Table 5 is 2.1 to 21.7. There is significant overlap. If 3.1 was the true figure, then that would still be consistent with Table 5. Table 2 has a narrower confidence interval because there is more data; Table 5 has less data specifically because critics of the Andreasson study have complained about confounding variables. So there is less confidence. But the result still confirms the original finding that cannabis is most probably dangerous.

    "Does this amount to anything more than special pleading?"
    I interpret that part of the paper as self-criticism. You will find the same thing in the 2009 study by Frisher et al. which gives the sort of result you want to see. (I'd be interested to know if you consider that work reliable.) Naturally no research of this type can be perfect.

    May I ask you a personal question... do you smoke cannabis? If not, why not?

    ReplyDelete
  3. that is exactly the reason. This is made clear by the paper's introduction

    Yes - clear enough, which is why I say it, and why I proceed on that basis - but not explicitly stated.

    I do not know why the authors have attempted to find a linear relationship

    I do - it's in the attempt to establish 'dose-dependence' which is one of the standard epidemiological criteria for a finding of causation. I would agree (and I state in the text) that the usage categories seem too finely made. Se below for comment on the 6.7 figure.

    Perhaps you mean Table 2

    I think it's pretty clear from the context - if not, well guessed.

    these are confidence intervals, not exact values...If 3.1 was the true figure, then that would still be consistent with Table 5.

    That's special pleading if ever I saw it. 'Consistent with' in many circumstances, including this one, is a pretty good indicator.

    There are, after all, exact values for the best estimate. The confidence interval just gives us a rough indication of how good (precise) an estimate it is. It doesn't provide extra leeway for finding consistency. The probability distribution over intervals within that range is not going to be be flat, and it's very unlikely that the 'true value' is going to be near the extremes.

    Since you mention it though, the headline 6.7 figure, the one you describe as 'of greatest interest', and the one that Murray is so attached to, is indeed very imprecise. It also falls well outside (above) the 95% confidence range for the unstratified data - which, if anything, should be an overestimate.


    Table 5 has less data specifically because critics of the Andreasson study have complained about confounding variables well, other drug use could have been included as one or more covariates in the regression analysis, rather than as the basis of a binary stratification. I don't know whether this would have introduced any greater confidence/precision into the findings, but it would at least be consistent with the way other confounders were treated. Why wasn't it done that way?

    I interpret that part of the paper as self-criticism.

    The first sentence is, yes. The next one (starting with 'But') claims not just that the lack of data is not too much of a problem, but that it should be interpreted in the authors' favour: the effect would actually have been stronger had better data been available - and it is claim that which I criticise.

    Thanks for raising this, though: I need to make a correction and add some further comment there. I've flagged up the relevant section and will complete the amendment after I've got section 3 out of the way.

    ReplyDelete
  4. To be clear - I think - concede, admit - that you're right to challenge my description of those remarks as special pleading aimed at explaining away the lower figure for late diagnosis.

    My criticism of that claim still stands as a merely ad hominem point, though.

    I'll (try to!) make that clear in the correction when I can.

    ReplyDelete
  5. "it's in the attempt to establish 'dose-dependence' which is one of the standard epidemiological criteria for a finding of causation."

    Ok, I understand now. Thankyou.

    I think that the researchers must have been quite limited by the nature of the source data. As it appears we can both agree, the scale (once, 2-4, 5-10 etc.) is not much good, and in any case determined by self reporting. The quality of the relationship suffers because the dose is unknown. And yet, what else could be done? The surveys cannot be redesigned.

    However, not everything about the Swedish study is limited. It involves more people across a longer time period than any other study. Even if the evidence for a dose-dependent link is weak, there is certainly enough here to worry any "heavy" user. And as we know, "heavy" users is a broad category.

    "other drug use could have been included as one or more covariates in the regression analysis, rather than as the basis of a binary stratification"

    Point taken. Yes, it's not clear why they did not do this. But I don't know if we can assume that it's because of some sort of preconceived intention to get a particular result and thus "hide the decline" as it were. It may simply make the results clearer.

    Experimenter bias works in two directions and I suspect that quite a few researchers have a personal or political interest in debunking the Swedish study. This is one reason why I am interested in your impression of Frisher's paper: http://www.ukcia.org/research/keele_study/Assessing-the-impact-of-cannabis.pdf

    ReplyDelete
  6. the researchers must have been quite limited by the nature of the source data

    - but they had to go ahead in order to answer the critics of Andreasson. there does seem to be a shortage of data that is (a) good, (b) capable of generating a finding of Rm-causation; not for want of well-funded efforts to get some.



    - my point is that there isn't.

    it's not clear why they did not do this.

    you can say that again - also not clear why they performed two different stratifications separately.

    I don't have time to look into Frisher but I'm not aware of specific suggestions of what might be wrong with it. At a first glance, it does at least have the merit of not doing a lot of torturing of the data, unlike Ajdacic-Gross et al., Changing incidence of psychotic disorders among the young in Zurich, which Murray popped over to help out with. That does some pretty cruel and unusual stuff with diagnostic data, then hurriedly summarises some cannabis usage figures and makes no attempt to combine the two sets of data. If I were to look at any other papers in detail, I think I'd do this one first, since a first look suggests it could be almost entertaining.

    BTW a friend suggests I clarify that the admission I make in comments above is of a very minor nature, since, as he points out, though I can't really believe it, some people might not have read the whole thing very closely.

    ReplyDelete
  7. In that gap should be: there is certainly enough here to worry any "heavy" user, to which I reply oh no there isn't in best panto style

    ReplyDelete
  8. Well, I was a heavy user, and I can tell you that there was certainly enough there to worry me.

    This was not the only paper I looked at, either. I looked at a paper by Dagenhardt et al in Drug and Alcohol Dependence (71 (2003) 37-48), which uses statistics about the Australian population to demonstrate that increasing cannabis use did not lead to an increase in psychiatric problems. This is essentially the same idea (and the same result) published by Frisher, except that Frisher's work covered Britain.

    It would be so convenient if Dagehardt and Frisher were right, but they make so many assumptions, relying on models derived in opaque and peculiar ways. It is like the sleight of hand that you reference above - whatever is really happening, it's being obfuscated by models and overcomplicated analyses. And they specifically target the Andreasson results, as if their only purpose was to discredit them, rather than find out the truth. (If a scientific fraud conspiracy led by Robin Murray is possible, then why not another even greater conspiracy against him?)

    I think if you were to apply the same level of analysis to these papers, you would find them similarly lacking. Certainly as a regular user, and keen to be convinced that there was nothing in this "Reefer Madness 2.0" thing, I found them most unsatisfying.

    But this has something to do with why I asked you if you use it yourself. I think if you do smoke it, then you're already aware that there are quite unpleasant short-term side effects even after the high has finished: trouble concentrating and remembering things, for instance (well-documented in scientific literature). It seems a bit incredible that these short-term side effects never precede something more permanent and serious.

    But if you don't use it, the question is "why not". If it's safe, moral, shouldn't be illegal, and it's fun, then why not enjoy yourself? What have you got to lose?

    ReplyDelete
  9. OK then - can you get me some?

    ReplyDelete
  10. Regarding Degenhardt et al. (please provide links to sources), you aren't very specific about what is wrong with it and your characterisation of their approach seems entirely incorrect, as far as a quick read through shows.

    To my - again fairly quick - inspection, it looks like rather a good paper in fact, so I'm curious as to why you describe it as you do.

    I can't see any basis for the description of opaque and peculiar ways of dealing with the data, since they use simple formulae which they provide in an appendix - nor, so far as I can see, is there any sign of the authors targeting Andreasson, as if their only purpose was to discredit them, rather than find out the truth.

    In fact I had to double-check that I was looking at the right paper.

    I also don't endorse your unfounded 'think it possible that...' suggestion of a scientific fraud conspiracy, which would of course be an extremely serious and damaging allegation.

    For the avoidance of doubt: no such allegation is endorsed by this site, and I would stress to readers that no evidence at all has been provided to substantiate any such claim.

    Do you even have any positive reason at all to think that those involved in these studies are subject to bias, let alone scientific fraud?

    I'm sorry if you found the short term effects of your reported heavy/regular cannabis use unpleasant, but I don't see that the anecdote and your accompanying assessment of what is credible has any relevance to the issues under consideration.

    I suppose it's obvious, but cet. par., I'd certainly advise people not to take a substance if they don't like the effects.

    ReplyDelete
  11. Then perhaps you should revise some of the following:

    1. "both of which have Murray's fingerprints on them"
    2. "common predisposition, for a true believer like Murray, is a possibility to be eliminated, not entertained"
    3. "Murray also had a hand in in one rehashing of the data from the Dunedin multidisciplinary health and development study conducted in New Zealand"
    4. "At a first glance, it does at least have the merit of not doing a lot of torturing of the data, unlike Ajdacic-Gross et al... which Murray popped over to help out with."

    I'm not sure exactly what you intended by these statements, and maybe you could clarify it, but the implication is that Murray was looking for a specific result, would "help" other scientists to get it, would "rehash" things and would leave his "fingerprints" everywhere in the process. Are these merely figures of speech?

    "Do you even have any positive reason at all to think that those involved in these studies are subject to bias, let alone scientific fraud?"

    Bias, yes, because their results contradict those from Sweden. Therefore, the results from Sweden are wrong, or the Dagenhardt/Frischer results are wrong, or all of them are wrong.

    Fraud, no. You are the one who suggested bias in the first place, not just with your comments about Murray, but also with your quotes from the press regarding "a merely illustrative example of the context in which this research is proceeding", and your suggestion that "sleight of hand" has been employed to emphasise particular results.

    I'm pointing out that this process goes two ways, and if you think that a scientist can be a "true believer" in the danger of cannabis, then surely another scientist can truly believe that there's nothing to worry about, yes?

    And an anecdote? Maybe this has no relevance to the evidence, but I think it's quite nicely highlighted that your knowledge of this substance is purely academic. Are you sure you should be advocating the legalisation of something that you know so little about?

    ReplyDelete
  12. Then perhaps you should revise some of the following...[etc]

    No - I am quite clear that Murray seems to be overly attached to the RM-causation hypothesis. I provide reasons for others to evaluate, in particular his choice to write polemical articles in the press citing inflated figures.

    FYI - "help" and "rehash" aren't figures of speech; "fingerprints" is.

    Bias, yes, because their results contradict those from Sweden. Therefore, the results from Sweden are wrong, or the Dagenhardt/Frischer results are wrong, or all of them are wrong.

    But even on that oversimplified characterisation, this wouldn't provide a reason to suppose any of them are biased, still less any identify which one.

    Fraud, no. - OK, good, so you've abandoned talk of scientific fraud conspiracy.

    As to You are the one who suggested bias in the first place, you mention:

    "a merely illustrative example of the context in which this research is proceeding"

    Key word: example. I provide the text and explain what I think it suggests.

    "sleight of hand"

    That's: 'the appearance of sleight of hand' - offered as a description of a specific example, which is provided, along with my reasons.

    I'm pointing out that this process goes two ways, and if you think that a scientist can be a "true believer" in the danger of cannabis, then surely another scientist can truly believe that there's nothing to worry about, yes?

    As the previous post points out, and I've been reiterating, ascribing or suggesting specific faults offering substantiated reasons for doing so is OK; chucking around the mere possibility of error in the hope that it sticks isn't.

    I'm doing the first one and you appear to be doing the second.

    ReplyDelete
  13. Let me try to follow your reasoning again. You have made an absolute statement. You have said that there is nothing here to give a heavy user any cause for alarm.

    Why do you think this? Apparently, because the best papers that show there *is* a risk are "compromised" by various problems, which you "consider typical of this research programme", and identify in your article. I don't dispute that the research has problems.

    Despite many years of attempts to deal with the very issues that you have raised, the ability to do so convincingly still eludes the researchers, and whether the claim is 3.1 times or 6.7 times, it is most likely not even in the right ballpark.

    Having reached that conclusion, you make an apparent logical leap, from "this specific evidence for harm is invalid" to "in general, there is nothing to worry about".

    I've tried to suggest why you might be wrong about this, using a few different approaches:

    1. That research supporting the "nothing to worry about" hypothesis may also have problems. Does it properly consider dose dependence? Does it rely on an assumption that the provision of GP/psychiatric services remained constant? Does it overestimate the degree of increase of cannabis use? Has it taken all confounders into account? Has it rejected "anomalous" or "implausible" outliers? etc.

    2. That the drug is powerful, and it would be surprising if it did no harm at all, and that you may not personally be aware how powerful it is. Do you know of any other substance that has all the positive features you ascribe to it in your article of 19/07/11, but does no harm at all? It seems implausibly miraculous.

    3. That confirmation bias and the search for a particular result can affect any research, including research that confirms your own opinion. Why believe one paper and not another? Because one paper is better written than the other? Or does it simply *appear* to be better, because it says what you wish to read? Note here that I am not accusing you (or anyone specific) of being biased! I am merely *suggesting* that *some* people's evaluation might *possibly* be influenced by bias.

    It seems that these objections are not enough to trouble you. Well, that's life. Part of me would be quite pleased if you were right, but I suspect that (as in so many other matters) the truth is not so convenient. Curiously, even NORML have stopped claiming that there is no link with psychoses (http://norml.org/pdf_files/NORML_Cannabis_Mental_Health_Context.pdf) and no scientist appears to be willing to make such an absolute "nothing to worry about" statement, preferring instead to say "little evidence" or "unconvincing evidence".

    Thankyou anyway for allowing me to respond here.

    ReplyDelete
  14. "Having reached that conclusion, you make an apparent logical leap, from "this specific evidence for harm is invalid" to "in general, there is nothing to worry about"."

    Where is this leap made and why are there quote marks around the two statements. I can't find those statements you are claiming were made by Tim Wilkinson.

    ReplyDelete
  15. Those aren't quotations and I don't claim that Tim Wilkinson used those exact words. Those phrases have been marked with inverted commas in order to emphasise their status as distinct concepts within the sentence. The intention is to express ideas as clearly as possible in a small space. If you would like to suggest an alternative way of structuring that sentence which is both clearer and shorter, please do.

    The first of these phrases characterises Tim Wilkinson's analysis of the evidence in two research papers, i.e. the main article. I hope that it is a fair characterisation of that article.

    The second of these phrases characterises Tim Wilkinson's statements of 20 July 2011 10:36 and 10:41, in addition to his overall conclusion that cannabis should be legalised. In particular:

    "In that gap should be: there is certainly enough here to worry any "heavy" user, to which I reply oh no there isn't in best panto style"

    Again, if "in general, there is nothing to worry about" is not a fair characterisation of Tim Wilkinson's view, then I will stand corrected. Though if there is something to worry about, or the Zammit paper's evidence is valid, then I'd question why he is advocating legalisation.

    ReplyDelete
  16. You've missed the relevance of the word "here" in the quote from TW - which makes all the difference when it comes to your characterisation of his position.

    ReplyDelete
  17. No. Consider the context. Tim Wilkinson also said (next article):

    "I do not believe any harmful effects to the user that might plausibly be discovered would be a sufficient justification for bringing to bear the power of the state to criminalise the possession and use of cannabis. Nonetheless, for those who disagree or whose attitude to cannabis has otherwise been shaped by highly exaggerated warnings, I've explained my reasons for thinking that the mental health risks from taking cannabis are minimal."

    As I said, I still think that "in general, there is nothing to worry about" is a fair way to paraphrase that. If this is truly wrong, then Tim Wilkinson should correct me.

    ReplyDelete
  18. Julia may of course worry as much as she likes about anything she chooses.

    I'm not interested in playing this game where Julia puts words in my mouth and I work out whether I'm happy with all their implications and if not, explain why not.

    I think the point here is that the accusation of making a 'logical leap', or indeed an apparent logical leap, is false.

    ReplyDelete
  19. Uk government has allowed the production of cannabis, weed and hemp to some extent when the guidelines are met. These naturally grown plants are used in medication and cosmetics. However, it is always recommended to use them after consultation with a pro. Here are some of the best cannabis, weed and hemp you many like to buy: https://greenbudhouse.net

    ReplyDelete
  20. nice post, keep up with this interesting work. It really is good to know that this topic is being covered also on this web site so cheers for taking time to discuss this!
    BUY MARIJUANA ONLINE

    ReplyDelete
  21. Buy cannabis online UK, We are located in Manchester, England, UK. Clients all over Europe can safely buy marijuana online UK, from us as we have the best quality Weed for sale. Buy weed online, Cannabis oil sale, Order weed online UK, buy cannabis online UK. All you need to do is contact us through +447898545641 or simply click on the link https://greenbudhouse.net/

    ReplyDelete