Science?
Dinah of Shrink Rap, left a comment on my previous post about the study on telephone therapy :
"I ranted about this on Shrink Rap
Hard for me to see it as 'science'"
So I hied myself over to her blog and read her rant, which indeed it was. First, she responds to it as merely a blog post, appearing as it did on the NY Times health blog. Perhaps she was unaware of other sources reporting on the study, including this release from Northwestern University, where the study was done. And she says:
It's a blog post, not a rigorous scientific article, but I'm going to start by saying I thought the post is irresponsible. That feels strong, and I'm an avid Well reader, but it's full of all these blanket statements, given as facts, with nothing that backs them up. There's a link to an abstract, and an email to request the full article, but I'm going to note that the abstract also gives very little information about the methods used and the conclusions reached. I didn't write for a copy of the full article (I will) -- maybe it was great science that warrants the conclusion that phone therapy for depression is as good as live therapy, but it's hard to get there from either the blog post or the abstract. Stay tuned: we'll use the full article for a future My Three Shrinks podcast.
Well, I took the time this morning to return to the Northwestern site and re-read the article there and I am reproducing it in its entirety here:
CHICAGO -- The problem with psychotherapy has long been that nearly half the patients quit going after a few sessions. Therapy can’t work if patients stop coming to the therapist’s office.
But a new meta-analysis has found that when patients receive psychotherapy for depression over the phone, most of them continue with the therapy.
Researchers from Northwestern University's Feinberg School of Medicine have taken the first "snapshot" of telephone-administered therapy studies around the country. Telephone therapy is becoming more widely used by health care providers and employee-assistance programs.
The new study found that the average attrition rate in the telephone therapy was only 7.6 percent compared to nearly 50 percent in face-to-face therapy. The telephone therapy also was effective in reducing depressive symptoms with results that appear to be similar to face-to-face treatment.
"The problem with face-to-face treatment has always been very few people who can benefit from it actually receive it because of emotional and structural barriers," said David Mohr, professor of preventive medicine at the Feinberg School and lead author of the study, published in the September issue of Clinical Psychology: Science and Practice. "The telephone is a tool that allows the therapists to reach out to patients, rather than requiring that patients reach out to therapists."
Mohr said that of the patients who say they want psychotherapy, only 20 percent actually show up for a referral and half later drop out of treatment.
"One of the symptoms of depression is people lose motivation," Mohr said. "It's hard for them to do the things they are supposed to do. Showing up for appointments is one of those things."
Patients also may not have the transportation or time to travel back and forth to a therapist's office. It may be hard to squeeze an appointment into days already crammed with work, caring for kids or elderly parents or other family obligations.
Telephone therapy seems to transcend all these barriers. Mohr began using telephone-administered therapy because he was working with patients who had multiple sclerosis who could not get to a therapist's office.
Mohr said what’s needed is a definitive study with a randomly selected population of patients that directly compares therapy delivered in the traditional face-to-face manner to therapy delivered over the phone. He has already launched such a study in subjects who receive their primary care from Northwestern's Medical Faculty Foundation. He expects to have results in two to three years.
Mohr's study was supported by the National Institute of Mental Health
Yes, this is a press release, not the full article. No claim was made that it was. And it was the press release which was picked up and reported in a variety of places. But the Times blog did not include that final sentence which I made bold -- the research was supported by the NIMH.
And when I go to the journal, Clinical Psychology: Science and Practice here is the abstract:
Increasingly, the telephone is being used to deliver psychotherapy for depression, in part as a means to reduce barriers to treatment. Twelve trials of telephone-administered psychotherapies, in which depressive symptoms were assessed, were included. There was a significant reduction in depressive symptoms for patients enrolled in telephone-administered psychotherapy as compared to control conditions (d = 0.26, 95% confidence interval [CI] = 0.14–0.39, p < .0001). There was also a significant reduction in depressive symptoms in analyses of pretreatment to posttreatment change (d = 0.81, 95% CI = 0.50–1.13, p < .0001). The mean attrition rate was 7.56% (95% CI = 4.23–10.90). These findings suggest that telephone-administered psychotherapy can produce significant reductions in depressive symptoms. Attrition rates were considerably lower than rates reported in face-to-face psychotherapy."
What one can discern about this study from the abstract suggests it was designed much like most of the studies of CBT. It is a meta-analysis of a number of studies looking at symptom abatement as the measure of success -- and because the whole diagnostic enterprise is based on impression ad self-report, this is as good as used in any other study of therapy -- and looking at attrition rates. So they were looking at 2 variables -- effect on symptoms and attrition rates. And they found that telephone therapy performed well on both. Looks like any of hundreds of studies in psychology and psychiatry that I have seen.
Science does not guide mental health treatment. The DSM is not based on theory or research -- see this post for more on this. Many of those within the field want to believe that what we do is science. But we depend on a nosology based on consensus statements of committees, statements which describe symptoms. There is no "scientific" way to arrive at a diagnosis, no lab tests or x-rays or MRIs or anything measurable. We have questionnaires which rely on inference on the part of the examiner and self-report by the patient. Medications which perform only slightly, when at all, better than placebo are routinely prescribed in the unscientific belief that brain chemistry is the culprit in depression. How is that scientific?
All of us in the field -- psychiatrists, psychologists, social workers and the rest -- practice what we believe. Those patients who share what we believe improve and report the treatment is successful. Those who do not go elsewhere.
People who find telephone sessions valuable find it valuable. Those who don't, don't. That is not science; that is anecdotal evidence. Which basically is all we have to measure outcome. All the questionnaires and similar measures to measure success of any form of treatment rely on patient self-report.
So, I suggest to Dinah, criticize this study because it goes against the grain of your beliefs, that's fair game. But science? In the face of the studies that are emerging about the efficacy of the most commonly prescribed psychotropics, it seems to me to be shaky ground indeed to base objection on "science".

