If you wanted to market AI therapy such as ChatGPT, the developers should follow NHS Talking Therapies lead:
- Make what you are trying to measure is opaque/fuzzy e.g difficulties
- Re-administer the same measures (PHQ-9 and GAD-7) some time later
- Wait until there is a large reduction in score
- Claim that this person has recovered or at least moved in the direction of recovery
Repeat the analysis a million plus viewers. You can then present the case that AI works. Further that as NHS Talking Therapies cannot refute the claim, they should move over and make space for the cheaper more accessible AI – hoisted by their own petard.

Haemorrhaging at NHS Talking Therapies
1.81 people contacted NHS Talking Therapies , according to the latest annual report https://www.google.com/goto?url=CAEStgEB6zswFbaxup-Ub0l-S3XIZberh7NvPgVk0BN6i2g3_VDsWmCEQuNeY8DtHkI7s3_6fYlwBwBiJrB7yRx3c1RHq7TJ_8VQm5050UN7KeKlGs9AbZsPAzZp9eng1tbfYevALTl5xUiVcz_TL0W_WJS1G6veme5UnBm1Iq-NzyPvubSEbqxtwcdzTbcly5bDayHbIQEZQADJARLdRaTN4Y6kThugiA5xTO95WrZy3bX8nmEG_EQShg but only 1.17 million accessed the service (presumably this means actually attended an appointment). So 0.64 million were lost to the Service i.e 35.4%. Thus approx a third of people go into the NHS Talking Therapies Shop and leave without any engagement.

674,683 completed treatment (2 or more sessions). Of those who attended an appointment (1.17 million) 495,317 did not complete treatment i.e 42.3 % . Thus NHS Talking Therapies alleged 50% recovery rate, applies to approximately the half of people who complete treatment.
NHS Talking Therapies ‘Works’ For a Fictitious Disorder!
Of the completers 642,940 that had an initial PHQ 9 at 10 or above (caseness) their mean score reduced from 15.4 to 9.4, an effect size {ES) of 1.1, but for those with depression the ES was 1.4, for those with PTSD the ES was 1, for OCD 0.8 and for BDD 1.1, For mixed anxiety and depressive disorder the ES was 1.1. But there is no evidence based treatment for this ‘disorder’, it h as never been the focus of NICE. This suggests NHS Talking Therapies is not measuring anything real, it is simply picking up noise in the system that changes over time.
Most Will Get A Bit Better With Time
Whether it be those treated by ChatGPT, NHS Talking Therapies or attendance at the Citizens Advice Bureau. It is simply time, attention and expectancies that are responsible for the change, nothing to do with the alleged CBT that has been conducted.

Treatment integrity checks have never been implemented in NHS Talking Therapies.
D r Mike Scott








