Make your opinion heard

I need your opinion on a new way to design clinical trials for PSP.  New except that it was invented back in the 1980s.  It’s called “combined assessment of function and survival” or CAFS.

When a drug is tested for its neuroprotective property, traditional trial designs have measured only the slowing of the rate of worsening of function (i.e., symptoms and disabilities).  Most of the neuroprotective studies of PSP are 12 months long.  The progression rate of PSP being what it is, about 15% of people with PSP will die each year.  Trial participants who die during a trial are  dropped from the analysis and the data they generated are wasted. 

For PSP and most other chronic, progressive diseases, one hopes that the experimental drug wouldn’t just slow decline of function, but that it would prolong survival as well.  So why not somehow integrate measures of both outcomes into one combined outcome measure?  That could reduce the size of the trials needed to answer the question, which means less expense for the drug company.  That’s important to you and me because it lower the bar for a small, start-up company with a promising drug to mount a clinical trial.  Could the CAFS method work for PSP? 


Combining survival and slowing of progression into one statistical measure would work as follows:  Patients are evenly assigned to receive active drug or placebo.  At the end of the observation period, each patient is compared with each of the other patients, generating either -1 or +1 points for each patient for each comparison.  A patient receives a point if they have survived the observation period but the comparator patient has not.  A patient receives a negative point for the reverse.  If both have died, the patient receives a point if they survived longer than the comparator.  If both have survived (probably the plurality), whoever has progressed more slowly on the standard disability measure over the observation period receives a point.  So, in a study with 50 patients on active drug and 50 on placebo, the best possible score for each patient would be 99, and the worst, -99.  Then, the average points for the patients on active drug is compared with the average for those on placebo.

Sounds great so far, but here’s the rub:  For PSP, the statistics on the progression and survival dictate that this study design assign 50% of the patients to placebo, which is more than the 33% or 25% placebo proportion for most traditional PSP trials.  Furthermore, the observation period would have to be 2 years long, as opposed to the one year of most PSP trials . By that time, your PSP is likely to be too far advanced to qualify for another trial.

That raises some difficult questions for a prospective study subject: What if the drug works but I’m on placebo for the 2 years?  Would converting to the active drug at that later stage of PSP help me?  What if instead I have the opportunity to enroll in a traditionally designed trial  with only a 33% chance of receiving placebo and an observation period of only one year, but with some unattractive features such as greater risk or discomfort or distant and frequent study visits?

So, here are my questions for you. 

Question 1: Suppose that you’re offered a spot in a trial of an experimental drug – let’s call it “PSP1.”  It’s the only trial available to you for the next 6 months, but after that, there may be other trials.  The PSP1 trial uses the novel CAFS design I’ve just described, with a 50% chance of being assigned to placebo and a 2-year duration.  Assume that the science behind the drug suggests that it might slow the rate of PSP progression by 40%, which is quite a large benefit.  Assume that the mode of administration of the drug, the frequency and distance of the study visits and the likelihood of adverse effects are all quite acceptable for you. Would you want to participate despite the possibility that you might receive placebo and that by the end of the 2-year trial you’d be unlikely to benefit much from any neuroprotective drug?

Question 2: Now suppose that 2 drug trials are available to you and, of course, you can join only one.  The first is the PSP1 trial described just above.  The other, for drug “PSP2,” has only the standard 33% chance of placebo and only the standard 12-month duration.  That shorter duration means that you’re likely to still qualify for another drug trial afterwards. Assume the same 40% potential disease-slowing benefit as PSP1.  But the PSP2 trial has some problems such as a greater likelihood of adverse effects, a difficult administration method, or a greater distance or frequency for the study visits. How bad are those problems?  Assume that if the placebo likelihood and the duration were the same as for PSP1, the problems would make PSP2 half as attractive for you as PSP1.

Here’s a convenient summary of all that for you:

 Trial
 PSP1PSP2
DesignCombined assessment of function and survival (CAFS)Assessment of function only
Duration2 years1 year
Placebo likelihood50%33%
Chance of substantial benefit40%40%
Practical issues (mode of administration, chance of adverse effects, distance to travel, visit frequency)Very acceptableMore difficult, making PSP2 half as attractive as PSP1 if all other things were equal.
Likelihood that you could participate in another trial after thisLowHigh

OK – time to vote.  Using the Comments feature or ligolbe@gmail.com, please answer these 2 questions:

Question 1:  Would you enroll in the PSP1 trial?  YES or NO

Question 2:  Would you choose the PSP1 trial or the PSP2 trial?

Feel free to include any comments or explanation.

4 thoughts on “Make your opinion heard

  1. My brother, who has PSP, votes for PSP 1 trial, because of the inconvenience and difficulty associated with the other option. I would have voted for PSP 2, because it gives him better odds overall (I’m his primary caregiver). If there weren’t more challenges associated with PSP 2 (especially travel), we would both vote for PSP 2.

    • Dear Dr Golbe

      Thank you very much for your contribution and support, this is well appreciated.

      I am a career for my wife who was diagnised with PSP about 2 years ago.

      In response to your questions, I am not sure why there is bias in the question to PSP1 in terms of practical issues, as naturally participants would elect fewer side effects and fewer barriers in almost all cases with prior study knowledge, rather than focusing on the question of randomisation and duration differences.

      From a UK perspective, therapeutic trials are so rare, that in reality this hypothetical situation would never arise (probability of enrolment and selection for clinical trials likely < 1% of PSP population).

      I would envisage that this may cloud the question, and other study designs would have multiple confounders for PSP patients. How does mortality be numerically attributed to PSP.

      Thanks.
      Mervyn

  2. Thank you Dr Golbe for all your work in educating us on the clinical trial process and trying to make it better for people with PSP. I have been watching the trials for PSP since my husband was diagnosed in Jan. 2021. The criteria for enrollment in a study is very strict and the rarity of therapeutic trials in the last few years has been challenging. We feel that we are fighting against time. Every week, month, year we have to wait means my husband’s PSP symptoms progress. I know that you know that and have read on this blog that you are trying to help get patients seen quicker by a physician who understands PSP. So to answer your questions: We would participate in PSP trial 1 and would choose PSP trial 2. The shorter time frame in PSP trial 2 and the lower probability of getting the placebo are the main reasons for our choice. The chance we would be able to get into another study is not a determining factor for us. Thank you again for all your work you do for us. All the best, Linda

Leave a reply to embreedo Cancel reply