Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Usually when a study is halted early it’s because of obvious harm to the experimental group from the treatment which means there would be no possible benefit and it would make continuation unethical.

A meta analysis of early stopping in randomized clinical trials has found no evidence that early stopping hides side effects or inflates benefit—and I challenge you to produce any examples of a phase 3 trial of an infectious disease treatment that was stopped early which later showed unduly harmful side effects for marginal benefit.

This trial showed 100% efficacy.

A major consideration of RCTs is also the benefit denied to the public by withholding a viable treatment. HIV remains a global epidemic with no existing good solutions for poor countries.

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5133138/



Your account is new and has no profile and for all we know could be a bot.

However, in adhering to the HN guidelines [0] I must "assume good faith".

And indeed, you provided an excellent, intelligent reference! Very interesting paper and debate.

In the paper the authors review the debate on early stopping, and then created a model/simulation to examine what one might expect.

I should note that the paper came out in 2016, which was before the December 2020 early stopping of the COVID vaccine trials, a real world example of an early stopping debacle, where trials were stopped and then efficacy turned out to be vastly less than originally reported (even worse than the "29% exaggeration of effect" Bassler et al originally reported).

I think your argument has convinced me that my position is not correct. However, it has not convinced me that early stopping is correct either. I think the obviously dumb thing is having these rigid trials, and a far better idea is to have real-time adjustable ongoing data collection and experimentation that never stops.

Thanks for the article. Good read!

[0] https://news.ycombinator.com/newsguidelines.html




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: