The TransEuro example makes me want delivery details kept alongside cell-manufacturing data. Device and surgical site changed together, and the Lund patients had less advanced disease. Otherwise a model might credit the cell preparation for a difference it cannot separate from delivery or patient selection.
I agree with you that a lot of these things are conflated and can't be cleanly separated. In researching this article, I grilled Claude a lot on trying to break down the bottlenecks and tease apart these kinds of questions, and I found its reasoning somewhat muddled, either parroting received opinion or being overly galaxy-brained and saying everything matters. For example, I had a lot of trouble getting it off the manifold of saying "sham-surgery controlled is the only way".
Maybe models can't reason very well about clinical trials because all they get is the public information and they don't really know how the sausage is made. Have you seen this effort at acquiring FDA submissions from defunct companies? https://www.ctdcommons.org/
Thank you Patrick, very thorough analysis!
The TransEuro example makes me want delivery details kept alongside cell-manufacturing data. Device and surgical site changed together, and the Lund patients had less advanced disease. Otherwise a model might credit the cell preparation for a difference it cannot separate from delivery or patient selection.
I agree with you that a lot of these things are conflated and can't be cleanly separated. In researching this article, I grilled Claude a lot on trying to break down the bottlenecks and tease apart these kinds of questions, and I found its reasoning somewhat muddled, either parroting received opinion or being overly galaxy-brained and saying everything matters. For example, I had a lot of trouble getting it off the manifold of saying "sham-surgery controlled is the only way".
Maybe models can't reason very well about clinical trials because all they get is the public information and they don't really know how the sausage is made. Have you seen this effort at acquiring FDA submissions from defunct companies? https://www.ctdcommons.org/