053: Why more testing from Theranos won’t prevent cancer




Hello PhD show

Summary: It’s a compelling promise: take a few drops of blood, and tell the patient what hidden diseases are lurking in his body.  If only we could have an early warning system for cancer, Alzheimer’s, or myriad other diseases, then we could treat them before they took hold.<br> This is the narrative of <a href="https://www.theranos.com">Theranos</a>, a company that wants to make medical testing affordable and fast for everyone.  They’ve taken the notion so far that they actually publish <a href="https://www.theranos.com/test-menu">a price list</a> for hundreds of tests right on their website.<a href="http://hellophd.com/wp-content/uploads/2016/07/price-list.png"></a><br> Recently, the company made less favorable headlines when the <a href="http://www.wsj.com/articles/theranos-has-struggled-with-blood-tests-1444881901">Wall Street Journal revealed</a> that many of the tests were performed on industry standard equipment, rather than the space-age technology Theranos markets.<br> The <a href="http://www.eastbaytimes.com/business/ci_30154878/after-sanctions-drop-theranos-hires-compliance-execs?source=rss">company’s troubles deepened</a> when federal regulators announced plans to revoke the license of one of its lab facilities and to ban CEO and founder Elizabeth Holmes from the industry for two years.<br> But technology and regulations aside, there’s a more fundamental question we should all be asking: is wider access to routine screening a good thing?<br> The math says no.<br> <br> Damn Lies and Statistics<br> This week on the show, we discuss a recent article from <a href="http://www.fivethirtyeight.com">fivethirtyeight.com</a> that makes a bold claim: “<a href="https://fivethirtyeight.com/features/theranos-is-wrong-we-dont-need-more-blood-tests/">We don’t need more blood tests.”</a>  The reason comes down to some counterintuitive probabilities.<br> Fundamentally, the value of routine screening for rare diseases comes down to just a few numbers: the sensitivity of our test, the specificity of our test, and the prevalence, or rareness, of the disease we’re trying to detect.<br> Even if sensitivity and specificity are high, they can lead to unintended consequences when we screen truly large numbers of people.  We walk through an example on this week’s episode with a made-up test and a made-up disease.<br> But the impact of broad scale screening is very real.  In fact, the <a href="http://www.mayoclinic.org/tests-procedures/mammogram/expert-answers/mammogram-guidelines/FAQ-20057759">recommendations for routine mammography</a> and breast cancer screening have been changed recently due to the outsized side-effects of false positives in the screen.<br> There’s value to testing, but we have to make every effort to test the right people at the right time, and to help them interpret their results.  Our intuition is not always a helpful guide.<br> This Beer is Hot Hot Hot<br> This week, we turn up the heat with a Habanero IPA from <a href="http://www.dingodogbrewing.com">Dingo Dog Brewing</a> in Carrboro, NC.  Dingo Dog grows some of its own ingredients onsite in a “zero waste” production facility, and they use the profits to fund grants to local, “no-kill,” animal rescue organizations.<br> Their mission is cool, but this beer is hot!  It’s got all the bitterness you love in an IPA with a little kick of spice on the back of the throat.  Keep another brew on hand as a chaser!<br>  <br>