Decision Points · a statistics mini case study

What did the trial show?

What you’re working out: what a clinical trial’s hypothesis test can tell you.

Nadia, a young woman in a hijab, sits cross-legged on her dorm bed in the evening, holding a bottle of Dozeberry sleep gummies, and looks up at her roommate as if about to ask a question.

Your roommate Nadia has a heart condition, and her doctor says a rise of 5 beats a minute in her resting heart rate would be too much.

Nadia is sleeping badly and wants to try Dozeberry sleep gummies. The bottle says “Clinically tested. No effect on heart rate.”

No effect on heart rate is exactly what Nadia needs. Does the trial behind the label show no effect?

How the lab tested the claim

To check a claim like this, a lab runs a hypothesis test. The null hypothesis is the bottle’s claim, no effect: the population mean change in resting heart rate, for everyone who takes the gummies, is 0.

The lab can’t test everyone, so it uses a sample. It tracked 40 adults for a week without the gummies and a week taking one each night, and found each person’s change in resting heart rate.

In the first picture, each dot is one person’s change, from −19 to 24 beats a minute. The diamond is the sample mean of the 40 changes, a rise of 2.5.

The second picture zooms in on the sample mean, from −4 to 10 beats a minute.

The shaded band runs from −3.1 to 3.1. The line through the band’s center marks 0, the value in the null hypothesis. The band is where the sample mean can fall without the lab rejecting the null hypothesis.

A sample mean in the band is close enough to 0 that it would not be unusual if the population mean change were 0. The diamond is inside the band, so the lab does not reject the null hypothesis.

Does the trial show what the bottle says, no effect on heart rate?