Confidence Levels (in Medical Research)

Definition

A confidence level represents the degree of certainty that a population parameter (like a mean or proportion) lies within a specified confidence interval (CI) based on sample data.

It tells us how confident we are that our estimate from the sample reflects the true value in the population.

Common Confidence Levels

Example

If a study finds that a new antihypertensive drug reduces systolic BP by 10 mmHg (95% CI: 8–12 mmHg):

• We are 95% confident the true average reduction lies between 8 and 12 mmHg.

• There is a 5% chance that the true value lies outside this range.

Key Concepts

• Confidence Level → Degree of certainty (e.g., 95%).

• Confidence Interval → Range of values that likely contain the true value.

• Higher Confidence Level → Greater certainty, but wider (less precise) interval.

• Lower Confidence Level → Narrower interval, but less certainty.

Clinical Relevance

• Helps in interpreting study reliability.

• Used in clinical trials, diagnostic test evaluation, and epidemiological studies.

• A 95% CI that does not include zero (or 1 for relative risk/odds ratio) suggests statistical significance.

• 1. Relationship Between Confidence Level and Confidence Interval

  A confidence level (e.g., 95%) corresponds to how certain we are that the true population value lies within the confidence interval (CI) computed from the sample data.
  It is based on the sampling distribution of the mean (or proportion) and uses the standard error to estimate variability.

  ---

  🔹 2. General Formula for Confidence Interval (for a Mean)

  Confidence Interval=Xˉ±Z×SDn\text{Confidence Interval} = \bar{X} \pm Z \times \frac{SD}{\sqrt{n}}Confidence Interval=Xˉ±Z×n​SD​

  Where:

  • Xˉ\bar{X}Xˉ = sample mean

  • SD = standard deviation of the sample

  • n = sample size

  • Z = Z-score corresponding to the chosen confidence level

  ---

  🔹 3. Z-Scores for Common Confidence Levels

  Confidence Level	Z-Score (from Normal Distribution)	Two-Tail α (error)
  90%	1.645	0.10
  95%	1.96	0.05
  99%	2.576	0.01

  So, for a 95% confidence level, you use Z = 1.96.

  ---

  🔹 4. Example Calculation

  Example:

  A study measures systolic blood pressure reduction after a drug trial.

  • Mean reduction (Xˉ\bar{X}Xˉ) = 10 mmHg

  • SD = 4 mmHg

  • Sample size (n) = 25

  • Confidence level = 95%

  Step 1: Compute Standard Error (SE)

  SE=SDn=425=45=0.8SE = \frac{SD}{\sqrt{n}} = \frac{4}{\sqrt{25}} = \frac{4}{5} = 0.8SE=n​SD​=25​4​=54​=0.8

  Step 2: Compute Margin of Error (ME)

  $$ME=Z\times SE=1.96\times 0.8=1.568$$

  Step 3: Construct Confidence Interval

  $$CI=10\pm 1.57=(8.43,11.57)$$

  ✅ Interpretation: We are 95% confident that the true mean BP reduction lies between 8.43 mmHg and 11.57 mmHg.

  ---

  🔹 5. For Proportions

  When dealing with proportions (like prevalence rates or vaccine efficacy):

  CI=p±Z×p(1−p)nCI = p \pm Z \times \sqrt{\frac{p(1 - p)}{n}}CI=p±Z×np(1−p)​​

  Where p = sample proportion (e.g., 0.40 for 40%).

  ---

  🔹 6. Relation Between Confidence Level and Width

  • Increasing confidence (e.g., 95% → 99%) increases Z, thus widening the CI.

  • Larger samples (↑n) reduce SE, thus narrowing the CI.

  ---

  🔹 7. Conceptual Analogy

  If you repeated the study 100 times,

  • At a 95% confidence level, about 95 of the 100 intervals would contain the true population mean.