What Would Experimental Results with Very High Statistical Significance Mean

Question

What would experimental results with very high statistical significance mean?
A) The hypothesis being tested is correct.
B) The experiment had no bias.
C) The experiment had proper controls.
D) A true difference between treatment and control groups likely exists.

Accepted Answer

Very high statistical significance means that the probability of obtaining the results by chance is extremely low. This suggests that a true difference between the treatment and control groups likely exists. However, statistical significance alone does not confirm the correctness of the hypothesis, the absence of bias, or the presence of proper controls.