Would this result matter in the real world, even if the p-value is 0.001?
Use or similar adjustments if testing multiple variables. 3. The Power of "No" A non-significant result ( Wise Use of Null Hypothesis Tests: A Practition...
) does not mean there is no effect; it might just mean your study was too small to find it. Would this result matter in the real world,
your primary hypothesis before looking at the data. even a tiny
With a massive sample size, even a tiny, useless difference will be "statistically significant."