The Undetectable Difference: An Experimental Look at the ‘Problem’ of p-Values

Statistical Literacy Website/Papers: Www.Statlit.Org/Pdf/2010GoodmanASA.Pdf (2010)
Download Edit this record How to cite View on PhilPapers
Abstract
In the face of continuing assumptions by many scientists and journal editors that p-values provide a gold standard for inference, counter warnings are published periodically. But the core problem is not with p-values, per se. A finding that “p-value is less than α” could merely signal that a critical value has been exceeded. The question is why, when estimating a parameter, we provide a range (a confidence interval), but when testing a hypothesis about a parameter (e.g. µ = x) we proceed as if “=” entails exact equality of the parameter with x. That standard is hard to meet, and is not a standard expected for power calculations, where we are satisfied to reject a null hypothesis H0 if the result is merely “detectably” different from (exact) H0. This paper explores, with resampling (simulation) methods, the impacts on p-values, and alternatives, if the null hypothesis is defined as a thick or thin range of values. It also examines, empirically, the extent to which the p-value may or may not be a good predictor of the probability that H0 is true, given the distribution of the data.
PhilPapers/Archive ID
GOOTUD
Revision history
Archival date: 2016-10-07
View upload history
References found in this work BETA

Add more references

Citations of this work BETA

No citations found.

Add more citations

Added to PP index
2016-10-07

Total views
71 ( #35,023 of 46,143 )

Recent downloads (6 months)
19 ( #35,121 of 46,143 )

How can I increase my downloads?

Downloads since first upload
This graph includes both downloads from PhilArchive and clicks to external links.