We outline a novel approach to calculate exact p-levels for two-sample randomization tests. The approach closely resembles permute in its applications, with the main difference being that the results are approximated only if the execution time needed to calculate exact p-levels would exceed a specified maximum. We demonstrate its use by deriving p-levels for the significance of Somers’ D, the coefficient of variation, the difference in means and in medians, and the difference in two multinomials.
CopeD. A., and LacyM. G.1995. Comparative application of the coefficient of variation and range-based statistics for assessing the taxonomic composition of fossil samples. Journal of Human Evolution29: 549–576.
DavisJ. A., SmithT. W., and MarsdenP. V.2006. General social surveys, 19722006 [cumulative file] (ICPSR 4697).Ann Arbor, MI.: Inter-university Consortium for Political and Social Research.
4.
DonnellyS. M., and KramerA.1999. Testing for multiple species in fossil samples: An evaluation and comparison of tests for equal relative variation. American Journal of Physical Anthropology108: 507–529.
EdwardesM. D. deB. 2000. Implications of random cut-points theory for the Mann–Whitney and binomial tests. Canadian Journal of Statistics28: 427–438.
7.
GentlemanJ. F.1975. Algorithm AS 88: Generation of all nCr combinations by simulating nested Fortran DO loops. Applied Statistics24: 374–376.
8.
KaiserJ.2007. An exact and a Monte Carlo proposal to the Fisher–Pitman permutation tests for paired replicates and for independent samples. Stata Journal7: 402–412.
9.
ManlyB. F. J.2006. Randomization, Bootstrap and Monte Carlo Methods in Biology. 3rd ed. Boca Raton, FL: Chapman & Hall/CRC.
10.
MannH. B., and WhitneyD. R.1947. On a test of whether one of two random variables is stochastically larger than the other. Annals of Mathematical Statistics18: 50–60.
11.
NarayananA., and WattsD.1996. Exact methods in the NPAR1WAY procedure. InProceedings of the Twenty-first Annual SAS Users Group International Conference.
12.
NewsonR.2002. Parameters behind “nonparametric” statistics: Kendall's tau, Somers’ D and median differences. Stata Journal2: 45–64.
13.
NewsonR.2007. Robust confidence intervals for Hodges–Lehmann median difference. 2007 uk Stata Users Group meeting. Downloadable from http://ideas.repec.org/p/boc/usug07/01.html.
