Hostname: page-component-7b7567c8c-z4zkx Total loading time: 0 Render date: 2026-11-16T17:12:06.513Z Has data issue: false hasContentIssue false

Detecting Treatment Effects with Small Samples: The Power of Some Tests Under the Randomization Model

Published online by Cambridge University Press:  01 January 2025

Bryan Keller*
Affiliation:
University of Wisconsin–Madison
*
Requests for reprints should be sent to Bryan Keller, University of Wisconsin–Madison, Madison, WI, USA. E-mail: bskeller@wisc.edu

Abstract

Randomization tests are often recommended when parametric assumptions may be violated because they require no distributional or random sampling assumptions in order to be valid. In addition to being exact, a randomization test may also be more powerful than its parametric counterpart. This was demonstrated in a simulation study which examined the conditional power of three nondirectional tests: the randomization t test, the Wilcoxon–Mann–Whitney (WMW) test, and the parametric t test. When the treatment effect was skewed, with degree of skewness correlated with the size of the effect, the randomization t test was systematically more powerful than the parametric t test. The relative power of the WMW test under the skewed treatment effect condition depended on the sample size ratio.

Information

Type
Original Paper
Copyright
Copyright © 2012 The Psychometric Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable