Hostname: page-component-7b7567c8c-wxvwp Total loading time: 0 Render date: 2026-11-16T06:43:14.256Z Has data issue: false hasContentIssue false

A Monte Carlo Analysis of the Fisher Randomization Technique: Reviving Randomization for Experimental Economists

Published online by Cambridge University Press:  14 March 2025

Robert Moir*
Affiliation:
Department of Economics, University of New Brunswick, P.O. Box 5050, Saint John, NB, E2L 4L5, Canada

Abstract

Data created in a controlled laboratory setting are a relatively new phenomenon to economists. Traditional data analysis methods using either parametric or nonparametric tests are not necessarily the best option available to economists analyzing laboratory data. In 1935, Fisher proposed the randomization technique as an alternative data analysis method when examining treatment effects. The observed data are used to create a test statistic. Then treatment labels are shuffled across the data and the test statistic is recalculated. The original statistic can be ranked against all possible test statistics that can be generated by these data, and a p-value can be obtained. A Monte Carlo analysis of t-test, the Mann-Whitney U-test, and the exact randomization t-test is conducted. The exact randomization t-test compares favorably to the other two tests both in terms of size and power. Given the limited distributional assumptions necessary for implementation of the exact randomization test, these results suggest that experimental economists should consider using the exact randomization test more often.

Information

Type
Research Article
Copyright
Copyright © 1998 Economic Science Association

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable