Hostname: page-component-7b7567c8c-wxvwp Total loading time: 0 Render date: 2026-11-15T09:45:04.843Z Has data issue: false hasContentIssue false
  • English
  • Français

Testing Theories with Qualitative and Quantitative Predictions

Published online by Cambridge University Press:  01 January 2026

Stephen Coleman
Stephen Coleman*
Affiliation:
Metropolitan State University, 1450 Energy Park Drive, Suite 100, St Paul, MN 55108, USA
*
E-mail: steve.coleman@metrostate.edu
Get accessRights & Permissions [Opens in a new window]

Abstract

Unlike theories in physics, social theories are usually tested by applying statistical hypothesis testing to observational data. This approach has more problems than commonly realised owing to false positives and model uncertainty, and it inhibits the development of social science. A better method to test a theory is by making definitive predictions that, if proved, strongly support the theory against alternative explanations.

Keywords

statistical hypothesis testingsocial theorymathematical modelsregression analysis

Information

Type
Symposium
Information
European Political Science , Volume 6 , Issue 2 , June 2007, pp. 124 - 133
Copyright
Copyright © 2007 European Consortium for Political Research

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Article purchase

Temporarily unavailable

References

Ahn, W., Kalish, C.W., Medin, D.L. and Gelman, S.A. (1995) ‘The role of covariation versus mechanism information in causal attribution’, Cognition 54: 299-352.10.1016/0010-0277(94)00640-7CrossRefGoogle ScholarPubMed
Arceneaux, K., Gerber, A.S. and Green, D.P. (2005) ‘Comparing experimental and matching methods using a large-scale voter mobilization experiment’, Political Analysis 14: 37-62.10.1093/pan/mpj001CrossRefGoogle Scholar
Borodin, A.D. (2005) ‘[Social Conformity in the Behaviour of Russian Voters]’, [Economics Journal HSE] 9: 74–81.Google Scholar
Breiman, L. (2001) ‘Statistical modelling: the two cultures’, Statistical Science 16: 199-231.Google Scholar
Buehner, M.J., Cheng, P.W. and Clifford, D. (2003) ‘From covariation to causation: a test of the assumption of causal power’, Journal of Experimental Psychology: Learning, Memory and Cognition 29: 1119-1140.Google ScholarPubMed
Chatfield, C. (1995) ‘Model uncertainty, data mining and statistical inference’, Journal of the Royal Statistical Society Series A 158: 419-466.10.2307/2983440CrossRefGoogle Scholar
Cheng, P.W. (1997) ‘From covariation to causation: a causal power theory’, Psychological Review 104: 367-405.10.1037/0033-295X.104.2.367CrossRefGoogle Scholar
Clauset, A. and Young, M. (2005) ‘Scale invariance in global terrorism’. http://arxiv.org/abs/physics/0502014.Google Scholar
Cohen, L. and Warwick, P. (1983) Political Cohesion in a Fragile Mosaic: The Yugoslav Experience Boulder, CO: Westview Press.Google Scholar
Coleman, S. (1975) Measurement and Analysis of Political Systems New York: Wiley-Interscience.Google Scholar
Coleman, S. (2004) ‘The effect of social conformity on collective voting behavior’, Political Analysis 12: 76-96.CrossRefGoogle Scholar
Coles, S.G. (2001) An Introduction to Statistical Modeling of Extreme Values New York: Springer Verlag.10.1007/978-1-4471-3675-0CrossRefGoogle Scholar
Dharmapala, D. and McAleer, M. (1996) ‘Econometric methodology and the philosophy of science’, Journal of Statistical Planning and Inference 49: 9-37.CrossRefGoogle Scholar
Gill, J. (2004) ‘Introduction to the special issue (Bayesian methods)’, Political Analysis 12: 323-337.10.1093/pan/mph021CrossRefGoogle Scholar
Heckman, J. (2000) ‘Causal parameters and policy analysis in economics: a twentieth century retrospective’, Quarterly Journal of Economics 115: 45-97.10.1162/003355300554674CrossRefGoogle Scholar
Ioannidis, J.P.A. (2005a) ‘Contradicted and initially stronger effects in highly cited clinical research’, Journal of the American Medical Association 294: 218-228.10.1001/jama.294.2.218CrossRefGoogle Scholar
Ioannidis, J.P.A. (2005b) ‘Why most published research findings are false’, PloS 2: 696-701, www.plosmedicine.org.Google Scholar
Longford, N.T. (2005) ‘Editorial: model selection and efficiency – is “Which model…?” the right question?’, Journal of the Royal Statistical Society Series A 168: 469-472.10.1111/j.1467-985X.2005.00366.xCrossRefGoogle Scholar
Malinetskii, G.G. and Kurdyumov, S.P. (2001) ‘Nonlinear dynamics and the problems of prediction’, Herald of the Russian Academy of Sciences 71(2) 94-113.Google Scholar
Manson, J.E., Hsia, J., Johnson, K.C., Rossouw, J.E., Assaf, A.R., Lasser, N.L., Trevisan, M., Black, H.R., Heckbert, S.R., Detrano, R., Stickland, O.L., Wong, N.D., Crouse, J.R., Stein, E. and Cushman, M. (2003) ‘Estrogen plus progestin and the risk of coronary heart disease’, New England Journal of Medicine 349: 523-534.CrossRefGoogle ScholarPubMed
Pesaran, M.H. and Smith, R. (1995) ‘The role of theory in econometrics’, Journal of Econometrics 67: 61-79.CrossRefGoogle Scholar
Plous, S. (1993) The Psychology of Judgment and Decision Making New York: McGraw-Hill.Google Scholar
Rimm, E.B., Stampfer, M.J., Ascherio, A., Giovannucci, E., Colditz, G.A. and Willett, W.C. (1993) ‘Vitamin E consumption and the risk of coronary heart disease in men’, New England Journal of Medicine 328: 1450-1456.10.1056/NEJM199305203282004CrossRefGoogle ScholarPubMed
Smith, V. (2003) ‘Constructivist and ecological rationality in economics’, American Economic Review 93(3) 465-508.10.1257/000282803322156954CrossRefGoogle Scholar
Sornette, D. (2002) Why Stock Markets Crash: Critical Events in Complex Financial Systems Princeton NJ: Princeton University Press.Google Scholar
Summers, L.H. (1991) ‘The scientific illusion in empirical macroeconomics’, Scandinavian Journal of Economics 93(2) 129-148.10.2307/3440321CrossRefGoogle Scholar
Vivekananthan, D.P., Penn, M., Sapp, S., Hsu, A. and Topol, E. (2003) ‘Use of antioxidant vitamins for the prevention of cardiovascular disease: meta-analysis of randomized trials’, Lancet 361: 2017-2023.CrossRefGoogle Scholar