How the unintended consequences of organizational interventions complicate the assessment of economic utility
DOI:
https://doi.org/10.17811/ebl.1.4.2012.33-42Abstract
Interventions in organizations (e.g., implementing new testing, training or leadership development programs) are likely to have a wide range of effects, some intended and some unintended. These outcomes are likely to unfold over time in a wide range of trajectories. A multi-stakeholder, multivariate longitudinal perspective is suggested as a way of reflecting more broadly the range of effects of organizational interventions when estimating their financial impact.
References
Arthur, W., Bennett, W., Edens, P.S. and Bell, S.T. (2003) Effectiveness of training in organizations: a meta-analysis of design and evaluation features, Journal of Applied Psychology, 88, 234-245.
Boudreau, J.W. (1991) Utility analysis for decisions in human resource management, in M. Dunnette and L. Hough (eds.), Handbook of industrial and organizational psychology, 2nd ed., Vol. 2, 621-745, Palo Alto, CA: Consulting Psychologists Press.
Boudreau, J.W. and Ramstad, P.M. (2003) Strategic HRM measurement in the 21st century: from justifying HR to strategic talent leadership, in M. Goldsmith, R.P. Gandossy and M.S. Efron (eds.) HRM in the 21stcentury, 79-90, New York: John Wiley.
Boudreau, J.W., Sturman, M.C. and Judge, T.A. (1994) Utility analysis: what are the black boxes, and do they affect decisions?, in N. Anderson and P. Herriot (eds.) Assessment and selection in organizations: Methods and practice for recruitment and appraisal, 77-96, New York: Wiley.
Bridgeman, B., Burton, N. and Cline, F. (2009) A note on presenting what predictive validity numbers mean, Applied Measurement in Education, 22, 109-119.
Brogden, H.E. (1949) When testing pays off, Personnel Psychology, 2, 171-183.
Cascio, W.F. (1993) Assessing the utility of selection decisions: theoretical and practical considerations, in N. Schmitt and W.C. Borman (eds.) Personnel selection in organizations, 310-340, San Francisco: Jossey Bass.
Cronbach, L.J. and Gleser, G.C. (1965) Psychological tests and personnel decisions, 2nd ed., Urbana: University of Illinois Press.
Edwards, W. and Newman, J.R. (1982) Multiattribute evaluation, Beverly Hills: Sage.
Gottfredson, L. (1986) Societal consequences of the g factor in employment, Journal of Vocational Behavior, 29, 379-410.
Hauskenecht, J.P., Day, D.V. and Thomas, S.C. (2004) Applicant reactions to selection procedures: an updated model and meta-analysis, Personnel Psychology, 57, 639-683.
Hazer, J.T. and Highhouse, S. (1997) Factors influencing managers' reactions to utility analysis: effects of SDy method, information frame, and focal intervention, Journal of Applied Psychology, 82, 104-112.
Hunter, J.E. and Hunter, R.F. (1984) The validity and utility of alternative predictors of job performance, Psychological Bulletin, 96, 72-98.
Hunter, J.E. and Schmidt, F.L. (1982) Fitting people to jobs: the impact of personnel selection on national productivity, in M. Dunnette and E. Fleishman (eds.) Human performance and productivity: human capability assessment, Hillsdale, NJ: Erlbaum.
Jensen, A. R. (1980) Bias in mental testing, New York: Free Press.
Klaas, B.S. and McClendon, J.A. (1996) To lead, lag, or match: estimating the financial impact of pay level policies, Personnel Psychology, 49, 121-141.
Martin, S.L. and Raju, N.S. (1992) Determining cutoff scores that optimize utility: a recognition of recruiting costs, Journal of Applied Psychology, 77, 15-23.
Murphy, K. (1986) When your top choice turns you down: effects of rejected offers on selection test utility, Psychological Bulletin, 99, 133-138.
Murphy, K. (2009) Validity, validation and values, The Academy of Management Annals, 3, 421-461.
Murphy, K.R. and Shiarella, A. (1997) Implications of the multidimensional nature of job performance for the validity of selection tests: multivariate frameworks for studying test validity, Personnel Psychology, 50, 823-854.
Neuman, G.A., Edwards, J. and Raju, N. (1989) Organizational development interventions: a meta-analysis of their effects on satisfaction and other variables, Personnel Psychology, 42, 461-489.
Pritchard, R.D. (1990) Measuring and improving organizational productivity, New York: Praeger.
Richardson, K.M. and Rothstein, H.R. (2008) Effects of occupational stress management intervention programs: a meta-analysis, Journal of Occupational Health Psychology, 13, 69-93.
Roth, P.L. (1994) Multi-attribute utility analysis using the ProMES approach, Journal of Business and Psychology, 9, 69-80.
Schmidt, F.L. and Hunter, J.E. (1999) The validity and utility of selection methods in personnel psychology: practical and theoretical implications of 85 years of research findings, Psychological Bulletin, 124, 262-274.
Schmidt, F.L., Mack, M.J. and Hunter, J.E. (1984) Selection utility in the occupation of U.S. Park Ranger for three modes of test use, Journal of Applied Psychology, 69, 490-497.
Taylor, H.C. and Russell, J.T. (1939) The relationship of validity coefficients to the practical effectiveness of tests in selection, Journal of Applied Psychology, 23, 565-578.
Whyte, G. and Latham, G. (1997) The futility of utility analysis revisited: when even an expert fails, Personnel Psychology, 50, 601-610.
Winkler, S., Köenig, C. J. and Kleinmann, M. (2010) Single-attribute utility analysis may be futile, but this can’t be the end of the story: causal chain analysis as an alternative, Personnel Psychology, 63, 1041-1065.
Downloads
Published
How to Cite
Issue
Section
License
The works published in this journal are subject to the following terms:
1. Oviedo University Press (the publisher) retains the property rights (copyright) of published works, and encourages and enables the reuse of the same under the license specified in paragraph 2.
© Ediuno. Ediciones de la Universidad de Oviedo / Oviedo University Press
2. The works are published in the online edition of the journal under a Creative Commons Attribution-Non Commercial-Non Derives 3.0 Spain (legal text). You can copy, use, distribute, transmit and publicly display, provided that: i) you cite the author and the original source of publication (journal, publisher and URL of the work), ii) they are not used for commercial purposes, iii) mentions the existence and specifications of this license.
3. Conditions of self-archiving. The author can archive the post-print version of the article (publisher’s version) on the author’s personal website and/or on the web of the institution where he belong, including a link to the page of the journal and putting the way of citation of the work. Economics and Business Letters and its URL https://reunido.uniovi.es/index.php/EBL/index are the only authorized source for correctly giving the reference of the publisher’s version in every mention of the article.
