Crossref Citations
This article has been cited by the following publications. This list is generated based on data provided by
Crossref.
Bracken, David W.
Rose, Dale S.
and
Church, Allan H.
2016.
The Evolution and Devolution of 360° Feedback.
Industrial and Organizational Psychology,
Vol. 9,
Issue. 4,
p.
761.
Adler, Seymour
Campion, Michael
Colquitt, Alan
Grubb, Amy
Murphy, Kevin
Ollander-Krane, Rob
and
Pulakos, Elaine D.
2016.
Getting Rid of Performance Ratings: Genius or Folly? A Debate.
Industrial and Organizational Psychology,
Vol. 9,
Issue. 2,
p.
219.
Vilkinas, Tricia
2016.
Comparing multisource ratings: can I believe what they say about my leadership behaviour?.
Management Research Review,
Vol. 39,
Issue. 9,
p.
1105.
Schmerling, Daniel
and
Scaduto, Anne
2016.
Use the Best; Leave the Rest: The Productivity Measurement and Enhancement System (ProMES) for Performance Ratings.
Industrial and Organizational Psychology,
Vol. 9,
Issue. 2,
p.
305.
Levy, Paul E.
Tseng, Steven T.
Rosen, Christopher C.
and
Lueke, Sarah B.
2017.
Research in Personnel and Human Resources Management.
p.
155.
Budworth, Marie-Hélène
and
Chummar, Sheryl
2017.
Handbuch Schlüsselkonzepte im Coaching.
p.
1.
Brown, LeAnn
George, Babu
and
Mehaffey-Kultgen, Candace
2018.
The development of a competency model and its implementation in a power utility cooperative: an action research study.
Industrial and Commercial Training,
Vol. 50,
Issue. 3,
p.
123.
Bull Schaefer, Rebecca A.
2018.
Conducting Midterm Performance Reviews: An Exercise for Teaching Performance Management.
Management Teaching Review,
Vol. 3,
Issue. 1,
p.
7.
Budworth, Marie-Hélène
and
Chummar, Sheryl
2018.
Handbuch Schlüsselkonzepte im Coaching.
p.
191.
Athota, Vidya S.
and
Malik, Ashish
2018.
The Cambridge Handbook of Instructional Feedback.
p.
313.
Higgins, Karen
Kirkland, Tracie
Le-Jenkins, Uyen
and
Rutledge, Carolyn
2019.
Preparing students to be ready for practice: An innovative approach to teaching advanced physical assessment skills online.
Journal of the American Association of Nurse Practitioners,
Vol. 31,
Issue. 11,
p.
640.
Allen, Jim
Belfi, Barbara
and
Borghans, Lex
2020.
Is There a Rise in the Importance of Socioemotional Skills in the Labor Market? Evidence From a Trend Study Among College Graduates.
Frontiers in Psychology,
Vol. 11,
Issue. ,
Shields, John
Rooney, Jim
Brown, Michelle
and
Kaine, Sarah
2020.
Managing Employee Performance and Reward.
Van der Berg-Cloete, Sophy Evelyn
Olorunju, Steve
White, John George
and
Buch, Eric
2020.
The Albertina Sisulu Executive Leadership Programme enhancing the competencies and performance of public health service managers in South Africa.
Leadership in Health Services,
Vol. 33,
Issue. 2,
p.
163.
Sepahvand, Faribah
Mohammadipour, Fatemeh
Parvizy, Soroor
Zagheri Tafreshi, Mansoureh
Skerrett, Victoria
and
Atashzadeh‐Shoorideh, Foroozan
2020.
Improving nurses’ organizational commitment by participating in their performance appraisal process.
Journal of Nursing Management,
Vol. 28,
Issue. 3,
p.
595.
Cigularov, Konstantin P.
and
Dillulio, Phillip
2020.
Does rater job position matter in training needs assessment? A study of municipal employees in the USA.
International Journal of Training and Development,
Vol. 24,
Issue. 4,
p.
337.
Finefter-Rosenbluh, Ilana
2020.
‘Try walking in my shoes’: teachers’ interpretation of student perception surveys and the role of self-efficacy beliefs, perspective taking and inclusivity in teacher evaluation.
Cambridge Journal of Education,
Vol. 50,
Issue. 6,
p.
747.
Han, Li
Li, Jing
and
Chen, Wenfeng
2020.
Improvement of Innovation Ability of Hospital Managers and Construction of Competitive Strategy.
International Journal of Circuits, Systems and Signal Processing,
Vol. 14,
Issue. ,
p.
751.
Seijts, Gerard
Espinoza, Jose A.
and
Carswell, Julie
2020.
Utility analysis of character assessment in employee placement.
Leadership & Organization Development Journal,
Vol. 41,
Issue. 5,
p.
703.
Black, Stephanie Lee
DeGrassi, Sandra W.
and
Sweet, Kenneth M.
2021.
Multisource Feedback as an Experiential Learning Enabler in Large-Format Management Classes.
Journal of Management Education,
Vol. 45,
Issue. 3,
p.
479.
The purpose of this commentary is to complement the lead article by Pulakos, Mueller Hanson, Arad, and Moye (Reference Pulakos, Mueller Hanson, Arad and Moye2015) by proposing the incorporation of 360 feedback as another means of improving performance management (PM). A 360 feedback refers to the practice of soliciting anonymous ratings and narrative comments on the job performance and other behaviors of the focal employee from a wide range of others who have worked with the employee. These sources include peers, subordinates, other managers, and often customers, as well as the immediate supervisor and self-ratings. There is an extensive body of research literature on 360s. Almost 300 articles and books have accumulated on the topic over the past 30 years (Campion, Campion, & Campion, Reference Campion, Campion and Campion2014), resulting in substantial knowledge about the usefulness and effectiveness of 360s. Although the primary purpose of 360s has been employee development, 360s are being increasingly used within PM systems.
We believe that the framework that Pulakos et al. (Reference Pulakos, Mueller Hanson, Arad and Moye2015) have proposed is in essence geared toward creating what organizational theorists might refer to as an “ambidextrous” PM system. In organizational theory, the term “ambidexterity” has been coined to explain why firms thrive under dynamic conditions. In particular, this is accomplished through the dually focused pursuit of facilitating efficiency (i.e., through exploitation of current competencies) and generating flexibility (i.e., through exploring for, and developing, new competencies necessary for survival; see He & Wong, Reference He and Wong2004; March, Reference March1991; Patel, Messersmith, & Lepak, Reference Patel, Messersmith and Lepak2013). In close parallel to this concept, with the framework that they have presented, Pulakos et al. (Reference Pulakos, Mueller Hanson, Arad and Moye2015) have argued for a more intentional focus on developing PM systems capable of (a) efficiently exploiting and/or reinforcing desirable, existing employee behaviors on a day-to-day basis and (b) defining and developing desirable, new employee behaviors in real time in order to ensure individual and organizational flexibility in response to the increasingly dynamic nature of work in organizations today.
We believe 360s have the potential to support the achievement of this desired end. Thus, we begin by highlighting two key points that Pulakos et al. (Reference Pulakos, Mueller Hanson, Arad and Moye2015) have made and examining how the incorporation of 360s into a PM system enhances the system's ability to seek and acquire the information necessary to define and develop desired employee behaviors in light of these points. After that, we go into greater detail, explaining how 360s are likely to improve a PM system's ability to measure and motivate (i.e., exploit) desired employee behaviors by addressing three fundamental problems that have historically limited the effectiveness of these systems.
Exploration: Defining and Developing Desired Behaviors
Involvement
One key point Pulakos et al. (Reference Pulakos, Mueller Hanson, Arad and Moye2015) have made is that managers cannot create an effective PM system alone. Parties, such as managers and lower level employees, are jointly responsible for this effort. Indeed, effective performance is increasingly interdependent in organizations today (Griffin, Neal, & Parker, Reference Griffin, Neal and Parker2007). Thus, information from an individual's network (e.g., supervisor, subordinates, peers, customers) is needed for the individual to effectively understand, perform, and develop in his or her role. In fact, this is precisely the argument on which 360s are based. The 360s not only solicit information of different types (qualitative and quantitative) from a greater number of unique perspectives but also facilitate information transference among these sources. In so doing, 360s may provide a more effective means of identifying and defining new knowledge, skills, abilities, and other characteristics (KSAOs) as well as behaviors that “matter,” whether it be because these KSAOs and behaviors are relevant to individual and unit outcomes (Pulakos et al., Reference Pulakos, Mueller Hanson, Arad and Moye2015; also see Ployhart, Nyberg, Reilly, & Maltarich, Reference Ployhart, Nyberg, Reilly and Maltarich2014) or because they are often unobservable to managers. An enhanced ability to seek out and identify KSAOs and behaviors that matter, in turn, may aid managers in more effectively recognizing employees for their contributions that are not necessarily observable. It may also aid managers in their attempts to coach their subordinates through “teachable moments” (Pulakos et al., Reference Pulakos, Mueller Hanson, Arad and Moye2015). Finally, because they naturally make individuals’ learning partners more salient to them, 360s may provide an effective means through which a firm can weave new behaviors into daily work.
A Systems-Level Perspective
A second key point Pulakos et al. (Reference Pulakos, Mueller Hanson, Arad and Moye2015) have made is that a more systems-level perspective is needed. To be sure, their point is that understanding how the PM system fits within the organization's entire talent management ecosystem enables smoother large-scale changes to be made to the PM system. We agree, and we would take this a step further by proposing that 360s may, when incorporated into the PM system, enable employees themselves to develop a more systems-level orientation regarding how the KSAOs they have and the behaviors employees exhibit impact key stakeholders (e.g., other organizational members, customers) as well as how employees fit within the organization's mission. This, in turn, may facilitate a greater understanding of the importance of developing new KSAOs and behaviors that the firm's PM system identifies as most critical. In this way, “what” behavior matters becomes more salient and the “how” and “why” become better understood.
Exploitation: Measuring and Motivating Performance
As an addition to an organization's PM system, 360 feedback has the potential to address at least three fundamental problems that have plagued PM systems throughout history. First, performance ratings tend to be unreliable and, perhaps, biased in part because of the fact that they are based on the judgments of a single person, usually the supervisor (Murphy & Cleveland, Reference Murphy and Cleveland1995). Second, performance ratings tend to be lenient and insufficiently differentiating, often to the point of making them useless (Roberson, Galvin, & Charles, Reference Roberson, Galvin and Charles2007). Third, for these reasons and others, performance ratings are not accepted as accurate and fair by employees (Folger, Konovsky, & Cropanzano, Reference Folger, Konovsky, Cropanzano, Staw and Cummings1992). Thus, the incorporation of 360s into PM can improve PM by helping raters address these three problems.
Increasing Reliability and Reducing Bias
Incorporating 360s into PM should increase reliability and reduce bias for several reasons. First, increasing the number of raters will increase interrater reliability, if there is any correlation among the ratings (Shrout & Fleiss, Reference Shrout and Fleiss1979). Research on the reliability of 360 feedback shows that it can be highly reliable, far exceeding the reliability of a single supervisor. For example, in a meta-analysis by Smither, London, and Reilly (Reference Smither, London and Reilly2005), the mean reliability of subordinate ratings was .63, and the mean reliability of peer ratings was .55. Smither et al. estimated the retest reliability of self-ratings to be .61. This compares with the meta-analytic mean reliabilities of supervisor ratings of .52 reported by Viswesvaran, Ones, and Schmidt (Reference Viswesvaran, Ones and Schmidt1996) and .48 reported by Rothstein (Reference Rothstein1990).
Second, 360 feedback broadens the range of inputs into the performance evaluation by including those who have worked with the employee in different contexts. This should reduce deficiency, thus increasing the validity of the resulting measure of job performance. According to Church and Bracken (Reference Church and Bracken1997, p. 150), “such systems are based on the simple assumption, derived in part from measurement theory, that observations obtained from multiple sources will yield more valid and reliable (and therefore more meaningful and useful) results for the individual.” Although there is some controversy, most of the evidence suggests that the different rating sources provide some unique information on performance based on their differing perspectives (e.g., Conway & Huffcutt, Reference Conway and Huffcutt1997; Greguras & Robie, Reference Greguras and Robie1998; Hannum, Reference Hannum2007; Harris & Schaubroeck, Reference Harris and Schaubroeck1988; Viswesvaran, Schmidt, & Ones, Reference Viswesvaran, Schmidt and Ones2002; but cf. LeBreton, Burgess, Kaiser, Atchley, & James, Reference LeBreton, Burgess, Kaiser, Atchley and James2003).
Third, 360s measure, and thus encourage, teamwork, corporate citizenship behavior, and other important aspects of job performance that are not always measured well in other performance evaluation systems. A major trend in research on PM is the recognition of the expanded domain of the facets of job performance (e.g., Borman & Motowidlo, Reference Borman, Motowidlo, Schmitt and Borman1993; Griffin et al., Reference Griffin, Neal and Parker2007; LePine, Erez, & Johnson, Reference LePine, Erez and Johnson2002; Smith, Organ, & Near, Reference Smith, Organ and Near1983). The 360s are a timely complement to traditional PM systems because they are better able to capture these facets (e.g., Antonioni, Reference Antonioni1996; London & Beatty, Reference London and Beatty1993). Many jobs in organizations involve intensive interaction with other employees, and not all aspects of job performance are visible to the supervisor.
Fourth, by including input from disparate voices, 360s should reduce the opportunities for individual biases or idiosyncratic views to influence outcomes. Research suggests that 360s should enhance many dimensions of procedural justice both conceptually (e.g., Flint, Reference Flint1999) and empirically (e.g., McDowall & Fletcher, Reference McDowall and Fletcher2004). Flint (Reference Flint1999) presented a model of organizational justice to explain how employees would react to 360s. McDowall and Fletcher (Reference McDowall and Fletcher2004) found that a measure of procedural justice rules predicted fairness perceptions of a 360 process.
Reducing Leniency
The 360s should reduce the leniency in PM ratings for at least two reasons. First, the anonymous nature of 360s should encourage candor. This is a fundamental assumption underlying the use of 360s since their inception (e.g., Bernardin, Reference Bernardin1986; Waldman, Atwater, & Antonioni, Reference Waldman, Atwater and Antonioni1998). In fact, in a survey following an early 360 feedback intervention, London and Wohlers (Reference London and Wohlers1991) found that 24% of respondents said they would have rated the manager differently if the ratings were not anonymous. In a later experimental field study, Antonioni (Reference Antonioni1994) found that subordinates in a nonanonymous condition rated their managers significantly higher than did the subordinates in an anonymous condition.
An important research question is whether there would be more leniency if the 360 ratings were used as an input in PM. In a survey study, London and Wohlers (Reference London and Wohlers1991) found that 34% of respondents said they might change their ratings. Another study showed that 360 ratings for development purposes were more reliable than were 360 ratings for evaluation purposes, but this was only true for subordinates and not for peers (Greguras, Robie, Schleicher, & Goff, Reference Greguras, Ford and Brutus2003).
Second, because ratings are collected from multiple sources, there will be checks on whether leniency is occurring. Leniency from all sources (e.g., peers, subordinates, other managers, etc.) would seem to be less likely than would leniency from just one source. In the review by Campion et al. (Reference Campion, Campion and Campion2014), 115 articles and book chapters were found to be devoted to the meaningfulness of differences in feedback from the different sources.
Increasing Acceptance
Simply put, it is harder for employees to question the accuracy of performance feedback when it comes from multiple sources. A negative evaluation from a supervisor might be discounted by attributing it to the peculiarities of the supervisor (e.g., “She does not like me”), but the feedback is much harder to dismiss when everyone is telling you the same thing, including your peers, subordinates, and others with different perspectives and motivations. Giving greater attention to the opinions of other coworkers in addition to the opinions of the supervisor is an inescapable consequence of the trend toward increasing teamwork in U.S. organizations over the last 20 years (Posthuma, Campion, Masimova, & Campion, Reference Posthuma, Campion, Masimova and Campion2013).
Early research suggested considerable acceptance of 360s among employees if used properly (McEvoy & Buller, Reference McEvoy and Buller1987), and other research since that time has shown that acceptance of 360s might depend on a host of factors, such as organizational culture and implementation (e.g., Waldman & Bowen, Reference Waldman and Bowen1998). There is also more recent research suggesting that employees will attend to the different rating sources (peers, supervisors, subordinates) and that some sources are perceived to provide more credible information on certain performance dimensions (Greguras, Ford, & Brutus, Reference Greguras, Ford and Brutus2003).
Should 360 Feedback Be Incorporated Into Performance Management?
Except for the earliest related research using “buddy ratings” to select military leaders in the 1940s and 1950s (e.g., Hollander, Reference Hollander1954; Wherry & Fryer, Reference Wherry and Fryer1949) and a resurgence of research on using “peer nominations” for promotions in the 1970s (e.g., Kane & Lawler, Reference Kane and Lawler1978; Lewin & Zwany, 1979), the modern version of 360 feedback was originally developed for the sole purpose of employee development, especially management development (e.g., Hazucha, Hezlett, & Schneider, Reference Hazucha, Hezlett and Schneider1993; Maurer, Mitchell, & Barbeite, Reference Maurer, Mitchell and Barbeite2002). There is considerable controversy over whether 360s should be used for evaluation as well as development or reserved just for development. Opponents argue that using 360 feedback for evaluation will ruin its proven value for development because raters will be less candid, ratings will be less accurate, political forces will be at play, recipients will be less accepting of feedback, and numerous other problems will arise if 360s have administrative consequences like implications for pay or promotion (e.g., DeNisi & Kluger, Reference DeNisi and Kluger2000; Toegel & Conger, Reference Toegel and Conger2003). This suspicion has also been raised in the focal article by Pulakos et al. (Reference Pulakos, Mueller Hanson, Arad and Moye2015).
Proponents argue that using 360s for evaluation will have the benefits articulated in this article. Moreover, the use of 360s is a trend that is occurring with or without our approval. Whether we like it or not, organizations are moving forward in using 360s for PM input. So, our choice is to help organizations do it better or be ignored.
The benefits of 360-feedback's involvement are numerous. For example, based on a review of almost 300 articles and book chapters on 360 feedback written by authors in our field over the last 30 years, Campion et al. (2014) identified 56 “best practices” from the findings of the research and the recommendations from practitioners on the full range of topics: strategy, items, scales, raters, administration, training, interpretation, development, and review. The guidance this voluminous literature has to offer is an invaluable resource to help improve PM through the use of 360s.