Skip to content Skip to navigation

OpenStax-CNX

You are here: Home » Content » Does Research Support New Approaches for the Evaluation of School Leaders: Using Emotional Intelligence in Formative Evaluation

Navigation

Recently Viewed

This feature requires Javascript to be enabled.
 

Does Research Support New Approaches for the Evaluation of School Leaders: Using Emotional Intelligence in Formative Evaluation

Module by: Lane Mills, William Rouse. E-mail the authors

Summary: Extravagant claims have been made about the role of Emotional Intelligence (EI) in Effective Leadership (EL); (Ashkanasy & Daus, 2005; Barbuto & Burbach, 2006; Goleman 1995, 1998). Other researchers question the linkage between EI and EL (Smith, 2005; Weinberger, 2003). The purpose of this paper was to conduct a meta-analysis to ascertain if there was empirical evidence to support the inclusion of emotional intelligence in the formal leadership evaluation process. It is proposed in this paper that Emotional Intelligence be a part of formative evaluation. The purpose of this study was to assess the effect of emotional intelligence on effective leadership. One Hundred and Forty-one studies were reviewed for possible analysis. Ultimately, 48 studies met the criteria for inclusion in the study. The study concludes that there is a moderately strong relationship between emotional intelligence and effective leadership. This study has implications for both the assessment of EI in current leaders and candidates for Educational Leadership Preparation Programs (ELPP).

logo.gif

Note:

This manuscript has been peer-reviewed, accepted, and sanctioned by the National Council of Professors of Educational Administration (NCPEA) as a significant contribution to the scholarship and practice of education administration. In addition to being published in Volume 10, Number 2 of the NCPEA Educational Leadership Review (ELR), it is also archived in the International Journal of Educational Leadership Preparation (Supplemental Link). Authors are: Lane Mills, James McDowelle, and William Rouse, East Carolina University.

Introduction

Over the course of the past two decades several new leadership attributes have been introduced to the leadership literature. Among these contemporary leadership properties are emotional intelligence, cultural intelligence and contextual intelligence (Earley & Mosakowski, 2004; Goleman, 1995; Silverthorne, 2004). Although these leadership attributes are frequently listed as highly desirable attributes for leaders to possess they are seldom incorporated into the formal leadership evaluation and development process. The purpose of this paper was to attempt to evaluate one of the new leadership archetypes, emotional intelligence, to determine its suitability for inclusion in the school leadership evaluation process.

The stated purpose of formative evaluation is to help individuals improve their performance (Young & Castetter, 2004). The notion driving the analysis described in this paper is that if emotional intelligence can be linked to effective leadership it should be part of the formative evaluation process and included in leadership development activities.

Major Eras

Goffee and Jones (2000) contend that since the 1920s there have been three major eras that represent evolution in thinking about leadership. The three theories that represent these eras are (a) Trait Theory, (b) Style Theory, and (c) Contingency Theory. The first era cited by Goffee and Jones was the era of Trait theory. Trait Theory focused on the traits or characteristics necessary for effective leadership. Trait theory eventually lapsed into disfavor because empirical studies failed to provide a definitive list of leadership traits that could be linked to effective leadership (Northouse, 2004). Trait Theory was eventually supplanted by Style Theory. Yukl (1994) noted that researchers have had difficulty in linking effective leadership to a specific style of leadership because of difficulties in conducting empirical studies that support both trait and style theory as effective conceptual prisms from which to view leadership. The current candidate for an explanation of effective leadership is Contingency Theory. Contingency Theory suggests that specific skills are required in specific leadership situations (Goffee & Jones).

Emotional Intelligence

One skill set frequently cited in the literature as necessary in a variety of situations are the intrapersonal and interpersonal skills associated with Emotional Intelligence (Downey, Papageorgiou, Stough, 2006;Dulewicz & Higgs, 2003; Rosete and Ciarrochi, 2005). While there are numerous studies that provide empirical evidence that EI has a positive effect on leadership effectiveness, (Coetzee & Schaap, 2004; Kerr, Garvin, Heaton, Boyle, 2006; Goleman, 1995,1998; Leban & Zulauf, 2004; Srivsastaava, Bharamanaikar, 2004; Wong & Law, 2002), there are also studies that provide empirical evidence that EI has no statistical significance in leadership effectiveness (Barbuto & Burbach, 2006; Barchard, 2003; Brown, 2005; Brown, Bryant, & Reilly, 2006; Schulte 2002; Weinberger, 2003).

Defining Effective Leadership and Emotional Intelligence

The question of definitions is a key element in conducting any research and a particularly critical component of any meta-analysis. The problem of defining leadership is well established in the literature (Bass, 1990; Collins, 2001; Nahavandi, 2003; Northhouse, 2004; Stogdill, 1974). Stoghill said that “there are almost as many different definitions of leadership as there are people who have tried to define it” (p.7). Collins contends that vague, expansive definitions of leadership create problems when analyzing organizational issues. When we define leadership by ascribing unlimited and undifferentiated functions and activities in an organization to leadership, according to Collins, we have really not defined leadership at all. We have simply thrown up our hands in frustration and “we prevent ourselves from gaining deeper, more scientific understanding about what makes companies tick” (p.22).

Although acknowledging the difficulty of providing a precise definition of leadership, Nahavandi (2003) and Northhouse (2004), after conducting comprehensive reviews of the leadership literature, have found elements common to the phenomena of leadership no matter where or how leadership is exercised. Both Nahavandi and Northouse list three common elements. Those three elements are as follows: (a) Leadership involves interaction with a group; (b) Leadership involves the exercise of influence; and (c) Leadership involves the attainment of a goal.

Once we have established a reasonably precise definition of leadership then effective leadership must be defined. Northhouse (2004) stated that leadership effectiveness is measured by the attainment of goals or objectives within a leadership context. Hartman (1999) contends that leadership effectiveness is defined both objectively and subjectively. Subjective measures are usually based on ratings obtained from the leader’s superiors, peers, or subordinates. Examples of objective measures of performance or goal attainment can include profits, profit margin, test scores, graduation rates, sales increases, market shares, or profitability. (Hartman, 1999) The two instruments used to measure leadership effectiveness most frequently cited in the studies included in the meta-analysis were the Multifactor Leadership Questionnaire (MLQ) and the Leadership Practices Inventory (LPI). The MLQ, developed by Bass and Avolio (2000), is a 45-question questionnaire that attempts to determine the multiple factors constituting a persons’ leadership style. The Leadership Practices Inventory (LPI), developed by Kouzes and Posner (1995), has been used to assess over 350,000 individuals’ leadership skills. It is based on qualitative and quantitative research of everyday actions and behaviors of exemplary leaders in a variety of settings.

Models of Emotional Intelligence

Researchers of emotional intelligence classify their conception of emotional intelligence as either ability models or mixed models. Ability models of emotional intelligence focus on the interplay of emotion and intelligence as traditionally defined while mixed models describe a conception of intelligence that includes mental abilities and other traits and talents including personality (Mayer, Salovey, & Caruso, 2000). Drawing from diverse elements of the EI literature, EI was defined for purposes of this study as the advanced ability to use self awareness and insight into self and others’ emotion to aid in cognitive processes to produce desired outcomes (Bar-On, 1997; Dulewicz & Higgs 2000; Goleman, 1998; Mayer, Salovey, & Caruso, 2000; McEnrue & Groves, 2006). One of the most frequently used instruments to measure emotional intelligence cited in this meta-analysis was the Mayer Salovey Caruso Emotional Intelligence Test (MSCEIT). The MSCEIT is an ability-based scale that measures the capacity to reason using feelings and the capacity of feelings to enhance thought.

Pertinent Literature

A meta-analysis conducted by Van Rooy and Viswesvaran (2004) was of assistance in informing the current study of the relationship between emotional intelligence and effective leadership. It is important to note that the Van Rooy and Viswesvaran study focused on work place performance and emotional intelligence. Also critical to the validity of this analysis were studies that questioned whether emotional intelligence had a significant effect on leadership effectiveness (Brown et al., 2006; Buford, 2001; Collins, 2001; Schulte, 2002; Weinberger, 2003). For example, Antonakis’ 2004 study was included in the meta-analysis. Antonakis’ main argument against EI stems from commercial claims that El is apparently twice as important as IQ or technical skills for leadership effectiveness (see also Goleman, 1998). As stated by Mayer and Caruso (2002), EI is an important capability, but one that co-exists with other strengths and weaknesses. The inclusion of Antonakis’ study and other work that questioned the linkage of EI to leadership effectiveness or stated specifically that EI did not contribute to leadership effectiveness provide more credibility for the ultimate conclusions of the study. It is also important to note that in order to avoid publication bias many of the studies included in this study were unpublished. Publication bias often occurs in meta-analysis when an emphasis is placed on published studies. Published studies tend to favor the subject under investigation (Hamer & Simpson, 2002).

Methods

The purpose of this paper was to conduct a meta-analysis of appropriate studies to ascertain if a consistent, research-based link can be established between the concept of emotional intelligence and effective leadership. If this link can be established, it could have a significant impact on the evaluation of educational leaders in schools as well as other educational settings. This linkage would also have implications for the exercise of leadership in educational arenas.

A meta-analysis is defined as “the statistical analysis of a large collection of analysis results from individual results for the purpose of integrating the findings” (Glass, McGaw & Smith, 1981, p.3). Hamer and Simpson (2002) state that meta-analysis is a particularly useful tool for synthesizing and integrating large quantities of information from many studies with contradictory information. Since a large body of contradictory information exists on the question of whether emotional intelligence does have an effect on effective leadership it was thought a meta-analysis examining the relationship between emotional intelligence and effective leadership would be helpful in answering many of the questions surrounding this newly popular concept. A meta-analysis of this relationship can help those responsible for school leadership determine if the skills associated with Emotional Intelligence should be an important element in the evaluation of school leaders.

Results of the Study

The comprehensive attempt to identify relevant studies on EI’s effect on leadership effectiveness conducted between 1990 to the present yielded 141 studies. Forty-eight studies met the criteria for inclusion in the meta-analysis sample. Those 48 studies yielded 99 correlations for analysis. Over half of the studies included in this study were in the form of unpublished dissertations (48%) and theses (8%) with forty-one percent of participants reported serving in the field of business or industry.

Determining the degree of homogeneity of the studies included in a meta-analysis helps to determine the statistical model to be used. A Q statistic was computed to explore whether the variability across effect sizes was greater than expected from sampling error alone. Based on a significant result for the Q statistic for these data, the hypothesis of homogeneity was rejected and a random-effects model was implemented. This significant Q statistic result was not unexpected given the essential random differences between studies that were associated with the framework of EI chosen and other study variables (e.g. the framework of leadership effectiveness, occupational setting, etc.). Incorporation of a random effects model allows for the estimation of the mean of a distribution of effects which prevents the underestimation of the weight of a small study or the overestimation of the weight of a large study (Borenstein, Hedges, Higgins, & Rothstein, 2007).

Using Biostat’s Comprehensive Meta-Analysis Software Version 2.0, the 99 effect sizes from the correlational studies with a total of 7,343 subjects were converted into Fisher z scores and an overall effect size z was computed and converted to the initial metric of correlation coefficient. Based on the rule of thumb for product moment correlation effect size magnitudes suggested by Lipsey and Wilson (2001), correlation effect size values are considered small if less than or equal to .10, medium if equal to .25, and large if greater than or equal to .40. This meta-analysis yielded a combined effect of r= .383 which can be interpreted as a moderately strong relationship between emotional intelligence and leadership effectiveness.

To examine for possible publication bias, several methods were employed by the researchers. A funnel plot of the standard error on the vertical axis and the converted Fisher Z effect size on the horizontal axis was computed and examined (See Figure 1). The plot revealed a largely symmetrical distribution around the mean effect size with no visual indications of extreme outliers suggesting that the probability of publication bias is low.

Figure 1. Funnel Plot

funnel.JPG

Further analysis for publication bias incorporated the calculation of a fail-safe N. The fail-safe N estimates the number of unpublished studies needed to nullify the positive effect found between EI and leadership effectiveness (Lipsey & Wilson). This meta-analysis incorporates data from 48 studies and using the CMA software, the fail-safe N is 11,249. This means that the researcher would need to locate and include 11,249 null studies in order for the combined 2-tailed p-value to exceed 0.05. In other words, there would need to be 225 missing studies that show a negative or non-significant effect for every observed study for the effect to be nullified. The fail-safe N test supports the other data that publication bias was likely not an issue since 62.5% of the studies included were unpublished sources.

Discussion

Although claims of the paramount or essential value of emotional intelligence as a component of leadership may be overstated, the results of this study would suggest that emotional intelligence is at least an important element in the exercise of effective leadership.

Informal assessments of leaders by subordinates, peers and supervisors may often cause confusion as to how some individuals manage to achieve and maintain positions of leadership and power. Further, given that even with adequate ability and training some leaders continue to fail, perhaps emotional intelligence is a contributing factor. The results of the current study show that EI affects leadership effectiveness. This finding can have significance for the evaluation of educational leaders. Perhaps a good first step for current and future educational leaders is an assessment of their own level of emotional intelligence and learning to be cognizant of how this factor affects their performance. EI provides a structure where emotions are connected to reasoning in a functional way. Those leaders who recognize and monitor their EI have learned to utilize their emotions towards the improvement of processing information in order to make better decisions, support interactions and relationships with others, and exhibit certain behaviors associated with success in order to be viewed as effective. Regardless of the scale used for assessing EI, the results could be used for self-reflection or discussion with supervisors as part of a professional development process. Incorporating these data into a 360 evaluation process might also be a productive approach in providing self and observer ratings of the leader’s level of EI as a means of improving performance and developing recommendations for improvement.

This study also has implications for the assessment of EI in candidates for Educational Leadership Preparation Programs (ELPP). Potential leaders should begin to develop an understanding of how self-awareness of emotions and understanding others’ emotions factor into selection, placement, training, and promotion within an organization as well as their success in an ELPP. Studies like this meta-analysis could be used to help introduce the need for self-assessment of the role of EI in the workplace and successful leadership experiences.

References

Antonakis, J. (2004). On why emotional intelligence will not predict leadership effectiveness beyond IQ or the “Big Five”: An extension and rejoinder. Organizational Analysis,12(2), 171-182.

Ashkanasy, N. M., & Daus, C. S. (2002). Emotion in the workplace: The new challenge for managers. Academy of Management Executive, 16, 76-86.

Bar-On, R. (1997). Bar-On Emotional Quotient Inventory: Technical manual. Toronto: Multi-Health Systems.

Barbuto, J. E., & Burbach, M. E. (2006). The emotional intelligence of transformational leaders: A field study of elected officials. The Journal of Social Psychology, 146(1), 51-64.

Barchard, K. A. (2003). Does emotional intelligence assist in prediction of academic success? Educational and Psychological Measurement, 63, 840-858.

Bass, B. M. (1990). From transactional to transformational leadership: Learning to share the vision. Organizational Dynamics, 18, 19-31.

Bass, B., & Avolio, B. (2000). Multifactor leadership questionnaire, (2nd ed.). Redwood City, CA: Mind Garden, Inc.

Borenstein, M., Hedges, L., Higgins, J., & Rothstein, H. (2007). Introduction to meta-analysis. Retrieved January 29, 2008, from http://www.Meta-Analysis.com

Brown, K. D. (2005). Relationship between emotional intelligence of leaders and motivational behaviors of employees. Dissertation Abstract International, 66(07), 2630. (UMI No. 3183509)

Brown, F. W., Bryant, S. E., & Reilly, M. D. (2006). Does emotional intelligence-as measured by the EQI-influence transformational leadership and/or desirable outcomes? Leadership and Organizational Development Journal, 27(5), 330-351.

Buford, B. A. (2001). Management effectiveness, personality, leadership, and emotional intelligence: A study of the validity evidence of the Emotional Quotient Inventory (EQ-I). Dissertations Abstracts International, 62, 12-B, (UMI No. 3034082)

Coetzee, C., & Schaap, P. (2004). The relationship between leadership styles and emotional intelligence. Paper presented at the 6th Annual Conference of the Society of Industrial and Organizational Psychology, as part of the symposium.

Collins, V. L. (2001). Emotional intelligence and leader success (Doctoral dissertation, The University of Nebraska, 2001). Dissertation Abstract International, 62(11), 5416. (UMI No. 3034371)

Downey, L. A., Papageorgiou, V., & Stough, C. (2006). Examining the relationship between leadership, emotional intelligence and intuition in senior female managers. Leadership & Organization Development Journal, 27(4), 250-264.

Dulewicz, V., & Higgs, M. (2000). Emotional intelligence a review and evaluation study. Journal of Managerial Psychology, 15(4), 341-372.

Dulewicz, V., & Higgs, M. (2003). Leadership at the top: The need for emotional intelligence in organizations. The International Journal of Organizational Analysis, 11(3) 193-210.

Early, P.C., & Mosakowski, E. (2004). Cultural intelligence. Harvard Business Review, October 139-146.

Glass, G.V., McGaw, B. & Smith, M.L. (1981). Meta-analysis in social research. Beverly Hills: Sage Publications.

Goffee, R. & Jones G. (2000 Sept.-Oct). Why should anyone be led by you? Harvard Business Review, (78) 9, 45-52.

Goleman, D. (1995). Emotional intelligence. New York: Bantum Books.

Goleman, D. (1998). Working with emotional intelligence. New York: Bantam.

Hamer, R., & Simpson, P. (2002). SAS tools for meta-analysis. Proceedings of the Twenty-Seventh Annual SAS Users Group International Conference, Cary, NC: SAS Institute Inc.

Hartman, L. (1999). A psychological analysis of leadership effectiveness. Strategy & Leadership, 27(6), 30-32.

Kerr, R., Gavin, J., Heaton, N., & Boyle, E. (2005). Emotional intelligence and leadership effectiveness. Leadership & Organization Development Journal, 27(4), 265-279.

Kouzes, O., & Posner, B. (1995). The leadership challenge. San Francisco, CA: Jossey-Bass.

Leban, W. and Zulauf, C. (2004). Linking emotional intelligence abilities and transformational leadership styles. The Leadership and Organization Development Journal, 25(7), 554-564.

Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.

Mayer, J. D., & Caruso, D. (2002). The effective leader: Understanding and applying emotional intelligence. Ivy Business Journal, Nov/Dec, 1-6.

Mayer, J. D., Salovey, P., & Caruso, D. R. (2000). Models of emotional intelligence. In R. Sternberg (Ed.), Handbook of intelligence. Cambridge, UK: Cambridge University Press.

McEnrue, M. P., & Groves, K. (2006). Choosing among tests of emotional intelligence: what is the evidence? Human Resource Development Quarterly, 17(1), 9-42.

Nahavandi, A. (2003). The art and science of leadership. Upper Saddle River, NJ: Prentice-Hall.

Northouse, P. G. (2004). Leadership: Theory and practice. Sage Publications: Thousand Oak, California.

Rosete, D. & Ciarrochi, J. (2005). Emotional intelligence and its relationship to workplace performance outcomes of leadership effectiveness. Leadership & Organization Development Journal, 26(5), 388-399.

Schulte, M. J. (2002). Emotional intelligence: A predictive or descriptive construct in ascertaining leadership style or a new name for old knowledge? (Doctoral dissertation, Our Lady of the Lake University, 2002). Dissertation Abstract International, 63(10), 3590. (UMI No. 3068435)

Silverthorne, S. (2004, April 12). What great leaders teach us. Harvard Leadership Initiative, Retrieved April 14th, 2009, from http://hbswk.hbs.edu/item/4053

Smith, R. M. (2005). An examination of the relationship between emotional intelligence and leader effectiveness. Dissertation Abstracts International, 67(02). (UMI No. 3205547)

Srivastava, K. B., & Bharamanaikar, S.R. (2004). Emotional intelligence and effective leadership behaviour. Psychological Studies, 49(2-3), 107-113.

Stogdill, R. M., (1974). Handbook of leadership. New York: Free Press.

Weinberger, L. A. (2003). An examination of the relationship between emotional intelligence, leadership style, and perceived leadership effectiveness. Dissertation Abstracts International,64(11), 5828. (UMI No. 3113218)

Wong, C., & Law, K.S. (2002). The effects of leader and follower emotional intelligence on performance and attitude: An exploratory study. The Leadership Quarterly, 13, 243-274.

Van Rooy, D. L., & Viswesvaran, C. (2004). Emotional intelligence: A meta-analytic investigation of predictive validity and nomological net. Journal of Vocational Behavior, 65, 71-95.

Young, I. & Castetter,W. (2004). The human resource function in educational administration (8th ed.) Upper Saddle River, NJ: Pearson Prentice Hall

Yukl, G. (1994). Leadership in organizations. (3rd ed.) Englewood : Prentice-Hall.

Content actions

Download module as:

Add module to:

My Favorites (?)

'My Favorites' is a special kind of lens which you can use to bookmark modules and collections. 'My Favorites' can only be seen by you, and collections saved in 'My Favorites' can remember the last module you were on. You need an account to use 'My Favorites'.

| A lens I own (?)

Definition of a lens

Lenses

A lens is a custom view of the content in the repository. You can think of it as a fancy kind of list that will let you see content through the eyes of organizations and people you trust.

What is in a lens?

Lens makers point to materials (modules and collections), creating a guide that includes their own comments and descriptive tags about the content.

Who can create a lens?

Any individual member, a community, or a respected organization.

What are tags? tag icon

Tags are descriptors added by lens makers to help label content, attaching a vocabulary that is meaningful in the context of the lens.

| External bookmarks