Changing needs within public schools of increased demands of accountability systems have called for leaders who would transform schools to foster increased learning as a primary responsibility (Donaldson, 2006; Leithwood, Seashore Louis, Anderson & Wahlstom, 2004; Leithwood & Riehl, 2005; Matthews & Crow, 2003; Waters, Marzano, & McNulty, 2003). As Darling-Hammond, LaPointe, Meyerson, and Orr (2007) suggested, “New expectations for schools-that they successfully teach a broad range of students with different needs, while steadily improving achievement for all students-mean that schools typically must be redesigned rather than merely administered” (p. 1). To accomplish the goal of improving achievement for all students, distributed leadership and collaborative, shared decision making is needed (Kochan & Reed, 2005; Lashway, 2006; Quantz, Rogers, & Dantley, 1991; Spillane, 2006).
Principals are charged to serve as facilitators of learning and school improvement creating democratic cultures of academic excellence and equity for students of diverse ethnic and socioeconomic backgrounds (Dantley, 2005; Furman & Shields, 2005; Prestine & Nelson, 2005) and to model moral, authentic leadership (Dantley, 2005; Sergiovanni, 2007). With these responsibilities, principals often assume roles as change facilitators for sustainable, systemic improvement (Duffy, 2004; Fullan, 2001; Schlechty, 2008).
Common elements of effective program design features identified by Darling-Hammond et al. (2007) included a coherent curriculum aligned with state and professional standards; curriculum emphasizing instructional leadership and school improvement; active, student-centered instruction; knowledgeable faculty who were experienced in school leadership; social and professional support through a cohort structure; vigorous, targeted recruitment; and a well-designed, supervised administrative internship. Although these common elements of effective principal preparation programs have been identified, an understanding of ways that school improvement efforts to improve teaching and learning are impacted by principal preparation programs with a clear focus on instructional leadership and school improvement is needed. As Levine (2005) emphasized, “Today, principals and superintendents have the job not only of managing our schools, but also of leading them through an era of profound social change that has required fundamental rethinking of what schools do and how they do it” (p. 5). Part of the problem for university-based programs has been that there is little empirical evidence that they have a significant impact on graduates’ ability to lead schools (Achilles, 1994; Brent, 1998; Brent & Haller, 1998). Research is needed that helps to illuminate the impact of principal preparation programs on school improvement (Young, 2008).
University-based principal preparation programs have been the subject of criticism for well over 20 years (Achilles, 1994). The need for structural and strategic reform around principal preparation became paramount in the 1990s (Beck & Murphy, 1994; Donmoyer, Imber, & Scheurich, 1995; Hallinger, Leithwood, & Murphy, 1993; Hannaway & Crowson, 1989; McCarthy & Kuh, 1997; Milstein & Associates, 1993; Mitchell & Cunningham, 1990; Mulkeen, Cambron-McCabe, & Anderson, 1994; Murphy, 1992, 1993; Murphy & Forsyth, 1999). This criticism hit a boiling point when two influential reform reports, A License to Lead? A New Leadership Agenda for American’s Schools (Hess, 2003)and Educating School Leaders (Levine, 2005), called for more aggressive reforms and questioned the capability of university-based programs to meet the needs of 21st Century school leaders. Levine expressed urgency for this reform asserting, “the quality of leadership in our schools has seldom mattered more... Today, principals and superintendents have the job not only of managing our schools, but also of leading them through an era of profound social change that has required fundamental rethinking of what schools do and how they do it” (p. 5). Since then, the university’s monopoly on principal preparation has been dissolved due to deregulation and choice. Several states no longer require principal certification and an increasing number of states have allowed alternative and non-traditional providers into the principal preparation landscape. This climate makes it imperative for university-based programs to gather data about their effectiveness and impact on graduates. To date, external evaluative measures most often consist of anecdotes and surveys of superintendents and principals. These self-reporting measures are wholly inadequate because the essence of principal preparation resides in what graduates are able to do in the practice of school leadership.
Similar to most forms of professional development, existing evaluations of principal preparation programs have consisted mainly of post-program surveys of graduates and short-term job placement results (Jacobson, 1998; Murphy& Vriesenga, 2004; Orr & Barber, 2007; Orr & Hung, 2002). Guskey (2000) identified three major mistakes in evaluations of professional development: ( a) they merely document what was done;( b) they consist of participants’ perceptions, attitudes, or beliefs; and( c) they are too brief and fail to document long-term effects. An evaluative process consisting of multiple measures has the potential to inform developing pedagogies that link context, practices, and thinking. Research designs should start with a chain of variables linking leadership preparation to leader practices and ultimately to student learning, so the effects of preparation and leader actions become more evident.
In 2001, Terry Orr and the University Council of Educational Administration/Leading and Teaching in Educational Leadership (UCEA/LTEL) Taskforce on Evaluating Educational Leadership Preparation began an investigation into the variables of the preparation of school leaders and developed a survey, the School Leadership Preparation and Practice Survey (SLPPS, formerly UCEA/LTEL Survey of Leadership Preparation and Practice). This survey was the foundation of a comparative study of public and private leadership preparation programs from 17 university-based leadership preparation programs in 13 institutions (Orr, 2010). Program graduates were asked to rate program features, their learning about leadership, their career intentions and beliefs, program satisfaction and advancement into leadership positions. The survey items and scales were drawn from the federal School and Staffing Survey of teachers and principals, and research studies on leadership effectiveness in school improvement (Leithwood & Jantzi, 2000; Marks & Printy, 2003). The survey has been field tested with a wide variety of programs and institutions nationwide, has demonstrated strong content validity, and its scales have robust measurement reliability (Orr, 2010).
The SLPPS gathers the perceptions of program graduates about their learning, leadership skills, and transitions to leadership positions, but what happens once these graduates become principals? The UCEA/LTEL-SIG Taskforce began to work on extending their learning about the effectiveness of principal preparation from the perceptions of program graduates to an assessment of leadership actions and school conditions of program graduates as principals. The UCEA/LTEL-SIG Teacher Survey aligns with the SLPPS and is designed to assess teachers’ assessments of (a) the principal’s leadership practices; (b) their school improvement practices and recent accomplishments; (c) organizational contexts in the schools; and (d) their own demographic and educational experiences. The Teacher Survey has been fielded in three distinctly different settings (Alford & Ballenger, 2010 & Korach & Newmann, 2010) to gain a greater understanding of how this survey tool could be used to validate principal self-report data and add to the chain of variables linking leadership preparation to principal practice.