Carnegie
Corporation
of New York
Fall 2007

 

 



< PREVIOUS 1 2 3 4 5 6 7 8 9 10



Collegiate Learning Assessment developers are in agreement that the test is most defi nitely not a silver bullet intended as a zero-sum assessment of all higher education student learning and should not be used as if it were. It is, they say, a step forward in measuring a signifi cant set of higher order skills critical to the broad spectrum of all student learning. Not coincidentally, they say, the Collegiate Learning Assessment’s focus—on the assessment of critical thinking, analytic reasoning, problem-solving and written communication through a series of performance tasks and writing prompts—is integral to the statement of mission of most colleges and universities. While debate within the academy regarding whether and how to assess student learning continues, it is clear that the attitude of “trust us, we know what we’re doing” is not going to satisfy those demanding change. “Timing is crucial,” warns Richard Hersh. “Lest the issues of learning assessment and institutional accountability be allowed to become the handmaiden of state and federal politics as many believed has occurred in the K-12 sector, the academy must act now. For this to happen, higher education needs to take the professional lead and control on issues of learning assessment and public accountability…”12

Time for a Reality Check
In an effort to assess the performance of their students with measures that could be benchmarked against the respective performances of other institutions, a total of 165 colleges and university systems nationwide have chosen to assume the mantle of professional leadership and control, in part by participating in the Collegiate Learning Assessment. While each of these institutions was motivated by its own particular agenda of issues and concerns, all decided that it was time for what Roger Benjamin refers to as “a reality check” to determine the degree to which they were meeting their respective institutional goals

The vast University of Texas System (UT), com-prising nine academic and six health science-related colleges,
selected the Collegiate Learning Assessment as a means to address the accountability concerns of the state legislature and to “show what we had to policymakers, parents, and students,” says Pedro Reyes, associate vice chancellor for academic planning and assessment. Seeking to measure learning outcomes that went beyond the content of specific courses, the UT system elected to participate in the Collegiate Learning Assessment in 2004–2005. The University of Texas System has participated in three cross-sectional administrations of the assessment thus far and will conduct a longitudinal study. “We envision that the Collegiate Learning Assessment will become part of the [University of Texas System] infrastructure,” says Reyes. The Collegiate Learning Assessment is one element of a four-pronged UT effort to address the twin issues of accountability and transparency. The University of Texas System also uses the National Survey of Student Engagement to assess student engagement and satisfaction, licensure exam pass rates to help determine whether graduates are prepared to enter the workforce in certain regulated professions, and the rates of postgraduate employment or further study. “We publish Collegiate Learning Assessment results to the world,” says Reyes, a practice that “begins to get the faculty’s attention.”

Emphasizing that leadership and a willingness to invest resources are essential to addressing the complex issue of accountability, Reyes credits University of Texas System chancellor Mark D. Yudof with providing both. The provost, deans, and faculty were encouraged to look at the Collegiate Learning Assessment reports, he says, and to ask themselves: What is it we need to do to meet national standards? “The individual colleges learned a great deal about themselves,” observes Reyes. The Collegiate Learning Assessment results for University of Texas, San Antonio, an open admissions institution, were particularly informative because they helped the college “see how much [it] has contributed to student development.”

Arizona State University executive vice president and provost of the University Elizabeth Capaldi shares Reyes’s view of the Collegiate Learning Assessment’s usefulness. “We owe it to the public to measure quality in higher education,” she says, adding, “We want to be able to show the effectiveness of [the institution] even when students who enter score low.” Arizona State University has an enrollment of 63,000 students at its three campuses, and offers 250 majors. “The truly meaningful thing is to educate them all,” she says. “So much of what we think about higher education is elitist,” observes Capaldi, and at many elite private colleges, the question frequently asked is “How high are the SAT scores of our students?” At Arizona State University, where the mission, according to Capaldi, is “To educate as many qualified students as possible,” this is not the relevant question. “The Collegiate Learning Assessment is a very smart test,” says Capaldi, because of what it measures, namely, higher order thinking and writing skills. For Arizona State University faculty, the Collegiate Learning Assessment is viewed as a measure of the university and its effectiveness in helping students to develop these skills. “This puts to rest personal fears,” she says, and encourages faculty to look at how courses in the various disciplines have or have not contributed to learning outcomes.


12 Richard Hersh, “The Feds Are Coming, The Feds Are Coming!” Inside Higher Ed, http://www.insidehighered.
com/views/
April 24, 2007.


MORE > 1 2 3 4 5 6 7 8 9 10