Another report urges changing API

A report this week from a Washington think tank bolsters Senate President pro Tem Darrell Steinberg’s call for significantly revising the state’s primary accountability measure, the Academic Performance Index. Now, if Gov. Jerry Brown would only read it…

“Ready by Design: A College and Career Ready Agenda for California,” published by Education Sector, recommends that the API shift focus from students’ performance on standardized tests to measures of readiness for college and careers, such as high school graduation rates, results of Advanced Placement tests, and percentages of students needing remediation in college. Account-EdSectorStudyCover062012That’s essentially what Steinberg’s bill, SB 1458, would do without specifying what measures would be included, and that is what his bill last year, SB 547, would have done, had Gov. Jerry Brown not vetoed it with a snarky message sharply critical of quantitative gauges of school achievement.

The report concluded that additional measures would not be a panacea, “but an outcomes-oriented API would at least measure and reinforce what’s most important: graduating students from high school with the knowledge and skills to succeed in higher education and a career,” wrote co-authors Anne Hyslop, a policy analyst with Education Sector, and Bill Tucker, deputy director, policy development at the Bill & Melinda Gates Foundation. The report was funded by the James Irvine Foundation, a big promoter and funder of an initiative to combine college readiness and career technical education, called linked learning.

This is the second report from Ed Sector in a month on the California API. Last week, I wrote about “Academic Growth over Time,” in which author Richard Lee Colvin, a former executive director of Ed Sector, recommends Los Angeles Unified’s alternative way to calculate student results on standardized tests. The reports need not be mutually exclusive; recommendations from both could be combined.

When establishing the three-digit API index in 1999, the Legislature implied that it would be adding a range of measures, but never did. Instead, the API is based on California Standards Tests results, primarily English language arts and math, plus results on the high school exit exam, which are not indicators of preparation for life beyond high school. But by adopting Common Core standards two years ago, the state embraced the goal of aligning high school achievement with college and career expectations. The API needs to change to reflect this, the Ed  Sector report says.

In his veto message of SB547 last year, Brown said that changing API now, when facing the challenges of new Common Core curriculum, texts, and tests, “doesn’t make sense.”

Sharply rebutting that, the authors wrote, “In fact, what doesn’t make sense is implementing new standards, tests, and curriculum that are aligned with college and career readiness while continuing to evaluate school performance based on an entirely different goal. More important, Brown’s continued opposition to CALPADS, his refusal to apply for federal funds to improve the state’s data collection, and his veto of the API redesign, only serve to maintain the very status quo that he repeatedly condemns.”

While college acceptance rates are indicators of readiness, the report recommends adding evidence of post-high school achievement to the API, such as college remediation rates, percentage of students who return to college after one year, and the percentage of students who enter the military or who go straight to work after high school. Unlike states like Florida, which track students after high school, California has incomplete, voluntarily collected data – hence the criticism of Brown for forgoing chances for federal database money.

Underutilized EAP measure

California does have one measure of readiness that other states consider a model: the Early Assessment Program, a series of questions created by the California State University and administered as a supplement to CSTs taken by high school juniors. But the authors said that “while touted as a model for those developing Common Core assessments, its respect outshines its influence.” The University of California and most community colleges don’t use results of EAP, and most high schools aren’t using the followup courses in math and expository writing that would enable high school seniors to bypass remediation in college.

Quoting a 2006 survey that found 10 percent of high school teachers said their students graduated not ready for college, compared with 44 percent of college faculty who said students arrived unprepared, the report cited “mismatched expectations on both sides.” Including college readiness measures in the API would encourage high schools, colleges and business leaders to work closer to create common expectations and share expertise and knowledge. The report cited promising examples: collaboration between a San Diego high school and the Grossmont-Cuyamaca Community College District to redesign high school English courses; and the extensive agreements between Long Beach Unified and the local community college and CSU, Long Beach.

Calling SB 1458 “my highest priority,” Steinberg said, “I really believe this bill would bring about a change in cultures. It would create incentives to link education with needs of economy in a fundamental way.”

“The Administration is fine with the API the way it is. I disagree and want to limit the importance of testing,” he said.

The bill, which has passed the Senate, will be heard in the Assembly Education Committee on June 27. Steinberg said he hoped to negotiate with Brown on the measures in the bill. It includes the possibility of including school inspections, which Brown raised in his veto message and mentioned in his State of the State message in January.

College readiness test’s next phase

California’s Early Assessment Program and affiliated efforts to get students college-ready are viewed in national education circles as a rare achievement, a model of K-12 and higher ed collaboration.

The recent naming of one of EAP’s key figures, California State University’s Beverly Young, to the Executive Committee of Smarter Balanced, the multistate group creating the Common Core assessment, is a sign that a new incarnation for EAP may be its ultimate triumph.

EAP is what high school juniors take, as a supplement to their state standardized tests in math and English language arts, to determine if they are college-ready. For those who aren’t, CSU has developed an expository reading and writing course and is developing a course in math for students to take as seniors. A number of states have adopted the reading and writing course for their own students.

“California’s EAP model is the best method currently available in the nation to assess and signal to students their preparedness for college-level coursework, providing them with
an opportunity to correct deficiencies before they enter college,” said a report, “California’s Early Assessment Program: Its Effectiveness and Obstacles to Successful Program Implementation,” which was released this week. It was produced by PACE (Policy Analysis for California Education) and written by Hilary McLean, former communications director for the state Department of Education.

California is a governing member of Smarter Balanced. CSU’s assistant vice chancellor of academic affairs, who’s been involved with EAP since its creation in 2004, will serve as one of two representatives of higher ed on the nine-member Executive Committee.

In announcing Young’s appointment, a Smarter Balanced press release reaffirmed the “goal of having the assessments be accepted indicators of college and career readiness.” Young this week said that she’ll be advocating that an EAP-type approach be incorporated into the 11th grade Common Core test. But she also acknowledged that, conceptual agreement aside, it will be a challenge to persuade colleges and universities from various states, all of which have their own standards for college readiness, to accept the test results. “College faculty will have to be brought in at the front end” of the test development, Young said this week. “Otherwise, they will not accept this.”

PARCC – the other Common Core assessment consortium – has explicitly said it wants to base its college-readiness system on EAP,  and has hired Allison Jones, a former CSU administrator in charge of EAP, to lead its effort.

Reputation exceeds impact

Even in California, EAP is not universally accepted. The University of California has steered clear of it, even though a quarter of its students systemwide need remediation classes in English (UCs don’t label their catch-up classes as remediation, but that’s what they are). And only about half of the state’s 112 community colleges accept EAP as a test for determining whether students are ready for credit-bearing courses.

CSU has invested a lot in EAP. On its dime, it developed the test and pays faculty to grade the 45-minute writing portion of it. It created the writing course and online math and English tutorials. It hired regional EAP coordinators to work with high schools and has trained more than 6,000 high school teachers to lead the writing course.

Still, respect for EAP probably exceeds its impact within California. It’s been a struggle to get students to understand what EAP is and to act on the results. Only 400 of the more than 1,000 high schools in the state offer the year-long expository writing and reading course, Young said.

Participation in EAP has steadily increased to more than 80 percent in English Language Arts. Source: California's Early Assessment Program (Click to enlarge).
Participation in EAP has steadily increased to more than 80 percent in English Language Arts. Source: California's Early Assessment Program (Click to enlarge).

Though voluntary, more than 80 percent of juniors now take the English piece, and nearly 40 percent take the math; fewer take the latter because they have to be enrolled in Algebra II as a junior, because CSU requires three years of math for admission. The test consists of 15 multiple-choice math and English questions, plus the writing piece.

If, as promised, Smarter Balanced’s assessment incorporates more complex short-answer questions and is computer-adaptive, posing questions based on the student’s previous answers, it could improve on EAP. EAP was not intended to be a diagnostic tool, but it could provide more information, particularly for community colleges, on gaps in students’ math knowledge. “The end game now is how to go beyond EAP with the Smarter Balanced assessment,” said PACE Executive Director David Plank.

CSU created EAP with the goal of reducing the number of students needing remediation to 10 percent of entering freshmen. That simply hasn’t happened. The percentage of juniors taking EAP deemed ready for college has edged up slightly to 15 percent in math and 21 percent in English. About two-thirds of entering CSU students still need remediation in either English or math, even though they have a 3.0 grade point average. Researchers estimate that EAP has cut the need for remediation by 6 percent in English and 4 percent in math.

The report listed some of the obstacles:

  • Students don’t understand the scores and what they mean; they assume, based on their grades, they are college-ready.
  • Since they’re part of the state standardized tests, EAP results don’t come back until August, which is late for scheduling the expository writing class;
  • Some high schools remain resistant to the CSU course, preferring to teach literature to seniors;
  • There’s a disconnect: Most high school teachers assume their students are college-ready; far fewer college instructors agree.

The picture may change soon. CSU campuses are adopting the policy that students must complete remediation courses before they arrive for school; that will encourage more to take expository writing and the new math course as high school seniors. Long Beach Unified, as part of its Long Beach Promise, requires students who don’t pass EAP to take the writing course. The year-long math course that Long Beach is piloting will go statewide this fall.

Starting this fall, Young said, students who test proficient on their standardized English language arts test and take the year-long expository writing course with a C or better will be designated college-ready in English.

“EAP has not proven a panacea,” said Plank. “Its primary value is the signal it sends to students to be ready for college. As the signal strengthens, impact on student outcomes will increase also.”

All agree on value of EAP

Seven years ago, the California State University system developed a test in math and English language arts to help inform high school juniors whether they are on track to attend one of their campuses. The Early Assessment Program – EAP –  has become a national model, and many high school students  use the results in deciding whether to seek extra math and English help in their senior year.

Now, the heads of the state community colleges and the University of California have gone on record in agreeing that EAP is a solid measure of college readiness. And they’ve  pledged to promote its use among their potential students. While that may not seem like a big deal, it’s a strong signal that the state’s staunchly independent higher ed institutions plan to unite in more assertively working  with K-12 schools to prepare students for graduation ­– not simply remediate them once they show up as freshmen.

Continue reading “All agree on value of EAP”