YOU ARE HERE: LAT HomeCollections


Whose Test Is It, Anyway?

July 12, 1998|Sigrid Bathen | Sigrid Bathen is senior editor at the California Journal, a magazine about politics and government

SACRAMENTO — As director of research and evaluation for the state Department of Education for 12 years, Alexander Law was responsible for the statewide testing of students under the California Assessment Program, or CAP. In retirement, he has continued to observe the twisted history of the state's efforts to measure student achievement, including the furor surrounding the STAR (Standardized Testing and Reporting) program, which utilized the Stanford 9 as the test. Alarmingly, it is a tale increasingly political, with worrisome consequences for education. It also raises the question of whether a standardized, statewide test can truly tell us anything meaningful about the academic progress of California's diverse student population.

Law was both a designer and an overseer of CAP, which replaced the standardized tests of the 1950s and '60s. "The early standardized tests were fairly straightforward, but they took several class periods, which in modern times does not seem inordinate, but then was," recalls Law. "So we had to develop a test that took a class period or less and was broad enough to assess a variety of commonly taught skills." The result was a "matrix" system that tested a student's mastery of subject matter, with students getting different sets of questions from the matrix.

CAP only produced scores in various subject areas. It did not individualize results, although it did offer comparisons among districts and groups of students. "The best part of CAP was that it was tailored to the state's curriculum," says David W. Gordon, who worked under Law and is now superintendent of the Elk Grove Unified School District near Sacramento. "We were always confident that we were testing what people expected to be taught. With a national standardized test [like the Stanford 9], by definition, you'll never get that."

CAP chiefly fell victim to the political wrangling between then-Gov. George Deukmejian and then-Superintendent of Public Instruction Bill Honig. It also lost out to a growing testing movement that favored more subjective, essay-type questions, which were thought to measure student achievement more accurately. The resulting test, called the California Learning Assessment System (CLAS), debuted in 1992-'93 and was quickly dumped, criticized for, among other things, being too subjective.

California's latest entry into statewide testing, the STAR program, has been no less controversial than its predecessor. From the outset, the use of a $35-million, "off-the-shelf," standardized test was opposed by virtually every major education group, in part because of Gov. Pete Wilson's insistence that the test be administered only in English and in part because state educators have been laboring to devise academic standards that would serve as a basis for a California-specific test. In the absence of such standards and corresponding curricula, the Stanford 9 results are all the more ambiguous, because any relationship the test may have with current curricula is coincidental.

An 11th-hour court ruling blocked release of some district scores, but test results have dribbled out, and reactions to them have ranged from outrage to disbelief, from resignation to disgust, all in an atmosphere of utter confusion. For example, when the Los Angeles Unified School District first released test results, it cheerfully reported that the district's overall scores, year-to-year, had improved. On second look, however, it soberly announced that the improvement was not as great as previously announced, because the results of limited-English-proficient students had not been included. (Interestingly, in some school districts, scores of bilingual students who have mastered English were higher than their English-speaking counterparts).

Not surprisingly, Stanford 9 scores in well-heeled districts were generally high, while in poverty-stricken ones low. The belief that education in California is patently unequal is nowhere borne out more starkly, and with less explanation of variables, than in standardized testing.

Educators caution that the first test period is a foundation year and that results, accordingly, should not be given too much weight. They shouldn't be dismissed, either. "It's important that people ask questions--what is working, what isn't?--as we begin to change the test, augment it, make it more aligned to the standards," says Robert L. Trigg, a member of the state Board of Education and former district superintendent.

Los Angeles Times Articles