California Schools Guide: Database of Scores With News Hook

    by Megan Taylor
    January 12, 2009
    i-66bb27f10a93fad565e3916101e20e5b-mediashift_spotlight small.jpg

    The MediaShift Innovation Spotlight looks in-depth at one great mash-up, database, mapping project or multimedia story that combines technology and journalism in useful ways. These projects can be at major newspaper or broadcast sites, or independent news sites or blogs.

    What It Is

    California Schools Guide from the Los Angeles Times is a comprehensive data-based guide to private, public and charter schools in California. The guide includes test scores, enrollment, student-teacher ratios, demographics, teacher experience and reader comments. Schools can be searched by county, city or name, and ranked by each indicator.

    The idea is to take a lot of the same data analysis work that papers have been doing for 10 to 15 years and turn them into web applications." -- Ben Welsh, L.A. Times database producer

    For people moving to or within the state, or just interested in tracking a school, this is an invaluable tool.


    Why It’s Innovative

    The California Department of Education has an enormous amount of information, but it is not provided in a usable manner. California Schools Guide presents more comprehensive, key information in a more user-friendly manner than other sites, such as GreatSchools.


    Ben Welsh

    Ben Welsh, the database producer at the L.A. Times who built the back end of the project, said, “Basically the idea is to take a lot of the same data analysis work that papers have been doing for 10 to 15 years and turn them into web applications.”


    The team at the L.A. Times started working on the California Schools Guide only one and a half months before it was launched last September. The launch date was based on the release of new test score data.

    Who’s Behind It

    California Schools Guide was created by Eric Ulken, who was the editor for interactive technology at the time (he is no longer at the LA Times); database producer Ben Welsh, and interactive graphics producer Sean Connelley, with help from members of the Computer-Assisted Reporting (CAR) team and education reporters.

    Ulken, who served as project manager, said the project was a collaboration. The L.A. Times CAR team had been downloading and using the Department of Education data for years. Eric sold the project to the metro editor and education staff, bringing them in on what he wanted to accomplish, getting input on what would be relevant and interesting, and asking reporters to link to the project from relevant stories in the future.


    The California Department of Education publishes “almost too much” information about education, said Welsh.

    Although data acquisition can be difficult for other topics (spread among bureaucracies, cities, counties, etc.), much of the data needed for the L.A. Times was easy to get. The team gathered basic demographic information and recent test scores for all public schools in the state of California, and as much as they could get on private and charter schools.

    California Schools Guide is built in Django, originally with a MySQL back end, but has since been ported to Django 1.0 using PostgreSQL. This change will mean that geographic information can be added in the future.

    Since Welsh wouldn’t get the most recent test scores until right before the project was due to be launched, he used the older data as a template, and “hoped they wouldn’t change too much.”


    For Ulken, the biggest challenge was managing a project that had to be finished on a firm date, one and a half months after the start of the project. Because of this deadline, the scope of the project had be limited, and the team’s ability to act quickly was put to the test.

    Welsh had to grind out a simplified version of the database, because the needed test scores weren’t yet available. He relied heavily on reporters who had previously worked with the education data to understand how the data fields worked.

    Ben Welsh, a database producer who worked on the California Schools Guide, wrote on his blog:

    I didn’t have the newsworthy data in hand until less than 24 hours before it would be publicly released. But by developing the site in advance using the previous year’s data as dummy entries, I was able to pre-script the loading of the 2008 data after only a few minor changes to the code. This meant that we were able to get our product out when the news hook dropped, at the same time as the paper was otherwise promoting an investigative story on the topic and the state’s propaganda arms were blasting its own message (“Things are getting better! Trust us!”).

    Welsh and Ulken had already encountered and overcome some of the obstacles on previous projects, so they were able to leverage the same server and reuse some code.

    3 Questions

    What has the response to California Schools Guide been like?

    Ulken: There have been lots of comments — the response has been mostly in the comments and traffic — not blockbuster traffic any one time, but steadily over the course of time.

    i-c80dc0a334d5301e213b508290907cf7-Eric Ulken.jpg

    Eric Ulken

    What is your favorite aspect of the project?

    Ulken: I think my favorite part is the ability to rank schools in your county by different criteria, such as average SAT scores or API score (California’s benchmark for academic performance). Factoid: Of the 10 schools statewide with the highest API scores, eight are in the Bay Area and four of those are in Fremont. Is it something in the water up there?

    What similar projects have been done at the L.A. Times?

    Ben Welsh: On a previous application, L.A.‘s Top Dogs, we had to get the dog registration records to calculate most popular dog names and breeds. Of course, there’s individual municipal county licensing and the bureaucratic terrain is so fragmented. The big question was ‘Can you get electronic records for a broad enough area to be meaningful?’


    Call for More Spotlights

    The MediaShift Innovation Spotlight will run every other week. Please let me know of any innovative projects you are working on or have seen lately. It doesn’t have to be from a major newspaper; it just has to be an innovative blend of journalism and technology. Please e-mail me at mtaylor[at]megantaylor[dot]org to submit a Spotlight recommendation.

    Photo of Eric Ulken by Old Man Lee via Flickr.

    Tagged: database education los angeles times schools

    One response to “California Schools Guide: Database of Scores With News Hook”

    1. Ben says:

      Thanks for the kind writeup, Megan. I’d like to thank the contributions of Times data analysts Sandra Poindexter and Doug Smith by name.

      Without their expertise about the state data — a thing hard won through years of admirable work — I would have been helpless.

  • Who We Are

    MediaShift is the premier destination for insight and analysis at the intersection of media and technology. The MediaShift network includes MediaShift, EducationShift, MetricShift and Idea Lab, as well as workshops and weekend hackathons, email newsletters, a weekly podcast and a series of DigitalEd online trainings.

    About MediaShift »
    Contact us »
    Sponsor MediaShift »
    MediaShift Newsletters »

    Follow us on Social Media