Tag: scraperwiki

by Shelly Tan

This post originally appeared on Northwestern University Knight Lab’s blog. This past fall, I spent time with the NPR News Apps team (now known as NPR Visuals) coding up some projects, working mainly as a visual/interaction designer. But in the last few months, I’ve been working on a project that involves scraping newspaper articles and […] more »

by Aine McGuire

This is a guest column by [ScraperWiki’s](https://scraperwiki.com) [Thomas Levine](http://thomaslevine.com), an awesome data scientist who spends his time roaming the globe finding interesting data and doing stuff with it. Blogging about [News Hack Day SF](http://newshackdaysf.tumblr.com), which brought together journalists, developers and designers for several days of creative news coding and data reporting, is so [three](http://www.civicplayground.com/2012/06/25/we-liberated-the-data-at-newshack/) [weeks](http://allthingsd.com/20120626/it-may-not-be-televised-but-the-journalism-revolution-will-be-hacked/) […] more »

by Ryan Thornburg

As much as the long-term success of the OpenRural project depends on technology and open records, it also depends on having enough reporters in rural communities who appreciate the journalistic power of data, but also know how to harness it correctly to tell stories and deliver reliable, relevant information to their communities. I’ve just finished […] more »

by Francis Irving

Lots of people, when they hear about ScraperWiki, ask, “Is scraping legal? How can you build a business off that?” Usually, they follow up by saying, “We do it in our company, but we would never tell anyone.” This is strange to us, as we have come from a world of good scraping: taking government […] more »

by Nicola Hughes

There’s a wonderful magic wand that every member of a digital newsroom wants to get their hands on. Take control and you can work wonders, untangle the world wide web of information, and even decrease your workload to fit in that extra cup of coffee. “What is this wand?” you ask, and “How can I […] more »

by Christopher Groskopf

Last time I wrote it was to solicit ideas for PANDA’s API. We’ve since implemented those ideas, and we’ve just released our third alpha, which includes a complete writable API, demo scripts showing how to import from three different data sources, and the ability to import data from Excel spreadsheets. The PANDA project aims to […] more »

by Nicola Hughes

Come the holidays, we all like to do ourselves up — a new frock for the party season, or a post-Movember shave. We all like to look our best in preparation for the Christmas glut. This extravagance now extends to the web. But instead of adding a bit of snowfall, ScraperWiki has driven that further […] more »

by Christopher Groskopf

Last Friday, we closed out our eighth iteration of PANDA Project development and published our second alpha. We’ve added a login/registration system, dataset search, complex query support and a variety of other improvements. You can try out the new release now by visiting our test site here. The PANDA project aims to make basic data […] more »

by Nicola Hughes

As part of the Knight News Challenge entry, we at ScraperWiki said we would roll out Journalism Data Camps across the U.S. We had done what we called “Hacks and Hackers Hack Day“ events across the U.K. and Ireland, bringing journalists and coders together. This happened at the same time as HacksHackers in the U.S. […] more »

by Nicola Hughes

Newsrooms don’t fear too much news. They fear not enough news. With news on demand 24/7, the stream of information that journalists work with is becoming the commodity upon which they rely — which is why “evergreen“ stories are becoming a staple for the modern newsroom. What they need now are evergreen news sources. So […] more »