Data News

  • Sun Nov 04 2012
    5 notes

    Predicting Questions, Building Answers

    With hurricane Sandy churning far off the Florida coast, we began anticipating questions people would have around the storm. And then we tried to code answers to those questions as fast as we could. 

    In order, those questions turned out to be:

    Where’s the storm forecast to go? For this, we dusted off our Hurricane Tracker, built for hurricane Irene, and fed it with the National Weather Service data for Sandy. As with almost all of our work, we made it free and easy to embed, and many news outlets did.

    What zone am I in? Again, we dusted off something made for Irene — our NYC Evacuation Zone Map. We updated it with better colors and areas newly designated as Zone A. We also published a project I’d been working on since Irene: a Storm Surge Map of the entire New York and New Jersey coastline.

    Where’s the storm now? As the storm approached land, we switched layers in the hurricane tracker from the forecast track to a real-time radar image.

    Sandy Radar Detail

    What systems are closing, and when? We knew there was a good chance the subways and other transit services would be shut down ahead of the storm. We also knew that there was no single place where all of that information resided. So days before the storm, we built our Transit Tracker. Thanks to Steve Melendez coding it over the weekend, we had it running when officials announced the transit shutdown plans. As an added bonus, the tracker is fed by a Google spreadsheet, so multiple producers can update it simultaneously.

    Where’s the water rising? With everything shuttered, we wanted to help people watch the storm’s effects in real time. The National Weather Service maintains a network of flood-level monitors on the coast and on inland rivers. We took a feed off that system and modified it slightly to show pop-up charts for our Flood Gauge Watch — which we monitored through the storm.

    As the storm hit, Melendez and I worked at WNYC under backup power making minor fixes and trying to catch up on our election-night mapping project.

    After the storm, the team tackled two more questions:

    What’s the traffic like? We heard traffic was gridlocked as people returned to work Wednesday, so we resurfaced our Traffic Map to show the trouble spots — which included most of Manhattan.

    Which subway lines are open? Anticipating the subway system would open in stages, we wanted give people a map as the restoration progressed. I guessed that the MTA would provide a list of partially-open lines before they had maps, so Louise Ma built a beautiful base map from files left over from our Lost Subways project and prepared to update it. Melendez found a clever way to let people to pan and zoom it like a Google map. But I was wrong: The MTA issued clear PDF maps right away, so we scrapped Ma’s map and fed the official version into Melendez’s Changing Trains app.

    There’s a lot more we wished we could have done — and could have done better. That may be the subject of another post. But we hope we what we made provided answers when they were needed.

    - John Keefe

  • Sun Dec 04 2011
    0 notes

    Journo-Hacker Sharing in Action

    By John Keefe, WNYC

    If you need more proof that it’s valuable for journalist-programmers to show their work, here’s some: WNYC’s Live New Jersey Election Map.

    Exactly one week after Albert Sun of the Wall Street Journal New York Times shared some of his work, we made this:

    Nj-elex-map-detail

    (Map isn’t embeddable for licensing reasons; the live version is here.)

    Here’s what happened.

    Last month I went to a Hacks/Hackers NYC meetup about mapping. There, Albert showed his WSJ Census Map Maker project and a map I had admired that has dynamic mouse-overs without using Flash. At one point, he showed his project’s code repository and welcomed us to use and build on it.

    The next day, I downloaded the code and tried to make a rough version of Albert’s map, but using the shapes of New Jersey legislative disricts (downladed from the US Census, stored in this Fusion Table, which generates this KML file). After a little tinkering, I managed to build one that works. I sent that to stellar coder Jonathan Soma, of Balance Media, who works with me to build interactives for WNYC.

    I also reached out to Al Shaw, of ProPublica, who I knew (from another Hacks/Hackers Meetup) had wrestled with live Associated Press election data for Talking Points Memo. He had some great tips, which I passed along to Soma, too.

    Also on the case were Balance’s Kate Reyes and Adda Birnir, who crafted the map’s design and user experience — a particularly tricky task because each district elects one person for state senate and two people for state assembly.

    A week later, as the results rolled in, WNYC’s map was live and rockin’ — listing real-time returns for each district, and changing colors when races were called.

    In the process, Soma built on Albert’s work, and those modifications are now a part of the code base (see Github commits here and here).

    And if you need proof that such work is valuable, the map was WNYC’s No. 6 traffic-getter for the month — despite the fact it was truly useful for about 4 hours late on the evening of an off-year election.

  • Tue Aug 30 2011
    0 notes

    Making the NYC Evacuation Map

    By John Keefe

    A couple of years ago, I had our WNYC engineers use a plotter to print out this huge evacuation map PDF. Seemed like a good thing for the disaster-planning file. Just in case.

    Then, back in June of this year, I was browsing the NYC DataMine (like you do), and realized New York City had posted a shapefile for the colored zones on that map.

    I knew I could use the shapefile to make a zoomable Google map — which would be a heckuvalot easier to use than the PDF. So I imported the shapefile into a Google fusion table. (It’s super easy to do; check out this step-by-step guide.) Next, I added that table as a layer in a Google Map and tacked on an address finder I’d developed for WNYC’s census maps.

    Then I tucked the code away on my computer. Just in case.

    Fast-forward to Thursday morning, as Irene approached. On the subway in to work, I polished the map and added a color key. It was up on WNYC.org by midmorning, long before the Mayor ordered an evacuation of Zone A.

    When the order was announced, I used another fusion table to add evacuation center locations, updating that list with info from New York City’s Chief Digital Officer Rachel Sterne. (The dots are gone now, since the sites are closed.)

    I’m not at liberty to reveal traffic numbers, but the site where we host our maps received, um, a lot more views than it usually does. By orders of magnitude. Huge props to the WNYC.org digital team for keeping the servers alive.

© 2011-2013 New York Public Radio.
  • Archive
  • RSS
Information, open data and behind-the-scenes details from the WNYC Data News Team.

Collectively, we’re  @datanews.

Photo of John Keefe

John Keefe

Editor
Go to profile

 

Photo of Steve Melendez

Steven Melendez

Developer
Go to profile

 

Photo of Louise Ma

Louise Ma

Designer
Go to profile

 

Photo of Louise Ma

Joe Geoghan

Intern
@joegeoghan

 


Like our work?

Support WNYC.