Category: Information

Obama’s promise for open government

I’m excited about Obama’s memorandum he wrote in his first week of office, on January 21st, 2009. In it, he calls for federal agencies to stop looking for legal ways to say no to requests for data, or in response to Freedom of Information Act requests.

He will help usher in a new American government, where “[a]ll agencies should adopt a presumption in favor of disclosure.” 

And the agencies shouldn’t be so passive about the distribution of their data. President Barack Obama continues with:

“…agencies should take affirmative steps to make information public. They should not wait for specific requests from the public. All agencies should use modern technology to inform citizens about what is known and done by their Government. Disclosure should be timely.”

The United States Government is probably the world’s largest collector and holder of data. It probably stores more data and information than the internet (minus what the government publishes there). I hope I can expect an onslaught of data, but it must be accessible in multiple formats and in ways we can use. Saving spreadsheets is NOT distributing data. That’s protecting it and trying to make it harder to manipulate. It means providing raw access to tables and databases, providing APIs for custom queries, and XML feeds for simple and broad presentation.

Perhaps we’ll need a White House Office of Data to coordinate with agencies about the formats and presentation and distribution methods they choose or will choose.

I’m glad Obama’s transition team took the advice from the Electronic Frontier Foundation (EFF) on this one – they fight for, among many things, the rights of the internet and information and how access to both should be equalized and open. Read the EFF’s news article about this about-face from George Bush’s archaic information policies.

To Obama: When you create that office, please consult the geniuses at EveryBlock for the Office’s “Public Consumption” division. They know how to package data for quick and informative understanding.

Converting shapefiles and KML files

Google Earth Pro is a slightly more advanced version than the free edition of the popular satellite imagery application (okay, it does way more, but many people just use that feature). One major additional feature it includes is the ability to import GIS shapefiles and display their features on top of the imagery, including terrain. It’s useful to have your data as KML (Keyhole Markup Language) because KML (or KMZ) is easier to share and Google Earth standard edition is free. But then again, it’s useful to have your KML files as shapefiles because proper GIS software is more powerful at analyzing data. Also, someone might ask you for your data in shapefile format (but they could easily follow these instructions).

Good data management requires options. Options mean your data won’t be locked into a proprietary format. Data want to be free! Read on for ways to convert your KML and shapefile data:

Converting KML files to shapefiles

Like Google Earth Pro, Quantum GIS (QGIS) can convert KML or KMZ to shapefile, and best of all – it doesn’t cost $400 per year (it’s free!). QGIS is a cross-platform application meaning it will run on Windows, Mac OS X, and Linux.

Use QGIS to convert a KML or KMZ file to shapefile:

  1. Click on Layer > Add Vector Layer
  2. Find your KML or KMZ file.
  3. Right-click your new layer and click “Save as shapefile.”

Zonums provides online conversion tools. Or, use ArcGIS and this plugin to convert KML files to shapefiles.

Converting shapefiles to KML files

The freeware Shp2kml 2.o (Windows only) from Zonums will convert shapefiles to KML files. Want some free, interesting data to try it out? Check my ever expanding repository.

ESRI’s ArcGIS can convert KML files to shapefiles using this plugin and then import the shapefile as a layer onto your map.

Creating KML files online

As I described in this post, BatchGecode will generate a KML file for you by inputting a list of addresses and names. Additionally, Google Earth (part of the rising Google GIS platform) creates KML files. Google’s My Maps feature also allows you to generate KML files (for sharing or download) by clicking and drawing points and lines on a map and inviting you to describe the features you create. Use this to get a map of your church congregation, or a map of people who voted for your candidate.

GeoCommons Finder lets you upload geodata in many formats, save it to your profile, and then download it into multiple formats. You can upload a shapefile (.shp) and its accompany files (shx, dbf, and prj), verify that it read your data correctly,

More choices for converting

Additional software with conversion capabilities:

  • MapWindow (another free software choice; Windows only) – An alternative to QuantumGIS and ArcGIS.
  • ExpertGPS (Windows only, not free) – Ideal for GPS device owners, or for researchers using GPS devices in projects. But it can convert the GPS and shapefile data into KML, shapefiles, or a spreadsheet, amongst other functions.
  • Zonums, creator of the standalone Shp2kml software converter, now offers many online tools for KML users, including one that reverses the conversion and exports shapefiles from KML files. I found the link on FreeGeographyTools.com.
  • OpenGeo Suite – Commercial software with non-profit licenses.
  • uDig – Free GIS software, but I haven’t had good experiences with it on my computers.

GeoCommunity has a good article, with screenshots, on how some of these programs work.

Need to work with General Transit Feed Spec (GTFS) data?

Finding geographic information about Chicago and elsewhere

The City of Chicago’s GIS division of the Department of Information and Technology as well as the Zoning Department provide copious data on boundaries, crime, zoning, etc… And I’m not talking about a library of PDF files. You can’t analyze or manipulate or calculate using PDF – I’m talking about data sets, shapefiles, or aerial photographs.

You can start here on the GIS website.

 The Chicago Police produce the CLEARMAP website. And even the Bicycle Program throws down with bikeways and bike parking data. Check out Wicker Park’s Center for Neighborhood Technology and its urban data visualization websites, like their Housing and Transportation Affordability Index.

List sources for your city’s data in the comments. Milwaukee has its own Spatial Decision Support System called COMPASS. Here’s Maricopa County’s (Phoenix, Mesa, Tempe) ArcServer-based online GIS website.

Check to see if EveryBlock has started data mining your city. They began their news collection and repackaging efforts in Chicago, naturally 🙂 They are the first organization to find a new way to present Chicago’s bike rack installation info.

UPDATE: The community at OpenStreetMap has a huge list of datasets available for cities and places around the world.

How to geocode multiple addresses in QGIS

UPDATE April 11, 2013: Updated the directions because the “Add delimited text layer” function moved from the Plugins to Layer menu. 

UPDATE March 24, 2011: I updated the directions to use GPS Visualizer instead of BatchGeocode.com because BG stopped giving geographic coordinates in its output.

Get directions on geocoding a single address in QGIS with a plugin.

QGIS is an open-source Geographic Information Systems (GIS) application that has been gaining ground since 2004. It runs on all operating systems (it began as a Linux project) and you can download it for free.

I use it often because ESRI doesn’t make the popular ArcGIS software for Mac. That’s unfortunate, but like I said here, software, technology and mapping issues can be easily overcome – we can use QGIS to create maps. QGIS, though, is missing one major feature for basic map building: geocoding.

Here’s a step-by-step tutorial on how to bring in multiple street addresses and their XY coordinates into your QGIS map en masse: Continue reading

Bike shops’ social responsibility

Bike shops have a responsibility to teach their customers safe cycling.

This is because the bike shop salesperson has the customer’s attention, and it’s when the customer will be most receptive to tips, advice, and training. The bike shop salesperson, in many cases, will be the first and last person the customer talks to about biking. Lastly, it’s because the bike shop is a community center with a wealth of knowledge and experience – all of which should be shared.

The customer’s family is probably not a good resource and websites and friends can only teach them so much. But a bike shop salesperson has two advantages over other friends, family, and the internet: the customer’s time and trust.

Each bike shop should take it upon themselves to teach each new customer how to ride safely and legally on the street, the local laws regarding its operating and accessories (buy some lights, please!), etiquette for multi-use paths (like Chicago’s Lakefront Trail), and proper locking techniques.

  1. All bikers will, at some point, have to ride on the street in mixed traffic.
  2. It’s unreasonable to expect cyclists to know the laws applicable to cycling when they’ve had very little experience cycling and when there are no widespread institutions that teach cycling.
  3. Multi-use paths are fountains of rage and dangerous commingling. 
  4. The cyclist will be in a situation that requires them to secure their bicycle.

No matter how adamant the customer is that they won’t be riding in the street, they will. The sidewalk is illegal territory in so many communities, and isn’t safe for the cyclist themselves or the pedestrians they might run over. On sidewalks or on multi-use paths, they will have to cross streets with automobile traffic. It’s a little different than being a pedestrian and crossing these streets because you are operating relatively heavy equipment and you move at a different speed. Eventually, this cyclist will graduate from scaredy-cat to coffeehouse comfortable, biking to a café down the street. Talking one on one about these things, using diagrams from a brochure will influence the new cyclist that safe cycling matters – for themselves and those with whom they’ll interact. Then show them how to read a map.

Bicycle laws are not handed to 16-year olds in high school (actually, they most likely are, but who reads that?). That might have been 10 years ago, and they won’t remember that a front headlight but only a rear reflector are required for post-dusk riding. Or that red lights are for all street users (and really dangerous to disobey). Don’t forget that some bicyclists were taught to ride against traffic, facing cars down on the wrong side of the street.

Those customers who might be telling the shop salesperson that they won’t be riding in the street probably think they’re only going to ride on the multi-use path. These customers need trail etiquette stressed to them. They need to know when it’s safe to pass, what to say to those they’ll pass, the right speed to travel, and when to stop or slow down. The trail is not a speeding zone; rollerbladers, children, strollermoms, teams in training, walkers, and in some places even horses and their riders, will all be groups with whom the cyclist must interact and take care of – this mix is fun to watch and be around, but path users must pay attention to each other. 

Real locking techniques may be one of the most useful things you can teach any cyclist. They won’t be cyclists if they can’t keep their bike! The City of Chicago offers a guide on theft prevention and proper locking, two unique but related concepts. You shouldn’t do one without the other, because they enhance the overall “theft-proof-ness” of a bike. The salesperson can spend five minutes demonstrating to the customer cross-locking, and then having the customer practice. They can also quiz the customer on appropriate locking locations. What structures are secure and which ones aren’t? Why or why not?

Preface this lesson to the customer that “in 20 minutes, you can become a bicycling expert!” The bike shop-customer bond will strengthen and you’ll have proved to them your service is necessary and appreciable. Because you took the time to show a customer how much you care about them, their new bike, and the sport or utility of bicycling, they’ll spread the word and come back.