Tools for working with Data

Web Scraping

Web scraping is a technique of extracting information from websites.



Scraperwiki has tutorials on scraping webpages for data, written for Python and Ruby.

Google Refine

Use to clean up messy and inconsistent data

Chrome Developer Tools

use to see the DOM underlying web pages

If there is a table of data on a web page that you want to scrape, select it with your mouse, right click on the selection and choose inspect element in the pop up menu. This should work in Safari, Chrome or Firefox with the Firebug plug-in.

Data Analysis