CUNY Academic Commons

Hi, folks. I got this question through H-HISTBIBL and thought I’d ask if any of you have suggestions I could pass along. Thanks, Daisy

From: Charles D’Aniello lclcharl@buffalo.edu
Subject: Recommendation for or Experience with Web Scraping Tool Requested
Date: 22 February 2012

I’m certain this is outside of most of our collective experiences; but I have a request to offer some guidance on a Web scraping tool for harvesting numeric data from Web sites. The intent is to harvest data that can be saved to a spreadsheet. Does anyone have anything to offer in this regard? Thanks -

I’ve had these bookmarked for a while but I’ve never used them:

1. http://www.propublica.org/nerds/item/doc-dollars-guides-collecting-the-data
2. http://www.stat.berkeley.edu/~luis/seminar/XML_presentation_LC.pdf

They seem pretty thorough, though.

Thanks!