Data Visualization

Public Group active 1 year, 2 months ago

Data Scraping – Automate the Boring Stuff with Python

Tagged: ,

Viewing 2 posts - 1 through 2 (of 2 total)
  • Author
    Posts
  • November 21, 2019 at 6:30 pm #81347
    Joanne Ramadani
    Participant

    Hi everyone, this is what we were just talking about in class re: data scraping and Python! https://automatetheboringstuff.com/chapter11/

    November 21, 2019 at 9:23 pm #81349
    Annalisa Wilde
    Member

    For more advanced control like dumping your scraped objects into dbs easily and sorting or granularity based on a text value I have been using the scrapy library. Their quickstart tutorial is pretty easy to follow and it’s best if you use xpath, but xpath is pretty simple to learn.

    If anyone else is using scrapy and has questions/issues, I’m happy to help troubleshoot.

  • Author
    Posts
Viewing 2 posts - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.