Public Group active 1 year, 6 months ago

Data Visualization

Collective space for students in Data Visualization and other interested parties

Admins:

Data Scraping – Automate the Boring Stuff with Python

Viewing 1 replies (of 1 total)
  • Annalisa Wilde
    Member
    November 21, 2019 at 9:23 pm

    For more advanced control like dumping your scraped objects into dbs easily and sorting or granularity based on a text value I have been using the scrapy library. Their quickstart tutorial is pretty easy to follow and it’s best if you use xpath, but xpath is pretty simple to learn.

    If anyone else is using scrapy and has questions/issues, I’m happy to help troubleshoot.

Viewing 1 replies (of 1 total)

You must be logged in to reply to this topic.