Projects with a web-scraping focus
Accelerating Web Data Processing with Scalable Techniques
After solving a significant web-scraping task for my employer, it seemed right to share key methods to scale webscraping, specifically some of the considerations in optimising data extraction for scale and efficieny.