Is Your Scraper Slow? Try THIS Simple Method
Get Proxies from Nodemaven Now: https://go.nodemaven.com/scrapingproxy
Use Code: JWR for +2 GB on purchase
Threads and parallel processing are still useful for scraping, even though most of the waiting is I/O which is best served by async, it still can make your code much faster in the right situations, and is very simple to implement.
Join the Discord to discuss all things Python and Web with our growing community! / discord
If you are new, welcome! I am John, a self taught Python developer working in the web and data space. I specialize in data extraction and JSON web API's both server and client. If you like programming and web content as much as I do, you can subscribe for weekly content.
:: Links ::
My Patrons Really keep the channel alive, and get extra content / johnwatsonrooney (NEW free tier)
Recommender Scraper API https://www.scrapingbee.com/?fpr=jhnwr
I Host almost all my stuff on Digital Ocean https://m.do.co/c/c7c90f161ff6
A rundown of the gear I use to create videos https://www.amazon.co.uk/shop/johnwat...
Proxies I use https://proxyscrape.com/?ref=jhnwr
:: Disclaimer ::
Some/all of the links above are affiliate links. By clicking on these links I receive a small commission should you chose to purchase any services or items.