Web Scrape Websites with a LOGIN - Python Basic Auth
Here we go through how to use requests to POST the login information and session to make it persistent, allowing us to scrape information behind a login wall.
Dummy site: https://the-internet.herokuapp.com/login
-------------------------------------
Patreon: / johnwatsonrooney
Scraper API I use: https://www.scrapingbee.com/?fpr=jhnwr
Proxies: https://iproyal.club/JWR50
Hosting: Digital Ocean: https://m.do.co/c/c7c90f161ff6
Gear I use: https://www.amazon.co.uk/shop/johnwat...
Twitter / jhnwr