Django API - Scraping Top 5 IT Stock Market Django Python Requests BeautifulSoup Pandas Matplotlib
GitHub Repository:
https://github.com/lba-source-code/pj...
Presentation
Thanks for stopping by. I would like to share a hands-on experience about a process automation with Django application. I am using some steps of DevOps methodology, like control version with git, and share development in remote repository like GitHub. I am also doing more than one integration each day.
Scope
The goal of this automation process project is to get from web page investing five stock values, and publish them into a dataframe table on html template.
Architecture
Operating system: Windows 10 Pro Virtual environments: venv module with runtime python version = 3.8.1 Packages: Django, requests, BeautifulSoup, pandas, matplotlib
Unit test
In the project I have included some examples of unit test.
test_check_request_status_ok
test_check_request_status_ko
test_check_content_have_stockname
test_check_content_have_stockvalue
The control flow structure of application is:
Connect to investing web page (requests.get)
Get all DOM elements and find stock name and value (BeautifulSoup)
Build a dataframe with all values scraping (pd.DataFrame)
And display them into a matplotlib bar in a html template (plt.Figure())