How to Easily Scrape data with Python from a Website that Requires a Login

To get through this hurdle, follow the directions on this site https://curlconverter.com/#.

If you are scraping an HTML table from the target site, another helpful piece of code is to use pd.read_html(response.text). That function will convert all the tables in the response and return a list of DataFrames.

Final Thoughts

Check out more Python tricks in this Colab Notebook or in my recent Python Posts.

Thanks for reading!


Posted

in

by

Tags: