If I think of ETL with Python, I think about frameworks like prefect or dagster. These are the future for orchestrating your data with Python, in my opinion. If you want to know more, check out my latest blog (and others) for this very matter: https://sspaeti.medium.com/building-a-data-engineering-project-in-20-minutes-85c37cad4d87

I also use Beautiful Soup for extracting data in the first place :-)