Use dagster.io to incorporate a notebook as one step of your pipeline. See an example here: https://dagster.readthedocs.io/en/0.6.6/sections/learn/airline_demo.html#dagstermill-executing-and-checkpointing-notebooks

This way you have the best of both worlds. This will be the future of data pipelines and ETL in general IMO.