Simon Späti
1 min readJan 21, 2020

--

Yes, I’m using it right now to get more hands-on. But already now I can say, it will be what we need for the future, especially if you have a data lake or blob storage somewhere. I believe you can’t get around, except you pay money for managed data lakes like Palantir or others.

Two things that are missing right now would be a kind of data lineage when you use delta tables on top of delta tables. Plus a data catalog. But latter is coming with Spark 3.0, that’s also one thing I want to try out sooner how it can incorporate with delta. Might be a perfect fit. Are you using spark? Or do you know more about data catalog in spark 3.0.0?

--

--

Simon Späti
Simon Späti

Written by Simon Späti

Data Engineer & Technical Author with 15+ years of experience. I enjoy maintaining awareness of new innovative and emerging open-source technologies.

No responses yet