1 min readJun 10, 2020
You have pandas in spark as well, it’s called koalas: https://github.com/databricks/koalas so no need to switch just for the matter of pandas.
Written by Simon Späti
Data Engineer & Technical Author with 15+ years of experience. I enjoy maintaining awareness of new innovative and emerging open-source technologies.