Chadrick Blog

release cached dataframe in pyspark

to release all cached dataframes use the following

spark.catalog.clearCache()

reference: https://sparkbyexamples.com/spark/spark-drop-dataframe-from-cache/