release cached dataframe in pyspark
to release all cached dataframes use the following
spark.catalog.clearCache()
reference: https://sparkbyexamples.com/spark/spark-drop-dataframe-from-cache/
to release all cached dataframes use the following
spark.catalog.clearCache()
reference: https://sparkbyexamples.com/spark/spark-drop-dataframe-from-cache/