A Step-by-step Guide for Debugging Memory Leaks in Spark Applications
( go to the article → https://databricks.com/blog/2020/12/16/a-step-by-step-guide-for-debugging-memory-leaks-in-spark-applications.html )
This is a guest authored post by Shivansh Srivastava, software engineer, Disney Streaming Services. Just a bit of context We at Disney Streaming Services use Apache Spark across the business and Spark Structured Streaming to develop our pipelines. These applications run on the Databricks Runtime(DBR) environment which is quite user-friendly. One of our Structured Streaming... The post A Step-by-step Guide for Debugging Memory Leaks in Spark Applications appeared first on Databricks.
Dec. 16, 2020, 11:27 p.m.