Sync presentation on global optimization of Apache Spark at the 2022 Databricks conference
We were thrilled to present our work at the 2022 Databricks conference in San Francisco! Below is a recording of our talk where we introduce the Apache Spark Gradient and the longer term orchestration work.
More from Sync:
Choosing the right Databricks cluster: Spot instances vs. on-demand clusters, All-Purpose Compute vs. Jobs Compute
Noa Shavit
Choosing the right Databricks cluster: Spot instances vs. on-demand clusters, All-Purpose Compute vs. Jobs Compute
Databricks Compute Comparison: Classic Jobs vs Serverless Jobs vs SQL Warehouses
Jeffrey Chou
Databricks Compute Comparison: Classic Jobs vs Serverless Jobs vs SQL Warehouses