Tag:
Graviton

Are Databricks clusters with Photon and Graviton instances worth it?

Are Databricks clusters with Photon and Graviton instances worth it?

Configuring Databricks clusters can seem more like art than science.  We’ve reported in the past about ways to optimize worker and driver nodes, and how the proper selection of instances impacts a job’s cost and performance.  We’ve also discussed how autoscaling performs, and how it’s not always the most efficient choice for static jobs.   In

Jeffrey Chou
17 Aug 2023

Blog

Do Graviton instances lower costs for Spark on EMR on AWS?

Do Graviton instances lower costs for Spark on EMR on AWS?

Here at Sync we are passionate about optimizing cloud infrastructure for Apache Spark workloads.  One question we receive a lot is “Do Graviton instances help lower costs?”   For a little background information, AWS built their own processors which promise to be a “major leap” in performance.  Specifically for Spark on EMR, AWS published a report

Jeffrey Chou
04 Apr 2023

Blog, Case Study