How a Disney Senior Data Engineer Obtained 80% Cost Savings using Gradient
Disney job speedup from 90 min. to 24 min.
![](https://synccomputing.com/wp-content/uploads/2022/06/1-CtNejMwVfXhGr3q5GmuiWQ.png)
Sr. Data Engineer at Disney Streaming
In the self-written blog post below, a Sr. Data Engineer chronicles his experience with the Spark Gradient for EMR. In the blog post we helped accelerate a job from 90 to 24 minutes, which was amazing to see!
![](https://miro.medium.com/max/1400/1*FEkR_l5W_RxVxUJD0BJ7UA.png)
![](https://miro.medium.com/max/1400/1*0NopkxiD-fwI3IC49kIpoA.png)
The first job I put into the gradient went from processing in around 90 minutes to 25 minutes after I changed the configurations, only using a slightly larger cluster. However, that time save makes up for using more nodes, so it definitely worked to our advantage.
Matthew Weingarten
![](https://synccomputing.com/wp-content/uploads/2022/05/blankspace-1-1024x141.png)
Extrapolated over a full year, our anticipated savings to his company was over $100K on AWS! Obviously this doesn’t include the extra time savings of removing the current manual guesswork of provisioning clusters.
![](https://synccomputing.com/wp-content/uploads/2022/05/blankspace-1-1024x141.png)
User’s blogpost here
More from Sync:
Databricks 101: An Introductory Guide on Navigating and Optimizing this Data Powerhouse
![Noa Shavit](https://synccomputing.com/wp-content/uploads/2024/06/Noa_bw-150x150.jpg)
Databricks 101: An Introductory Guide on Navigating and Optimizing this Data Powerhouse
Top 9 Lessons Learned about Databricks Jobs Serverless
![](https://synccomputing.com/wp-content/uploads/2021/12/JeffChou-150x150.png)
Top 9 Lessons Learned about Databricks Jobs Serverless
Gradient Product Update— Discover, Monitor, and Automate Databricks Clusters
![](https://synccomputing.com/wp-content/uploads/2021/12/JeffChou-150x150.png)
Gradient Product Update— Discover, Monitor, and Automate Databricks Clusters