Tag:
cluster

How to evaluate the performance of your Databricks Jobs clusters with Gradient

How to evaluate the performance of your Databricks Jobs clusters with Gradient

Many data engineers and platform managers at companies want to understand “How are my pipelines doing from a cost and performance perspective?” It turns out this very benign and simple question is riddled in complexity.  Fundamentally there are so many things that can change from run to run, that even determining if it’s the same

Jeffrey Chou
03 Sep 2024

Blog, Case Study

Introducing: Gradient for Databricks

Introducing: Gradient for Databricks

Wow the day is finally here! It’s been a long journey, but we’re so excited to announce our newest product: Gradient for Databricks. Checkout our promo video here! The quick pitch Gradient is a new tool to help data engineers know when and how to optimize and lower their Databricks costs – without sacrificing performance.

Jeffrey Chou
19 Jun 2023

Blog