How to evaluate the performance of your Databricks Jobs clusters with Gradient
How to evaluate the performance of your Databricks Jobs clusters with Gradient
Many data engineers and platform managers at companies want to understand “How are my pipelines doing from a cost and performance perspective?” It turns out this very benign and simple question is riddled in complexity. Fundamentally there are so many things that can change from run to run, that even determining if it’s the same
Jeffrey Chou
03 Sep 2024
Blog, Case Study
How Abnormal Security Reduced Databricks Costs by 38% with Gradient
How Abnormal Security Reduced Databricks Costs by 38% with Gradient
Who is Abnormal Security? Abnormal Security, aka Abnormal, is a hypergrowth company in the email security space that helps companies worldwide prevent email attacks while automating security operations. They rely on Databricks extensively to help process terabytes of data across thousands of jobs daily, translating to an enormous amount of daily Databricks usage. From ETL
Jeffrey Chou
18 May 2024
Case Study
How Forma.ai improved their Databricks costs quickly and easily with Gradient
How Forma.ai improved their Databricks costs quickly and easily with Gradient
Forma.ai is a B2B SaaS startup based in Toronto, Canada building an AI powered sales compensation system for enterprise. Specifically, they seamlessly unify the design, execution, and orchestration of sales compensation to better mobilize sales teams and optimize go-to-market performance. Behind the scenes, Forma.ai deploys their pipelines on Databricks to process sales compensation pipelines for their
Jeffrey Chou
12 Feb 2024
Case Study
