From chaos to clarity: How Gradient Insights saves your budget (and sanity)
From chaos to clarity: How Gradient Insights saves your budget (and sanity)
In the world of data engineering, managing Databricks jobs can feel like herding cats while juggling flaming torches. You’re responsible for hundreds or even thousands of jobs, each with its own quirks and performance characteristics. And let’s be honest, most of us don’t have the time, expertise, or frankly, the patience to sift through mountains
Kartik Nagappa
11 Mar 2025
Blog, News
Unleashing the power of Declarative Computing
Unleashing the power of Declarative Computing
Imagine a world where you could simply tell your data infrastructure what you want it to achieve, rather than meticulously configuring every detail. That’s exactly what Sync Co-founder and CEO, Jeff Chou, and Alation Co-founder and CEO, Satyen Sangani, discuss in this episode of the Data Radicals podcast. “Instead of having to pick the right
Noa Shavit
05 Mar 2025
![]()
Blog
Gradient introduces cloud and Databricks cost breakdowns
Gradient introduces cloud and Databricks cost breakdowns
For data teams, understanding the true cost of operations has always been a complex puzzle. This is because your monthly bills come from multiple sources. For example, when using Databricks you have: This fragmented view makes it challenging to understand your true total cost of ownership (TCO). It also makes it difficult to identify opportunities
Kartik Nagappa
18 Feb 2025
Blog, News
Databricks Workspace Health SQL Toolkit
Databricks Workspace Health SQL Toolkit
As data engineers, understanding the intricacies of your Databricks environment is important. You can’t optimize performance, budget or ensure efficient resource allocations without it. Thankfully, Databricks gives you a behind-the-scenes look at how your workspace is running in system tables. Everything from query performance to job execution and cluster activity is in those tables. But
Noa Shavit
05 Feb 2025
Blog, News
Optimizing EC2 costs on Databricks
Optimizing EC2 costs on Databricks
The global data landscape is experiencing remarkable growth, with unprecedented increases in data generation and substantial investments in analytics and infrastructure. According to data from sources like Network World and, G2 the global datasphere is projected to expand from 33 zettabytes in 2018 to an astounding 175 zettabytes by 2025, reflecting a compound annual growth
Noa Shavit
27 Jan 2025
![]()
Blog
Adding an AI agent to your data infrastructure in 2025
Adding an AI agent to your data infrastructure in 2025
Imagine a world where you could simply tell your data infrastructure what you want it to achieve, rather than meticulously configuring every detail. This is precisely what Jeff Chou, Co-founder and CEO of Sync, discussed in the latest daily.dev webinar. This innovative concept is being made real through Gradient, the AI agent for data infrastructure
Noa Shavit
16 Jan 2025
![]()
Blog, Videos
