From chaos to clarity: How Gradient Insights saves your budget (and sanity)
From chaos to clarity: How Gradient Insights saves your budget (and sanity)
In the world of data engineering, managing Databricks jobs can feel like herding cats while juggling flaming torches. You’re responsible for hundreds or even thousands of jobs, each with its own quirks and performance characteristics. And let’s be honest, most of us don’t have the time, expertise, or frankly, the patience to sift through mountains
Kartik Nagappa
11 Mar 2025
Blog, News
Unleashing the power of Declarative Computing
Unleashing the power of Declarative Computing
Imagine a world where you could simply tell your data infrastructure what you want it to achieve, rather than meticulously configuring every detail. That’s exactly what Sync Co-founder and CEO, Jeff Chou, and Alation Co-founder and CEO, Satyen Sangani, discuss in this episode of the Data Radicals podcast. “Instead of having to pick the right
Noa Shavit
05 Mar 2025
![]()
Blog
Gradient introduces cloud and Databricks cost breakdowns
Gradient introduces cloud and Databricks cost breakdowns
For data teams, understanding the true cost of operations has always been a complex puzzle. This is because your monthly bills come from multiple sources. For example, when using Databricks you have: This fragmented view makes it challenging to understand your true total cost of ownership (TCO). It also makes it difficult to identify opportunities
Kartik Nagappa
18 Feb 2025
Blog, News
Optimizing EC2 costs on Databricks
Optimizing EC2 costs on Databricks
The global data landscape is experiencing remarkable growth, with unprecedented increases in data generation and substantial investments in analytics and infrastructure. According to data from sources like Network World and, G2 the global datasphere is projected to expand from 33 zettabytes in 2018 to an astounding 175 zettabytes by 2025, reflecting a compound annual growth
Noa Shavit
27 Jan 2025
![]()
Blog
Adding an AI agent to your data infrastructure in 2025
Adding an AI agent to your data infrastructure in 2025
Imagine a world where you could simply tell your data infrastructure what you want it to achieve, rather than meticulously configuring every detail. This is precisely what Jeff Chou, Co-founder and CEO of Sync, discussed in the latest daily.dev webinar. This innovative concept is being made real through Gradient, the AI agent for data infrastructure
Noa Shavit
16 Jan 2025
![]()
Blog, Videos
Choosing the right Databricks cluster: Spot instances vs. on-demand clusters, All-Purpose Compute vs. Jobs Compute
Choosing the right Databricks cluster: Spot instances vs. on-demand clusters, All-Purpose Compute vs. Jobs Compute
According to Wavestone’s 2024 Data and AI Leadership Executive Survey, about 82.2% of data and AI leaders report that their organizations are increasing investments in data and analytics. As companies increasingly rely on big data, the significance of efficient data processing solutions and optimal configuration of clusters become even more crucial. Choosing the correct cluster
Noa Shavit
17 Dec 2024
![]()
Blog
