Media and Entertainment · Mid-Market · $180K · owned by Yusuf Abdel-Rahman
Steve has not written one for this account. Everything it would read is below.
Every record Steve is allowed to cite
Director of Data Engineering
Analytics Engineering Manager
Media and Entertainment · Mid-Market · $180K · owned by Yusuf Abdel-Rahman
Steve has not written one for this account. Everything it would read is below.
Every record Steve is allowed to cite
Director of Data Engineering
Analytics Engineering Manager
Director of Technology Finance
Next step: Reserved-capacity model and query cost review by 2026-07-25
Concurrency slots were exhausted for roughly three hours on Sunday evening with about 9,000 queries submitted and p95 queue wait at 47 seconds. Raised the concurrency limit for the reporting workgroup and moved the overnight refresh out of the window.
Provided a per-query cost breakdown for the ad-hoc warehouse. Twelve recurring queries accounted for 61 percent of compute spend, nine of them full scans of the impressions table with no partition predicate.
Scale-up took about six minutes against a demand ramp that reached peak in roughly 90 seconds, so queries queued at the front of the July 4 spike. Evaluating a pre-warmed capacity floor for scheduled event windows. Still open.
Priyanka asked what a reserved-capacity floor would have to look like to carry the ordinary weeks without paying all year for the peaks. Worked it against the last nine weeks of volume: a floor around 4.2M queries per week covers every non-event week, and the two event weeks at 5.9M and 11.4M need burst on top. The harder problem is shape rather than size, since the July 4 demand ramp reached peak in about 90 seconds while scale-up currently takes about six minutes, so a burst tier only helps if capacity is pre-warmed into a scheduled window. Priyanka asked what the burst tier costs per query at that shape and how other platforms structure the same split. Jonah confirmed the platform itself is not in question and that the rollups have already reduced the Sunday peak.
Reviewed the twelve queries carrying 61 percent of compute spend and agreed on materialised daily rollups for the impressions table plus result caching on the two dashboards that refresh every five minutes. Lena estimated the rollups would remove most of the full scans. Jonah said finance is asking him for a defensible cost per query figure he can put into next year's budget.
Director of Technology Finance
Next step: Reserved-capacity model and query cost review by 2026-07-25
Concurrency slots were exhausted for roughly three hours on Sunday evening with about 9,000 queries submitted and p95 queue wait at 47 seconds. Raised the concurrency limit for the reporting workgroup and moved the overnight refresh out of the window.
Provided a per-query cost breakdown for the ad-hoc warehouse. Twelve recurring queries accounted for 61 percent of compute spend, nine of them full scans of the impressions table with no partition predicate.
Scale-up took about six minutes against a demand ramp that reached peak in roughly 90 seconds, so queries queued at the front of the July 4 spike. Evaluating a pre-warmed capacity floor for scheduled event windows. Still open.
Priyanka asked what a reserved-capacity floor would have to look like to carry the ordinary weeks without paying all year for the peaks. Worked it against the last nine weeks of volume: a floor around 4.2M queries per week covers every non-event week, and the two event weeks at 5.9M and 11.4M need burst on top. The harder problem is shape rather than size, since the July 4 demand ramp reached peak in about 90 seconds while scale-up currently takes about six minutes, so a burst tier only helps if capacity is pre-warmed into a scheduled window. Priyanka asked what the burst tier costs per query at that shape and how other platforms structure the same split. Jonah confirmed the platform itself is not in question and that the rollups have already reduced the Sunday peak.
Reviewed the twelve queries carrying 61 percent of compute spend and agreed on materialised daily rollups for the impressions table plus result caching on the two dashboards that refresh every five minutes. Lena estimated the rollups would remove most of the full scans. Jonah said finance is asking him for a defensible cost per query figure he can put into next year's budget.