On Thursday, October 2nd, 2025 between 11:35 AM and 2:50PM EDT and again between 3:05PM EDT and 5:15 PM EDT, the Studio platform experienced degraded performance during which customers could have experienced slow loading or failure to load dynamic campaign assets in our US data centers.
On-call engineers were engaged during both incident windows and after investigation it was determined that the first degraded performance window was due to a downstream service's scaling configuration change as part of a recent service release, which resulted in increased latency to upstream services. Once the issue was identified, Engineering initiated a rollback of the scaling configuration change which resulted in the restoration of normal dynamic campaign asset rendering performance.
The second degraded performance window was due to a rate limiting issue within the platform during autoscaling of the dynamic campaign asset service. Once the issue was identified, Engineers initiated a scale in of resources to mitigate the rate limiting issue and normal dynamic campaign asset rendering performance was restored.
Engineering has improved the process around autoscaling configuration changes, along with introducing an update to further mitigate the likelihood of the rate limiting that was encountered from occurring again.