← Patterns

Incident update · P1 · Investigating

P1 ingestion delay affects Checkout, Catalog, and Inventory

Started 2026-07-30 14:12 UTC; this update is 14:31 UTC and the next update is due 14:45 UTC.

StatusInvestigatingcause not yet known
Impact3 teams503 or blocking
Next update14:45 UTCcommitted

Producer action

Retry with bounds and preserve event IDs

Mitigation underway

Platform is adding one consumer replica and observing lag for three minutes. No queue will be deleted and replica count will not exceed six without Reliability.

Escalation

After 15 minutes without falling lag, or on any crash loop, Platform pages Reliability and stops replica changes.