Live Status\Incident History\Caching service overload
Outage
Caching service overload
Affects Ticket shop
- Resolved
Systems are now stabilized and operation of services are smooth again. Incident description: During a service disruption, some users might have encountered issues during the checkout process. A significant portion of user activities, such as viewing products, adding items to the cart, or making payments, experienced errors. It is estimated that this affected approximately 8.3% of all requests made within the time period of the disruption. Why did it happen: The service disruption was primarily caused by issues with how our caching service was configured. Certain services were unable to write to the cache as intended, necessitating a direct load of data from the database for each user request. This unexpected burden led to high load levels on our database and subsequent slowdown of services, ultimately causing portion of them to fail.
- Identified
We're manually adjusting the scale of the caching service. Systems should be back on track soon.