2018-08-29T04:44:06.862551+00:00
Incident impacting All Subbly Services

Everything looks good for now. We think we found the root problem but are just confirming the cause. Closing this off for now.

Status changed to
Fully Operational
2018-08-30T03:12:12.905411+00:00

Back off maintenance mode and testing

Status remaining
Degraded Performance
2018-08-30T00:40:23.299481+00:00

Offline temporarily making some changes to db cluster

Status remaining
Degraded Performance
2018-08-30T00:20:57.174524+00:00

Things seem to be stabilising. We ruled out the security patch. Need to do some further digging and find the root cause, but we think it may just be a case of "perfect storm".

Status remaining
Degraded Performance
2018-08-29T10:54:32.357019+00:00

We believe the performance issue is from the security patches implemented by the data centre earlier. We're working on a solution.

Status remaining
Degraded Performance
2018-08-29T07:02:56.576191+00:00

Still seeing instability and working on it still

Status remaining
Degraded Performance
2018-08-29T06:29:20.869807+00:00

Back online, we're monitoring and upgrading the status of this incident to degraded performance

Status changed to
Degraded Performance
2018-08-29T05:35:48.568800+00:00

Currently trying to isolate the reason for the instability and are temporarily offline, stay tuned!

Status changed to
Major Outage
2018-08-29T04:58:23.531531+00:00

We're experiencing some db stability issues and are working on a fix

Status changed to
Degraded Performance
2018-08-29T04:44:06.862576+00:00
Back to Current Status