Past Incidents

Sunday 9th June 2019

Cellar A cellar node is restarting

One node of our old Cellar cluster is restarting, some requests are failing (timeouts or 500 errors). This will be resolved once the node has fully restarted. We may need to restart more nodes right after.

EDIT 23:30 UTC: Other nodes need to be restarted. We saw <1% of failing requests, expect the same amount for the remaining restarts.

EDIT 02:00 UTC: Nodes have been restarted, failing requests are getting lower and lower, still under 1%.

Saturday 8th June 2019

No incidents reported

Friday 7th June 2019

API API Unavailable or very slow

Our main API is currently having some troubles to respond to requests in a timely manner. We are investigating it.

EDIT 15:32 UTC: The issue has been identified, we are currently re-deploying the API. Console is still unavailable.

EDIT 15:34 UTC: The API successfully redeployed and is now available. Console is now available too. The incident is over.

Logs system part restart, scheduled 4 years ago

We will restart a part of our logs system, it will take 2 minutes. After this interruption, the logs produced during the restart will be available but the logs ordering will be lost. This restart is a part of our new logs system development.

EDIT 14:27UTC: finished.

Thursday 6th June 2019

No incidents reported

Wednesday 5th June 2019

No incidents reported

Tuesday 4th June 2019

No incidents reported

Monday 3rd June 2019

Console Two Factor Authentication

Two Factor Authentication is currently down, resulting in users unable to log in.