Logs SystemLogs are deactivated while we are investigating an issue
Logs are deactivated while we are investigating an issue.
EDIT 19:14 UTC: Logs should now be back to normal. Sorry for the interruption.
APIAPI, console and other Clever Cloud applications partially unreachable
Dedicated load balancers for Clever Cloud's own applications (APIs, Console, website, ...) are overloaded.
We are in the process of adding capacity to resolve this issue.
14:28 UTC: Performance is back to normal.
Reverse ProxiesSome applications are responding slowly or are unreachable
At 11:30 UTC we started getting tickets about customer's applications not responding.
We started investigating. It looks like the network or the reverse proxies are responsible for that.
EDIT 12:46 UTC: we are experiencing abnormal new connection rates on public reverse proxies.
EDIT 12:50 UTC: we found the responsible application for this new connection rate and are mitigating it.
EDIT 14:19 UTC: Load balancers have been upscaled so they can handle more traffic. Performance is back to normal since 13:12 UTC.
Tuesday 8th June 2021
Logs SystemLogs ingestion malfunction
Logs ingestion is malfunctioning. We are investigating.
08:00 UTC: New logs are being ingested. Logs emitted during the incident will not be ingested in the main logs storage system. Log drains may start receiving (part of) the older logs, we are still investigating this part.
08:15 UTC: Looks like everything that could be ingested has been ingested. Ingestion delay may still be a little higher than normal though, it should go back to normal soon.