Some systems are experiencing issues

Past Incidents

Thursday 18th June 2020

No incidents reported

Wednesday 17th June 2020

No incidents reported

Tuesday 16th June 2020

Access logs Important delay in Metrics ingestion

Metrics ingestion is delayed, we are investigating.

08:37 UTC: Ingestion delay is back to normal. Incident was caused by a few storage nodes misbehaving after a short network issue.

Monday 15th June 2020

API Core API is experiencing issues

Our Core API is experiencing issues that impact deployments, we are working on it.

EDIT 14:50 UTC: situation is back to normal.

FS Buckets [Paris] PHP sessions and temporary files failed to be written

Due to an excessive amount of temporary files created by various PHP sessions in a very short time (+6GB in two minutes), the underlying fs-bucket for PHP sessions became full. You may have noticed various errors from 'write failed: No space left on device' to some more "random" errors that were caused by this.

Applications using redis as a session backend were not impacted by the session issue. It may have been impacted if your application generates temporary files, which are on the same fs-bucket.

Our clean-up policy of temporary files was not aggressive enough, we'll reduce it to once a day and will continue to monitor if we need to upgrade the current disk space.

This incident started at 11:33 UTC+2 and was fully resolved at 11:41 UTC+2

Sunday 14th June 2020

No incidents reported

Saturday 13th June 2020

No incidents reported

Friday 12th June 2020

Cellar Cellar Buckets are slow

We are investigating issues on Cellar Addons, we are experiencing network issues.

EDIT 15:20 UTC: fixed.