Some systems are experiencing issues

Past Incidents

Wednesday 1st June 2022

No incidents reported

Tuesday 31st May 2022

TCP reverse proxies on Montreal zone are experiencing issues

We identified one flaky TCP reverse proxy in the Montreal zone. We are investigating.

EDIT 20:37 UTC - fixed.

Unique IP for outgoing traffic [PAR] Unique outgoing IP service issues

There are some issues with this service for now, applications traffic may not be routed through the proxy and may end up using another IP (hypervisor's IP) instead. We are investigating.

EDIT 09:21 UTC: The issue should have been fixed. Your applications might need to be redeployed if the issue persists. We continue to monitor the service.

EDIT 13:11 UTC: We didn't see any other issues with the service, the issue is now resolved.

Monday 30th May 2022

Infrastructure PAR: An hypervisor is currently unreachable

We are currently having an unreachable hypervisor on the Paris zone due to a connection loss. We are trying to restart it. Impacted applications are automatically redeployed.

EDIT 22:46 UTC: The hypervisor doesn't reboot, we continue our investigation.

EDIT 00:06 UTC: The hypervisor is back online since a few minutes. All services are now available again. The extended period of downtime has been identified and will be fixed on similar hypervisors to have a faster recovery next time.

Sunday 29th May 2022

Access logs Metrics / Access logs: ingestion issues

Ingestion of new access logs and metrics points is currently having an issue, leading to missing data points in metrics. Access logs ingestion is currently on hold and will be processed later. The issue has been identified and we are working to fix it.

EDIT 21:04 UTC: Ingestion is now back to normal. Access logs will be processed over the next few hours.

Saturday 28th May 2022

No incidents reported

Friday 27th May 2022

Infrastructure [PAR] Server lost

We lost a server which host severval components on PAR zone

UPDATE: all applications have been redeployed

Thursday 26th May 2022

No incidents reported