Some systems are experiencing issues

Past Incidents

Tuesday 26th April 2022

Logs System Live logs workflow unavailable

Live logs are unavailable EDIT: an internal service was unreachable, Live Logs system is now fully operational

Monday 25th April 2022

MongoDB shared cluster [RETROACTIVE] Lost MongoDB node

A mongodb node was unreachable. This node is now fixed

Access logs Metrics & Access logs are experiencing ingestion and query issues

Metrics and access logs are currently having ingestion and query issues. We are working on it.

EDIT: Ingestion fixed, query almost restored

Sunday 24th April 2022

No incidents reported

Saturday 23rd April 2022

No incidents reported

Friday 22nd April 2022

Logs System Logs pipeline is experiencing issues

Logs pipeline components lost their connection EDIT: Connection issue fixed, we are consuming logs queue lag. we lost almost30 min of logs. EDIT: Lag consumed.

Thursday 21st April 2022

Access logs Metrics & Access logs are experiencing issues

We are facing an issue with the indexes which result on some metrics and access logs unavailability at egress-level. EDIT: all indexes has been rebooted

Wednesday 20th April 2022

No incidents reported