Removing users or licenses is failing in Admin Console

Incident
October 18th 2024, 10:05pm GMT

Removing users or licenses is failing in Admin Console

Status: closed
Start: October 18th 2024, 6:06pm GMT
End: October 18th 2024, 10:05pm GMT
Duration: 3 hours 59 minutes
Affected Components:
Americas Service portals Admin Console (AC)
Investigating

October 18th 2024, 6:06pm GMT

October 18th 2024, 6:06pm GMT

8x8 is currently investigating intermittent periods where deleting a user or removing a license from a user is giving an error. We are currently investigating and will provide updates as they become available. 

Identified

October 18th 2024, 6:28pm GMT

October 18th 2024, 6:28pm GMT

Our engineers are currently working to resolve the issue as a matter of urgency. We will continue to provide updates as they become available. 

Update

October 18th 2024, 6:58pm GMT

October 18th 2024, 6:58pm GMT

We are doing our very best to get this issue resolved as a matter of priority, we thank you for your patience. We will provide further update as they become available and we again apologize for the inconvenience. 

Monitoring

October 18th 2024, 7:08pm GMT

October 18th 2024, 7:08pm GMT

8x8 has performed mitigation to avoid the issue causing these actions to fail. Please retry to remove a license or delete a user. These actions should now complete without errors. If you continue to experience issues please contact 8x8 to continue troubleshooting. 

Update

October 18th 2024, 8:01pm GMT

October 18th 2024, 8:01pm GMT

8x8 has seen continued impact to user deletion and license removal. We're continuing to investigate will continue to post updates until resolved. 

Update

October 18th 2024, 8:21pm GMT

October 18th 2024, 8:21pm GMT

Our engineers are currently working to resolve the issue as a matter of urgency. We will continue to provide updates as they become available. 

Update

October 18th 2024, 8:55pm GMT

October 18th 2024, 8:55pm GMT

We are doing our very best to get this issue resolved as a matter of priority, we thank you for your patience. We will provide further update as they become available and we again apologize for the inconvenience. 

Monitoring

October 18th 2024, 9:22pm GMT

October 18th 2024, 9:22pm GMT

8x8 has reviewed the cause and once again have mitigated and restored normal performance. Please retry to delete a user or remove a license. We expect successful completion without any errors at this time. If you continue to experience issues please contact support to continue troubleshooting while we validate resolution. 

Resolved

October 18th 2024, 10:05pm GMT

October 18th 2024, 10:05pm GMT

8x8 has confirmed resolution of the issue casing the errors. We are performing a full root cause investigation and we apologize for the inconvenience.